Statistical Significance, p-Values, and the Reporting of Uncertainty
Author
Abstract
Suggested Citation
DOI: 10.1257/jep.35.3.157
Download full text from publisher
References listed on IDEAS
- Charles F. Manski, 2013. "Response to the Review of ‘Public Policy in an Uncertain World’," Economic Journal, Royal Economic Society, vol. 0, pages 412-415, August.
- Andrew C. Chang & Phillip Li, 2017. "A Preanalysis Plan to Replicate Sixty Economics Research Papers That Worked Half of the Time," American Economic Review, American Economic Association, vol. 107(5), pages 60-64, May.
- Susan Athey & Dean Eckles & Guido W. Imbens, 2018.
"Exact p-Values for Network Interference,"
Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 230-240, January.
- Athey, Susan & Eckles, Dean & Imbens, Guido W., 2015. "Exact P-Values for Network Interference," Research Papers 3351, Stanford University, Graduate School of Business.
- Athey, Susan & Eckles, Dean & Imbens, Guido W., 2015. "Exact P-Values for Network Interference," Research Papers 3287, Stanford University, Graduate School of Business.
- Susan Athey & Dean Eckles & Guido W. Imbens, 2015. "Exact P-values for Network Interference," NBER Working Papers 21313, National Bureau of Economic Research, Inc.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2018.
"Methods Matter: P-Hacking and Causal Inference in Economics,"
IZA Discussion Papers
11796, Institute of Labor Economics (IZA).
- Abel Brodeur & Nikolai Cook & Anthony Heyes, 2018. "Methods Matter: P-Hacking and Causal Inference in Economics," Working Papers 1809E, University of Ottawa, Department of Economics.
- Monya Baker, 2016. "Statisticians issue warning over misuse of P values," Nature, Nature, vol. 531(7593), pages 151-151, March.
- Bruno Crépon & Florencia Devoto & Esther Duflo & William Parienté, 2015.
"Estimating the Impact of Microcredit on Those Who Take It Up: Evidence from a Randomized Experiment in Morocco,"
American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 123-150, January.
- Crépon, Bruno & Duflo, Esther & Parienté, William & Devoto, Florencia, 2014. "Estimating the impact of microcredit on those who take it up: Evidence from a randomized experiment in Morocco," CEPR Discussion Papers 9984, C.E.P.R. Discussion Papers.
- Bruno Crépon & Florencia Devoto & Esther Duflo & William Pariente, 2014. "Estimating the Impact of Microcredit on Those Who Take It Up: Evidence from a Randomized Experiment in Morocco," NBER Working Papers 20144, National Bureau of Economic Research, Inc.
- Bruno CREPON & Florencia DEVOTO & Esther DUFLO & William PARIENTE, 2014. "Estimating the impact of microcredit on those who take it up: Evidence from a randomized experiment in Morocco," LIDAM Discussion Papers IRES 2014012, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
- Alan B. Krueger & Diane M. Whitmore, 1999. "The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR," Working Papers 806, Princeton University, Department of Economics, Industrial Relations Section..
- Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011.
"How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
- Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2010. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence From Project STAR," NBER Working Papers 16381, National Bureau of Economic Research, Inc.
- Chetty, Raj & Friedman, John Norton & Hilger, Nathanial & Saez, Emmanuel & Schanzenbach, Dianne Whitmore & Yagan, Danny, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," Scholarly Articles 9639983, Harvard Kennedy School of Government.
- Guido W. Imbens, 2010.
"Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009),"
Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
- Guido W. Imbens, 2009. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," NBER Working Papers 14896, National Bureau of Economic Research, Inc.
- Manski, Charles F., 2013. "Public Policy in an Uncertain World: Analysis and Decisions," Economics Books, Harvard University Press, number 9780674066892, march.
- Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022.
"Detecting p‐Hacking,"
Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
- Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2019. "Detecting p-hacking," Papers 1906.06711, arXiv.org, revised May 2021.
- Elliott, Graham & Kudrin, Nikolay & Wüthrich, Kaspar, 2022. "Detecting p‐Hacking," University of California at San Diego, Economics Working Paper Series qt2p04s3dr, Department of Economics, UC San Diego.
- Abhijit Banerjee & Esther Duflo & Amy Finkelstein & Lawrence F. Katz & Benjamin A. Olken & Anja Sautmann, 2020. "In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics," NBER Working Papers 26993, National Bureau of Economic Research, Inc.
- Ronald D. Fricker & Katherine Burke & Xiaoyan Han & William H. Woodall, 2019. "Assessing the Statistical Analyses Used in Basic and Applied Social Psychology After Their p-Value Ban," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 374-384, March.
- Abhijit Banerjee & Dean Karlan & Jonathan Zinman, 2015. "Six Randomized Evaluations of Microcredit: Introduction and Further Steps," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 1-21, January.
- Krueger, Alan B & Whitmore, Diane M, 2001.
"The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR,"
Economic Journal, Royal Economic Society, vol. 111(468), pages 1-28, January.
- Alan B. Krueger & Diane M. Whitmore, 1999. "The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR," Working Papers 806, Princeton University, Department of Economics, Industrial Relations Section..
- Alan Krueger & Diane Whitmore, 2000. "The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR," NBER Working Papers 7656, National Bureau of Economic Research, Inc.
- Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504, December.
- Nicky J. Welton & Howard H. Z. Thom, 2015. "Value of Information," Medical Decision Making, , vol. 35(5), pages 564-566, July.
- Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Susan Athey & Raj Chetty & Guido Imbens, 2020. "Combining Experimental and Observational Data to Estimate Treatment Effects on Long Term Outcomes," Papers 2006.09676, arXiv.org.
- Susan Athey & Guido W. Imbens, 2017.
"The State of Applied Econometrics: Causality and Policy Evaluation,"
Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
- Susan Athey & Guido Imbens, 2016. "The State of Applied Econometrics - Causality and Policy Evaluation," Papers 1607.00699, arXiv.org.
- Bo, Hao & Galiani, Sebastian, 2021.
"Assessing external validity,"
Research in Economics, Elsevier, vol. 75(3), pages 274-285.
- Hao Bo & Sebastian Galiani, 2019. "Assessing External Validity," NBER Working Papers 26422, National Bureau of Economic Research, Inc.
- Justman, Moshe, 2018. "Randomized controlled trials informing public policy: Lessons from project STAR and class size reduction," European Journal of Political Economy, Elsevier, vol. 54(C), pages 167-174.
- Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
- Tarek Azzam & Michael Bates & David Fairris, 2019.
"Do Learning Communities Increase First Year College Retention? Testing Sample Selection and External Validity of Randomized Control Trials,"
Working Papers
202002, University of California at Riverside, Department of Economics.
- Tarek Azzam & Michael Bates & David Fairris, 2020. "Do Learning Communities Increase First Year College Retention? Testing Sample Selection and External Validity of Randomized Control Trials," Working Papers 202022, University of California at Riverside, Department of Economics, revised Jul 2020.
- Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024. "Lost in the Design Space? Construct Validity in the Microfinance Literature," OSF Preprints nwp8k_v1, Center for Open Science.
- Stephen Machin & Sandra McNally & Martina Viarengo, 2018.
"Changing How Literacy Is Taught: Evidence on Synthetic Phonics,"
American Economic Journal: Economic Policy, American Economic Association, vol. 10(2), pages 217-241, May.
- Machin, Stephen & McNally, Sandra & Viarengo, Martina, 2018. "Changing how literacy is taught: evidence on synthetic phonics," LSE Research Online Documents on Economics 88350, London School of Economics and Political Science, LSE Library.
- Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016.
"Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice,"
Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
- Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2013. "Stand and Deliver: Effects of Boston's Charter High School on College Preparation, Entry, and Choice," CESifo Working Paper Series 4396, CESifo.
- Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2013. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," NBER Working Papers 19275, National Bureau of Economic Research, Inc.
- Jonathan Fu & Annette Krauss, 2024. "Preparing fertile ground: how does the quality of business environments affect MSE growth?," Small Business Economics, Springer, vol. 63(1), pages 51-103, June.
- Marie Connolly & Catherine Haeck, 2018. "Le lien entre la taille des classes et les compétences cognitives et non cognitives," CIRANO Project Reports 2018rp-18, CIRANO.
- Vilsa E. Curto & Roland G. Fryer Jr., 2014. "The Potential of Urban Boarding Schools for the Poor: Evidence from SEED," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 65-93.
- Michael Gilraine & Hugh Macartney & Robert McMillan, 2018.
"Estimating the Direct and Indirect Effects of Major Education Reforms,"
NBER Working Papers
24191, National Bureau of Economic Research, Inc.
- Michael Gilraine & Hugh Macartney & Robert McMillan, 2020. "Estimating the Direct and Indirect Effects of Major Education Reforms," Working Papers tecipa-673, University of Toronto, Department of Economics.
- Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015.
"Value-added modeling: A review,"
Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
- Cory Koedel & Kata Mihaly & Jonah E. Rockoff, 2015. "Value-Added Modeling: A Review," Working Papers 1501, Department of Economics, University of Missouri.
- repec:spo:wpmain:info:hdl:2441/5lge9h8e809258uvvpjn34ekm4 is not listed on IDEAS
- Douglas Almond & Bhashkar Mazumder & Reyn Ewijk, 2015.
"In Utero Ramadan Exposure and Children's Academic Performance,"
Economic Journal, Royal Economic Society, vol. 125(589), pages 1501-1533, December.
- Douglas Almond & Bhashkar Mazumder & Reyn van Ewijk, 2014. "In Utero Ramadan Exposure and Children’s Academic Performance," Working Papers 1410, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz, revised 18 Sep 2014.
- Steven N. Durlauf & Ananth Seshadri, 2018.
"Understanding the Great Gatsby Curve,"
NBER Macroeconomics Annual, University of Chicago Press, vol. 32(1), pages 333-393.
- Steven N. Durlauf & Ananth Seshadri, 2017. "Understanding the Great Gatsby Curve," NBER Chapters, in: NBER Macroeconomics Annual 2017, volume 32, pages 333-393, National Bureau of Economic Research, Inc.
- Guido W. Imbens, 2020.
"Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics,"
Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
- Guido Imbens, 2019. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," NBER Working Papers 26104, National Bureau of Economic Research, Inc.
- Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024.
"Lost in the design space? Construct validity in the microfinance literature,"
Ruhr Economic Papers
1097, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024. "Lost in the Design Space? Construct Validity in the Microfinance Literature," I4R Discussion Paper Series 184, The Institute for Replication (I4R).
- Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024. "Lost in the Design Space? Construct Validity in the Microfinance Literature," OSF Preprints nwp8k, Center for Open Science.
- Denis Fougère & Arthur Heim, 2019.
"L'évaluation socioéconomique de l'investissement social,"
Working Papers
hal-03456048, HAL.
- Denis Fougère & Arthur Heim, 2019. "L'évaluation socioéconomique de l'investissement social," SciencePo Working papers Main hal-03456048, HAL.
- Bartalotti, Otávio & Kédagni, Désiré & Possebom, Vitor, 2023.
"Identifying marginal treatment effects in the presence of sample selection,"
Journal of Econometrics, Elsevier, vol. 234(2), pages 565-584.
- Bartalotti, Otávio & Kedagni, Desire & Possebom, Vitor, 2019. "Identifying Marginal Treatment Effects in the Presence of Sample Selection," ISU General Staff Papers 201909150700001080, Iowa State University, Department of Economics.
- Ot'avio Bartalotti & D'esir'e K'edagni & Vitor Possebom, 2021. "Identifying Marginal Treatment Effects in the Presence of Sample Selection," Papers 2112.07014, arXiv.org.
- Bartalotti, Otávio & Kédagni, Désiré & Possebom, Vítor Augusto, 2021. "Identifying Marginal Treatment Effects in the Presence of Sample Selection," IZA Discussion Papers 14428, Institute of Labor Economics (IZA).
More about this item
JEL classification:
- C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
- D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:jecper:v:35:y:2021:i:3:p:157-74. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.