IDEAS home Printed from https://ideas.repec.org/a/jtc/journl/v8y2023i3p173-193.html
   My bibliography  Save this article

P-Hacking Made Easy

Author

Listed:
  • James Herndon

    (Regions Bank)

Abstract

Using a public data set of Major League Baseball salaries and on-field statistics, this paper runs regressions for all possible combinations of the se...

Suggested Citation

  • James Herndon, 2023. "P-Hacking Made Easy," Journal of Economics Teaching, Journal of Economics Teaching, vol. 8(3), pages 173-193, October.
  • Handle: RePEc:jtc:journl:v:8:y:2023:i:3:p:173-193
    as

    Download full text from publisher

    File URL: http://downloads.journalofeconomicsteaching.org/2023/2023-4.pdf
    Download Restriction: no

    File URL: https://journalofeconomicsteaching.org/p-hacking-made-easy-herndon/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2017. "Undergraduate Econometrics Instruction: Through Our Classes, Darkly," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 125-144, Spring.
    2. Guido W. Imbens, 2021. "Statistical Significance, p-Values, and the Reporting of Uncertainty," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 157-174, Summer.
    3. Megan L Head & Luke Holman & Rob Lanfear & Andrew T Kahn & Michael D Jennions, 2015. "The Extent and Consequences of P-Hacking in Science," PLOS Biology, Public Library of Science, vol. 13(3), pages 1-15, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2022. "The Power of Tests for Detecting $p$-Hacking," Papers 2205.07950, arXiv.org, revised Apr 2024.
    2. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    3. Jeremy Arkes, 2020. "Teaching Graduate (and Undergraduate) Econometrics: Some Sensible Shifts to Improve Efficiency, Effectiveness, and Usefulness," Econometrics, MDPI, vol. 8(3), pages 1-23, September.
    4. Cantone, Giulio Giacomo, 2023. "The multiversal methodology as a remedy of the replication crisis," MetaArXiv kuhmz, Center for Open Science.
    5. Abel Brodeur, Nikolai M. Cook, Anthony Heyes, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," LCERPA Working Papers am0133, Laurier Centre for Economic Research and Policy Analysis.
    6. Jasper Brinkerink, 2023. "When Shooting for the Stars Becomes Aiming for Asterisks: P-Hacking in Family Business Research," Entrepreneurship Theory and Practice, , vol. 47(2), pages 304-343, March.
    7. Arnaud Vaganay, 2016. "Cluster Sampling Bias in Government-Sponsored Evaluations: A Correlational Study of Employment and Welfare Pilots in England," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-21, August.
    8. Kenneth G. Stewart, 2019. "Suits' Watermelon Model: The Missing Simultaneous Equations Empirical Application," Journal of Economics Teaching, Journal of Economics Teaching, vol. 4(2), pages 115-139, December.
    9. Ricardo Reis, 2018. "Is something really wrong with macroeconomics?," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 34(1-2), pages 132-155.
    10. Rosa Lavelle-Hill & Gavin Smith & Anjali Mazumder & Todd Landman & James Goulding, 2021. "Machine learning methods for “wicked” problems: exploring the complex drivers of modern slavery," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-11, December.
    11. David Winkelmann & Marius Ötting & Christian Deutscher & Tomasz Makarewicz, 2024. "Are Betting Markets Inefficient? Evidence From Simulations and Real Data," Journal of Sports Economics, , vol. 25(1), pages 54-97, January.
    12. Rinne, Sonja, 2024. "Estimating the merit-order effect using coarsened exact matching: Reconciling theory with the empirical results to improve policy implications," Energy Policy, Elsevier, vol. 185(C).
    13. Andre R. Neveu & Angela M. Smith, 2023. "Engaging Students, Faculty, and External Professionals with a Data-Centered Group Capstone Project," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 49(3), pages 408-432, June.
    14. Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022. "Detecting p‐Hacking," Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
    15. Konrad Neumann & Ulrike Grittner & Sophie K Piper & Andre Rex & Oscar Florez-Vargas & George Karystianis & Alice Schneider & Ian Wellwood & Bob Siegerink & John P A Ioannidis & Jonathan Kimmelman & Ul, 2017. "Increasing efficiency of preclinical research by group sequential designs," PLOS Biology, Public Library of Science, vol. 15(3), pages 1-9, March.
    16. Stephan B Bruns & John P A Ioannidis, 2016. "p-Curve and p-Hacking in Observational Research," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-13, February.
    17. Miguel Baiao & Ilze Buligina, 2021. "Work Experience Led Programs and Employment Attainment," International Journal of Economics & Business Administration (IJEBA), International Journal of Economics & Business Administration (IJEBA), vol. 0(1), pages 180-198.
    18. Vikram Dayal & Anand Murugesan, 2020. "Demystifying causal inference: ingredients of a recipe," IEG Working Papers 393, Institute of Economic Growth.
    19. Bhatt, Monica & Heller, Sara & Kapustin, Max & Bertrand, Marianne & Blattman, Christopher, 2023. "Predicting and Preventing Gun Violence: An Experimental Evaluation of READI Chicago," SocArXiv dks29, Center for Open Science.
    20. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments," GLO Discussion Paper Series 1157, Global Labor Organization (GLO).

    More about this item

    JEL classification:

    • A21 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Pre-college
    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jtc:journl:v:8:y:2023:i:3:p:173-193. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ben Smith (email available below). General contact details of provider: https://www.journalofeconomicsteaching.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.