IDEAS home Printed from https://ideas.repec.org/a/spr/rvmgts/v16y2022i8d10.1007_s11846-021-00504-6.html
   My bibliography  Save this article

Moving to a world beyond p-value

Author

Listed:
  • Jae H. Kim

    (La Trobe University)

Abstract

In light of the recent statements on the p-value criterion made by the American Statistical Association (ASA), it is now clear that that the current paradigm of statistical significance and its decision rule should be modified, in many fields of science including the business disciplines. We need a new or modified paradigm for “thoughtful, open and modest” research. This paper explains why we should adopt the ASA recommendations, and proposes a range of possible alternatives that may be included in a new paradigm for statistical research. As an application, the effect of seasonal affective disorder on stock return is re-evaluated.

Suggested Citation

  • Jae H. Kim, 2022. "Moving to a world beyond p-value," Review of Managerial Science, Springer, vol. 16(8), pages 2467-2493, November.
    • Handle: RePEc:spr:rvmgts:v:16:y:2022:i:8:d:10.1007_s11846-021-00504-6
    DOI: 10.1007/s11846-021-00504-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11846-021-00504-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11846-021-00504-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Deirdre N. McCloskey & Stephen T. Ziliak, 1996. "The Standard Error of Regressions," Journal of Economic Literature, American Economic Association, vol. 34(1), pages 97-114, March.
    2. Sander Greenland, 2019. "Valid P-Values Behave Exactly as They Should: Some Misleading Criticisms of P-Values and Their Resolution With S-Values," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 106-114, March.
    3. Alberto Abadie, 2020. "Statistical Nonsignificance in Empirical Economics," American Economic Review: Insights, American Economic Association, vol. 2(2), pages 193-208, June.
    4. Daniel J. Benjamin & James O. Berger, 2019. "Three Recommendations for Improving the Use of p-Values," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 186-191, March.
    5. Schneider, Jesper W., 2013. "Caveats for using statistical significance tests in research assessments," Journal of Informetrics, Elsevier, vol. 7(1), pages 50-62.
    6. Jae H. Kim & In Choi, 2021. "Choosing the Level of Significance: A Decision‐theoretic Approach," Abacus, Accounting Foundation, University of Sydney, vol. 57(1), pages 27-71, March.
    7. Andres Algaba & David Ardia & Keven Bluteau & Samuel Borms & Kris Boudt, 2020. "Econometrics Meets Sentiment: An Overview Of Methodology And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 512-547, July.
    8. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    9. Startz, Richard, 2014. "Choosing the More Likely Hypothesis," Foundations and Trends(R) in Econometrics, now publishers, vol. 7(2), pages 119-189, November.
    10. Keuzenkamp, Hugo A. & Magnus, Jan R., 1995. "On tests and significance in econometrics," Journal of Econometrics, Elsevier, vol. 67(1), pages 5-24, May.
    11. David Trafimow, 2019. "A Frequentist Alternative to Significance Testing, p -Values, and Confidence Intervals," Econometrics, MDPI, vol. 7(2), pages 1-14, June.
    12. Kim, Jae H. & Ji, Philip Inyeob, 2015. "Significance testing in empirical finance: A critical review and assessment," Journal of Empirical Finance, Elsevier, vol. 34(C), pages 1-14.
    13. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-1272, December.
    14. Rebecca A. Betensky, 2019. "The p-Value Requires Context, Not a Threshold," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 115-117, March.
    15. Stephen T. Ziliak, 2008. "Retrospectives: Guinnessometrics: The Economic Foundation of "Student's" t," Journal of Economic Perspectives, American Economic Association, vol. 22(4), pages 199-216, Fall.
    16. Aris Spanos, 2018. "Mis†Specification Testing In Retrospect," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 541-577, April.
    17. Edward E. Leamer, 1988. "3 Things That Bother Me," The Economic Record, The Economic Society of Australia, vol. 64(4), pages 331-335, December.
    18. McCloskey, Donald N, 1985. "The Loss Function Has Been Mislaid: The Rhetoric of Significance Tests," American Economic Review, American Economic Association, vol. 75(2), pages 201-205, May.
    19. Jae H. Kim & Andrew P. Robinson, 2019. "Interval-Based Hypothesis Testing and Its Applications to Economics and Finance," Econometrics, MDPI, vol. 7(2), pages 1-22, May.
    20. Jae H. Kim & In Choi, 2017. "Unit Roots in Economic and Financial Time Series: A Re-Evaluation at the Decision-Based Significance Levels," Econometrics, MDPI, vol. 5(3), pages 1-23, September.
    21. James A. Ohlson, 2015. "Accounting Research and Common Sense," Abacus, Accounting Foundation, University of Sydney, vol. 51(4), pages 525-535, December.
    22. Jae H. Kim, 2020. "Decision-Theoretic Hypothesis Testing: A Primer With R Package OptSig," The American Statistician, Taylor & Francis Journals, vol. 74(4), pages 370-379, October.
    23. Guido W. Imbens, 2021. "Statistical Significance, p-Values, and the Reporting of Uncertainty," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 157-174, Summer.
    24. Campbell R. Harvey, 2017. "Presidential Address: The Scientific Outlook in Financial Economics," Journal of Finance, American Finance Association, vol. 72(4), pages 1399-1440, August.
    25. Andrew A. Anderson, 2019. "Assessing Statistical Results: Magnitude, Precision, and Model Uncertainty," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 118-121, March.
    26. Mark J. Kamstra & Lisa A. Kramer & Maurice D. Levi, 2003. "Winter Blues: A SAD Stock Market Cycle," American Economic Review, American Economic Association, vol. 93(1), pages 324-343, March.
    27. David J. Hand, 2016. "Editorial: ‘Big data’ and data sharing," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(3), pages 629-631, June.
    28. Keim, Donald B. & Madhavan, Ananth, 1997. "Transactions costs and investment style: an inter-exchange analysis of institutional equity trades," Journal of Financial Economics, Elsevier, vol. 46(3), pages 265-292, December.
    29. Mingfeng Lin & Henry C. Lucas & Galit Shmueli, 2013. "Research Commentary ---Too Big to Fail: Large Samples and the p -Value Problem," Information Systems Research, INFORMS, vol. 24(4), pages 906-917, December.
    30. Gandomi, Amir & Haider, Murtaza, 2015. "Beyond the hype: Big data concepts, methods, and analytics," International Journal of Information Management, Elsevier, vol. 35(2), pages 137-144.
    31. Jae H. Kim, 2019. "Tackling False Positives In Business Research: A Statistical Toolbox With Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 862-895, July.
    32. Valentin Amrhein & Sander Greenland & Blake McShane, 2019. "Scientists rise up against statistical significance," Nature, Nature, vol. 567(7748), pages 305-307, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jae H. Kim & Philip I. Ji, 2024. "Testing for signal-to-noise ratio in linear regression: a test under large or massive sample," Review of Managerial Science, Springer, vol. 18(10), pages 3007-3024, October.
    2. Jae H. Kim & Kamran Ahmed & Philip Inyeob Ji, 2018. "Significance Testing in Accounting Research: A Critical Evaluation Based on Evidence," Abacus, Accounting Foundation, University of Sydney, vol. 54(4), pages 524-546, December.
    3. Jae H. Kim & Andrew P. Robinson, 2019. "Interval-Based Hypothesis Testing and Its Applications to Economics and Finance," Econometrics, MDPI, vol. 7(2), pages 1-22, May.
    4. Jeremy Arkes, 2020. "Teaching Graduate (and Undergraduate) Econometrics: Some Sensible Shifts to Improve Efficiency, Effectiveness, and Usefulness," Econometrics, MDPI, vol. 8(3), pages 1-23, September.
    5. Kim, Jae H. & Shamsuddin, Abul, 2023. "Stock market anomalies: An extreme bounds analysis," International Review of Financial Analysis, Elsevier, vol. 90(C).
    6. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    7. Kim, Jae H., 2017. "Stock returns and investors' mood: Good day sunshine or spurious correlation?," International Review of Financial Analysis, Elsevier, vol. 52(C), pages 94-103.
    8. Michaelides, Michael, 2021. "Large sample size bias in empirical finance," Finance Research Letters, Elsevier, vol. 41(C).
    9. Todd Mitton, 2022. "Methodological Variation in Empirical Corporate Finance," The Review of Financial Studies, Society for Financial Studies, vol. 35(2), pages 527-575.
    10. Heckelei, Thomas & Huettel, Silke & Odening, Martin & Rommel, Jens, 2021. "The replicability crisis and the p-value debate – what are the consequences for the agricultural and food economics community?," Discussion Papers 316369, University of Bonn, Institute for Food and Resource Economics.
    11. Jae H. Kim & In Choi, 2021. "Choosing the Level of Significance: A Decision‐theoretic Approach," Abacus, Accounting Foundation, University of Sydney, vol. 57(1), pages 27-71, March.
    12. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    13. Markku Maula & Wouter Stam, 2020. "Enhancing Rigor in Quantitative Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 44(6), pages 1059-1090, November.
    14. Muhammad Ishaq Bhatti & Jae H. Kim, 2020. "Towards a New Paradigm for Statistical Evidence in the Use of p -Value," Econometrics, MDPI, vol. 9(1), pages 1-3, December.
    15. Engsted, Tom & Schneider, Jesper W., 2023. "Non-Experimental Data, Hypothesis Testing, and the Likelihood Principle: A Social Science Perspective," SocArXiv nztk8, Center for Open Science.
    16. Johnstone, David, 2022. "Accounting research and the significance test crisis," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 89(C).
    17. Kellner, Ralf & Rösch, Daniel, 2021. "A Bayesian Re-Interpretation of “significant” empirical financial research," Finance Research Letters, Elsevier, vol. 38(C).
    18. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    19. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    20. Black, Bernard & Hollingsworth, Alex & Nunes, Letícia & Simon, Kosali, 2022. "Simulated power analyses for observational studies: An application to the Affordable Care Act Medicaid expansion," Journal of Public Economics, Elsevier, vol. 213(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:rvmgts:v:16:y:2022:i:8:d:10.1007_s11846-021-00504-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.