IDEAS home Printed from https://ideas.repec.org/p/ebg/heccah/1578.html

Persistent Anomalies and Nonstandard Errors

Author

Listed:
  • Coqueret, Guillaume

    (EMLYON Business School)

  • Pérignon, Christophe

    (HEC Paris - Finance Department)

Abstract

This article presents a framework for rigorous inference that accounts for the many methodological choices involved in testing asset pricing anomalies. We demonstrate that running multiple paths on the same original dataset inherently results in high correlation across outcomes, which significantly alters inference. In contrast, path-specific resampling greatly reduces outcome correlations and tightens the confidence interval of the estimated average return. Jointly accounting for across-path and within-path variability allows the variance of the average return to be decomposed into a standard error, a nonstandard error, and a correlation term. In our empirical analysis, we identify 29 persistent anomalies for which the 95% confidence intervals of their average returns exclude zero. Our tests also indicate that, for most anomalies, nonstandard errors dwarf standard errors and, in turn, are the primary determinants of the width of confidence intervals for multi-path average effects.

Suggested Citation

  • Coqueret, Guillaume & Pérignon, Christophe, 2025. "Persistent Anomalies and Nonstandard Errors," HEC Research Papers Series 1578, HEC Paris.
  • Handle: RePEc:ebg:heccah:1578
    DOI: 10.2139/ssrn.5276723
    as

    Download full text from publisher

    File URL: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5276723
    File Function: Full text
    Download Restriction: no

    File URL: https://libkey.io/10.2139/ssrn.5276723?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    2. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    3. Tarun Chordia & Amit Goyal & Alessio Saretto & Andrew KarolyiEditor, 2020. "Anomalies and False Rejections," Review of Finance, European Finance Association, vol. 33(5), pages 2134-2179.
    4. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    5. Guanhao Feng & Stefano Giglio & Dacheng Xiu, 2020. "Taming the Factor Zoo: A Test of New Factors," Journal of Finance, American Finance Association, vol. 75(3), pages 1327-1370, June.
    6. Nick Huntington-Klein & Claus Pörtner & Yubraj Acharya & Matus Adamkovic & Joop Adema & Lameck Ondieki Agasa & Imtiaz Ahmad & Mevlude Akbulut-Yuksel & Martin Eckhoff Andresen & David Angenendt & José-, 2025. "The Sources of Researcher Variation in Economics," Working Papers hal-05187084, HAL.
    7. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    8. Soebhag, Amar & Van Vliet, Bart & Verwijmeren, Patrick, 2024. "Non-standard errors in asset pricing: Mind your sorts," Journal of Empirical Finance, Elsevier, vol. 78(C).
    9. Laurent Barras & Olivier Scaillet & Russ Wermers, 2010. "False Discoveries in Mutual Fund Performance: Measuring Luck in Estimated Alphas," Journal of Finance, American Finance Association, vol. 65(1), pages 179-216, February.
    10. Campbell R. Harvey & Yan Liu, 2020. "False (and Missed) Discoveries in Financial Economics," Journal of Finance, American Finance Association, vol. 75(5), pages 2503-2553, October.
    11. Antonello Cirulli & Gianluca De Nard & Joshua Traut & Patrick Walker, 2025. "Low risk, high variability: practical guide for portfolio construction," ECON - Working Papers 463, Department of Economics - University of Zurich, revised Nov 2025.
    12. Davidson Heath & Matthew C. Ringgenberg & Mehrdad Samadi & Ingrid M. Werner, 2023. "Reusing Natural Experiments," Journal of Finance, American Finance Association, vol. 78(4), pages 2329-2364, August.
    13. Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Albert J Menkveld & Michael Razen & Utz Weitzel, 2024. "Computational Reproducibility in Finance: Evidence from 1,000 Tests," The Review of Financial Studies, Society for Financial Studies, vol. 37(11), pages 3558-3593.
    14. Andrew Y. Chen & Jack McCoy, 2022. "Missing Values Handling for Machine Learning Portfolios," Papers 2207.13071, arXiv.org, revised Jan 2024.
    15. Joel L. Horowitz, 2019. "Bootstrap Methods in Econometrics," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 193-224, August.
    16. Joachim Freyberger & Andreas Neuhierl & Michael Weber & Andrew KarolyiEditor, 2020. "Dissecting Characteristics Nonparametrically," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2326-2377.
    17. Beyer, Victor & Bauckloh, Michael Tobias, 2024. "Non-standard errors in carbon premia," CFR Working Papers 24-06, University of Cologne, Centre for Financial Research (CFR).
    18. Campbell R. Harvey, 2017. "Presidential Address: The Scientific Outlook in Financial Economics," Journal of Finance, American Finance Association, vol. 72(4), pages 1399-1440, August.
    19. Bryzgalova, Svetlana & Huang, Jiantao & Julliard, Christian, 2023. "Bayesian solutions for the factor zoo: we just ran two quadrillion models," LSE Research Online Documents on Economics 126151, London School of Economics and Political Science, LSE Library.
    20. Theis Ingerslev Jensen & Bryan Kelly & Lasse Heje Pedersen, 2023. "Is There a Replication Crisis in Finance?," Journal of Finance, American Finance Association, vol. 78(5), pages 2465-2518, October.
    21. Dickerson, Alexander & Mueller, Philippe & Robotti, Cesare, 2023. "Priced risk in corporate bonds," Journal of Financial Economics, Elsevier, vol. 150(2).
    22. Todd Mitton, 2022. "Methodological Variation in Empirical Corporate Finance," The Review of Financial Studies, Society for Financial Studies, vol. 35(2), pages 527-575.
    23. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    24. Rotem Botvinik-Nezer & Felix Holzmeister & Colin F. Camerer & Anna Dreber & Juergen Huber & Magnus Johannesson & Michael Kirchler & Roni Iwanir & Jeanette A. Mumford & R. Alison Adcock & Paolo Avesani, 2020. "Variability in the analysis of a single neuroimaging dataset by many teams," Nature, Nature, vol. 582(7810), pages 84-88, June.
    25. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    26. Kewei Hou & Chen Xue & Lu Zhang, 2015. "Editor's Choice Digesting Anomalies: An Investment Approach," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 650-705.
    27. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    28. Kewei Hou & Chen Xue & Lu Zhang, 2020. "Replicating Anomalies," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2019-2133.
    29. Whitney Newey & Kenneth West, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    30. Chen, Andrew Y. & McCoy, Jack, 2024. "Missing values handling for machine learning portfolios," Journal of Financial Economics, Elsevier, vol. 155(C).
    31. Roxana A. Ion & Chris A. J. Klaassen & Edwin R. van den Heuvel, 2023. "Sharp inequalities of Bienaymé–Chebyshev and Gauß type for possibly asymmetric intervals around the mean," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 566-601, June.
    32. Svetlana Bryzgalova & Jiantao Huang & Christian Julliard, 2023. "Bayesian Solutions for the Factor Zoo: We Just Ran Two Quadrillion Models," Journal of Finance, American Finance Association, vol. 78(1), pages 487-557, February.
    33. Tarun Chordia & Amit Goyal & Alessio Saretto, 2020. "Anomalies and False Rejections," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2134-2179.
    34. Bryan T. Kelly & Semyon Malamud, 2025. "Understanding The Virtue of Complexity," Swiss Finance Institute Research Paper Series 25-96, Swiss Finance Institute.
    35. Fama, Eugene F & French, Kenneth R, 1996. "Multifactor Explanations of Asset Pricing Anomalies," Journal of Finance, American Finance Association, vol. 51(1), pages 55-84, March.
    36. Andrew Y. Chen, 2021. "The Limits of p‐Hacking: Some Thought Experiments," Journal of Finance, American Finance Association, vol. 76(5), pages 2447-2480, October.
    37. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    38. Andrew Y. Chen & Tom Zimmermann, 2022. "Open Source Cross-Sectional Asset Pricing," Critical Finance Review, now publishers, vol. 11(2), pages 207-264, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    2. Li, Bin & Rossi, Alberto G. & Yan, Xuemin (Sterling) & Zheng, Lingling, 2025. "Machine learning from a “Universe” of signals: The role of feature engineering," Journal of Financial Economics, Elsevier, vol. 172(C).
    3. Dickerson, Alexander & Julliard, Christian & Mueller, Philippe, 2026. "The co-pricing factor zoo," LSE Research Online Documents on Economics 138476, London School of Economics and Political Science, LSE Library.
    4. Dong, Mengmeng, 2025. "Economic aggregation of return signals in global markets," Journal of Empirical Finance, Elsevier, vol. 84(C).
    5. Alexander Dickerson & Christian Julliard & Philippe Mueller, 2026. "The Co-Pricing Factor Zoo," Papers 2604.04430, arXiv.org.
    6. Smith, Simon C., 2022. "Time-variation, multiple testing, and the factor zoo," International Review of Financial Analysis, Elsevier, vol. 84(C).
    7. Sak, Halis & Huang, Tao & Chng, Michael T., 2024. "Exploring the factor zoo with a machine-learning portfolio," International Review of Financial Analysis, Elsevier, vol. 96(PA).
    8. Söhnke M. Bartram & Harald Lohre & Peter F. Pope & Ananthalakshmi Ranganathan, 2021. "Navigating the factor zoo around the world: an institutional investor perspective," Journal of Business Economics, Springer, vol. 91(5), pages 655-703, July.
    9. Doron Avramov & Si Cheng & Lior Metzker & Stefan Voigt, 2023. "Integrating Factor Models," Journal of Finance, American Finance Association, vol. 78(3), pages 1593-1646, June.
    10. Fieberg, Christian & Liedtke, Gerrit & Zaremba, Adam & Cakici, Nusret, 2025. "A factor model for the cross-section of country equity risk premia," Journal of Banking & Finance, Elsevier, vol. 171(C).
    11. G Andrew Karolyi & Stijn Van Nieuwerburgh, 2020. "New Methods for the Cross-Section of Returns," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 1879-1890.
    12. Yuxiao Jiao & Guofu Zhou & Wu Zhu & Yingzi Zhu, 2025. "Interpretable Factors of Firm Characteristics," Papers 2508.02253, arXiv.org.
    13. Clint Howard, 2024. "Choices Matter When Training Machine Learning Models for Return Prediction," Financial Analysts Journal, Taylor & Francis Journals, vol. 80(4), pages 81-107, October.
    14. Joseph E. Engelberg & Richard B. Evans & Greg Leonard & Adam V. Reed & Matthew C. Ringgenberg, 2025. "The Loan Fee Anomaly: A Short Seller’s Best Ideas," Management Science, INFORMS, vol. 71(7), pages 5529-5551, July.
    15. Doron Avramov & Guy Kaplanski & Avanidhar Subrahmanyam, 2022. "Postfundamentals Price Drift in Capital Markets: A Regression Regularization Perspective," Management Science, INFORMS, vol. 68(10), pages 7658-7681, October.
    16. Hanauer, Matthias X. & Kalsbach, Tobias, 2023. "Machine learning and the cross-section of emerging market stock returns," Emerging Markets Review, Elsevier, vol. 55(C).
    17. Cakici, Nusret & Zaremba, Adam & Bianchi, Robert J. & Pham, Nga, 2021. "False discoveries in the anomaly research: New insights from the Stock Exchange of Melbourne (1927–1987)," Pacific-Basin Finance Journal, Elsevier, vol. 70(C).
    18. Wang, Ming-Long & Shi, Huai-Long & Wan, Yu-Lei & Wang, Jing-Jin, 2026. "Luck “duels” among factors in China," The Quarterly Review of Economics and Finance, Elsevier, vol. 106(C).
    19. Bryzgalova, Svetlana & Huang, Jiantao & Julliard, Christian, 2023. "Bayesian solutions for the factor zoo: we just ran two quadrillion models," LSE Research Online Documents on Economics 126151, London School of Economics and Political Science, LSE Library.
    20. Huang, Haitao & Jiang, Lei & Leng, Xuan & Peng, Liang, 2023. "Bootstrap analysis of mutual fund performance," Journal of Econometrics, Elsevier, vol. 235(1), pages 239-255.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ebg:heccah:1578. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: David Melon (email available below). General contact details of provider: https://edirc.repec.org/data/hecpafr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.