IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v84y2022ics1057521922003441.html
   My bibliography  Save this article

Time-variation, multiple testing, and the factor zoo

Author

Listed:
  • Smith, Simon C.

Abstract

Bayesians circumvent the need for significance threshold correction when multiple testing and we recommend controlling the Type-S (sign), rather than the Type-1, error rate because it yields more reliable frequency properties for inferences. Our unified Bayesian framework, with theory-informed priors, identifies two breaks (2001 and 2008) in our 1980–2018 sample period. After each break the set of characteristics changes, and only market beta is selected in all regimes. In a portfolio application, the method generates significantly larger Sharpe ratios after transaction costs than a range of benchmark methods, including the same model that uses a Type-1 (not Type-S) error framework.

Suggested Citation

  • Smith, Simon C., 2022. "Time-variation, multiple testing, and the factor zoo," International Review of Financial Analysis, Elsevier, vol. 84(C).
    • Handle: RePEc:eee:finana:v:84:y:2022:i:c:s1057521922003441
    DOI: 10.1016/j.irfa.2022.102394
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521922003441
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.irfa.2022.102394?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    2. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    3. Shanken, Jay, 1992. "The Current State of the Arbitrage Pricing Theory," Journal of Finance, American Finance Association, vol. 47(4), pages 1569-1574, September.
    4. Jagannathan, Ravi & Wang, Zhenyu, 1996. "The Conditional CAPM and the Cross-Section of Expected Returns," Journal of Finance, American Finance Association, vol. 51(1), pages 3-53, March.
    5. Lewellen, Jonathan, 2015. "The Cross-section of Expected Stock Returns," Critical Finance Review, now publishers, vol. 4(1), pages 1-44, June.
    6. Dybvig, Philip H., 1983. "An explicit bound on individual assets' deviations from APT pricing in a finite economy," Journal of Financial Economics, Elsevier, vol. 12(4), pages 483-496, December.
    7. Tarun Chordia & Amit Goyal & Alessio Saretto & Andrew KarolyiEditor, 2020. "Anomalies and False Rejections," Review of Finance, European Finance Association, vol. 33(5), pages 2134-2179.
    8. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    9. Stefano Giglio & Yuan Liao & Dacheng Xiu, 2021. "Thousands of Alpha Tests," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3456, National Bureau of Economic Research, Inc.
    10. Guanhao Feng & Stefano Giglio & Dacheng Xiu, 2020. "Taming the Factor Zoo: A Test of New Factors," Journal of Finance, American Finance Association, vol. 75(3), pages 1327-1370, June.
    11. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    12. Ľluboš Pástor & Robert F. Stambaugh, 2001. "The Equity Premium and Structural Breaks," Journal of Finance, American Finance Association, vol. 56(4), pages 1207-1239, August.
    13. Barillas, Francisco & Kan, Raymond & Robotti, Cesare & Shanken, Jay, 2020. "Model Comparison with Sharpe Ratios," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 55(6), pages 1840-1874, September.
    14. Kozak, Serhiy & Nagel, Stefan & Santosh, Shrihari, 2020. "Shrinking the cross-section," Journal of Financial Economics, Elsevier, vol. 135(2), pages 271-292.
    15. Bekaert, Geert & Harvey, Campbell R. & Lumsdaine, Robin L., 2002. "Dating the integration of world equity markets," Journal of Financial Economics, Elsevier, vol. 65(2), pages 203-247, August.
    16. Campbell R. Harvey & Yan Liu, 2020. "False (and Missed) Discoveries in Financial Economics," Journal of Finance, American Finance Association, vol. 75(5), pages 2503-2553, October.
    17. John Y. Campbell, 2000. "Asset Pricing at the Millennium," Journal of Finance, American Finance Association, vol. 55(4), pages 1515-1567, August.
    18. Lettau, Martin & Pelger, Markus, 2020. "Estimating latent asset-pricing factors," Journal of Econometrics, Elsevier, vol. 218(1), pages 1-31.
    19. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    20. Gary Koop & Simon M. Potter, 2007. "Estimation and Forecasting in Models with Multiple Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(3), pages 763-789.
    21. Fama, Eugene F. & French, Kenneth R., 2015. "Incremental variables and the investment opportunity set," Journal of Financial Economics, Elsevier, vol. 117(3), pages 470-488.
    22. Joachim Freyberger & Andreas Neuhierl & Michael Weber & Andrew KarolyiEditor, 2020. "Dissecting Characteristics Nonparametrically," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2326-2377.
    23. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    24. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    25. Pastor, Lubos & Stambaugh, Robert F., 2003. "Liquidity Risk and Expected Stock Returns," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 642-685, June.
    26. Francisco Barillas & Jay Shanken, 2018. "Comparing Asset Pricing Models," Journal of Finance, American Finance Association, vol. 73(2), pages 715-754, April.
    27. Victor DeMiguel & Alberto Martín-Utrera & Francisco J Nogales & Raman Uppal, 2020. "A Transaction-Cost Perspective on the Multitude of Firm Characteristics," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2180-2222.
    28. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    29. Eugene F Fama & Kenneth R French, 2020. "Comparing Cross-Section and Time-Series Factor Models," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 1891-1926.
    30. Campbell R. Harvey, 2017. "Presidential Address: The Scientific Outlook in Financial Economics," Journal of Finance, American Finance Association, vol. 72(4), pages 1399-1440, August.
    31. Eugene F Fama & Kenneth R French & Andrew KarolyiEditor, 2020. "Comparing Cross-Section and Time-Series Factor Models," Review of Finance, European Finance Association, vol. 33(5), pages 1891-1926.
    32. Tobias Adrian & Erkko Etula & Tyler Muir, 2014. "Financial Intermediaries and the Cross-Section of Asset Returns," Journal of Finance, American Finance Association, vol. 69(6), pages 2557-2596, December.
    33. Ľuboš Pástor & Robert F. Stambaugh, 1999. "Costs of Equity Capital and Model Mispricing," Journal of Finance, American Finance Association, vol. 54(1), pages 67-121, February.
    34. Jeremiah Green & John R. M. Hand & X. Frank Zhang, 2017. "The Characteristics that Provide Independent Information about Average U.S. Monthly Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4389-4436.
    35. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    36. Shleifer, Andrei & Vishny, Robert W, 1997. "The Limits of Arbitrage," Journal of Finance, American Finance Association, vol. 52(1), pages 35-55, March.
    37. Soosung Hwang & Alexandre Rubesam, 2022. "Bayesian Selection of Asset Pricing Factors Using Individual Stocks [Bayesian Variable Selection for the Seemingly Unrelated Regression Model with a Large Number of Predictors]," Journal of Financial Econometrics, Oxford University Press, vol. 20(4), pages 716-761.
    38. Grinblatt, Mark & Titman, Sheridan, 1983. "Factor pricing in a finite economy," Journal of Financial Economics, Elsevier, vol. 12(4), pages 497-507, December.
    39. Alex Chinco & Adam D. Clark‐Joseph & Mao Ye, 2019. "Sparse Signals in the Cross‐Section of Returns," Journal of Finance, American Finance Association, vol. 74(1), pages 449-492, February.
    40. Smith, Simon C. & Timmermann, Allan, 2022. "Have risk premia vanished?," Journal of Financial Economics, Elsevier, vol. 145(2), pages 553-576.
    41. Smith, Simon C. & Timmermann, Allan & Zhu, Yinchu, 2019. "Variable selection in panel models with breaks," Journal of Econometrics, Elsevier, vol. 212(1), pages 323-344.
    42. Martin Lettau & Sydney Ludvigson, 2001. "Resurrecting the (C)CAPM: A Cross-Sectional Test When Risk Premia Are Time-Varying," Journal of Political Economy, University of Chicago Press, vol. 109(6), pages 1238-1287, December.
    43. Kewei Hou & Chen Xue & Lu Zhang, 2020. "Replicating Anomalies," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2019-2133.
    44. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    45. Campbell R. Harvey & Yan Liu, 2020. "False (and Missed) Discoveries in Financial Economics," Papers 2006.04269, arXiv.org.
    46. Siddhartha Chib & Xiaming Zeng & Lingxiao Zhao, 2020. "On Comparing Asset Pricing Models," Journal of Finance, American Finance Association, vol. 75(1), pages 551-577, February.
    47. Michael Johannes & Arthur Korteweg & Nicholas Polson, 2014. "Sequential Learning, Predictability, and Optimal Portfolio Returns," Journal of Finance, American Finance Association, vol. 69(2), pages 611-644, April.
    48. Motohiro Yogo, 2006. "A Consumption‐Based Explanation of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 61(2), pages 539-580, April.
    49. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    50. Doron Avramov & John C. Chao, 2006. "An Exact Bayes Test of Asset Pricing Models with Application to International Markets," The Journal of Business, University of Chicago Press, vol. 79(1), pages 293-324, January.
    51. Tarun Chordia & Amit Goyal & Alessio Saretto, 2020. "Anomalies and False Rejections," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2134-2179.
    52. Victor DeMiguel & Alberto Martín-Utrera & Francisco J Nogales & Raman Uppal & Andrew KarolyiEditor, 2020. "A Transaction-Cost Perspective on the Multitude of Firm Characteristics," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2180-2222.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jinghua Wang & Geoffrey M. Ngene & Yan Shi & Ann Nduati Mungai, 2023. "An Investigation of the Predictability of Uncertainty Indices on Bitcoin Returns," JRFM, MDPI, vol. 16(10), pages 1-12, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Smith, Simon C. & Timmermann, Allan, 2022. "Have risk premia vanished?," Journal of Financial Economics, Elsevier, vol. 145(2), pages 553-576.
    2. Smith, Simon C., 2021. "International stock return predictability," International Review of Financial Analysis, Elsevier, vol. 78(C).
    3. Doron Avramov & Si Cheng & Lior Metzker & Stefan Voigt, 2023. "Integrating Factor Models," Journal of Finance, American Finance Association, vol. 78(3), pages 1593-1646, June.
    4. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    5. Svetlana Bryzgalova & Jiantao Huang & Christian Julliard, 2023. "Bayesian Solutions for the Factor Zoo: We Just Ran Two Quadrillion Models," Journal of Finance, American Finance Association, vol. 78(1), pages 487-557, February.
    6. Söhnke M. Bartram & Harald Lohre & Peter F. Pope & Ananthalakshmi Ranganathan, 2021. "Navigating the factor zoo around the world: an institutional investor perspective," Journal of Business Economics, Springer, vol. 91(5), pages 655-703, July.
    7. Clarke, Charles, 2022. "The level, slope, and curve factor model for stocks," Journal of Financial Economics, Elsevier, vol. 143(1), pages 159-187.
    8. Caldeira, João F. & Santos, André A.P. & Torrent, Hudson S., 2023. "Semiparametric portfolios: Improving portfolio performance by exploiting non-linearities in firm characteristics," Economic Modelling, Elsevier, vol. 122(C).
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Cakici, Nusret & Fieberg, Christian & Metko, Daniel & Zaremba, Adam, 2023. "Machine learning goes global: Cross-sectional return predictability in international stock markets," Journal of Economic Dynamics and Control, Elsevier, vol. 155(C).
    11. Kristoffer Pons Bertelsen, 2022. "The Prior Adaptive Group Lasso and the Factor Zoo," CREATES Research Papers 2022-05, Department of Economics and Business Economics, Aarhus University.
    12. Chen, Ding & Guo, Biao & Zhou, Guofu, 2023. "Firm fundamentals and the cross-section of implied volatility shapes," Journal of Financial Markets, Elsevier, vol. 63(C).
    13. Doron Avramov & Si Cheng & Lior Metzker, 2023. "Machine Learning vs. Economic Restrictions: Evidence from Stock Return Predictability," Management Science, INFORMS, vol. 69(5), pages 2587-2619, May.
    14. Ma, Tian & Leong, Wen Jun & Jiang, Fuwei, 2023. "A latent factor model for the Chinese stock market," International Review of Financial Analysis, Elsevier, vol. 87(C).
    15. Feng, Guanhao & He, Jingyu, 2022. "Factor investing: A Bayesian hierarchical approach," Journal of Econometrics, Elsevier, vol. 230(1), pages 183-200.
    16. Mykola Babiak & Jozef Barunik, 2020. "Deep Learning, Predictability, and Optimal Portfolio Returns," CERGE-EI Working Papers wp677, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    17. Keunbae Ahn, 2021. "Predictable Fluctuations in the Cross-Section and Time-Series of Asset Prices," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 1-2021, March.
    18. Wang, Jianqiu & Wu, Ke & Tong, Guoshi & Chen, Dongxu, 2023. "Nonlinearity in the cross-section of stock returns: Evidence from China," International Review of Economics & Finance, Elsevier, vol. 85(C), pages 174-205.
    19. Guanhao Feng & Stefano Giglio & Dacheng Xiu, 2020. "Taming the Factor Zoo: A Test of New Factors," Journal of Finance, American Finance Association, vol. 75(3), pages 1327-1370, June.
    20. Andrew Y. Chen & Tom Zimmermann, 2022. "Open Source Cross-Sectional Asset Pricing," Critical Finance Review, now publishers, vol. 11(2), pages 207-264, May.

    More about this item

    Keywords

    Cross-section of expected returns; Firm characteristics; Type-1 errors; Type-S errors; Type-M errors; Multiple testing; Bayesian inference; Time-variation;
    All these keywords.

    JEL classification:

    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:84:y:2022:i:c:s1057521922003441. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.