IDEAS home Printed from https://ideas.repec.org/p/sin/wpaper/17-a003.html
   My bibliography  Save this paper

Do Cross-Sectional Stock Return Predictors Pass the Test without Data-Snooping Bias?

Author

Abstract

This study examines the possible data-snooping bias as a competing explanation for the anomalies in the cross-section of stock returns. We posit that the exhaustive standalone searches for profitable strategies could lead to recommending spuriously predictive variables. In order to explore the severity of this problem, we use a multiple testing method to evaluate the profitability of portfolios constructed by these predictors. Our empirical analyses suggest that over half of the findings based on individual testing method are no longer statistically significant after we adjust for data-snooping bias. Excluding the micro-cap stocks before portfolios construction and applying the notion of economic significance in this study further weaken the evidence for predictability. JEL Classification: G11, G12, G14

Suggested Citation

  • Yu-Chin Hsu & Hsiou-Wei Lin & Kendro Vincent, 2017. "Do Cross-Sectional Stock Return Predictors Pass the Test without Data-Snooping Bias?," IEAS Working Paper : academic research 17-A003, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    • Handle: RePEc:sin:wpaper:17-a003
    as

    Download full text from publisher

    File URL: https://www.econ.sinica.edu.tw/~econ/pdfPaper/17-A003.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    4. repec:cup:jfinqa:v:46:y:2011:i:06:p:1629-1650_00 is not listed on IDEAS
    5. Frederico Belo & Xiaoji Lin & Santiago Bazdresch, 2014. "Labor Hiring, Investment, and Stock Return Predictability in the Cross Section," Journal of Political Economy, University of Chicago Press, vol. 122(1), pages 129-177.
    6. Lewellen, Jonathan, 2015. "The Cross-section of Expected Stock Returns," Critical Finance Review, now publishers, vol. 4(1), pages 1-44, June.
    7. Novy-Marx, Robert, 2013. "The other side of value: The gross profitability premium," Journal of Financial Economics, Elsevier, vol. 108(1), pages 1-28.
    8. Chordia, Tarun & Subrahmanyam, Avanidhar & Anshuman, V. Ravi, 2001. "Trading activity and expected stock returns," Journal of Financial Economics, Elsevier, vol. 59(1), pages 3-32, January.
    9. Jacobs, Heiko, 2015. "What explains the dynamics of 100 anomalies?," Journal of Banking & Finance, Elsevier, vol. 57(C), pages 65-85.
    10. Kewei Hou & Tobias J. Moskowitz, 2005. "Market Frictions, Price Delay, and the Cross-Section of Expected Returns," The Review of Financial Studies, Society for Financial Studies, vol. 18(3), pages 981-1020.
    11. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    12. Basu, Sanjoy, 1983. "The relationship between earnings' yield, market value and return for NYSE common stocks : Further evidence," Journal of Financial Economics, Elsevier, vol. 12(1), pages 129-156, June.
    13. Balakrishnan, Karthik & Bartov, Eli & Faurel, Lucile, 2010. "Post loss/profit announcement drift," Journal of Accounting and Economics, Elsevier, vol. 50(1), pages 20-41, May.
    14. Laurent Barras & Olivier Scaillet & Russ Wermers, 2010. "False Discoveries in Mutual Fund Performance: Measuring Luck in Estimated Alphas," Journal of Finance, American Finance Association, vol. 65(1), pages 179-216, February.
    15. Jacob Thomas & Frank X. Zhang, 2011. "Tax Expense Momentum," Journal of Accounting Research, Wiley Blackwell, vol. 49(3), pages 791-821, June.
    16. Bali, Turan G. & Cakici, Nusret & Whitelaw, Robert F., 2011. "Maxing out: Stocks as lotteries and the cross-section of expected returns," Journal of Financial Economics, Elsevier, vol. 99(2), pages 427-446, February.
    17. Laura Xiaolei Liu & Toni M. Whited & Lu Zhang, 2009. "Investment-Based Expected Stock Returns," Journal of Political Economy, University of Chicago Press, vol. 117(6), pages 1105-1139, December.
    18. Richardson, Scott A. & Sloan, Richard G. & Soliman, Mark T. & Tuna, Irem, 2005. "Accrual reliability, earnings persistence and stock prices," Journal of Accounting and Economics, Elsevier, vol. 39(3), pages 437-485, September.
    19. Eugene F. Fama & Kenneth R. French, 2008. "Dissecting Anomalies," Journal of Finance, American Finance Association, vol. 63(4), pages 1653-1678, August.
    20. Matti Keloharju & Juhani T. Linnainmaa & Peter Nyberg, 2016. "Return Seasonalities," Journal of Finance, American Finance Association, vol. 71(4), pages 1557-1590, August.
    21. Bali, Turan G. & Cakici, Nusret, 2008. "Idiosyncratic Volatility and the Cross Section of Expected Returns," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 43(1), pages 29-58, March.
    22. Joseph P. Romano & Michael Wolf, "undated". "Control of Generalized Error Rates in Multiple Testing," IEW - Working Papers 245, Institute for Empirical Research in Economics - University of Zurich.
    23. Lee, Kang-Kook & Islam, Md. Rabiul, 2011. "Financial Development and Financing Constraints in a Developing Country: The Case of Bangladesh," Indian Economic Review, Department of Economics, Delhi School of Economics, vol. 46(1), pages 41-67.
    24. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    25. Jegadeesh, Narasimhan, 1990. "Evidence of Predictable Behavior of Security Returns," Journal of Finance, American Finance Association, vol. 45(3), pages 881-898, July.
    26. Yu-Chin Hsu & Chung-Ming Kuan & Meng-Feng Yen, 2014. "A Generalized Stepwise Procedure with Improved Power for Multiple Inequalities Testing," Journal of Financial Econometrics, Oxford University Press, vol. 12(4), pages 730-755.
    27. Han, Yufeng & Yang, Ke & Zhou, Guofu, 2013. "A New Anomaly: The Cross-Sectional Profitability of Technical Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 48(5), pages 1433-1461, October.
    28. Lev, B & Thiagarajan, Sr, 1993. "Fundamental Information Analysis," Journal of Accounting Research, Wiley Blackwell, vol. 31(2), pages 190-215.
    29. Michael J. Cooper & Huseyin Gulen & Michael J. Schill, 2008. "Asset Growth and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 63(4), pages 1609-1651, August.
    30. Kewei Hou & David T. Robinson, 2006. "Industry Concentration and Average Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1927-1956, August.
    31. Genovese, Christopher R. & Wasserman, Larry, 2006. "Exceedance Control of the False Discovery Proportion," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1408-1417, December.
    32. repec:bla:jfinan:v:43:y:1988:i:2:p:507-28 is not listed on IDEAS
    33. Hsu, Po-Hsuan & Hsu, Yu-Chin & Kuan, Chung-Ming, 2010. "Testing the predictive ability of technical analysis using a new stepwise test without data snooping bias," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 471-484, June.
    34. Palazzo, Berardino, 2012. "Cash holdings, risk, and expected returns," Journal of Financial Economics, Elsevier, vol. 104(1), pages 162-185.
    35. Banz, Rolf W., 1981. "The relationship between return and market value of common stocks," Journal of Financial Economics, Elsevier, vol. 9(1), pages 3-18, March.
    36. Jegadeesh, Narasimhan & Livnat, Joshua, 2006. "Revenue surprises and stock returns," Journal of Accounting and Economics, Elsevier, vol. 41(1-2), pages 147-171, April.
    37. Kent Daniel & Sheridan Titman, 2006. "Market Reactions to Tangible and Intangible Information," Journal of Finance, American Finance Association, vol. 61(4), pages 1605-1643, August.
    38. Beaver, William & McNichols, Maureen & Price, Richard, 2007. "Delisting returns and their effect on accounting-based market anomalies," Journal of Accounting and Economics, Elsevier, vol. 43(2-3), pages 341-368, July.
    39. Andrea L. Eisfeldt & Dimitris Papanikolaou, 2013. "Organization Capital and the Cross-Section of Expected Returns," Journal of Finance, American Finance Association, vol. 68(4), pages 1365-1406, August.
    40. Christopher W. Anderson & Luis Garcia‐Feijóo, 2006. "Empirical Evidence on Capital Investment, Growth Options, and Security Returns," Journal of Finance, American Finance Association, vol. 61(1), pages 171-194, February.
    41. R. David Mclean & Jeffrey Pontiff, 2016. "Does Academic Research Destroy Stock Return Predictability?," Journal of Finance, American Finance Association, vol. 71(1), pages 5-32, February.
    42. repec:bla:jfinan:v:59:y:2004:i:5:p:2145-2176 is not listed on IDEAS
    43. Kewei Hou & Chen Xue & Lu Zhang, 2015. "Editor's Choice Digesting Anomalies: An Investment Approach," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 650-705.
    44. Amihud, Yakov, 2002. "Illiquidity and stock returns: cross-section and time-series effects," Journal of Financial Markets, Elsevier, vol. 5(1), pages 31-56, January.
    45. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    46. Loughran, Tim & Wellman, Jay W., 2011. "New Evidence on the Relation between the Enterprise Multiple and Average Stock Returns," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 46(6), pages 1629-1650, December.
    47. De Bondt, Werner F M & Thaler, Richard, 1985. "Does the Stock Market Overreact?," Journal of Finance, American Finance Association, vol. 40(3), pages 793-805, July.
    48. Ou, Jane A. & Penman, Stephen H., 1989. "Financial statement analysis and the prediction of stock returns," Journal of Accounting and Economics, Elsevier, vol. 11(4), pages 295-329, November.
    49. Andrew Ang & Robert J. Hodrick & Yuhang Xing & Xiaoyan Zhang, 2006. "The Cross‐Section of Volatility and Expected Returns," Journal of Finance, American Finance Association, vol. 61(1), pages 259-299, February.
    50. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    51. Jaehoon Hahn & Hangyong Lee, 2009. "Financial Constraints, Debt Capacity, and the Cross‐section of Stock Returns," Journal of Finance, American Finance Association, vol. 64(2), pages 891-921, April.
    52. Titman, Sheridan & Wei, K. C. John & Xie, Feixue, 2004. "Capital Investments and Stock Returns," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 39(4), pages 677-700, December.
    53. Yoav Benjamini & Marina Bogomolov, 2014. "Selective inference on multiple families of hypotheses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 297-318, January.
    54. Liu, Weimin, 2006. "A liquidity-augmented capital asset pricing model," Journal of Financial Economics, Elsevier, vol. 82(3), pages 631-671, December.
    55. Fama, Eugene F & MacBeth, James D, 1973. "Risk, Return, and Equilibrium: Empirical Tests," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 607-636, May-June.
    56. Eugene F. Fama & Kenneth R. French, 2016. "Dissecting Anomalies with a Five-Factor Model," The Review of Financial Studies, Society for Financial Studies, vol. 29(1), pages 69-103.
    57. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    58. Chan, Louis K C & Jegadeesh, Narasimhan & Lakonishok, Josef, 1996. "Momentum Strategies," Journal of Finance, American Finance Association, vol. 51(5), pages 1681-1713, December.
    59. Novy-Marx, Robert, 2012. "Is momentum really momentum?," Journal of Financial Economics, Elsevier, vol. 103(3), pages 429-453.
    60. Ball, Ray, 1978. "Anomalies in relationships between securities' yields and yield-surrogates," Journal of Financial Economics, Elsevier, vol. 6(2-3), pages 103-126.
    61. Jegadeesh, Narasimhan & Titman, Sheridan, 1993. "Returns to Buying Winners and Selling Losers: Implications for Stock Market Efficiency," Journal of Finance, American Finance Association, vol. 48(1), pages 65-91, March.
    62. Collins, Daniel W. & Hribar, Paul, 2000. "Earnings-based and accrual-based market anomalies: one effect or two?," Journal of Accounting and Economics, Elsevier, vol. 29(1), pages 101-123, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dichtl, Hubert & Drobetz, Wolfgang & Neuhierl, Andreas & Wendt, Viktoria-Sophie, 2021. "Data snooping in equity premium prediction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 72-94.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vincent, Kendro & Hsu, Yu-Chin & Lin, Hsiou-Wei, 2021. "Investment styles and the multiple testing of cross-sectional stock return predictability," Journal of Financial Markets, Elsevier, vol. 56(C).
    2. Hou, Kewei & Xue, Chen & Zhang, Lu, 2017. "Replicating Anomalies," Working Paper Series 2017-10, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
    3. Geertsema, Paul & Lu, Helen, 2020. "The correlation structure of anomaly strategies," Journal of Banking & Finance, Elsevier, vol. 119(C).
    4. Andrew Y. Chen & Tom Zimmermann, 2022. "Open Source Cross-Sectional Asset Pricing," Critical Finance Review, now publishers, vol. 11(2), pages 207-264, May.
    5. Wang, Feifei & Yan, Xuemin Sterling, 2021. "Downside risk and the performance of volatility-managed portfolios," Journal of Banking & Finance, Elsevier, vol. 131(C).
    6. Cederburg, Scott & O’Doherty, Michael S. & Wang, Feifei & Yan, Xuemin (Sterling), 2020. "On the performance of volatility-managed portfolios," Journal of Financial Economics, Elsevier, vol. 138(1), pages 95-117.
    7. Adam Zaremba & Jacob Koby Shemer, 2018. "Price-Based Investment Strategies," Springer Books, Springer, number 978-3-319-91530-2, July.
    8. De Nard, Gianluca & Zhao, Zhao, 2022. "A large-dimensional test for cross-sectional anomalies:Efficient sorting revisited," International Review of Economics & Finance, Elsevier, vol. 80(C), pages 654-676.
    9. Jiaju Miao & Pawel Polak, 2023. "Online Ensemble of Models for Optimal Predictive Performance with Applications to Sector Rotation Strategy," Papers 2304.09947, arXiv.org.
    10. Stephen A. Gorman & Frank J. Fabozzi, 2021. "The ABC’s of the alternative risk premium: academic roots," Journal of Asset Management, Palgrave Macmillan, vol. 22(6), pages 405-436, October.
    11. Bui, Dien Giau & Kong, De-Rong & Lin, Chih-Yung & Lin, Tse-Chun, 2023. "Momentum in machine learning: Evidence from the Taiwan stock market," Pacific-Basin Finance Journal, Elsevier, vol. 82(C).
    12. Weichuan Deng & Pawel Polak & Abolfazl Safikhani & Ronakdilip Shah, 2023. "A Unified Framework for Fast Large-Scale Portfolio Optimization," Papers 2303.12751, arXiv.org, revised Nov 2023.
    13. Kewei Hou & Haitao Mo & Chen Xue & Lu Zhang, 2019. "Which Factors?," Review of Finance, European Finance Association, vol. 23(1), pages 1-35.
    14. Joachim Freyberger & Andreas Neuhierl & Michael Weber, 2020. "Dissecting Characteristics Nonparametrically," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2326-2377.
    15. Tran, Vu Le, 2023. "Sentiment and covariance characteristics," International Review of Financial Analysis, Elsevier, vol. 86(C).
    16. Tobek, Ondrej & Hronec, Martin, 2021. "Does it pay to follow anomalies research? Machine learning approach with international evidence," Journal of Financial Markets, Elsevier, vol. 56(C).
    17. Hediger, Simon & Michel, Loris & Näf, Jeffrey, 2022. "On the use of random forest for two-sample testing," Computational Statistics & Data Analysis, Elsevier, vol. 170(C).
    18. Hoang, Khoa & Cannavan, Damien & Gaunt, Clive & Huang, Ronghong, 2019. "Is that factor just lucky? Australian evidence," Pacific-Basin Finance Journal, Elsevier, vol. 57(C).
    19. Guanhao Feng & Stefano Giglio & Dacheng Xiu, 2020. "Taming the Factor Zoo: A Test of New Factors," Journal of Finance, American Finance Association, vol. 75(3), pages 1327-1370, June.
    20. Nettayanun, Sampan, 2023. "Asset pricing in bull and bear markets," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 83(C).

    More about this item

    Keywords

    anomalies; data-snooping bias; stock return predictability; portfolio strategies;
    All these keywords.

    JEL classification:

    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sin:wpaper:17-a003. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: HsiaoyunLiu (email available below). General contact details of provider: https://edirc.repec.org/data/sinictw.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.