IDEAS home Printed from https://ideas.repec.org/a/eee/jbfina/v84y2017icp188-201.html
   My bibliography  Save this article

Out-of-sample equity premium predictability and sample split–invariant inference

Author

Listed:
  • Kolev, Gueorgui I.
  • Karapandza, Rasa

Abstract

For a comprehensive set of 21 equity premium predictors we find extreme variation in out-of-sample predictability results depending on the choice of the sample split date. To resolve this issue we propose reporting in graphical form the out-of-sample predictability criteria for every possible sample split, and two out-of-sample tests that are invariant to the sample split choice. We provide Monte Carlo evidence that our bootstrap-based inference is valid. The in-sample, and the sample split invariant out-of-sample mean and maximum tests that we propose, are in broad agreement. Finally we demonstrate how one can construct sample split invariant out-of-sample predictability tests that simultaneously control for data mining across many variables.

Suggested Citation

  • Kolev, Gueorgui I. & Karapandza, Rasa, 2017. "Out-of-sample equity premium predictability and sample split–invariant inference," Journal of Banking & Finance, Elsevier, vol. 84(C), pages 188-201.
  • Handle: RePEc:eee:jbfina:v:84:y:2017:i:c:p:188-201
    DOI: 10.1016/j.jbankfin.2016.07.017
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378426616301376
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jbankfin.2016.07.017?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Amihud, Yakov & Hurvich, Clifford M., 2004. "Predictive Regressions: A Reduced-Bias Estimation Method," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 39(4), pages 813-841, December.
    3. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    4. Peter Reinhard Hansen & Allan Timmermann, 2012. "Choice of Sample Split in Out-of-Sample Forecast Evaluation," CREATES Research Papers 2012-43, Department of Economics and Business Economics, Aarhus University.
    5. Todd Clark & Michael McCracken, 2012. "Reality Checks and Comparisons of Nested Predictive Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 53-66.
    6. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    7. Polk, Christopher & Thompson, Samuel & Vuolteenaho, Tuomo, 2006. "Cross-sectional forecasts of the equity premium," Journal of Financial Economics, Elsevier, vol. 81(1), pages 101-141, July.
    8. Lee, Charles M C & Shleifer, Andrei & Thaler, Richard H, 1991. "Investor Sentiment and the Closed-End Fund Puzzle," Journal of Finance, American Finance Association, vol. 46(1), pages 75-109, March.
    9. Kirstin Hubrich & Kenneth D. West, 2010. "Forecast evaluation of small nested model sets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 574-594.
    10. Benjamin Golez, 2014. "Expected Returns and Dividend Growth Rates Implied by Derivative Markets," Review of Financial Studies, Society for Financial Studies, vol. 27(3), pages 790-822.
    11. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    12. Foster, F Douglas & Smith, Tom & Whaley, Robert E, 1997. "Assessing Goodness-of-Fit of Asset Pricing Models: The Distribution of the Maximal R-Squared," Journal of Finance, American Finance Association, vol. 52(2), pages 591-607, June.
    13. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    14. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    15. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    16. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
    17. Ashley, R & Granger, C W J & Schmalensee, R, 1980. "Advertising and Aggregate Consumption: An Analysis of Causality," Econometrica, Econometric Society, vol. 48(5), pages 1149-1167, July.
    18. Neal, Robert & Wheatley, Simon M., 1998. "Do Measures of Investor Sentiment Predict Returns?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 33(4), pages 523-547, December.
    19. Rapach, David E. & Wohar, Mark E., 2006. "In-sample vs. out-of-sample tests of stock return predictability in the context of data mining," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 231-247, March.
    20. Zweig, Martin E, 1973. "An Investor Expectations Stock Price Predictive Model Using Closed-End Fund Premiums," Journal of Finance, American Finance Association, vol. 28(1), pages 67-78, March.
    21. Mark Britten‐Jones, 1999. "The Sampling Error in Estimates of Mean‐Variance Efficient Portfolio Weights," Journal of Finance, American Finance Association, vol. 54(2), pages 655-671, April.
    22. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    23. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    24. Gueorgui I. Kolev, 2008. "Forecasting aggregate stock returns using the number of initial public offerings as a predictor," Economics Bulletin, AccessEcon, vol. 7(13), pages 1-8.
    25. Cochrane, John H., 2011. "Understanding policy in the great recession: Some unpleasant fiscal arithmetic," European Economic Review, Elsevier, vol. 55(1), pages 2-30, January.
    26. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-218, March.
    27. Kirby, Chris & Ostdiek, Barbara, 2012. "It’s All in the Timing: Simple Active Portfolio Strategies that Outperform Naïve Diversification," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 47(2), pages 437-467, April.
    28. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
    29. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    30. Alexandros Kostakis & Nikolaos Panigirtzoglou & George Skiadopoulos, 2011. "Market Timing with Option-Implied Distributions: A Forward-Looking Approach," Management Science, INFORMS, vol. 57(7), pages 1231-1249, July.
    31. van Binsbergen, Jules & Hueskes, Wouter & Koijen, Ralph & Vrugt, Evert, 2013. "Equity yields," Journal of Financial Economics, Elsevier, vol. 110(3), pages 503-519.
      • Jules H. van Binsbergen & Wouter Hueskes & Ralph Koijen & Evert B. Vrugt, 2011. "Equity Yields," NBER Working Papers 17416, National Bureau of Economic Research, Inc.
    32. Lo, Andrew W & MacKinlay, A Craig, 1990. "Data-Snooping Biases in Tests of Financial Asset Pricing Models," Review of Financial Studies, Society for Financial Studies, vol. 3(3), pages 431-467.
    33. Gregory Mankiw, N. & Shapiro, Matthew D., 1986. "Do we reject too often? : Small sample properties of tests of rational expectations models," Economics Letters, Elsevier, vol. 20(2), pages 139-145.
    34. repec:ebl:ecbull:v:7:y:2008:i:13:p:1-8 is not listed on IDEAS
    35. Nelson, Charles R & Kim, Myung J, 1993. "Predictable Stock Returns: The Role of Small Sample Bias," Journal of Finance, American Finance Association, vol. 48(2), pages 641-661, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yin, Anwen, 2020. "Equity premium prediction and optimal portfolio decision with Bagging," The North American Journal of Economics and Finance, Elsevier, vol. 54(C).
    2. Esra Ulasan & A. Özlem Önder, 2023. "Large portfolio optimisation approaches," Journal of Asset Management, Palgrave Macmillan, vol. 24(6), pages 485-497, October.
    3. Demetrescu, Matei & Georgiev, Iliyan & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2022. "Testing for episodic predictability in stock returns," Journal of Econometrics, Elsevier, vol. 227(1), pages 85-113.
    4. Anibal Emiliano Da Silva Neto & Jesús Gonzalo & Jean‐Yves Pitarakis, 2021. "Uncovering Regimes in Out of Sample Forecast Errors from Predictive Regressions," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 713-741, June.
    5. Golez, Benjamin & Koudijs, Peter, 2018. "Four centuries of return predictability," Journal of Financial Economics, Elsevier, vol. 127(2), pages 248-263.
    6. Yin, Anwen, 2019. "Out-of-sample equity premium prediction in the presence of structural breaks," International Review of Financial Analysis, Elsevier, vol. 65(C).
    7. Procasky, William J. & Yin, Anwen, 2023. "Identifying the true nature of price discovery and cross-market informational flow in the investment grade CDS and equity markets," The North American Journal of Economics and Finance, Elsevier, vol. 64(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    2. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    3. Nonejad, Nima, 2021. "Predicting equity premium using news-based economic policy uncertainty: Not all uncertainty changes are equally important," International Review of Financial Analysis, Elsevier, vol. 77(C).
    4. Charles, Amelie & Darne, Olivier & Kim, Jae, 2016. "Stock Return Predictability: Evaluation based on Prediction Intervals," MPRA Paper 70143, University Library of Munich, Germany.
    5. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    6. Goh, Jeremy C. & Jiang, Fuwei & Tu, Jun & Wang, Yuchen, 2013. "Can US economic variables predict the Chinese stock market?," Pacific-Basin Finance Journal, Elsevier, vol. 22(C), pages 69-87.
    7. Lin, Qi & Lin, Xi, 2021. "Cash conversion cycle and aggregate stock returns," Journal of Financial Markets, Elsevier, vol. 52(C).
    8. Kuntz, Laura-Chloé, 2020. "Beta dispersion and market timing," Journal of Empirical Finance, Elsevier, vol. 59(C), pages 235-256.
    9. Dichtl, Hubert & Drobetz, Wolfgang & Neuhierl, Andreas & Wendt, Viktoria-Sophie, 2021. "Data snooping in equity premium prediction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 72-94.
    10. Amélie Charles & Olivier Darné & Jae H. Kim, 2022. "Stock return predictability: Evaluation based on interval forecasts," Bulletin of Economic Research, Wiley Blackwell, vol. 74(2), pages 363-385, April.
    11. Sousa, Ricardo M. & Vivian, Andrew & Wohar, Mark E., 2016. "Predicting asset returns in the BRICS: The role of macroeconomic and fundamental predictors," International Review of Economics & Finance, Elsevier, vol. 41(C), pages 122-143.
    12. Ana Sequeira, 2013. "Predicting aggregate returns using valuation ratios out-of-sample," Economic Bulletin and Financial Stability Report Articles and Banco de Portugal Economic Studies, Banco de Portugal, Economics and Research Department.
    13. Rapach, David E. & Wohar, Mark E., 2006. "In-sample vs. out-of-sample tests of stock return predictability in the context of data mining," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 231-247, March.
    14. Jordan, Steven J. & Vivian, Andrew & Wohar, Mark E., 2017. "Forecasting market returns: bagging or combining?," International Journal of Forecasting, Elsevier, vol. 33(1), pages 102-120.
    15. Jurdi, Doureige J., 2022. "Predicting the Australian equity risk premium," Pacific-Basin Finance Journal, Elsevier, vol. 71(C).
    16. Todd E. Clark & Michael W. McCracken, 2010. "Reality checks and nested forecast model comparisons," Working Papers 2010-032, Federal Reserve Bank of St. Louis.
    17. Nonejad, Nima, 2021. "Predicting equity premium using dynamic model averaging. Does the state–space representation matter?," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    18. Rapach, David E. & Wohar, Mark E. & Rangvid, Jesper, 2005. "Macro variables and international stock return predictability," International Journal of Forecasting, Elsevier, vol. 21(1), pages 137-166.
    19. Kuntz, Laura-Chloé, 2020. "Beta dispersion and market timing," Discussion Papers 46/2020, Deutsche Bundesbank.
    20. Yu, Deshui & Huang, Difang & Chen, Li, 2023. "Stock return predictability and cyclical movements in valuation ratios," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 36-53.

    More about this item

    Keywords

    Equity premium predictability; Out-of-sample inference; Sample split choice; Bootstrap;
    All these keywords.

    JEL classification:

    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbfina:v:84:y:2017:i:c:p:188-201. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbf .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.