IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v42y2023i7p1805-1822.html
   My bibliography  Save this article

Forecasting the stock risk premium: A new statistical constraint

Author

Listed:
  • Xianfeng Hao
  • Yudong Wang

Abstract

We develop a new statistical constraint to improve the stock return forecasting performance of predictive models. This constraint uses a new objective function that combines the Huber loss function with the Ridge penalty. Out‐of‐sample results indicate that our constraint improves the predictive ability of the univariate models. The constrained univariate models significantly outperform the historical average benchmark model assuming no predictability. The forecast improvement based on the new constraint is also evident for multivariate information methods including forecast combination and diffusion index. The model is capable of capturing time‐varying risk which serves as the potential economic explanation of the improved return predictability. Our results are robust to different evaluation subsamples, validation sample lengths, and different risk aversion coefficients.

Suggested Citation

  • Xianfeng Hao & Yudong Wang, 2023. "Forecasting the stock risk premium: A new statistical constraint," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1805-1822, November.
  • Handle: RePEc:wly:jforec:v:42:y:2023:i:7:p:1805-1822
    DOI: 10.1002/for.2984
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.2984
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.2984?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Malcolm Baker & Jeffrey Wurgler, 2000. "The Equity Share in New Issues and Aggregate Stock Returns," Journal of Finance, American Finance Association, vol. 55(5), pages 2219-2257, October.
    3. Andrew Ang & Geert Bekaert, 2007. "Stock Return Predictability: Is it There?," The Review of Financial Studies, Society for Financial Studies, vol. 20(3), pages 651-707.
    4. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    5. John Y. Campbell & John Cochrane, 1999. "Force of Habit: A Consumption-Based Explanation of Aggregate Stock Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 107(2), pages 205-251, April.
    6. Charlotte Christiansen & Maik Schmeling & Andreas Schrimpf, 2012. "A comprehensive look at financial volatility prediction by economic variables," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 956-977, September.
    7. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    8. Ľuboš Pástor & Robert F. Stambaugh, 2012. "Are Stocks Really Less Volatile in the Long Run?," Journal of Finance, American Finance Association, vol. 67(2), pages 431-478, April.
    9. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    10. Li, Jiahan & Tsiakas, Ilias, 2017. "Equity premium prediction: The role of economic and statistical constraints," Journal of Financial Markets, Elsevier, vol. 36(C), pages 56-75.
    11. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    12. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    13. Martin Lettau & Sydney Ludvigson, 2001. "Consumption, Aggregate Wealth, and Expected Stock Returns," Journal of Finance, American Finance Association, vol. 56(3), pages 815-849, June.
    14. Ľuboš Pástor & Robert F. Stambaugh, 2009. "Predictive Systems: Living with Imperfect Predictors," Journal of Finance, American Finance Association, vol. 64(4), pages 1583-1628, August.
    15. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    16. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    17. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    18. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    19. Jacob Boudoukh & Roni Michaely & Matthew Richardson & Michael R. Roberts, 2007. "On the Importance of Measuring Payout Yield: Implications for Empirical Asset Pricing," Journal of Finance, American Finance Association, vol. 62(2), pages 877-915, April.
    20. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    21. Li Liu & Zhiyuan Pan & Yudong Wang, 2021. "What can we learn from the return predictability over the business cycle?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(1), pages 108-131, January.
    22. Cochrane, John H, 1991. "Production-Based Asset Pricing and the Link between Stock Returns and Economic Fluctuations," Journal of Finance, American Finance Association, vol. 46(1), pages 209-237, March.
    23. Jianqing Fan & Quefeng Li & Yuyan Wang, 2017. "Estimation of high dimensional mean regression in the absence of symmetry and light tail assumptions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 247-265, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    2. Wang, Yudong & Pan, Zhiyuan & Liu, Li & Wu, Chongfeng, 2019. "Oil price increases and the predictability of equity premium," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 43-58.
    3. Pan, Zhiyuan & Pettenuzzo, Davide & Wang, Yudong, 2020. "Forecasting stock returns: A predictor-constrained approach," Journal of Empirical Finance, Elsevier, vol. 55(C), pages 200-217.
    4. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    5. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    6. Smith, Simon C., 2021. "International stock return predictability," International Review of Financial Analysis, Elsevier, vol. 78(C).
    7. Gonçalo Faria & Fabio Verona, 2016. "Forecasting the equity risk premium with frequency-decomposed predictors," Working Papers de Economia (Economics Working Papers) 06, Católica Porto Business School, Universidade Católica Portuguesa.
    8. Ma, Feng & Wang, Ruoxin & Lu, Xinjie & Wahab, M.I.M., 2021. "A comprehensive look at stock return predictability by oil prices using economic constraint approaches," International Review of Financial Analysis, Elsevier, vol. 78(C).
    9. Faias, José Afonso, 2023. "Predicting the equity risk premium using the smooth cross-sectional tail risk: The importance of correlation," Journal of Financial Markets, Elsevier, vol. 63(C).
    10. Dai, Zhifeng & Zhu, Huan, 2020. "Stock return predictability from a mixed model perspective," Pacific-Basin Finance Journal, Elsevier, vol. 60(C).
    11. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    12. Mathias S. Kruttli, 2016. "From Which Consumption-Based Asset Pricing Models Can Investors Profit? Evidence from Model-Based Priors," Finance and Economics Discussion Series 2016-027, Board of Governors of the Federal Reserve System (U.S.).
    13. Yufeng Han, 2010. "On the Economic Value of Return Predictability," Annals of Economics and Finance, Society for AEF, vol. 11(1), pages 1-33, May.
    14. Wang, Yunqi & Zhou, Ti, 2023. "Out-of-sample equity premium prediction: The role of option-implied constraints," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 199-226.
    15. José Afonso Faias & Tiago Castel-Branco, 2018. "Out-Of-Sample Stock Return Prediction Using Higher-Order Moments," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 21(06), pages 1-27, September.
    16. Schrimpf, Andreas, 2010. "International stock return predictability under model uncertainty," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1256-1282, November.
    17. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    18. John Y. Campbell, 2008. "Viewpoint: Estimating the equity premium," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 1-21, February.
    19. Demetrescu, Matei & Georgiev, Iliyan & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2022. "Testing for episodic predictability in stock returns," Journal of Econometrics, Elsevier, vol. 227(1), pages 85-113.
    20. Jessica A. Wachter, 2010. "Asset Allocation," Annual Review of Financial Economics, Annual Reviews, vol. 2(1), pages 175-206, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:42:y:2023:i:7:p:1805-1822. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.