IDEAS home Printed from https://ideas.repec.org/a/eee/empfin/v83y2025ics0927539825000696.html

Predicting risk premiums: A constraint-based model

Author

Listed:
  • Yuan, Ying
  • Qu, Yong
  • Wang, Tianyang

Abstract

This research introduces a novel constraint-based model framework for predicting risk premiums, thoroughly examining the mechanism and limitations of existing models in the literature and leveraging advanced machine learning techniques. The proposed framework effectively captures the regime-dependent forecasting characteristics. It incorporates the information content of predictive regression, “naive” historical average model, and zero value model, significantly reducing model uncertainty and parameter instability across univariate and multivariate predictions. Empirical analysis demonstrates the superiority of our strategy in terms of out-of-sample forecasting performance over a variety of competing models and under different market conditions, highlighting the robustness of our results. We further substantiate the validity of considering the market regime as an economic state variable and justify the rationality of our constraint-based model in elucidating the source of the improved predictability. Our study holds significant implications for financial and economic research, as well as practical applications in portfolio management and risk assessment.

Suggested Citation

  • Yuan, Ying & Qu, Yong & Wang, Tianyang, 2025. "Predicting risk premiums: A constraint-based model," Journal of Empirical Finance, Elsevier, vol. 83(C).
  • Handle: RePEc:eee:empfin:v:83:y:2025:i:c:s0927539825000696
    DOI: 10.1016/j.jempfin.2025.101647
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927539825000696
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jempfin.2025.101647?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Faria, Gonçalo & Verona, Fabio, 2018. "Forecasting stock market returns by summing the frequency-decomposed parts," Journal of Empirical Finance, Elsevier, vol. 45(C), pages 228-242.
    2. Jingwen Jiang & Bryan Kelly & Dacheng Xiu, 2023. "(Re‐)Imag(in)ing Price Trends," Journal of Finance, American Finance Association, vol. 78(6), pages 3193-3249, December.
    3. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    4. Jonathan Iworiso & Spyridon Vrontos, 2020. "On the directional predictability of equity premium using machine learning techniques," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(3), pages 449-469, April.
    5. Nelson, Charles R, 1976. "Inflation and Rates of Return on Common Stocks," Journal of Finance, American Finance Association, vol. 31(2), pages 471-483, May.
    6. Lv, Wendai & Qi, Jipeng, 2022. "Stock market return predictability: A combination forecast perspective," International Review of Financial Analysis, Elsevier, vol. 84(C).
    7. Tsiakas, Ilias & Li, Jiahan & Zhang, Haibin, 2020. "Equity premium prediction and the state of the economy," Journal of Empirical Finance, Elsevier, vol. 58(C), pages 75-95.
    8. Cao, Jie & Chordia, Tarun & Lin, Chen, 2016. "Alliances and Return Predictability," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 51(5), pages 1689-1717, October.
    9. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    10. John Y. Campbell & Tuomo Vuolteenaho, 2004. "Inflation Illusion and Stock Prices," American Economic Review, American Economic Association, vol. 94(2), pages 19-23, May.
    11. repec:bla:jfinan:v:43:y:1988:i:3:p:661-76 is not listed on IDEAS
    12. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    13. Daniele Bianchi & Matthias Büchner & Andrea Tamoni, 2021. "Bond Risk Premiums with Machine Learning [Quadratic term structure models: Theory and evidence]," The Review of Financial Studies, Society for Financial Studies, vol. 34(2), pages 1046-1089.
    14. Bryan Kelly & Seth Pruitt, 2013. "Market Expectations in the Cross-Section of Present Values," Journal of Finance, American Finance Association, vol. 68(5), pages 1721-1756, October.
    15. García, Diego & Hu, Xiaowen & Rohrer, Maximilian, 2023. "The colour of finance words," Journal of Financial Economics, Elsevier, vol. 147(3), pages 525-549.
    16. Campbell, John & Shiller, Robert, 1988. "Stock Prices, Earnings, and Expected Dividends," Scholarly Articles 3224293, Harvard University Department of Economics.
    17. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    18. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    19. Leippold, Markus & Wang, Qian & Zhou, Wenyu, 2022. "Machine learning in the Chinese stock market," Journal of Financial Economics, Elsevier, vol. 145(2), pages 64-82.
    20. Tim Bollerslev & George Tauchen & Hao Zhou, 2009. "Expected Stock Returns and Variance Risk Premia," The Review of Financial Studies, Society for Financial Studies, vol. 22(11), pages 4463-4492, November.
    21. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    22. Zhao, Albert Bo & Cheng, Tingting, 2022. "Stock return prediction: Stacking a variety of models," Journal of Empirical Finance, Elsevier, vol. 67(C), pages 288-317.
    23. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    24. Xi Dong & Yan Li & David E. Rapach & Guofu Zhou, 2022. "Anomalies and the Expected Market Return," Journal of Finance, American Finance Association, vol. 77(1), pages 639-681, February.
    25. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    26. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    27. Rapach, David E. & Ringgenberg, Matthew C. & Zhou, Guofu, 2016. "Short interest and aggregate stock returns," Journal of Financial Economics, Elsevier, vol. 121(1), pages 46-65.
    28. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    29. Hongwei Zhang & Qiang He & Ben Jacobsen & Fuwei Jiang, 2020. "Forecasting stock returns with model uncertainty and parameter instability," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 629-644, August.
    30. Jondeau, Eric & Zhang, Qunzi & Zhu, Xiaoneng, 2019. "Average skewness matters," Journal of Financial Economics, Elsevier, vol. 134(1), pages 29-47.
    31. Wang, Yunqi & Zhou, Ti, 2023. "Out-of-sample equity premium prediction: The role of option-implied constraints," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 199-226.
    32. Kothari, S. P. & Shanken, Jay, 1997. "Book-to-market, dividend yield, and expected market returns: A time-series analysis," Journal of Financial Economics, Elsevier, vol. 44(2), pages 169-203, May.
    33. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    34. Chen, Jian & Tang, Guohao & Yao, Jiaquan & Zhou, Guofu, 2022. "Investor Attention and Stock Returns," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 57(2), pages 455-484, March.
    35. Martin, Ian W.R. & Nagel, Stefan, 2022. "Market efficiency in the age of big data," Journal of Financial Economics, Elsevier, vol. 145(1), pages 154-177.
    36. Andrii Babii & Eric Ghysels & Jonas Striaukas, 2022. "Machine Learning Time Series Regressions With an Application to Nowcasting," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1094-1106, June.
    37. Wang, Yudong & Liu, Li & Ma, Feng & Diao, Xundi, 2018. "Momentum of return predictability," Journal of Empirical Finance, Elsevier, vol. 45(C), pages 141-156.
    38. Hai Lin & Chunchi Wu & Guofu Zhou, 2018. "Forecasting Corporate Bond Returns with a Large Set of Predictors: An Iterated Combination Approach," Management Science, INFORMS, vol. 64(9), pages 4218-4238, September.
    39. John Y. Campbell & John Cochrane, 1999. "Force of Habit: A Consumption-Based Explanation of Aggregate Stock Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 107(2), pages 205-251, April.
    40. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2013. "International Stock Return Predictability: What Is the Role of the United States?," Journal of Finance, American Finance Association, vol. 68(4), pages 1633-1662, August.
    41. Quinn McNemar, 1947. "Note on the sampling error of the difference between correlated proportions or percentages," Psychometrika, Springer;The Psychometric Society, vol. 12(2), pages 153-157, June.
    42. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    43. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    44. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    45. Baltas, Nick & Karyampas, Dimitrios, 2018. "Forecasting the equity risk premium: The importance of regime-dependent evaluation," Journal of Financial Markets, Elsevier, vol. 38(C), pages 83-102.
    46. Li, Yuze & Jiang, Shangrong & Li, Xuerong & Wang, Shouyang, 2021. "The role of news sentiment in oil futures returns and volatility forecasting: Data-decomposition based deep learning approach," Energy Economics, Elsevier, vol. 95(C).
    47. Dai, Zhifeng & Kang, Jie & Wen, Fenghua, 2021. "Predicting stock returns: A risk measurement perspective," International Review of Financial Analysis, Elsevier, vol. 74(C).
    48. Obaid, Khaled & Pukthuanthong, Kuntara, 2022. "A picture is worth a thousand words: Measuring investor sentiment by combining machine learning and photos from news," Journal of Financial Economics, Elsevier, vol. 144(1), pages 273-297.
    49. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    50. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    51. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    52. Dashan Huang & Fuwei Jiang & Kunpeng Li & Guoshi Tong & Guofu Zhou, 2022. "Scaled PCA: A New Approach to Dimension Reduction," Management Science, INFORMS, vol. 68(3), pages 1678-1695, March.
    53. Narayan, Paresh Kumar & Liu, Ruipeng, 2018. "A new GARCH model with higher moments for stock return predictability," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 56(C), pages 93-103.
    54. Jing-Zhi Huang & Zhan Shi, 2023. "Machine-Learning-Based Return Predictors and the Spanning Controversy in Macro-Finance," Management Science, INFORMS, vol. 69(3), pages 1780-1804, March.
    55. Pan, Zhiyuan & Pettenuzzo, Davide & Wang, Yudong, 2020. "Forecasting stock returns: A predictor-constrained approach," Journal of Empirical Finance, Elsevier, vol. 55(C), pages 200-217.
    56. Pontiff, Jeffrey & Schall, Lawrence D., 1998. "Book-to-market ratios as predictors of market returns," Journal of Financial Economics, Elsevier, vol. 49(2), pages 141-160, August.
    57. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    58. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    59. Manela, Asaf & Moreira, Alan, 2017. "News implied volatility and disaster concerns," Journal of Financial Economics, Elsevier, vol. 123(1), pages 137-162.
    60. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    61. Yi, Yongsheng & Ma, Feng & Zhang, Yaojie & Huang, Dengshi, 2019. "Forecasting stock returns with cycle-decomposed predictors," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 250-261.
    62. Zhang, Yaojie & Wei, Yu & Ma, Feng & Yi, Yongsheng, 2019. "Economic constraints and stock return predictability: A new approach," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 1-9.
    63. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    64. Andrew Detzel & Robert Novy‐Marx & Mihail Velikov, 2023. "Model Comparison with Transaction Costs," Journal of Finance, American Finance Association, vol. 78(3), pages 1743-1775, June.
    65. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    66. Lanbiao Liu & Chen Chen & Bo Wang, 2022. "Predicting financial crises with machine learning methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(5), pages 871-910, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dai, Zhifeng & Jiang, Fuwei & Kang, Jie & Xue, Bowen, 2025. "Stock return predictability in the frequency domain," International Journal of Forecasting, Elsevier, vol. 41(3), pages 1126-1147.
    2. Maung, Kenwin & Swanson, Norman R., 2025. "A survey of models and methods used for forecasting when investing in financial markets," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1355-1382.
    3. Yuan, Ying & Qu, Yong & Qiao, Sijia, 2025. "Equity premium prediction: A constraint-based predictor decomposition approach," Global Finance Journal, Elsevier, vol. 68(C).
    4. Dai, Zhifeng & Zhu, Huan, 2020. "Stock return predictability from a mixed model perspective," Pacific-Basin Finance Journal, Elsevier, vol. 60(C).
    5. Dai, Zhifeng & Kang, Jie & Wen, Fenghua, 2021. "Predicting stock returns: A risk measurement perspective," International Review of Financial Analysis, Elsevier, vol. 74(C).
    6. Gonçalo Faria & Fabio Verona, 2016. "Forecasting the equity risk premium with frequency-decomposed predictors," Working Papers de Economia (Economics Working Papers) 06, Católica Porto Business School, Universidade Católica Portuguesa.
    7. Gonçalo Faria & Fabio Verona, 2016. "Forecasting the equity risk premium with frequency-decomposed predictors," Working Papers de Economia (Economics Working Papers) 06, Católica Porto Business School, Universidade Católica Portuguesa.
    8. Yong Qu & Ying Yuan, 2025. "Predicting Equity Premium: A New Momentum Indicator Selection Strategy With Machine Learning," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(2), pages 424-435, March.
    9. Dai, Zhifeng & Zhu, Huan, 2021. "Indicator selection and stock return predictability," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    10. Wang, Yunqi & Zhou, Ti, 2023. "Out-of-sample equity premium prediction: The role of option-implied constraints," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 199-226.
    11. Alexandridis, Antonios K. & Apergis, Iraklis & Panopoulou, Ekaterini & Voukelatos, Nikolaos, 2023. "Equity premium prediction: The role of information from the options market," Journal of Financial Markets, Elsevier, vol. 64(C).
    12. Wang, Yudong & Pan, Zhiyuan & Liu, Li & Wu, Chongfeng, 2019. "Oil price increases and the predictability of equity premium," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 43-58.
    13. Ma, Feng & Wang, Ruoxin & Lu, Xinjie & Wahab, M.I.M., 2021. "A comprehensive look at stock return predictability by oil prices using economic constraint approaches," International Review of Financial Analysis, Elsevier, vol. 78(C).
    14. Xi Dong & Yan Li & David E. Rapach & Guofu Zhou, 2022. "Anomalies and the Expected Market Return," Journal of Finance, American Finance Association, vol. 77(1), pages 639-681, February.
    15. Yuan Zhao & Xue Gong & Weiguo Zhang & Weijun Xu, 2025. "Stock return forecasting based on the proxy variables of category factors," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 11(1), pages 1-48, December.
    16. Dai, Zhifeng & Dong, Xiaodi & Kang, Jie & Hong, Lianying, 2020. "Forecasting stock market returns: New technical indicators and two-step economic constraint method," The North American Journal of Economics and Finance, Elsevier, vol. 53(C).
    17. Dai, Zhifeng & Zhu, Huan & Kang, Jie, 2021. "New technical indicators and stock returns predictability," International Review of Economics & Finance, Elsevier, vol. 71(C), pages 127-142.
    18. Pan, Zhiyuan & Zhong, Hao & Wang, Yudong & Huang, Juan, 2024. "Forecasting oil futures returns with news," Energy Economics, Elsevier, vol. 134(C).
    19. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    20. Dong, Dayong & Yue, Sishi & Cao, Jiawei, 2020. "Site visit information content and return predictability: Evidence from China," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:empfin:v:83:y:2025:i:c:s0927539825000696. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jempfin .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.