IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.16019.html
   My bibliography  Save this paper

Quantile Predictions for Equity Premium using Penalized Quantile Regression with Consistent Variable Selection across Multiple Quantiles

Author

Listed:
  • Shaobo Li
  • Ben Sherwood

Abstract

This paper considers equity premium prediction, for which mean regression can be problematic due to heteroscedasticity and heavy-tails of the error. We show advantages of quantile predictions using a novel penalized quantile regression that offers a model for a full spectrum analysis on the equity premium distribution. To enhance model interpretability and address the well-known issue of crossing quantile predictions in quantile regression, we propose a model that enforces the selection of a common set of variables across all quantiles. Such a selection consistency is achieved by simultaneously estimating all quantiles with a group penalty that ensures sparsity pattern is the same for all quantiles. Consistency results are provided that allow the number of predictors to increase with the sample size. A Huberized quantile loss function and an augmented data approach are implemented for computational efficiency. Simulation studies show the effectiveness of the proposed approach. Empirical results show that the proposed method outperforms several benchmark methods. Moreover, we find some important predictors reverse their relationship to the excess return from lower to upper quantiles, potentially offering interesting insights to the domain experts. Our proposed method can be applied to other fields.

Suggested Citation

  • Shaobo Li & Ben Sherwood, 2025. "Quantile Predictions for Equity Premium using Penalized Quantile Regression with Consistent Variable Selection across Multiple Quantiles," Papers 2505.16019, arXiv.org.
  • Handle: RePEc:arx:papers:2505.16019
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2505.16019
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    3. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    4. Loukia Meligkotsidou & Ekaterini Panopoulou & Ioannis D. Vrontos & Spyridon D. Vrontos, 2014. "A Quantile Regression Approach to Equity Premium Prediction," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(7), pages 558-576, November.
    5. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    6. Lee, Ji Hyung, 2016. "Predictive quantile regression with persistent covariates: IVX-QR approach," Journal of Econometrics, Elsevier, vol. 192(1), pages 105-118.
    7. He, Qianchuan & Kong, Linglong & Wang, Yanhua & Wang, Sijian & Chan, Timothy A. & Holland, Eric, 2016. "Regularized quantile regression under heterogeneous sparsity with application to quantitative genetic traits," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 222-239.
    8. Amit Goyal & Ivo Welch & Athanasse Zafirov, 2024. "A Comprehensive 2022 Look at the Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 37(11), pages 3490-3557.
    9. Len Umantsev & Victor Chernozhukov, 2001. "Conditional value-at-risk: Aspects of modeling and estimation," Empirical Economics, Springer, vol. 26(1), pages 271-292.
    10. Howard D. Bondell & Brian J. Reich & Huixia Wang, 2010. "Noncrossing quantile regression curve estimation," Biometrika, Biometrika Trust, vol. 97(4), pages 825-838.
    11. Hui Guo, 2006. "On the Out-of-Sample Predictability of Stock Market Returns," The Journal of Business, University of Chicago Press, vol. 79(2), pages 645-670, March.
    12. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    13. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    14. Yanming Li & Bin Nan & Ji Zhu, 2015. "Multivariate sparse group lasso for the multivariate multiple linear regression with an arbitrary group structure," Biometrics, The International Biometric Society, vol. 71(2), pages 354-363, June.
    15. James, Robert & Leung, Henry & Leung, Jessica Wai Yin & Prokhorov, Artem, 2023. "Forecasting tail risk measures for financial time series: An extreme value approach with covariates," Journal of Empirical Finance, Elsevier, vol. 71(C), pages 29-50.
    16. Robert Tibshirani & Jacob Bien & Jerome Friedman & Trevor Hastie & Noah Simon & Jonathan Taylor & Ryan J. Tibshirani, 2012. "Strong rules for discarding predictors in lasso‐type problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(2), pages 245-266, March.
    17. Qu, Zhongjun & Yoon, Jungmo, 2015. "Nonparametric estimation and inference on conditional quantile processes," Journal of Econometrics, Elsevier, vol. 185(1), pages 1-19.
    18. Lee, Ji Hyung & Shi, Zhentao & Gao, Zhan, 2022. "On LASSO for predictive regression," Journal of Econometrics, Elsevier, vol. 229(2), pages 322-349.
    19. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    20. Mohamed Ouhourane & Yi Yang & Andréa L. Benedet & Karim Oualkacha, 2022. "Group penalized quantile regression," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(3), pages 495-529, September.
    21. Zou, Hui & Yuan, Ming, 2008. "Regularized simultaneous model selection in multiple quantiles regression," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5296-5304, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    2. Faias, José Afonso, 2023. "Predicting the equity risk premium using the smooth cross-sectional tail risk: The importance of correlation," Journal of Financial Markets, Elsevier, vol. 63(C).
    3. Afsaneh Bahrami & Abul Shamsuddin & Katherine Uylangco, 2018. "Out‐of‐sample stock return predictability in emerging markets," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 58(3), pages 727-750, September.
    4. Alexandridis, Antonios K. & Apergis, Iraklis & Panopoulou, Ekaterini & Voukelatos, Nikolaos, 2023. "Equity premium prediction: The role of information from the options market," Journal of Financial Markets, Elsevier, vol. 64(C).
    5. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    6. Fan, Rui & Lee, Ji Hyung & Shin, Youngki, 2023. "Predictive quantile regression with mixed roots and increasing dimensions: The ALQR approach," Journal of Econometrics, Elsevier, vol. 237(2).
    7. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    8. Chen, Yong & Da, Zhi & Huang, Dayong, 2022. "Short selling efficiency," Journal of Financial Economics, Elsevier, vol. 145(2), pages 387-408.
    9. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    10. Yu, Deshui & Huang, Difang & Chen, Li, 2023. "Stock return predictability and cyclical movements in valuation ratios," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 36-53.
    11. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    12. Cem Cakmakli & Dick van Dijk, 2010. "Getting the Most out of Macroeconomic Information for Predicting Stock Returns and Volatility," Tinbergen Institute Discussion Papers 10-115/4, Tinbergen Institute.
    13. Zhao, Albert Bo & Cheng, Tingting, 2022. "Stock return prediction: Stacking a variety of models," Journal of Empirical Finance, Elsevier, vol. 67(C), pages 288-317.
    14. Gonçalo Faria & Fabio Verona, 2016. "Forecasting the equity risk premium with frequency-decomposed predictors," Working Papers de Economia (Economics Working Papers) 06, Católica Porto Business School, Universidade Católica Portuguesa.
    15. , & Stein, Tobias, 2021. "Equity premium predictability over the business cycle," CEPR Discussion Papers 16357, C.E.P.R. Discussion Papers.
    16. Yongan Xu & Jianqiong Wang & Zhonglu Chen & Chao Liang, 2023. "Sentiment indices and stock returns: Evidence from China," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(1), pages 1063-1080, January.
    17. Chaohua Dong & Jiti Gao & Bin Peng & Yundong Tu, 2021. "Multiple-index Nonstationary Time Series Models: Robust Estimation Theory and Practice," Papers 2111.02023, arXiv.org.
    18. Phan, Dinh Hoang Bach & Sharma, Susan Sunila & Narayan, Paresh Kumar, 2015. "Stock return forecasting: Some new evidence," International Review of Financial Analysis, Elsevier, vol. 40(C), pages 38-51.
    19. Ana Sofia Monteiro & Helder Sebastião & Nuno Silva, 2025. "Prediction and Allocation of Stocks, Bonds, and REITs in the US Market," Computational Economics, Springer;Society for Computational Economics, vol. 65(3), pages 1191-1230, March.
    20. Maynard, Alex & Shimotsu, Katsumi & Kuriyama, Nina, 2024. "Inference in predictive quantile regressions," Journal of Econometrics, Elsevier, vol. 245(1).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.16019. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.