IDEAS home Printed from https://ideas.repec.org/p/kan/wpaper/202514.html
   My bibliography  Save this paper

Penalized Optimal Forecast Combination for Quantile Regressions

Author

Listed:
  • Haowen Bao

    (State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China and School of Economics and Management, and MOE Social Science Laboratory of Digital Economic Forecasts and Policy Simulation, University of Chinese Academy of Sciences, Beijing, China)

  • Zongwu Cai

    (Department of Economics, The University of Kansas, Lawrence, KS 66045, USA)

  • Yuying Sun

    (State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China and School of Economics and Management, and MOE Social Science Laboratory of Digital Economic Forecasts and Policy Simulation, University of Chinese Academy of Sciences, Beijing, China)

  • Shouyang Wang

    (State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China and School of Economics and Management, and MOE Social Science Laboratory of Digital Economic Forecasts and Policy Simulation, University of Chinese Academy of Sciences, Beijing, China)

Abstract

This paper develops a novel forecast combination approach for quantile regressions (QR) that accommodate both linear and nonlinear forms for parameters and regressors. We propose a penalized weight choice criterion based on the Kullback-Leibler loss in a quasi-likelihood framework that allows parameter uncertainty and model misspecification. This criterion simultaneously selects optimal combination weights and reduces model complexity, which covers special cases such as the Mallows-type criterion in linear QR. First, we prove the asymptotic optimality of the proposed combination method in diverging-dimensional settings for both linear and nonlinear QR cases. Second, we establish the consistency of the selected weights either for the misspecified and correctly specified candidate models, which complements existing model averaging literature for QR that only focuses on asymptotic optimality. Finally, we examine finite sample performance through Monte Carlo simulations and demonstrate advantages over existing methods via an empirical application to excess return forecasting.

Suggested Citation

  • Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Optimal Forecast Combination for Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202514, University of Kansas, Department of Economics, revised May 2025.
  • Handle: RePEc:kan:wpaper:202514
    as

    Download full text from publisher

    File URL: https://kuwpaper.ku.edu/2025Papers/202514.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Miaomiao Wang & Xinyu Zhang & Alan T. K. Wan & Kang You & Guohua Zou, 2023. "Jackknife model averaging for high‐dimensional quantile regression," Biometrics, The International Biometric Society, vol. 79(1), pages 178-189, March.
    2. Peng, Jingfu & Yang, Yuhong, 2022. "On improvability of model selection by model averaging," Journal of Econometrics, Elsevier, vol. 229(2), pages 246-262.
    3. Komunjer, Ivana, 2005. "Quasi-maximum likelihood estimation for conditional quantiles," Journal of Econometrics, Elsevier, vol. 128(1), pages 137-164, September.
    4. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    5. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    6. Koenker, Roger & Xiao, Zhijie, 2006. "Quantile Autoregression," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 980-990, September.
    7. Lukas Meier & Sara Van De Geer & Peter Bühlmann, 2008. "The group lasso for logistic regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(1), pages 53-71, February.
    8. Newey, Whitney K, 1991. "Uniform Convergence in Probability and Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 59(4), pages 1161-1167, July.
    9. Ivana Komunjer, 2007. "Asymmetric power distribution: Theory and applications to risk measurement," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(5), pages 891-921.
    10. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    11. Xiaohui Liu & Wei Long & Liang Peng & Bingduo Yang, 2024. "A Unified Inference for Predictive Quantile Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(546), pages 1526-1540, April.
    12. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    13. Chen, Bin & Maung, Kenwin, 2023. "Time-varying forecast combination for high-dimensional data," Journal of Econometrics, Elsevier, vol. 237(2).
    14. Xinyu Zhang & Huihang Liu & Yizheng Wei & Yanyuan Ma, 2024. "Prediction Using Many Samples with Models Possibly Containing Partially Shared Parameters," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(1), pages 187-196, January.
    15. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    16. Xie, Tian, 2017. "Heteroscedasticity-robust model screening: A useful toolkit for model averaging in big data analytics," Economics Letters, Elsevier, vol. 151(C), pages 119-122.
    17. Escanciano, Juan Carlos & Velasco, Carlos, 2010. "Specification tests of parametric dynamic conditional quantiles," Journal of Econometrics, Elsevier, vol. 159(1), pages 209-221, November.
    18. Luhao Zhang & Jincheng Yang & Rui Gao, 2024. "Optimal Robust Policy for Feature-Based Newsvendor," Management Science, INFORMS, vol. 70(4), pages 2315-2329, April.
    19. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    20. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    21. White, Halbert & Kim, Tae-Hwan & Manganelli, Simone, 2015. "VAR for VaR: Measuring tail dependence using multivariate regression quantiles," Journal of Econometrics, Elsevier, vol. 187(1), pages 169-188.
    22. Sainan Jin & Liangjun Su & Aman Ullah, 2014. "Robustify Financial Time Series Forecasting with Bagging," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 575-605, August.
    23. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    24. repec:hal:journl:peer-00732534 is not listed on IDEAS
    25. Oberhofer, Walter & Haupt, Harry, 2016. "Asymptotic Theory For Nonlinear Quantile Regression Under Weak Dependence," Econometric Theory, Cambridge University Press, vol. 32(3), pages 686-713, June.
    26. Tomohiro Ando & Ker-Chau Li, 2014. "A Model-Averaging Approach for High-Dimensional Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 254-265, March.
    27. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    28. P. J. Brown & M. Vannucci & T. Fearn, 2002. "Bayes model averaging with selection of regressors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 519-536, August.
    29. Cai, Zongwu & Xu, Xiaoping, 2009. "Nonparametric Quantile Estimations for Dynamic Smooth Coefficient Models," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 371-383.
    30. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    31. Retsef Levi & Georgia Perakis & Joline Uichanco, 2015. "The Data-Driven Newsvendor Problem: New Bounds and Insights," Operations Research, INFORMS, vol. 63(6), pages 1294-1306, December.
    32. Xiao, Zhijie & Xu, Lan, 2019. "What do mean impacts miss? Distributional effects of corporate diversification," Journal of Econometrics, Elsevier, vol. 213(1), pages 92-120.
    33. Cai, Zongwu & Chen, Haiqiang & Liao, Xiaosai, 2023. "A new robust inference for predictive quantile regression," Journal of Econometrics, Elsevier, vol. 234(1), pages 227-250.
    34. Eun Ryung Lee & Hohsuk Noh & Byeong U. Park, 2014. "Model Selection via Bayesian Information Criterion for Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 216-229, March.
    35. Fang, Fang & Yuan, Chaoxia & Tian, Wenling, 2023. "An Asymptotic Theory For Least Squares Model Averaging With Nested Models," Econometric Theory, Cambridge University Press, vol. 39(2), pages 412-441, April.
    36. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    37. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    38. Jialiang Li & Jing Lv & Alan T. K. Wan & Jun Liao, 2022. "AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(537), pages 495-509, January.
    39. Cai, Zongwu, 2002. "Regression Quantiles For Time Series," Econometric Theory, Cambridge University Press, vol. 18(1), pages 169-192, February.
    40. Jia Chen & Degui Li & Oliver Linton & Zudi Lu, 2018. "Semiparametric Ultra-High Dimensional Model Averaging of Nonlinear Dynamic Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 919-932, April.
    41. Xu, Qifa & Niu, Xufeng & Jiang, Cuixia & Huang, Xue, 2015. "The Phillips curve in the US: A nonlinear quantile regression approach," Economic Modelling, Elsevier, vol. 49(C), pages 186-197.
    42. Alhamzawi, Rahim, 2016. "Bayesian model selection in ordinal quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 68-78.
    43. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    44. Liao, Jun & Zou, Guohua & Gao, Yan & Zhang, Xinyu, 2021. "Model averaging prediction for time series models with a diverging number of parameters," Journal of Econometrics, Elsevier, vol. 223(1), pages 190-221.
    45. Cai, Zongwu & Chen, Linna & Fang, Ying, 2018. "A semiparametric quantile panel data model with an application to estimating the growth effect of FDI," Journal of Econometrics, Elsevier, vol. 206(2), pages 531-553.
    46. Yu, Keming & Moyeed, Rana A., 2001. "Bayesian quantile regression," Statistics & Probability Letters, Elsevier, vol. 54(4), pages 437-447, October.
    47. Lan Wang & Yichao Wu & Runze Li, 2012. "Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 214-222, March.
    48. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    49. Liao, Jun & Zong, Xianpeng & Zhang, Xinyu & Zou, Guohua, 2019. "Model averaging based on leave-subject-out cross-validation for vector autoregressions," Journal of Econometrics, Elsevier, vol. 209(1), pages 35-60.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics.
    2. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    3. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2023. "Optimal Local Model Averaging for Divergent-Dimensional Functional-Coefficient Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202309, University of Kansas, Department of Economics, revised Sep 2023.
    4. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2025. "State-Varying Model Averaging Prediction," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202507, University of Kansas, Department of Economics.
    5. Jingwen Tu & Hu Yang & Chaohui Guo & Jing Lv, 2021. "Model averaging marginal regression for high dimensional conditional quantile prediction," Statistical Papers, Springer, vol. 62(6), pages 2661-2689, December.
    6. Yuan, Chaoxia & Fang, Fang & Ni, Lyu, 2022. "Mallows model averaging with effective model size in fragmentary data prediction," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    7. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    8. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    9. Wenchao Xu & Xinyu Zhang, 2024. "On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included," Papers 2411.09258, arXiv.org.
    10. Zhang, Xiaomeng & Zhang, Xinyu, 2023. "Optimal model averaging based on forward-validation," Journal of Econometrics, Elsevier, vol. 237(2).
    11. Xiaochao Xia & Sijin He & Naiwen Pang, 2025. "Communication-efficient model averaging prediction for massive data with asymptotic optimality," Statistical Papers, Springer, vol. 66(2), pages 1-45, February.
    12. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    13. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    14. Zhongqi Liang & Caiya Zhang & Linjun Xu, 2024. "Model averaging for right censored data with measurement error," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 30(2), pages 501-527, April.
    15. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    16. De Gooijer, Jan G. & Zerom, Dawit, 2019. "Semiparametric quantile averaging in the presence of high-dimensional predictors," International Journal of Forecasting, Elsevier, vol. 35(3), pages 891-909.
    17. Zishu Zhan & Yang Li & Yuhong Yang & Cunjie Lin, 2023. "Model averaging for semiparametric varying coefficient quantile regression models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(4), pages 649-681, August.
    18. Timo Dimitriadis & Tobias Fissler & Johanna Ziegel, 2020. "The Efficiency Gap," Papers 2010.14146, arXiv.org, revised Sep 2022.
    19. Miaomiao Wang & Xinyu Zhang & Alan T. K. Wan & Kang You & Guohua Zou, 2023. "Jackknife model averaging for high‐dimensional quantile regression," Biometrics, The International Biometric Society, vol. 79(1), pages 178-189, March.
    20. Guo, Chaohui & Lv, Jing & Wu, Jibo, 2021. "Composite quantile regression for ultra-high dimensional semiparametric model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).

    More about this item

    Keywords

    Asymptotic optimality; Forecast combination; Misspecification; Quantile regressions; Weight convergence;
    All these keywords.

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kan:wpaper:202514. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Zongwu Cai (email available below). General contact details of provider: https://edirc.repec.org/data/deuksus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.