IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.16224.html
   My bibliography  Save this paper

Prediction Intervals for Model Averaging

Author

Listed:
  • Zhongjun Qu
  • Wendun Wang
  • Xiaomeng Zhang

Abstract

A rich set of frequentist model averaging methods has been developed, but their applications have largely been limited to point prediction, as measuring prediction uncertainty in general settings remains an open problem. In this paper we propose prediction intervals for model averaging based on conformal inference. These intervals cover out-of-sample realizations of the outcome variable with a pre-specified probability, providing a way to assess predictive uncertainty beyond point prediction. The framework allows general model misspecification and applies to averaging across multiple models that can be nested, disjoint, overlapping, or any combination thereof, with weights that may depend on the estimation sample. We establish coverage guarantees under two sets of assumptions: exact finite-sample validity under exchangeability, relevant for cross-sectional data, and asymptotic validity under stationarity, relevant for time-series data. We first present a benchmark algorithm and then introduce a locally adaptive refinement and split-sample procedures that broaden applicability. The methods are illustrated with a cross-sectional application to real estate appraisal and a time-series application to equity premium forecasting.

Suggested Citation

  • Zhongjun Qu & Wendun Wang & Xiaomeng Zhang, 2025. "Prediction Intervals for Model Averaging," Papers 2510.16224, arXiv.org.
  • Handle: RePEc:arx:papers:2510.16224
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2510.16224
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. D. W. K. Andrews, 2003. "End-of-Sample Instability Tests," Econometrica, Econometric Society, vol. 71(6), pages 1661-1694, November.
    2. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    3. Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
    4. Xinyu Zhang & Guohua Zou & Hua Liang & Raymond J. Carroll, 2020. "Parsimonious Model Averaging With a Diverging Number of Parameters," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 972-984, April.
    5. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    6. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    7. Amit Goyal & Ivo Welch & Athanasse Zafirov, 2024. "A Comprehensive 2022 Look at the Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 37(11), pages 3490-3557.
    8. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, January.
    9. Jing Lei & Max G’Sell & Alessandro Rinaldo & Ryan J. Tibshirani & Larry Wasserman, 2018. "Distribution-Free Predictive Inference for Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1094-1111, July.
    10. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    11. Jacob Boudoukh & Matthew Richardson & Robert F. Whitelaw, 2008. "The Myth of Long-Horizon Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1577-1605, July.
    12. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    13. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    14. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    15. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    16. Liao, Jun & Zou, Guohua & Gao, Yan & Zhang, Xinyu, 2021. "Model averaging prediction for time series models with a diverging number of parameters," Journal of Econometrics, Elsevier, vol. 223(1), pages 190-221.
    17. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hongwei Zhang & Qiang He & Ben Jacobsen & Fuwei Jiang, 2020. "Forecasting stock returns with model uncertainty and parameter instability," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 629-644, August.
    2. Hounyo, Ulrich & Lahiri, Kajal, 2023. "Estimating the variance of a combined forecast: Bootstrap-based approach," Journal of Econometrics, Elsevier, vol. 232(2), pages 445-468.
    3. Tu, Yundong & Yi, Yanping, 2017. "Forecasting cointegrated nonstationary time series with time-varying variance," Journal of Econometrics, Elsevier, vol. 196(1), pages 83-98.
    4. Wan, Alan T.K. & Zhang, Xinyu & Wang, Shouyang, 2014. "Frequentist model averaging for multinomial and ordered logit models," International Journal of Forecasting, Elsevier, vol. 30(1), pages 118-128.
    5. repec:isu:genstf:201501010800005727 is not listed on IDEAS
    6. Wenchao Xu & Xinyu Zhang, 2024. "On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included," Papers 2411.09258, arXiv.org.
    7. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    8. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    9. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2025. "State-Varying Model Averaging Prediction," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202507, University of Kansas, Department of Economics.
    10. Chen, Yi-Ting & Liu, Chu-An, 2023. "Model averaging for asymptotically optimal combined forecasts," Journal of Econometrics, Elsevier, vol. 235(2), pages 592-607.
    11. Greenaway-McGrevy, Ryan, 2022. "Forecast combination for VARs in large N and T panels," International Journal of Forecasting, Elsevier, vol. 38(1), pages 142-164.
    12. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    13. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    14. Samuels, Jon D. & Sekkel, Rodrigo M., 2017. "Model Confidence Sets and forecast combination," International Journal of Forecasting, Elsevier, vol. 33(1), pages 48-60.
    15. Lastauskas, Povilas & Stakėnas, Julius, 2024. "Labor market policies in high- and low-interest rate environments: Evidence from the euro area," Economic Modelling, Elsevier, vol. 141(C).
    16. Zhao, Shangwei & Xie, Tian & Ai, Xin & Yang, Guangren & Zhang, Xinyu, 2023. "Correcting sample selection bias with model averaging for consumer demand forecasting," Economic Modelling, Elsevier, vol. 123(C).
    17. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.
    18. Rongjie Jiang & Liming Wang & Yang Bai, 2021. "Optimal model averaging estimator for semi-functional partially linear models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(2), pages 167-194, February.
    19. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    20. Alena Skolkova, 2023. "Model Averaging with Ridge Regularization," CERGE-EI Working Papers wp758, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    21. Yundong Tu & Siwei Wang, 2023. "Variable Screening and Model Averaging for Expectile Regressions," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 574-598, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.16224. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.