IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v41y2025i2p733-747.html
   My bibliography  Save this article

Adaptively aggregated forecast for exponential family panel model

Author

Listed:
  • Yu, Dalei
  • Tang, Nian-Sheng
  • Shi, Yang

Abstract

Aggregation strategies play an important role akin to that of model selection and have been extensively studied in different statistical models to improve forecasting accuracy. However, traditional aggregated forecast strategies for panel data are mainly developed under the assumption that response variables are continuously distributed (or normally distributed). Replacing this assumption by a more general family of distributions, i.e., exponential family distributions, this paper proposes a computationally efficient way to construct the cumulative risk function and to explicitly accommodate the correlation structure of within-subject observations, develops two novel adaptively aggregated forecasting strategies via exponential reweighting and quadratic reweighting, and rigorously establishes the corresponding tight oracle inequalities. The proposed exponential reweighting-based strategy enjoys promising Kullback–Leibler risk-bound adaptation. Moreover, under the quadratic risk, a promising adaptation property can be achieved by the quadratic reweighting-based strategy. The risk-bound properties of the two proposed procedures in the presence of pre-screening are established under mild conditions. The calibration properties of the proposed methods are also analyzed. Simulation studies, together with an example in analyzing television viewers’ binary decision sequence of watching drama episodes, verify the superiority of our methods over existing model selection and aggregation methods.

Suggested Citation

  • Yu, Dalei & Tang, Nian-Sheng & Shi, Yang, 2025. "Adaptively aggregated forecast for exponential family panel model," International Journal of Forecasting, Elsevier, vol. 41(2), pages 733-747.
  • Handle: RePEc:eee:intfor:v:41:y:2025:i:2:p:733-747
    DOI: 10.1016/j.ijforecast.2024.06.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207024000591
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2024.06.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sha Yang & Vishal Narayan & Henry Assael, 2006. "Estimating the Interdependence of Television Program Viewership Between Spouses: A Bayesian Simultaneous Equation Model," Marketing Science, INFORMS, vol. 25(4), pages 336-349, July.
    2. Gao, Yan & Zhang, Xinyu & Wang, Shouyang & Zou, Guohua, 2016. "Model averaging based on leave-subject-out cross-validation," Journal of Econometrics, Elsevier, vol. 192(1), pages 139-151.
    3. Malte Knüppel, 2015. "Evaluating the Calibration of Multi-Step-Ahead Density Forecasts Using Raw Moments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 270-281, April.
    4. Jeffrey S. Racine & Qi Li & Dalei Yu & Li Zheng, 2023. "Optimal Model Averaging of Mixed-Data Kernel-Weighted Spline Regressions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1251-1261, October.
    5. Shinpei Imori, 2015. "Model Selection Criterion Based on the Multivariate Quasi-Likelihood for Generalized Estimating Equations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 1214-1224, December.
    6. M. J. Sweeting & S. G. Thompson, 2012. "Making predictions from complex longitudinal data, with application to planning monitoring intervals in a national screening programme," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 569-586, April.
    7. Qingfeng Liu & Ryo Okui, 2013. "Heteroscedasticity‐robust C(p) model averaging," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 463-472, October.
    8. Yang, Yuhong, 2004. "Combining Forecasting Procedures: Some Theoretical Results," Econometric Theory, Cambridge University Press, vol. 20(1), pages 176-222, February.
    9. Roopesh Ranjan & Tilmann Gneiting, 2010. "Combining probability forecasts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 71-91, January.
    10. Qian, Wei & Rolling, Craig A. & Cheng, Gang & Yang, Yuhong, 2022. "Combining forecasts for universally optimal performance," International Journal of Forecasting, Elsevier, vol. 38(1), pages 193-208.
    11. Carro, Jesus M., 2007. "Estimating dynamic panel data discrete choice models with fixed effects," Journal of Econometrics, Elsevier, vol. 140(2), pages 503-528, October.
    12. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    13. Cheryl J. Flynn & Clifford M. Hurvich & Jeffrey S. Simonoff, 2013. "Efficiency for Regularization Parameter Selection in Penalized Likelihood Estimation of Misspecified Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 1031-1043, September.
    14. Peng, Jingfu & Yang, Yuhong, 2022. "On improvability of model selection by model averaging," Journal of Econometrics, Elsevier, vol. 229(2), pages 246-262.
    15. Wei Pan, 2001. "Akaike's Information Criterion in Generalized Estimating Equations," Biometrics, The International Biometric Society, vol. 57(1), pages 120-125, March.
    16. Zheng Yuan & Debashis Ghosh, 2008. "Combining Multiple Biomarker Models in Logistic Regression," Biometrics, The International Biometric Society, vol. 64(2), pages 431-439, June.
    17. Ratcliffe, Sarah J. & Shults, Justine, 2008. "GEEQBOX: A MATLAB Toolbox for Generalized Estimating Equations and Quasi-Least Squares," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 25(i14).
    18. Dalei Yu & Xinyu Zhang & Kelvin K. W. Yau, 2018. "Asymptotic properties and information criteria for misspecified generalized linear mixed models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(4), pages 817-836, September.
    19. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    20. Xinyu Zhang & Guohua Zou & Hua Liang, 2014. "Model averaging and weight choice in linear mixed-effects models," Biometrika, Biometrika Trust, vol. 101(1), pages 205-218.
    21. Bharat N. Anand & Ron Shachar, 2011. "Advertising, the matchmaker," RAND Journal of Economics, RAND Corporation, vol. 42(2), pages 205-245, June.
    22. Xinyu Zhang & Guohua Zou & Hua Liang & Raymond J. Carroll, 2020. "Parsimonious Model Averaging With a Diverging Number of Parameters," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 972-984, April.
    23. Zhang, Xinyu & Lu, Zudi & Zou, Guohua, 2013. "Adaptively combined forecasting for discrete response time series," Journal of Econometrics, Elsevier, vol. 176(1), pages 80-91.
    24. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
    25. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    26. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    27. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    28. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    29. Gospodinov, Nikolay & Maasoumi, Esfandiar, 2021. "Generalized aggregation of misspecified models: With an application to asset pricing," Journal of Econometrics, Elsevier, vol. 222(1), pages 451-467.
    30. Yang Feng & Qingfeng Liu & Qingsong Yao & Guoqing Zhao, 2022. "Model Averaging for Nonlinear Regression Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 785-798, April.
    31. Xinyu Zhang & Hua Liang & Anna Liu & David Ruppert & Guohua Zou, 2016. "Selection Strategy for Covariance Structure of Random Effects in Linear Mixed-effects Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 275-291, March.
    32. Song Liu & Yuhong Yang, 2012. "Combining models in longitudinal data analysis," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(2), pages 233-254, April.
    33. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    34. Greenaway-McGrevy, Ryan, 2022. "Forecast combination for VARs in large N and T panels," International Journal of Forecasting, Elsevier, vol. 38(1), pages 142-164.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Xiaomeng & Zhang, Xinyu, 2023. "Optimal model averaging based on forward-validation," Journal of Econometrics, Elsevier, vol. 237(2).
    2. Fang, Fang & Li, Jialiang & Xia, Xiaochao, 2022. "Semiparametric model averaging prediction for dichotomous response," Journal of Econometrics, Elsevier, vol. 229(2), pages 219-245.
    3. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    4. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    5. Wei, Yuting & Wang, Qihua, 2021. "Cross-validation-based model averaging in linear models with response missing at random," Statistics & Probability Letters, Elsevier, vol. 171(C).
    6. Haili Zhang & Guohua Zou, 2020. "Cross-Validation Model Averaging for Generalized Functional Linear Model," Econometrics, MDPI, vol. 8(1), pages 1-35, February.
    7. Shangwei Zhao & Jun Liao & Dalei Yu, 2020. "Model averaging estimator in ridge regression and its large sample properties," Statistical Papers, Springer, vol. 61(4), pages 1719-1739, August.
    8. Peng, Jingfu & Yang, Yuhong, 2022. "On improvability of model selection by model averaging," Journal of Econometrics, Elsevier, vol. 229(2), pages 246-262.
    9. Yuan, Chaoxia & Fang, Fang & Ni, Lyu, 2022. "Mallows model averaging with effective model size in fragmentary data prediction," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    10. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    11. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    12. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    13. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics.
    14. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    15. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    16. Shou-Yung Yin & Chu-An Liu & Chang-Ching Lin, 2021. "Focused Information Criterion and Model Averaging for Large Panels With a Multifactor Error Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 54-68, January.
    17. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    18. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.
    19. Liao, Jun & Zou, Guohua & Gao, Yan & Zhang, Xinyu, 2021. "Model averaging prediction for time series models with a diverging number of parameters," Journal of Econometrics, Elsevier, vol. 223(1), pages 190-221.
    20. Zhihao Zhao & Xinyu Zhang & Guohua Zou & Alan T. K. Wan & Geoffrey K. F. Tso, 2024. "Model averaging for estimating treatment effects," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 76(1), pages 73-92, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:41:y:2025:i:2:p:733-747. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.