IDEAS home Printed from https://ideas.repec.org/a/inm/orijoc/v37y2025i6p1605-1623.html

Model Averaging Under Flexible Loss Functions

Author

Listed:
  • Dieqi Gu

    (International Institute of Finance, School of Management, University of Science and Technology of China, Hefei, Anhui 230052, China; and Department of Management Sciences, College of Business, City University of Hong Kong, Kowloon, Hong Kong)

  • Qingfeng Liu

    (Department of Industrial and Systems Engineering, Hosei University, Koganei, Tokyo 184-8584, Japan)

  • Xinyu Zhang

    (International Institute of Finance, School of Management, University of Science and Technology of China, Hefei, Anhui 230052, China; and Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100045, China)

Abstract

To address model uncertainty under flexible loss functions in prediction problems, we propose a model averaging method that accommodates various loss functions, including asymmetric linear and quadratic loss functions as well as many other asymmetric/symmetric loss functions as special cases. The flexible loss function allows the proposed method to average a large range of models such as the quantile and expectile regression models. To determine the weights of the candidate models, we establish a J-fold cross-validation criterion. Asymptotic optimality and weight convergence are proved for the proposed method. Simulations and an empirical application show the superior performance of the proposed method compared with other methods of model selection and averaging.

Suggested Citation

  • Dieqi Gu & Qingfeng Liu & Xinyu Zhang, 2025. "Model Averaging Under Flexible Loss Functions," INFORMS Journal on Computing, INFORMS, vol. 37(6), pages 1605-1623, November.
  • Handle: RePEc:inm:orijoc:v:37:y:2025:i:6:p:1605-1623
    DOI: 10.1287/ijoc.2023.0291
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/ijoc.2023.0291
    Download Restriction: no

    File URL: https://libkey.io/10.1287/ijoc.2023.0291?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Miaomiao Wang & Xinyu Zhang & Alan T. K. Wan & Kang You & Guohua Zou, 2023. "Jackknife model averaging for high‐dimensional quantile regression," Biometrics, The International Biometric Society, vol. 79(1), pages 178-189, March.
    2. Jie Ding & Vahid Tarokh & Yuhong Yang, 2018. "Model Selection Techniques -- An Overview," Papers 1810.09583, arXiv.org.
    3. Zhang, Xinyu & Liu, Chu-An, 2019. "Inference After Model Averaging In Linear Regression Models," Econometric Theory, Cambridge University Press, vol. 35(4), pages 816-841, August.
    4. Gao, Yan & Zhang, Xinyu & Wang, Shouyang & Zou, Guohua, 2016. "Model averaging based on leave-subject-out cross-validation," Journal of Econometrics, Elsevier, vol. 192(1), pages 139-151.
    5. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    6. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    7. Liu, Guannan & Long, Wei & Zhang, Xinyu & Li, Qi, 2019. "Detecting Financial Data Dependence Structure By Averaging Mixture Copulas," Econometric Theory, Cambridge University Press, vol. 35(4), pages 777-815, August.
    8. Christoffersen, Peter F & Diebold, Francis X, 1996. "Further Results on Forecasting and Model Selection under Asymmetric Loss," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 561-571, Sept.-Oct.
    9. Xinyu Zhang & Guohua Zou & Hua Liang & Raymond J. Carroll, 2020. "Parsimonious Model Averaging With a Diverging Number of Parameters," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 972-984, April.
    10. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    11. Ray, Sourav & Chen, Haipeng (Allan) & Bergen, Mark & Levy, Daniel, 2006. "Asymmetric Wholesale Pricing: Theory and Evidence," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 25(2), pages 109-201.
    12. Tu, Yundong & Wang, Siwei, 2020. "Jackknife model averaging for expectile regressions in increasing dimension," Economics Letters, Elsevier, vol. 197(C).
    13. Koenker, Roger & Bassett, Gilbert, Jr, 1982. "Robust Tests for Heteroscedasticity Based on Regression Quantiles," Econometrica, Econometric Society, vol. 50(1), pages 43-61, January.
    14. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    15. Qi Chen & Zeqiong Huang & Xu Jiang & Gaoqing Zhang & Yun Zhang, 2021. "Asymmetric Reporting Timeliness and Informational Feedback," Management Science, INFORMS, vol. 67(8), pages 5194-5208, August.
    16. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    17. Barry L. Nelson & Alan T. K. Wan & Guohua Zou & Xinyu Zhang & Xi Jiang, 2021. "Reducing Simulation Input-Model Risk via Input Model Averaging," INFORMS Journal on Computing, INFORMS, vol. 33(2), pages 672-684, May.
    18. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258.
    19. George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
    20. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    21. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    22. Rongjie Jiang & Liming Wang & Yang Bai, 2022. "Optimal model averaging estimator for multinomial logit models," Statistical Theory and Related Fields, Taylor & Francis Journals, vol. 6(3), pages 227-240, August.
    23. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    24. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    25. Xinyu Zhang & Jeng-Min Chiou & Yanyuan Ma, 2018. "Functional prediction through averaging estimated functional linear regression models," Biometrika, Biometrika Trust, vol. 105(4), pages 945-962.
    26. Qingfeng Liu & Ryo Okui, 2013. "Heteroscedasticity‐robust C(p) model averaging," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 463-472, October.
    27. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    28. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    29. Yanhang Zhang & Junxian Zhu & Jin Zhu & Xueqin Wang, 2023. "A Splicing Approach to Best Subset of Groups Selection," INFORMS Journal on Computing, INFORMS, vol. 35(1), pages 104-119, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Tzu-Chi & Liu, Chu-An, 2025. "Model averaging prediction for possibly nonstationary autoregressions," Journal of Econometrics, Elsevier, vol. 249(PB).
    2. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    3. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    4. Zhang, Xiaomeng & Zhang, Xinyu, 2023. "Optimal model averaging based on forward-validation," Journal of Econometrics, Elsevier, vol. 237(2).
    5. Tu, Yundong & Wang, Siwei, 2025. "Quantile prediction with factor-augmented regression: Structural instability and model uncertainty," Journal of Econometrics, Elsevier, vol. 249(PB).
    6. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    7. Yundong Tu & Siwei Wang, 2023. "Variable Screening and Model Averaging for Expectile Regressions," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 574-598, June.
    8. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    9. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    10. Shou-Yung Yin & Chu-An Liu & Chang-Ching Lin, 2021. "Focused Information Criterion and Model Averaging for Large Panels With a Multifactor Error Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 54-68, January.
    11. Jingwen Tu & Hu Yang & Chaohui Guo & Jing Lv, 2021. "Model averaging marginal regression for high dimensional conditional quantile prediction," Statistical Papers, Springer, vol. 62(6), pages 2661-2689, December.
    12. Wenchao Xu & Xinyu Zhang, 2024. "On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included," Papers 2411.09258, arXiv.org.
    13. Chen, Yi-Ting & Liu, Chu-An, 2023. "Model averaging for asymptotically optimal combined forecasts," Journal of Econometrics, Elsevier, vol. 235(2), pages 592-607.
    14. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    15. Shangwei Zhao & Jun Liao & Dalei Yu, 2020. "Model averaging estimator in ridge regression and its large sample properties," Statistical Papers, Springer, vol. 61(4), pages 1719-1739, August.
    16. Yang Feng & Qingfeng Liu, 2020. "Nested Model Averaging on Solution Path for High-dimensional Linear Regression," Papers 2005.08057, arXiv.org.
    17. Peng, Jingfu & Yang, Yuhong, 2022. "On improvability of model selection by model averaging," Journal of Econometrics, Elsevier, vol. 229(2), pages 246-262.
    18. Giuseppe De Luca & Jan Magnus & Franco Peracchi, 2022. "Asymptotic properties of the weighted average least squares (WALS) estimator," Tinbergen Institute Discussion Papers 22-022/III, Tinbergen Institute.
    19. Tong Zeng, 2024. "Frequentist model averaging in the generalized multinomial logit model," Computational Statistics, Springer, vol. 39(2), pages 605-627, April.
    20. Chen, Yi-Ting & Liu, Chu-An & Su, Jiun-Hua, 2025. "Bregman model averaging for forecast combination," Journal of Econometrics, Elsevier, vol. 251(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijoc:v:37:y:2025:i:6:p:1605-1623. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.