IDEAS home Printed from https://ideas.repec.org/p/kyo/wpaper/855.html
   My bibliography  Save this paper

Generalized Least Squares Model Averaging

Author

Listed:
  • Qingfeng Liu

    (Otaru University of Commerce)

  • Ryo Okui

    (Institute of Economic Research, Kyoto University)

  • Arihiro Yoshimura

    (Kyoto University)

Abstract

This paper proposes a method of averaging generalized least squares (GLS) estimators for linear regression models with heteroskedastic errors. We derive two kinds of Mallows' Cp criteria, calculated from the estimates of the mean of the squared errors of the tted value based on the averaged GLS estimators, for this class of models. The averaging weights are chosen by minimizing Mallows' Cp criterion. We show that this method achieves asymptotic optimality. It is also shown that the asymptotic optimality holds even when the variances of the error terms are estimated and the feasible generalized least squares (FGLS) estimators are averaged. Monte Carlo simulations demonstrate that averaging FGLS estimators yields an estimate that has a remarkably lower level of risk compared with averaging least squares estimators in the presence of heteroskedasticity, and it also works when heteroskedasticity is not present, in nite samples.

Suggested Citation

  • Qingfeng Liu & Ryo Okui & Arihiro Yoshimura, 2013. "Generalized Least Squares Model Averaging," KIER Working Papers 855, Kyoto University, Institute of Economic Research.
    • Handle: RePEc:kyo:wpaper:855
    as

    Download full text from publisher

    File URL: http://www.kier.kyoto-u.ac.jp/DP/DP855.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yuan, Zheng & Yang, Yuhong, 2005. "Combining Linear Regression Models: When and How?," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1202-1214, December.
    2. Qingfeng Liu & Ryo Okui, 2013. "Heteroscedasticity‐robust C(p) model averaging," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 463-472, October.
    3. Magnus, Jan R. & Wan, Alan T.K. & Zhang, Xinyu, 2011. "Weighted average least squares estimation with nonspherical disturbances and an application to the Hong Kong housing market," Computational Statistics & Data Analysis, Elsevier, vol. 55(3), pages 1331-1341, March.
    4. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258.
    5. Lichtenberg, Frank R. & Pushner, George M., 1994. "Ownership structure and corporate performance in Japan," Japan and the World Economy, Elsevier, vol. 6(3), pages 239-261, October.
    6. Morck, Randall & Nakamura, Masao & Shivdasani, Anil, 2000. "Banks, Ownership Structure, and Firm Value in Japan," The Journal of Business, University of Chicago Press, vol. 73(4), pages 539-567, October.
    7. Robinson, P M, 1987. "Asymptotically Efficient Estimation in the Presence of Heteroskedasticity of Unknown Form," Econometrica, Econometric Society, vol. 55(4), pages 875-891, July.
    8. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    9. Lewis, Richard & Reinsel, Gregory C., 1985. "Prediction of multivariate time series by autoregressive model fitting," Journal of Multivariate Analysis, Elsevier, vol. 16(3), pages 393-411, June.
    10. Bruce E. Hansen, 2014. "Model averaging, asymptotic risk, and regressor groups," Quantitative Economics, Econometric Society, vol. 5(3), pages 495-530, November.
    11. Hayashi, Fumio, 1982. "Tobin's Marginal q and Average q: A Neoclassical Interpretation," Econometrica, Econometric Society, vol. 50(1), pages 213-224, January.
    12. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    13. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    14. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    15. Wan, Alan T.K. & Zhang, Xinyu & Zou, Guohua, 2010. "Least squares model averaging by Mallows criterion," Journal of Econometrics, Elsevier, vol. 156(2), pages 277-283, June.
    16. John R. Nofsinger & Richard W. Sias, 1999. "Herding and Feedback Trading by Institutional and Individual Investors," Journal of Finance, American Finance Association, vol. 54(6), pages 2263-2295, December.
    17. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    18. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
    19. Xinyu Zhang & Alan Wan & Sherry Zhou, 2012. "Focused Information Criteria, Model Selection, and Model Averaging in a Tobit Model With a Nonzero Threshold," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 132-142.
    20. Faleye, Olubunmi & Hoitash, Rani & Hoitash, Udi, 2011. "The costs of intense board monitoring," Journal of Financial Economics, Elsevier, vol. 101(1), pages 160-181, July.
    21. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guozhi Hu & Weihu Cheng & Jie Zeng, 2023. "Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data," Mathematics, MDPI, vol. 11(3), pages 1-21, February.
    2. Qingfeng Liu & Qingsong Yao & Guoqing Zhao, 2020. "Model averaging estimation for conditional volatility models with an application to stock market volatility forecast," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(5), pages 841-863, August.
    3. Mohitosh Kejriwal & Xuewen Yu, 2019. "Generalized Forecasr Averaging in Autoregressions with a Near Unit Root," Purdue University Economics Working Papers 1318, Purdue University, Department of Economics.
    4. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    5. Povilas Lastauskas & Julius Stakenas, 2019. "Does It Matter When Labor Market Reforms Are Implemented? The Role of the Monetary Policy Environment," Bank of Lithuania Working Paper Series 66, Bank of Lithuania.
    6. Cong Li & Qi Li & Jeffrey Racine & DAIQIANG ZHANG, 2017. "Optimal Model Averaging Of Varying Coefficient Models," Department of Economics Working Papers 2017-01, McMaster University.
    7. Ryan Greenaway-McGrevy & Kade Sorensen, 2021. "A spatial model averaging approach to measuring house prices," Journal of Spatial Econometrics, Springer, vol. 2(1), pages 1-32, December.
    8. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    9. Michael Schomaker & Christian Heumann, 2020. "When and when not to use optimal model averaging," Statistical Papers, Springer, vol. 61(5), pages 2221-2240, October.
    10. Cheng, Tzu-Chang F. & Ing, Ching-Kang & Yu, Shu-Hui, 2015. "Toward optimal model averaging in regression models with time series errors," Journal of Econometrics, Elsevier, vol. 189(2), pages 321-334.
    11. Liao, Jun & Wan, Alan T.K. & He, Shuyuan & Zou, Guohua, 2022. "Optimal model averaging for multivariate regression models," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    12. Qingfeng Liu & Andrey L. Vasnev, 2019. "A Combination Method for Averaging OLS and GLS Estimators," Econometrics, MDPI, vol. 7(3), pages 1-12, September.
    13. Yang Feng & Qingfeng Liu, 2020. "Nested Model Averaging on Solution Path for High-dimensional Linear Regression," Papers 2005.08057, arXiv.org.
    14. Longbiao Liao & Jinghao Liu, 2024. "Model Averaging for Accelerated Failure Time Models with Missing Censoring Indicators," Mathematics, MDPI, vol. 12(5), pages 1-16, February.
    15. Greenaway-McGrevy, Ryan, 2022. "Forecast combination for VARs in large N and T panels," International Journal of Forecasting, Elsevier, vol. 38(1), pages 142-164.
    16. Dong, Qingkai & Liu, Binxia & Zhao, Hui, 2023. "Weighted least squares model averaging for accelerated failure time models," Computational Statistics & Data Analysis, Elsevier, vol. 184(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    2. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    3. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    4. Aman Ullah & Alan T. K. Wan & Huansha Wang & Xinyu Zhang & Guohua Zou, 2017. "A semiparametric generalized ridge estimator and link with model averaging," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 370-384, March.
    5. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    6. Liao, Jun & Zou, Guohua & Gao, Yan & Zhang, Xinyu, 2021. "Model averaging prediction for time series models with a diverging number of parameters," Journal of Econometrics, Elsevier, vol. 223(1), pages 190-221.
    7. Liao, Jun & Zong, Xianpeng & Zhang, Xinyu & Zou, Guohua, 2019. "Model averaging based on leave-subject-out cross-validation for vector autoregressions," Journal of Econometrics, Elsevier, vol. 209(1), pages 35-60.
    8. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    9. Christopher F. Parmeter & Alan T. K. Wan & Xinyu Zhang, 2019. "Model averaging estimators for the stochastic frontier model," Journal of Productivity Analysis, Springer, vol. 51(2), pages 91-103, June.
    10. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    11. Wan, Alan T.K. & Zhang, Xinyu & Wang, Shouyang, 2014. "Frequentist model averaging for multinomial and ordered logit models," International Journal of Forecasting, Elsevier, vol. 30(1), pages 118-128.
    12. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    13. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    14. Shou-Yung Yin & Chu-An Liu & Chang-Ching Lin, 2021. "Focused Information Criterion and Model Averaging for Large Panels With a Multifactor Error Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 54-68, January.
    15. Jingwen Tu & Hu Yang & Chaohui Guo & Jing Lv, 2021. "Model averaging marginal regression for high dimensional conditional quantile prediction," Statistical Papers, Springer, vol. 62(6), pages 2661-2689, December.
    16. Aman Ullah & Huansha Wang, 2013. "Parametric and Nonparametric Frequentist Model Selection and Model Averaging," Econometrics, MDPI, vol. 1(2), pages 1-23, September.
    17. Qiu, Yue & Wang, Zongrun & Xie, Tian & Zhang, Xinyu, 2021. "Forecasting Bitcoin realized volatility by exploiting measurement error under model uncertainty," Journal of Empirical Finance, Elsevier, vol. 62(C), pages 179-201.
    18. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    19. Shangwei Zhao, 2014. "Model averaging based on James–Stein estimators," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(8), pages 1013-1022, November.
    20. Tian Xie, 2019. "Forecast Bitcoin Volatility with Least Squares Model Averaging," Econometrics, MDPI, vol. 7(3), pages 1-20, September.

    More about this item

    Keywords

    model averaging; GLS; FGLS; asymptotic optimality; Mallows' Cp;
    All these keywords.

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kyo:wpaper:855. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Makoto Watanabe (email available below). General contact details of provider: https://edirc.repec.org/data/iekyojp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.