IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v174y2019icp65-69.html

Averaging estimators for discrete choice by M-fold cross-validation

Author

Listed:
  • Zhao, Shangwei
  • Zhou, Jianhong
  • Yang, Guangren

Abstract

Considering model averaging estimation under multinomial and ordered logit models, we propose a weight choice method by minimizing an M-fold cross-validation criterion. Unlike Jackknife model averaging in Hansen and Racine (2012), our method deletes one group observations instead of deleting only one observation. Therefore, under the maximum likelihood estimation framework, the computational cost of our method is greatly reduced. We prove the asymptotic optimality of the proposed model averaging estimator under certain assumptions. The simulation results show that our proposed method produces more accurate forecasts than other model selection and averaging methods.

Suggested Citation

  • Zhao, Shangwei & Zhou, Jianhong & Yang, Guangren, 2019. "Averaging estimators for discrete choice by M-fold cross-validation," Economics Letters, Elsevier, vol. 174(C), pages 65-69.
  • Handle: RePEc:eee:ecolet:v:174:y:2019:i:c:p:65-69
    DOI: 10.1016/j.econlet.2018.10.014
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176518304294
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econlet.2018.10.014?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Tomohiro Ando & Ker-Chau Li, 2014. "A Model-Averaging Approach for High-Dimensional Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 254-265, March.
    2. Gerda Claeskens & Christophe Croux & Johan Van Kerckhoven, 2006. "Variable Selection for Logistic Regression Using a Prediction-Focused Information Criterion," Biometrics, The International Biometric Society, vol. 62(4), pages 972-979, December.
    3. Zhang, Xinyu & Lu, Zudi & Zou, Guohua, 2013. "Adaptively combined forecasting for discrete response time series," Journal of Econometrics, Elsevier, vol. 176(1), pages 80-91.
    4. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    5. Yuan, Zheng & Yang, Yuhong, 2005. "Combining Linear Regression Models: When and How?," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1202-1214, December.
    6. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.
    7. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    8. Wan, Alan T.K. & Zhang, Xinyu & Wang, Shouyang, 2014. "Frequentist model averaging for multinomial and ordered logit models," International Journal of Forecasting, Elsevier, vol. 30(1), pages 118-128.
    9. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    10. Gourieroux,Christian, 2000. "Econometrics of Qualitative Dependent Variables," Cambridge Books, Cambridge University Press, number 9780521589857, January.
    11. Franses,Philip Hans & Paap,Richard, 2010. "Quantitative Models in Marketing Research," Cambridge Books, Cambridge University Press, number 9780521143653, November.
    12. White, Halbert, 1983. "Corrigendum [Maximum Likelihood Estimation of Misspecified Models]," Econometrica, Econometric Society, vol. 51(2), pages 513-513, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tong Zeng, 2024. "Frequentist model averaging in the generalized multinomial logit model," Computational Statistics, Springer, vol. 39(2), pages 605-627, April.
    2. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2023. "Optimal Local Model Averaging for Divergent-Dimensional Functional-Coefficient Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202309, University of Kansas, Department of Economics, revised Sep 2023.
    3. Hancock, Thomas O. & Hess, Stephane & Daly, Andrew & Fox, James, 2020. "Using a sequential latent class approach for model averaging: Benefits in forecasting and behavioural insights," Transportation Research Part A: Policy and Practice, Elsevier, vol. 139(C), pages 429-454.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    2. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics.
    3. Zhang, Xiaomeng & Zhang, Xinyu, 2023. "Optimal model averaging based on forward-validation," Journal of Econometrics, Elsevier, vol. 237(2).
    4. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    5. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    6. Wei, Yuting & Wang, Qihua, 2021. "Cross-validation-based model averaging in linear models with response missing at random," Statistics & Probability Letters, Elsevier, vol. 171(C).
    7. Fang, Fang & Li, Jialiang & Xia, Xiaochao, 2022. "Semiparametric model averaging prediction for dichotomous response," Journal of Econometrics, Elsevier, vol. 229(2), pages 219-245.
    8. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2023. "Optimal Local Model Averaging for Divergent-Dimensional Functional-Coefficient Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202309, University of Kansas, Department of Economics, revised Sep 2023.
    9. Wenchao Xu & Xinyu Zhang, 2024. "On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included," Papers 2411.09258, arXiv.org.
    10. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    11. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2025. "State-Varying Model Averaging Prediction," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202507, University of Kansas, Department of Economics.
    12. Chen, Yi-Ting & Liu, Chu-An, 2023. "Model averaging for asymptotically optimal combined forecasts," Journal of Econometrics, Elsevier, vol. 235(2), pages 592-607.
    13. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    14. Lin, Tzu-Chi & Liu, Chu-An, 2025. "Model averaging prediction for possibly nonstationary autoregressions," Journal of Econometrics, Elsevier, vol. 249(PB).
    15. Chen, Yi-Ting & Liu, Chu-An & Su, Jiun-Hua, 2025. "Bregman model averaging for forecast combination," Journal of Econometrics, Elsevier, vol. 251(C).
    16. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    17. Steven F. Lehrer & Tian Xie, 2022. "The Bigger Picture: Combining Econometrics with Analytics Improves Forecasts of Movie Success," Management Science, INFORMS, vol. 68(1), pages 189-210, January.
    18. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    19. Gao, Yan & Zhang, Xinyu & Wang, Shouyang & Zou, Guohua, 2016. "Model averaging based on leave-subject-out cross-validation," Journal of Econometrics, Elsevier, vol. 192(1), pages 139-151.
    20. Liao, Jun & Zou, Guohua & Gao, Yan & Zhang, Xinyu, 2021. "Model averaging prediction for time series models with a diverging number of parameters," Journal of Econometrics, Elsevier, vol. 223(1), pages 190-221.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:174:y:2019:i:c:p:65-69. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.