IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.14822.html

Regression Model Selection Under General Conditions

Author

Listed:
  • Amaze Lusompa

Abstract

Model selection criteria are one of the most important tools in statistics. Proofs showing a model selection criterion is asymptotically optimal are tailored to the type of model (linear regression, quantile regression, penalized regression, etc.), the estimation method (linear smoothers, maximum likelihood, generalized method of moments, etc.), the type of data (i.i.d., dependent, high dimensional, etc.), and the type of model selection criterion. Moreover, assumptions are often restrictive and unrealistic making it a slow and winding process for researchers to determine if a model selection criterion is selecting an optimal model. This paper provides general proofs showing asymptotic optimality for a wide range of model selection criteria under general conditions. This paper not only asymptotically justifies model selection criteria for most situations, but it also unifies and extends a range of previously disparate results.

Suggested Citation

  • Amaze Lusompa, 2025. "Regression Model Selection Under General Conditions," Papers 2510.14822, arXiv.org.
    • Handle: RePEc:arx:papers:2510.14822
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2510.14822
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Andrews, Donald W. K., 1991. "Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 359-377, February.
    4. Donald W. K. Andrews, 2003. "Tests for Parameter Instability and Structural Change with Unknown Change Point: A Corrigendum," Econometrica, Econometric Society, vol. 71(1), pages 395-397, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:isu:genstf:201501010800005727 is not listed on IDEAS
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Narayan, Paresh Kumar & Narayan, Seema & Sharma, Susan Sunila, 2013. "An analysis of commodity markets: What gain for investors?," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3878-3889.
    4. Ryan Compton & Syeed Khan, 2010. "An examination of the stability of short-run Canadian stock predictability," Economics Bulletin, AccessEcon, vol. 30(2), pages 1293-1306.
    5. Moench, Emanuel & Stein, Tobias, 2026. "Equity Premium Predictability over the Business Cycle," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 61(3), pages 1216-1246, May.
    6. Hui Hong & Zhicun Bian & Chien-Chiang Lee, 2021. "COVID-19 and instability of stock market performance: evidence from the U.S," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-18, December.
    7. Christis Katsouris, 2023. "Predictability Tests Robust against Parameter Instability," Papers 2307.15151, arXiv.org.
    8. Schrimpf, Andreas & Wang, Qingwei, 2010. "A reappraisal of the leading indicator properties of the yield curve under structural instability," International Journal of Forecasting, Elsevier, vol. 26(4), pages 836-857, October.
    9. Yijie Fei, 2024. "A joint test of predictability and structural break in predictive regressions," Empirical Economics, Springer, vol. 67(3), pages 985-1013, September.
    10. Baetje, Fabian & Menkhoff, Lukas, 2016. "Equity premium prediction: Are economic and technical indicators unstable?," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1193-1207.
    11. Jiawen Xu & Pierre Perron, 2024. "Forecasting in the presence of in-sample and out-of-sample breaks," Advanced Studies in Theoretical and Applied Econometrics, in: Subal C. Kumbhakar & Robin C. Sickles & Hung-Jen Wang (ed.), Advances in Applied Econometrics, pages 545-579, Springer.
    12. Fu, Zhonghao & Hong, Yongmiao, 2019. "A model-free consistent test for structural change in regression possibly with endogeneity," Journal of Econometrics, Elsevier, vol. 211(1), pages 206-242.
    13. Inoue, Atsushi & Jin, Lu & Rossi, Barbara, 2017. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Journal of Econometrics, Elsevier, vol. 196(1), pages 55-67.
    14. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 669-705.
    15. Georgiev, Iliyan & Harvey, David I. & Leybourne, Stephen J. & Taylor, A.M. Robert, 2018. "Testing for parameter instability in predictive regression models," Journal of Econometrics, Elsevier, vol. 204(1), pages 101-118.
    16. Zongwu Cai & Seong Yeon Chang, 2018. "A New Test In A Predictive Regression with Structural Breaks," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201811, University of Kansas, Department of Economics, revised Dec 2018.
    17. Rossi, Barbara & Inoue, Atsushi & Jin, Lu, 2014. "Window Selection for Out-of-Sample Forecasting with Time-Varying Parameters," CEPR Discussion Papers 10168, Centre for Economic Policy Research.
    18. Neely, Christopher J., 2022. "How persistent are unconventional monetary policy effects?," Journal of International Money and Finance, Elsevier, vol. 126(C).
    19. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    20. Simon C. Smith, 2020. "Equity premium prediction and structural breaks," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 25(3), pages 412-429, July.
    21. Tae‐Hwy Lee & Shahnaz Parsaeian & Aman Ullah, 2022. "Optimal forecast under structural breaks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 965-987, August.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.14822. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.