IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v42y1999i4p333-343.html
   My bibliography  Save this article

A large-sample model selection criterion based on Kullback's symmetric divergence

Author

Listed:
  • Cavanaugh, Joseph E.

Abstract

The Akaike information criterion, AIC, is a widely known and extensively used tool for statistical model selection. AIC serves as an asymptotically unbiased estimator of a variant of Kullback's directed divergence between the true model and a fitted approximating model. The directed divergence is an asymmetric measure of separation between two statistical models, meaning that an alternate directed divergence may be obtained by reversing the roles of the two models in the definition of the measure. The sum of the two directed divergences is Kullback's symmetric divergence. Since the symmetric divergence combines the information in two related though distinct measures, it functions as a gauge of model disparity which is arguably more sensitive than either of its individual components. With this motivation, we propose a model selection criterion which serves as an asymptotically unbiased estimator of a variant of the symmetric divergence between the true model and a fitted approximating model. We examine the performance of the criterion relative to other well-known criteria in a simulation study.

Suggested Citation

  • Cavanaugh, Joseph E., 1999. "A large-sample model selection criterion based on Kullback's symmetric divergence," Statistics & Probability Letters, Elsevier, vol. 42(4), pages 333-343, May.
  • Handle: RePEc:eee:stapro:v:42:y:1999:i:4:p:333-343
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-7152(98)00200-4
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cavanaugh, Joseph E., 1997. "Unifying the derivations for the Akaike and corrected Akaike information criteria," Statistics & Probability Letters, Elsevier, vol. 33(2), pages 201-208, April.
    2. D. F. Findley, 1985. "On The Unbiasedness Property Of Aic For Exact Or Approximating Linear Stochastic Time Series Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 6(4), pages 229-252, July.
    3. Clifford M. Hurvich & Chih‐Ling Tsai, 1993. "A Corrected Akaike Information Criterion For Vector Autoregressive Model Selection," Journal of Time Series Analysis, Wiley Blackwell, vol. 14(3), pages 271-279, May.
    4. Hirotugu Akaike, 1969. "Fitting autoregressive models for prediction," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 21(1), pages 243-247, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nicolas Depraetere & Martina Vandebroek, 2014. "Order selection in finite mixtures of linear regressions," Statistical Papers, Springer, vol. 55(3), pages 871-911, August.
    2. Patrick Ten Eyck & Joseph E. Cavanaugh, 2018. "Model selection criteria based on cross-validatory concordance statistics," Computational Statistics, Springer, vol. 33(2), pages 595-621, June.
    3. Kim, Jae-Young, 2012. "Model selection in the presence of nonstationarity," Journal of Econometrics, Elsevier, vol. 169(2), pages 247-257.
    4. Christopher H. Jackson & Simon G. Thompson & Linda D. Sharples, 2009. "Accounting for uncertainty in health economic decision models by using model averaging," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(2), pages 383-404, April.
    5. Kim, Jae-Young, 2014. "An alternative quasi likelihood approach, Bayesian analysis and data-based inference for model specification," Journal of Econometrics, Elsevier, vol. 178(P1), pages 132-145.
    6. Hafidi, Bezza, 2006. "A small-sample criterion based on Kullback's symmetric divergence for vector autoregressive modeling," Statistics & Probability Letters, Elsevier, vol. 76(15), pages 1647-1654, September.
    7. Hafidi, Bezza & Mkhadri, Abdallah, 2010. "The Kullback information criterion for mixture regression models," Statistics & Probability Letters, Elsevier, vol. 80(9-10), pages 807-815, May.
    8. Hojin Moon & Steven B. Kim & James J. Chen & Nysia I. George & Ralph L. Kodell, 2013. "Model Uncertainty and Model Averaging in the Estimation of Infectious Doses for Microbial Pathogens," Risk Analysis, John Wiley & Sons, vol. 33(2), pages 220-231, February.
    9. Joemari Olea & Kevin Carl Santos, 2024. "A General Mixture Model for Cognitive Diagnosis," Journal of Educational and Behavioral Statistics, , vol. 49(2), pages 268-307, April.
    10. Hafidi, B. & Mkhadri, A., 2006. "A corrected Akaike criterion based on Kullback's symmetric divergence: applications in time series, multiple and multivariate regression," Computational Statistics & Data Analysis, Elsevier, vol. 50(6), pages 1524-1550, March.
    11. Steffen Barra & Marcel Aebi & Delfine d’Huart & Klaus Schmeck & Marc Schmid & Cyril Boonmann, 2022. "Adverse Childhood Experiences, Personality, and Crime: Distinct Associations among a High-Risk Sample of Institutionalized Youth," IJERPH, MDPI, vol. 19(3), pages 1-21, January.
    12. Daniel F. Schmidt & Enes Makalic, 2013. "Estimation of stationary autoregressive models with the Bayesian LASSO," Journal of Time Series Analysis, Wiley Blackwell, vol. 34(5), pages 517-531, September.
    13. Marhuenda, Yolanda & Morales, Domingo & del Carmen Pardo, María, 2014. "Information criteria for Fay–Herriot model selection," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 268-280.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bengtsson, Thomas & Cavanaugh, Joseph E., 2006. "An improved Akaike information criterion for state-space model selection," Computational Statistics & Data Analysis, Elsevier, vol. 50(10), pages 2635-2654, June.
    2. Carlos A. Medel, 2015. "Probabilidad Clásica de Sobreajuste con Criterios de Información: Estimaciones con Series Macroeconómicas Chilenas," Revista de Analisis Economico – Economic Analysis Review, Universidad Alberto Hurtado/School of Economics and Business, vol. 30(1), pages 57-72, Abril.
    3. Nan Li & Simon S. Kwok, 2021. "Jointly determining the state dimension and lag order for Markov‐switching vector autoregressive models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 471-491, July.
    4. Hafidi, B. & Mkhadri, A., 2006. "A corrected Akaike criterion based on Kullback's symmetric divergence: applications in time series, multiple and multivariate regression," Computational Statistics & Data Analysis, Elsevier, vol. 50(6), pages 1524-1550, March.
    5. Marhuenda, Yolanda & Morales, Domingo & del Carmen Pardo, María, 2014. "Information criteria for Fay–Herriot model selection," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 268-280.
    6. Lee, Shyan-Yuan & Tsai, Chih-Ling, 1998. "Model selection for causal models: The global procedure with AICC and AICU," Global Finance Journal, Elsevier, vol. 9(2), pages 205-223.
    7. An Hoai Duong & Ernoiz Antriyandarti, 2023. "The Willingness to get Vaccinated Against SARS-CoV-2 Virus among Southeast Asian Countries: Does the Vaccine Brand Matter?," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 18(2), pages 765-793, April.
    8. Ng, Serena, 2013. "Variable Selection in Predictive Regressions," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 752-789, Elsevier.
    9. Hafidi, Bezza, 2006. "A small-sample criterion based on Kullback's symmetric divergence for vector autoregressive modeling," Statistics & Probability Letters, Elsevier, vol. 76(15), pages 1647-1654, September.
    10. Campos, Eduardo Lima & Cysne, Rubens Penha, 2017. "A time-varying fiscal reaction function for Brazil," FGV EPGE Economics Working Papers (Ensaios Economicos da EPGE) 795, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil).
    11. Rodrigo Hakim das Neves, 2020. "Bitcoin pricing: impact of attractiveness variables," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 6(1), pages 1-18, December.
    12. Asghar, Zahid & Abid, Irum, 2007. "Performance of lag length selection criteria in three different situations," MPRA Paper 40042, University Library of Munich, Germany.
    13. Kathryn M. Dominguez, 1991. "Do Exchange Auctions Work? An Examination of the Bolivian Experience," NBER Working Papers 3683, National Bureau of Economic Research, Inc.
    14. Bin Liu & Weifeng Chen & Bo Li & Xiuping Liu, 2022. "Neural Subspace Learning for Surface Defect Detection," Mathematics, MDPI, vol. 10(22), pages 1-16, November.
    15. Cavanaugh, Joseph E., 1997. "Unifying the derivations for the Akaike and corrected Akaike information criteria," Statistics & Probability Letters, Elsevier, vol. 33(2), pages 201-208, April.
    16. Jacint Balaguer & Manuel Cantavella-Jorda, 2004. "Structural change in exports and economic growth: cointegration and causality analysis for Spain (1961-2000)," Applied Economics, Taylor & Francis Journals, vol. 36(5), pages 473-477.
    17. Han Lin Shang, 2023. "Sieve bootstrapping the memory parameter in long-range dependent stationary functional time series," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 107(3), pages 421-441, September.
    18. Muhammad Farooq Arby & Amjad Ali, 2017. "Threshold Inflation in Pakistan," SBP Research Bulletin, State Bank of Pakistan, Research Department, vol. 13, pages 1-19.
    19. Ramona Dumitriu & Razvan Stefanescu, 2015. "The Relationship Between Romanian Exports And Economic Growth After The Adhesion To European Union," Risk in Contemporary Economy, "Dunarea de Jos" University of Galati, Faculty of Economics and Business Administration, pages 17-26.
    20. David F. Hendry & Hans-Martin Krolzig, 2005. "The Properties of Automatic "GETS" Modelling," Economic Journal, Royal Economic Society, vol. 115(502), pages C32-C61, 03.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:42:y:1999:i:4:p:333-343. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.