IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v132y2014icp160-170.html
   My bibliography  Save this article

Effective degrees of freedom and its application to conditional AIC for linear mixed-effects models with correlated error structures

Author

Listed:
  • Overholser, Rosanna
  • Xu, Ronghui

Abstract

The effective degrees of freedom is a useful concept for describing model complexity. Recently the number of effective degrees of freedom has been shown to relate to the concept of conditional Akaike information (cAI) in the mixed effects models. This relationship was made explicit under linear mixed-effects models with i.i.d. errors, and later also extended to the generalized linear and the proportional hazards mixed models. We show that under linear mixed-effects models with correlated errors, the number of effective degrees of freedom is asymptotically equal to the trace of the usual ‘hat’ matrix plus the number of parameters in the error covariance matrix. Using it one can define a crude version of the conditional AIC (cAIC), which is known to be inaccurate due to the estimation of unknown variance parameters. We compare this crude version to several corrected versions of cAIC for linear mixed models with correlated errors, including one that is asymptotically unbiased counting for the unknown parameters, but one which is also difficult to compute without specific programming for each case of the error correlation structure.

Suggested Citation

  • Overholser, Rosanna & Xu, Ronghui, 2014. "Effective degrees of freedom and its application to conditional AIC for linear mixed-effects models with correlated error structures," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 160-170.
    • Handle: RePEc:eee:jmvana:v:132:y:2014:i:c:p:160-170
    DOI: 10.1016/j.jmva.2014.08.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X14001869
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2014.08.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yuhong Yang, 2005. "Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation," Biometrika, Biometrika Trust, vol. 92(4), pages 937-950, December.
    2. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    3. M. C. Donohue & R. Overholser & R. Xu & F. Vaida, 2011. "Conditional Akaike information under generalized linear and proportional hazards mixed models," Biometrika, Biometrika Trust, vol. 98(3), pages 685-700.
    4. Hua Liang & Hulin Wu & Guohua Zou, 2008. "A note on conditional aic for linear mixed-effects models," Biometrika, Biometrika Trust, vol. 95(3), pages 773-778.
    5. Sonja Greven & Thomas Kneib, 2010. "On the behaviour of marginal and conditional AIC in linear mixed models," Biometrika, Biometrika Trust, vol. 97(4), pages 773-789.
    6. Florin Vaida & Suzette Blanchard, 2005. "Conditional Akaike information for mixed-effects models," Biometrika, Biometrika Trust, vol. 92(2), pages 351-370, June.
    7. Yang, Yuhong, 2007. "Prediction/Estimation With Simple Linear Models: Is It Really That Simple?," Econometric Theory, Cambridge University Press, vol. 23(1), pages 1-36, February.
    8. Kubokawa, Tatsuya, 2011. "Conditional and unconditional methods for selecting variables in linear mixed models," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 641-660, March.
    9. Clifford M. Hurvich & Jeffrey S. Simonoff & Chih‐Ling Tsai, 1998. "Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 271-293.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. María José Lombardía & Esther López‐Vizcaíno & Cristina Rueda, 2017. "Mixed generalized Akaike information criterion for small area models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 1229-1252, October.
    2. Philipp F. M. Baumann & Enzo Rossi & Alexander Volkmann, 2020. "What Drives Inflation and How: Evidence from Additive Mixed Models Selected by cAIC," Papers 2006.06274, arXiv.org, revised Aug 2022.
    3. Konrad Klotzke & Jean-Paul Fox, 2019. "Modeling Dependence Structures for Response Times in a Bayesian Framework," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 649-672, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kawakubo, Yuki & Kubokawa, Tatsuya, 2014. "Modified conditional AIC in linear mixed models," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 44-56.
    2. Yu, Dalei & Zhang, Xinyu & Yau, Kelvin K.W., 2013. "Information based model selection criteria for generalized linear mixed models with unknown variance component parameters," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 245-262.
    3. Simona Buscemi & Antonella Plaia, 2020. "Model selection in linear mixed-effect models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(4), pages 529-575, December.
    4. Braun, Julia & Sabanés Bové, Daniel & Held, Leonhard, 2014. "Choice of generalized linear mixed models using predictive crossvalidation," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 190-202.
    5. Yu, Dalei & Yau, Kelvin K.W., 2012. "Conditional Akaike information criterion for generalized linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 56(3), pages 629-644.
    6. Yuki Kawakubo & Shonosuke Sugasawa & Tatsuya Kubokawa, 2014. "Conditional AIC under Covariate Shift with Application to Small Area Prediction," CIRJE F-Series CIRJE-F-944, CIRJE, Faculty of Economics, University of Tokyo.
    7. Kubokawa, Tatsuya & Nagashima, Bui, 2012. "Parametric bootstrap methods for bias correction in linear mixed models," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 1-16.
    8. Philipp F. M. Baumann & Enzo Rossi & Alexander Volkmann, 2020. "What Drives Inflation and How: Evidence from Additive Mixed Models Selected by cAIC," Papers 2006.06274, arXiv.org, revised Aug 2022.
    9. Jonathan Bradley & Noel Cressie & Tao Shi, 2015. "Comparing and selecting spatial predictors using local criteria," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(1), pages 1-28, March.
    10. Yuki Kawakubo & Tatsuya Kubokawa, 2013. "Modfiied Conditional AIC in Linear Mixed Models," CIRJE F-Series CIRJE-F-895, CIRJE, Faculty of Economics, University of Tokyo.
    11. Kruse, René-Marcel & Silbersdorff, Alexander & Säfken, Benjamin, 2022. "Model averaging for linear mixed models via augmented Lagrangian," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    12. Kubokawa, Tatsuya, 2011. "Conditional and unconditional methods for selecting variables in linear mixed models," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 641-660, March.
    13. Craiu, Radu V. & Duchesne, Thierry, 2018. "A scalable and efficient covariate selection criterion for mixed effects regression models with unknown random effects structure," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 154-161.
    14. Dalei Yu, 2016. "Conditional Akaike Information Criteria for a Class of Poisson Mixture Models with Random Effects," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(4), pages 1214-1235, December.
    15. Jie Ding & Vahid Tarokh & Yuhong Yang, 2018. "Model Selection Techniques -- An Overview," Papers 1810.09583, arXiv.org.
    16. Simon N. Wood & Natalya Pya & Benjamin Säfken, 2016. "Smoothing Parameter and Model Selection for General Smooth Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1548-1563, October.
    17. Karimu, Amin & Brännlund, Runar, 2013. "Functional form and aggregate energy demand elasticities: A nonparametric panel approach for 17 OECD countries," Energy Economics, Elsevier, vol. 36(C), pages 19-27.
    18. Masahiro Kojima & Tatsuya Kubokawa, 2013. "Bartlett Adjustments for Hypothesis Testing in Linear Models with General Error Covariance Matrices," CIRJE F-Series CIRJE-F-884, CIRJE, Faculty of Economics, University of Tokyo.
    19. Benjamin Säfken & Thomas Kneib, 2020. "Conditional covariance penalties for mixed models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(3), pages 990-1010, September.
    20. Ward, Eric J., 2008. "A review and comparison of four commonly used Bayesian and maximum likelihood model selection tools," Ecological Modelling, Elsevier, vol. 211(1), pages 1-10.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:132:y:2014:i:c:p:160-170. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.