IDEAS home Printed from https://ideas.repec.org/p/bep/hvdbio/1019.html
   My bibliography  Save this paper

Cholesky Residuals for Assessing Normal Errors in a Linear Model with Correlated Outcomes: Technical Report

Author

Listed:
  • E. Andres Houseman

    (Harvard School of Public Health)

  • Louise Ryan

    (Harvard School of Public Health and Dana-Farber Cancer Institute)

  • Brent Coull

    (Harvard School of Public Health)

Abstract

Despite the widespread popularity of linear models for correlated outcomes (e.g. linear mixed models and time series models), distribution diagnostic methodology remains relatively underdeveloped in this context. In this paper we present an easy-to-implement approach that lends itself to graphical displays of model fit. Our approach involves multiplying the estimated margional residual vector by the Cholesky decomposition of the inverse of the estimated margional variance matrix. The resulting "rotated" residuals are used to construct an empirical cumulative distribution function and pointwise standard errors. The theoretical framework, including conditions and asymptotic properties, involves technical details that are motivated by Lange and Ryan (1989), Pierce (1982), and Randles (1982). Our method appears to work well in a variety of circumstances, including models having independent units of sampling (clustered data) and models for which all observations are correlated (e.g., a single time series). Our methods can produce satisfactory results even for models that do not satisfy all of the technical conditions stated in our theory.

Suggested Citation

  • E. Andres Houseman & Louise Ryan & Brent Coull, 2004. "Cholesky Residuals for Assessing Normal Errors in a Linear Model with Correlated Outcomes: Technical Report," Harvard University Biostatistics Working Paper Series 1019, Berkeley Electronic Press.
  • Handle: RePEc:bep:hvdbio:1019
    Note: oai:bepress.com:harvardbiostat-1019
    as

    Download full text from publisher

    File URL: http://www.bepress.com/cgi/viewcontent.cgi?article=1019&context=harvardbiostat
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nicholas T. Longford, 2001. "Simulation‐based diagnostics in random‐coefficient models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 164(2), pages 259-273.
    2. Wand M. P., 2002. "Vector Differential Calculus in Statistics," The American Statistician, American Statistical Association, vol. 56, pages 55-62, February.
    3. Coull B.A. & Hobert J.P. & Ryan L.M. & Holmes L.B., 2001. "Crossed Random Effect Models for Multiple Outcomes in a Study of Teratogenesis," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1194-1204, December.
    4. J. S. Hodges, 1998. "Some algebra and geometry for hierarchical models, applied to diagnostics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(3), pages 497-536.
    5. Fraccaro, R. & Hyndman, R. & Veevers, A., 1998. "Residual Diagnostic Plots for Checking for model Mis-Specification in Time Series Regression," Monash Econometrics and Business Statistics Working Papers 12/98, Monash University, Department of Econometrics and Business Statistics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. B. N. Sánchez & E. A. Houseman & L. M. Ryan, 2009. "Residual-Based Diagnostics for Structural Equation Models," Biometrics, The International Biometric Society, vol. 65(1), pages 104-115, March.
    2. Ahmed Bani-Mustafa & K. M. Matawie & C. F. Finch & Amjad Al-Nasser & Enrico Ciavolino, 2019. "Recursive residuals for linear mixed models," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(3), pages 1263-1274, May.
    3. Hejazi, Taha-Hossein & Badri, Hossein & Yang, Kai, 2019. "A Reliability-based Approach for Performance Optimization of Service Industries: An Application to Healthcare Systems," European Journal of Operational Research, Elsevier, vol. 273(3), pages 1016-1025.
    4. E. Andres Houseman, 2004. "A Robust Regression Model for a First-Order Autoregressive Time Series with Unequal Spacing: Technical Report," Harvard University Biostatistics Working Paper Series 1016, Berkeley Electronic Press.
    5. Agresti, Alan & Caffo, Brian & Ohman-Strickland, Pamela, 2004. "Examples in which misspecification of a random effects distribution reduces efficiency, and possible remedies," Computational Statistics & Data Analysis, Elsevier, vol. 47(3), pages 639-653, October.
    6. Mark Reiser & Silvia Cagnone & Junfei Zhu, 2023. "An Extended GFfit Statistic Defined on Orthogonal Components of Pearson’s Chi-Square," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 208-240, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eberly, Lynn E. & Thackeray, Lisa M., 2005. "On Lange and Ryan's plotting technique for diagnosing non-normality of random effects," Statistics & Probability Letters, Elsevier, vol. 75(2), pages 77-85, November.
    2. Chengcheng Hao & Dietrich Rosen & Tatjana Rosen, 2014. "Local Influence Analysis in AB–BA Crossover Designs," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 1153-1166, December.
    3. Shi, Lei & Chen, Gemai, 2012. "Deletion, replacement and mean-shift for diagnostics in linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 202-208, January.
    4. Andrew Gelman & Iain Pardoe, 2004. "Bayesian measures of explained variance and pooling in multilevel (hierarchical) models," EERI Research Paper Series EERI_RP_2004_04, Economics and Econometrics Research Institute (EERI), Brussels.
    5. Jay Verkuilen & Michael Smithson, 2012. "Mixed and Mixture Regression Models for Continuous Bounded Responses Using the Beta Distribution," Journal of Educational and Behavioral Statistics, , vol. 37(1), pages 82-113, February.
    6. Matos, Larissa A. & Bandyopadhyay, Dipankar & Castro, Luis M. & Lachos, Victor H., 2015. "Influence assessment in censored mixed-effects models using the multivariate Student’s-t distribution," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 104-117.
    7. E. Andres Houseman & Brent Coull & Louise Ryan, 2004. "A Functional-Based Distribution Diagnostic for a Linear Model with Correlated Outcomes: Technical Report," Harvard University Biostatistics Working Paper Series 1018, Berkeley Electronic Press.
    8. Shi, Lei & Lu, Jun & Zhao, Jianhua & Chen, Gemai, 2016. "Case deletion diagnostics for GMM estimation," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 176-191.
    9. McQuestion, Michael J. & Velasquez, Anibal, 2006. "Evaluating program effects on institutional delivery in Peru," Health Policy, Elsevier, vol. 77(2), pages 221-232, July.
    10. C. Fernandez & M. F. J. Steel, 1999. "Some comments on model development and posterior existence," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 89-96.
    11. Liying Luo & James S. Hodges, 2016. "Block Constraints in Age–Period–Cohort Models with Unequal-width Intervals," Sociological Methods & Research, , vol. 45(4), pages 700-726, November.
    12. B. Arendacká & S. Puntanen, 2015. "Further remarks on the connection between fixed linear model and mixed linear model," Statistical Papers, Springer, vol. 56(4), pages 1235-1247, November.
    13. Shi, Lei & Ojeda, Mario Miguel, 2004. "Local influence in multilevel regression for growth curves," Journal of Multivariate Analysis, Elsevier, vol. 91(2), pages 282-304, November.
    14. Wand, M.P., 2007. "Fisher information for generalised linear mixed models," Journal of Multivariate Analysis, Elsevier, vol. 98(7), pages 1412-1416, August.
    15. Padoan, S.A. & Wand, M.P., 2008. "Mixed model-based additive models for sample extremes," Statistics & Probability Letters, Elsevier, vol. 78(17), pages 2850-2858, December.
    16. Anders Skrondal & Sophia Rabe‐Hesketh, 2009. "Prediction in multilevel generalized linear models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 659-687, June.
    17. repec:jss:jstsof:25:i10 is not listed on IDEAS
    18. Jialing Tao & Kaibo Wang & Bo Li & Liang Liu & Qi Cai, 2016. "Hierarchical models for the spatial–temporal carbon nanotube height variations," International Journal of Production Research, Taylor & Francis Journals, vol. 54(21), pages 6613-6632, November.
    19. He, Yi & Hodges, James S., 2008. "Point estimates for variance-structure parameters in Bayesian analysis of hierarchical models," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2560-2577, January.
    20. David I. Ohlssen & Linda D. Sharples & David J. Spiegelhalter, 2007. "A hierarchical modelling framework for identifying unusual performance in health care providers," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(4), pages 865-890, October.
    21. James Bennett & Jon Wakefield, 2001. "Errors-in-Variables in Joint Population Pharmacokinetic/Pharmacodynamic Modeling," Biometrics, The International Biometric Society, vol. 57(3), pages 803-812, September.

    More about this item

    Keywords

    Cumulative distribution function; Goodness-of-fit; Linear mixed model; Random effects; Residual diagnostics;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bep:hvdbio:1019. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.bepress.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.