IDEAS home Printed from https://ideas.repec.org/p/boc/wsug07/14.html
   My bibliography  Save this paper

Multilevel modeling of complex survey data

Author

Listed:
  • Sophia Rabe-Hesketh

    (University of California, Berkeley)

Abstract

Survey data are often analyzed using multilevel or hierarchical models. For example, in education surveys, schools may be sampled at the first stage and students at the second stage and multilevel models used to model within-school and between-school variability. An important aspect of most surveys that is often ignored in multilevel modeling is that units at each stage are sampled with unequal probabilities. Standard maximum likelihood estimation can be modified to take the sampling probabilities into account, yielding pseudomaximum likelihood estimation, which is typically combined with robust standard errors based on the sandwich estimator. This approach is implemented in gllamm. I will introduce the ideas, discuss issues that arise such as the scaling of the weights, and illustrate the approach by applying it to data from the Program for International Student Assessment (PISA).

Suggested Citation

  • Sophia Rabe-Hesketh, 2007. "Multilevel modeling of complex survey data," West Coast Stata Users' Group Meetings 2007 14, Stata Users Group.
    • Handle: RePEc:boc:wsug07:14
    as

    Download full text from publisher

    File URL: http://repec.org/wcsug2007/stata_sophia.pdf
    File Function: presentation slides
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. S. Rabe-Hesketh & A. Skrondal, 2001. "Parameterization of Multivariate Random Effects Models for Categorical Data," Biometrics, The International Biometric Society, vol. 57(4), pages 1256-1263, December.
    2. Ganzeboom, H.B.G. & de Graaf, P.M. & Treiman, D.J. & de Leeuw, J., 1992. "A standard international socio-economic index of occupational status," WORC Paper 92.01.001/1, Tilburg University, Work and Organization Research Centre.
    3. Rabe-Hesketh, Sophia & Skrondal, Anders & Pickles, Andrew, 2005. "Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects," Journal of Econometrics, Elsevier, vol. 128(2), pages 301-323, October.
    4. D. Pfeffermann & C. J. Skinner & D. J. Holmes & H. Goldstein & J. Rasbash, 1998. "Weighting for unequal selection probabilities in multilevel models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(1), pages 23-40.
    5. Germán Rodríguez & Noreen Goldman, 2001. "Improved estimation procedures for multilevel models with binary response: a case‐study," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 164(2), pages 339-355.
    6. Germáan Rodríguez & Noreen Goldman, 1995. "An Assessment of Estimation Procedures for Multilevel Models with Binary Responses," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 158(1), pages 73-89, January.
    7. Anders Skrondal & Sophia Rabe-Hesketh, 2003. "Multilevel logistic regression for polytomous data and rankings," Psychometrika, Springer;The Psychometric Society, vol. 68(2), pages 267-287, June.
    8. Edward L. Korn & Barry I. Graubard, 2003. "Estimating variance components by using survey data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 175-190, February.
    9. Anders Skrondal & Sophia Rabe‐Hesketh, 2007. "Latent Variable Modelling: A Survey," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 712-745, December.
    10. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "Generalized multilevel structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 167-190, June.
    11. Thomas Warm, 1989. "Weighted likelihood estimation of ability in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 427-450, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rabe-Hesketh, Sophia & Skrondal, Anders & Pickles, Andrew, 2005. "Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects," Journal of Econometrics, Elsevier, vol. 128(2), pages 301-323, October.
    2. Sun-Joo Cho & Paul Boeck & Susan Embretson & Sophia Rabe-Hesketh, 2014. "Additive Multilevel Item Structure Models with Random Residuals: Item Modeling for Explanation and Item Generation," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 84-104, January.
    3. Anders Skrondal & Sophia Rabe‐Hesketh, 2009. "Prediction in multilevel generalized linear models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 659-687, June.
    4. Anders Skrondal & Sophia Rabe‐Hesketh, 2007. "Latent Variable Modelling: A Survey," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 712-745, December.
    5. Sophia Rabe-Hesketh & Anders Skrondal, 2007. "Multilevel and Latent Variable Modeling with Composite Links and Exploded Likelihoods," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 123-140, June.
    6. Minjeong Jeon & Sophia Rabe-Hesketh, 2012. "Profile-Likelihood Approach for Estimating Generalized Linear Mixed Models With Factor Structures," Journal of Educational and Behavioral Statistics, , vol. 37(4), pages 518-542, August.
    7. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    8. Anders Skrondal & Sophia Rabe-Hesketh, 2022. "The Role of Conditional Likelihoods in Latent Variable Modeling," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 799-834, September.
    9. Quinones, Esteban J. & Barham, Bradford L., 2018. "Endogenous Selection, Migration and Occupation Outcomes for Rural Southern Mexicans," Staff Paper Series 587, University of Wisconsin, Agricultural and Applied Economics.
    10. S. Rabe-Hesketh & A. Skrondal & H. K. Gjessing, 2008. "Biometrical Modeling of Twin and Family Data Using Standard Mixed Model Software," Biometrics, The International Biometric Society, vol. 64(1), pages 280-288, March.
    11. Cho, S.-J. & Rabe-Hesketh, S., 2011. "Alternating imputation posterior estimation of models with crossed random effects," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 12-25, January.
    12. Anders Skrondal & Jouni Kuha, 2012. "Improved Regression Calibration," Psychometrika, Springer;The Psychometric Society, vol. 77(4), pages 649-669, October.
    13. Nicholas J. Rockwood, 2021. "Efficient Likelihood Estimation of Generalized Structural Equation Models with a Mix of Normal and Nonnormal Responses," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 642-667, June.
    14. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "GLLAMM Manual," U.C. Berkeley Division of Biostatistics Working Paper Series 1160, Berkeley Electronic Press.
    15. Michela Battauz & Ruggero Bellio, 2011. "Structural Modeling of Measurement Error in Generalized Linear Models with Rasch Measures as Covariates," Psychometrika, Springer;The Psychometric Society, vol. 76(1), pages 40-56, January.
    16. Hammon, Angelina & Zinn, Sabine, 2020. "Multiple imputation of binary multilevel missing not at random data," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 69(3), pages 547-564.
    17. Woodward, Albert & Das, Abhik & Raskin, Ira E. & Morgan-Lopez, Antonio A., 2006. "An exploratory analysis of treatment completion and client and organizational factors using hierarchical linear modeling," Evaluation and Program Planning, Elsevier, vol. 29(4), pages 335-351, November.
    18. Tamara Fioroni & Andrea Mario Lavezzi & Giovanni Trovato, 2023. "Organized Crime, Corruption and Economic Growth," Discussion Papers 2023/298, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    19. Gregory Camilli & Jean-Paul Fox, 2015. "An Aggregate IRT Procedure for Exploratory Factor Analysis," Journal of Educational and Behavioral Statistics, , vol. 40(4), pages 377-401, August.
    20. Getinet A. Haile, 2015. "Workplace Job Satisfaction in Britain: Evidence from Linked Employer–Employee Data," LABOUR, CEIS, vol. 29(3), pages 225-242, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:boc:wsug07:14. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F Baum (email available below). General contact details of provider: https://edirc.repec.org/data/stataea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.