IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v82y2017i1d10.1007_s11336-016-9532-y.html
   My bibliography  Save this article

Generalized SAMPLE SIZE Determination Formulas for Investigating Contextual Effects by a Three-Level Random Intercept Model

Author

Listed:
  • Satoshi Usami

    (University of Tsukuba)

Abstract

Behavioral and psychological researchers have shown strong interests in investigating contextual effects (i.e., the influences of combinations of individual- and group-level predictors on individual-level outcomes). The present research provides generalized formulas for determining the sample size needed in investigating contextual effects according to the desired level of statistical power as well as width of confidence interval. These formulas are derived within a three-level random intercept model that includes one predictor/contextual variable at each level to simultaneously cover various kinds of contextual effects that researchers can show interest. The relative influences of indices included in the formulas on the standard errors of contextual effects estimates are investigated with the aim of further simplifying sample size determination procedures. In addition, simulation studies are performed to investigate finite sample behavior of calculated statistical power, showing that estimated sample sizes based on derived formulas can be both positively and negatively biased due to complex effects of unreliability of contextual variables, multicollinearity, and violation of assumption regarding the known variances. Thus, it is advisable to compare estimated sample sizes under various specifications of indices and to evaluate its potential bias, as illustrated in the example.

Suggested Citation

  • Satoshi Usami, 2017. "Generalized SAMPLE SIZE Determination Formulas for Investigating Contextual Effects by a Three-Level Random Intercept Model," Psychometrika, Springer;The Psychometric Society, vol. 82(1), pages 133-157, March.
    • Handle: RePEc:spr:psycho:v:82:y:2017:i:1:d:10.1007_s11336-016-9532-y
    DOI: 10.1007/s11336-016-9532-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-016-9532-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-016-9532-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David M. Murray & Jonathan L. Blitstein, 2003. "Methods To Reduce The Impact Of Intraclass Correlation In Group-Randomized Trials," Evaluation Review, , vol. 27(1), pages 79-103, February.
    2. Franklin Satterthwaite, 1941. "Synthesis of variance," Psychometrika, Springer;The Psychometric Society, vol. 6(5), pages 309-316, October.
    3. Donald Hedeker & Robert D. Gibbons & Christine Waternaux, 1999. "Sample Size Estimation for Longitudinal Designs with Attrition: Comparing Time-Related Contrasts Between Two Groups," Journal of Educational and Behavioral Statistics, , vol. 24(1), pages 70-93, March.
    4. Moonseong Heo & Andrew C. Leon, 2008. "Statistical Power and Sample Size Requirements for Three Level Hierarchical Cluster Randomized Trials," Biometrics, The International Biometric Society, vol. 64(4), pages 1256-1262, December.
    5. Tom A. B. Snijders & Roel J. Bosker, 1993. "Standard Errors and Sample Sizes for Two-Level Research," Journal of Educational and Behavioral Statistics, , vol. 18(3), pages 237-259, September.
    6. Yongyun Shin & Stephen W. Raudenbush, 2010. "A Latent Cluster-Mean Approach to the Contextual Effects Model With Missing Data," Journal of Educational and Behavioral Statistics, , vol. 35(1), pages 26-53, February.
    7. Heo, Moonseong & Xue, Xiaonan & Kim, Mimi Y., 2013. "Sample size requirements to detect an intervention by time interaction in longitudinal cluster randomized clinical trials with random slopes," Computational Statistics & Data Analysis, Elsevier, vol. 60(C), pages 169-178.
    8. Michael A. Rotondi & Allan Donner, 2009. "Sample Size Estimation in Cluster Randomized Educational Trials: An Empirical Bayes Approach," Journal of Educational and Behavioral Statistics, , vol. 34(2), pages 229-237, June.
    9. Anindya Roy & Dulal K. Bhaumik & Subhash Aryal & Robert D. Gibbons, 2007. "Sample Size Determination for Hierarchical Longitudinal Designs with Differential Attrition Rates," Biometrics, The International Biometric Society, vol. 63(3), pages 699-707, September.
    10. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "Generalized multilevel structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 167-190, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anup Amatya & Dulal K. Bhaumik, 2018. "Sample size determination for multilevel hierarchical designs using generalized linear mixed models," Biometrics, The International Biometric Society, vol. 74(2), pages 673-684, June.
    2. Nicholas J. Rockwood, 2020. "Maximum Likelihood Estimation of Multilevel Structural Equation Models with Random Slopes for Latent Covariates," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 275-300, June.
    3. Heo, Moonseong & Xue, Xiaonan & Kim, Mimi Y., 2013. "Sample size requirements to detect an intervention by time interaction in longitudinal cluster randomized clinical trials with random slopes," Computational Statistics & Data Analysis, Elsevier, vol. 60(C), pages 169-178.
    4. Steven Teerenstra & Bing Lu & John S. Preisser & Theo van Achterberg & George F. Borm, 2010. "Sample Size Considerations for GEE Analyses of Three-Level Cluster Randomized Trials," Biometrics, The International Biometric Society, vol. 66(4), pages 1230-1237, December.
    5. Lada, Emily K. & Wilson, James R., 2006. "A wavelet-based spectral procedure for steady-state simulation analysis," European Journal of Operational Research, Elsevier, vol. 174(3), pages 1769-1801, November.
    6. Steven Andrew Culpepper & Herman Aguinis & Justin L. Kern & Roger Millsap, 2019. "High-Stakes Testing Case Study: A Latent Variable Approach for Assessing Measurement and Prediction Invariance," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 285-309, March.
    7. Ryan Mullins & Raj Agnihotri, 2022. "Digital selling: organizational and managerial influences for frontline readiness and effectiveness," Journal of the Academy of Marketing Science, Springer, vol. 50(4), pages 800-821, July.
    8. Bura, Efstathia & Cook, R. Dennis, 2003. "Rank estimation in reduced-rank regression," Journal of Multivariate Analysis, Elsevier, vol. 87(1), pages 159-176, October.
    9. Julia Volaufova, 2009. "Heteroscedastic ANOVA: old p values, new views," Statistical Papers, Springer, vol. 50(4), pages 943-962, August.
    10. Matthew Houser, 2022. "Does adopting a nitrogen best management practice reduce nitrogen fertilizer rates?," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(1), pages 79-94, March.
    11. Siyun Yang & Mirjam Moerbeek & Monica Taljaard & Fan Li, 2023. "Power analysis for cluster randomized trials with continuous coprimary endpoints," Biometrics, The International Biometric Society, vol. 79(2), pages 1293-1305, June.
    12. Yuan, Ke-Hai & Chan, Wai, 2008. "Structural equation modeling with near singular covariance matrices," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4842-4858, June.
    13. Liuyang Yao & Qian Zhang & Kin Keung Lai & Xianyu Cao, 2020. "Explaining Local Residents’ Attitudes toward Shale Gas Exploitation: The Mediating Roles of Risk and Benefit Perceptions," IJERPH, MDPI, vol. 17(19), pages 1-13, October.
    14. Wenjia Zhang & Ming Zhang, 2018. "Incorporating land use and pricing policies for reducing car dependence: Analytical framework and empirical evidence," Urban Studies, Urban Studies Journal Limited, vol. 55(13), pages 3012-3033, October.
    15. Narayan Sastry & Bonnie Ghosh-Dastidar & John Adams & Anne R. Pebley, 2003. "The Design of Multilevel Survey of Children, Families, and Communities: The Los Angeles Family and Neighborhood Survey," Working Papers 03-21, RAND Corporation.
    16. Sun-Joo Cho & Allan S. Cohen, 2010. "A Multilevel Mixture IRT Model With an Application to DIF," Journal of Educational and Behavioral Statistics, , vol. 35(3), pages 336-370, June.
    17. Christine T Cigolle & Corey L Nagel & Caroline S Blaum & Jersey Liang & Ana R Quiñones, 2018. "Inconsistency in the Self-report of Chronic Diseases in Panel Surveys: Developing an Adjudication Method for the Health and Retirement Study," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 73(5), pages 901-912.
    18. Christopher F. Baum & Hans Lööf & Pardis Nabavi & Andreas Stephan, 2017. "A new approach to estimation of the R&D–innovation–productivity relationship," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 26(1-2), pages 121-133, February.
    19. Zereyesus, Yacob & Ross, Kara & Shanoyan, Aleksan & Amanor-Boadu, Vincent, 2014. "Children First: Understanding Children’s Well-Being in Northern Ghana," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170653, Agricultural and Applied Economics Association.
    20. Pesko, Michael F. & Baum, Christopher F., 2016. "The self-medication hypothesis: Evidence from terrorism and cigarette accessibility," Economics & Human Biology, Elsevier, vol. 22(C), pages 94-102.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:82:y:2017:i:1:d:10.1007_s11336-016-9532-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.