IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v84y2019i1d10.1007_s11336-018-9620-2.html
   My bibliography  Save this article

Simplified Estimation and Testing in Unbalanced Repeated Measures Designs

Author

Listed:
  • Martin Spiess

    (University of Hamburg)

  • Pascal Jordan

    (University of Hamburg)

  • Mike Wendt

    (Medical School Hamburg)

Abstract

In this paper we propose a simple estimator for unbalanced repeated measures design models where each unit is observed at least once in each cell of the experimental design. The estimator does not require a model of the error covariance structure. Thus, circularity of the error covariance matrix and estimation of correlation parameters and variances are not necessary. Together with a weak assumption about the reason for the varying number of observations, the proposed estimator and its variance estimator are unbiased. As an alternative to confidence intervals based on the normality assumption, a bias-corrected and accelerated bootstrap technique is considered. We also propose the naive percentile bootstrap for Wald-type tests where the standard Wald test may break down when the number of observations is small relative to the number of parameters to be estimated. In a simulation study we illustrate the properties of the estimator and the bootstrap techniques to calculate confidence intervals and conduct hypothesis tests in small and large samples under normality and non-normality of the errors. The results imply that the simple estimator is only slightly less efficient than an estimator that correctly assumes a block structure of the error correlation matrix, a special case of which is an equi-correlation matrix. Application of the estimator and the bootstrap technique is illustrated using data from a task switch experiment based on an experimental within design with 32 cells and 33 participants.

Suggested Citation

  • Martin Spiess & Pascal Jordan & Mike Wendt, 2019. "Simplified Estimation and Testing in Unbalanced Repeated Measures Designs," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 212-235, March.
  • Handle: RePEc:spr:psycho:v:84:y:2019:i:1:d:10.1007_s11336-018-9620-2
    DOI: 10.1007/s11336-018-9620-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-018-9620-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11336-018-9620-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James G. MacKinnon, 2002. "Bootstrap inference in econometrics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 35(4), pages 615-645, November.
    2. Huynh Huynh & Leonard S. Feldt, 1976. "Estimation of the Box Correction for Degrees of Freedom from Sample Data in Randomized Block and Split-Plot Designs," Journal of Educational and Behavioral Statistics, , vol. 1(1), pages 69-82, March.
    3. Stephen Bond & Frank Windmeijer, 2005. "Reliable Inference For Gmm Estimators? Finite Sample Properties Of Alternative Test Procedures In Linear Panel Data Models," Econometric Reviews, Taylor & Francis Journals, vol. 24(1), pages 1-37.
    4. Horowitz, J., 1996. "Bootstrap Critical Values For Tests Based On The Smoothed Maximum Score Estimator," SFB 373 Discussion Papers 1996,44, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    5. Cheng, Guang & Yu, Zhuqing & Huang, Jianhua Z., 2013. "The cluster bootstrap consistency in generalized estimating equations," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 33-47.
    6. Samuel Greenhouse & Seymour Geisser, 1959. "On methods in the analysis of profile data," Psychometrika, Springer;The Psychometric Society, vol. 24(2), pages 95-112, June.
    7. Bradley, Richard C., 1981. "Central limit theorems under weak dependence," Journal of Multivariate Analysis, Elsevier, vol. 11(1), pages 1-16, March.
    8. Joel L. Horowitz, 1996. "Bootstrap Critical Values for Tests Based on the Smoothed Maximum Score Estimator," Econometrics 9603003, University Library of Munich, Germany.
    9. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    10. Martin Spieß, 2006. "Estimation of a Two-Equation Panel Model with Mixed Continuous and Ordered Categorical Outcomes and Missing Data," Discussion Papers 010, Europa-Universität Flensburg, International Institute of Management.
    11. Martin Spiess, 2006. "Estimation of a two‐equation panel model with mixed continuous and ordered categorical outcomes and missing data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 55(4), pages 525-538, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yazid Dissou & Reza Ghazal, 2010. "Energy Substitutability in Canadian Manufacturing Econometric Estimation with Bootstrap Confidence Intervals," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 121-148.
    2. Lee, Seojeong, 2014. "Asymptotic refinements of a misspecification-robust bootstrap for generalized method of moments estimators," Journal of Econometrics, Elsevier, vol. 178(P3), pages 398-413.
    3. Lee, Seojeong, 2016. "Asymptotic refinements of a misspecification-robust bootstrap for GEL estimators," Journal of Econometrics, Elsevier, vol. 192(1), pages 86-104.
    4. Yang, Zhenlin, 2015. "LM tests of spatial dependence based on bootstrap critical values," Journal of Econometrics, Elsevier, vol. 185(1), pages 33-59.
    5. Hwang, Jungbin & Kang, Byunghoon & Lee, Seojeong, 2022. "A doubly corrected robust variance estimator for linear GMM," Journal of Econometrics, Elsevier, vol. 229(2), pages 276-298.
    6. Seojeong Lee, 2018. "Asymptotic Refinements of a Misspecification-Robust Bootstrap for Generalized Empirical Likelihood Estimators," Papers 1806.00953, arXiv.org, revised Jun 2018.
    7. Jungbin Hwang & Gonzalo Valdés, 2020. "Finite-sample Corrected Inference for Two-step GMM in Time Series," Working papers 2020-02, University of Connecticut, Department of Economics.
    8. Zhenlin Yang, 2018. "Bootstrap LM tests for higher-order spatial effects in spatial linear regression models," Empirical Economics, Springer, vol. 55(1), pages 35-68, August.
    9. Hwang, Jungbin, 2021. "Simple and trustworthy cluster-robust GMM inference," Journal of Econometrics, Elsevier, vol. 222(2), pages 993-1023.
    10. Hwang, Jungbin & Valdés, Gonzalo, 2023. "Finite-sample corrected inference for two-step GMM in time series," Journal of Econometrics, Elsevier, vol. 234(1), pages 327-352.
    11. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    12. Groneck, Max & Ludwig, Alexander & Zimper, Alexander, 2016. "A life-cycle model with ambiguous survival beliefs," Journal of Economic Theory, Elsevier, vol. 162(C), pages 137-180.
    13. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    14. Nicolas Roys, 2016. "Persistence of Shocks and the Reallocation of Labor," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 22, pages 109-130, October.
    15. Jaedo Choi & Jin Seo Cho & Hyungsik Roger Moon, 2020. "Sequentially Estimating the Structural Equation by Power Transformation," Working papers 2020rwp-162, Yonsei University, Yonsei Economics Research Institute.
    16. Aretz, Kevin & Bartram, Söhnke M. & Pope, Peter F., 2011. "Asymmetric loss functions and the rationality of expected stock returns," International Journal of Forecasting, Elsevier, vol. 27(2), pages 413-437.
    17. Vasco J. Gabriel & Luis F. Martins, 2010. "The Cost Channel Reconsidered: A Comment Using an Identification‐Robust Approach," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 42(8), pages 1703-1712, December.
    18. Joon-Woo Nahm, 2008. "Shrinking Middle Class and Changing Income Distribution of Korea: 1995-2005," Korean Economic Review, Korean Economic Association, vol. 24, pages 345-365.
    19. Hill, Jonathan B. & Prokhorov, Artem, 2016. "GEL estimation for heavy-tailed GARCH models with robust empirical likelihood inference," Journal of Econometrics, Elsevier, vol. 190(1), pages 18-45.
    20. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:84:y:2019:i:1:d:10.1007_s11336-018-9620-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.