IDEAS home Printed from https://ideas.repec.org/p/nbr/nberte/0230.html
   My bibliography  Save this paper

Combining Panel Data Sets with Attrition and Refreshment Samples

Author

Listed:
  • Keisuke Hirano
  • Guido W. Imbens
  • Geert Ridder
  • Donald B. Rebin

Abstract

In many fields researchers wish to consider statistical models that allow for more complex relationships than can be inferred using only cross-sectional data. Panel or longitudinal data where the same units are observed repeatedly at different points in time can often provide the richer data needed for such models. Although such data allows researchers to identify more complex models than cross-sectional data, missing data problems can be more severe in panels. In particular, even units who respond in initial waves of the panel may drop out in subsequent waves, so that the subsample with complete data for all waves of the panel can be less representative of the population than the original sample. Sometimes, in the hope of mitigating the effects of attrition without losing the advantages of panel data over cross-sections, panel data sets are augmented by replacing units who have dropped out with new units randomly sampled from the original population. Following Ridder (1992), who used these replacement units to test some models for attrition, we call such additional samples refreshment samples. We explore the benefits of these samples for estimating models of attrition. We describe the manner in which the presence of refreshment samples allows the researcher to test various models for attrition in panel data, including models based on the assumption that missing data are missing at random (MAR, Rubin, 1976; Little and Rubin, 1987). The main result in the paper makes precise the extent to which refreshment samples are informative about the attrition process; a class of non-ignorable missing data models can be identified without making strong distributional or functional form assumptions if refreshment samples are available.

Suggested Citation

  • Keisuke Hirano & Guido W. Imbens & Geert Ridder & Donald B. Rebin, 1998. "Combining Panel Data Sets with Attrition and Refreshment Samples," NBER Technical Working Papers 0230, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberte:0230
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/t0230.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-473, March.
    2. John M. Abowd & Bruno Crepon & Francis Kramarz & Alain Trognon, 1995. "A La Recherche des Moments Perdus: Covariance Models for Unbalanced Panels with Endogenous Death," NBER Technical Working Papers 0180, National Bureau of Economic Research, Inc.
    3. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589833.
    4. John Geweke, "undated". "Posterior Simulators in Econometrics," Computing in Economics and Finance 1996 _019, Society for Computational Economics.
    5. Manski, Charles F., 1992. "Identification Problems In The Social Sciences," SSRI Workshop Series 292716, University of Wisconsin-Madison, Social Systems Research Institute.
    6. Verbeek, Marno & Nijman, Theo, 1992. "Testing for Selectivity Bias in Panel Data Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(3), pages 681-703, August.
    7. Judith K. Hellerstein & Guido W. Imbens, 1999. "Imposing Moment Restrictions From Auxiliary Data By Weighting," The Review of Economics and Statistics, MIT Press, vol. 81(1), pages 1-14, February.
    8. John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 251-299.
    9. Horowitz, Joel L. & Manski, Charles F., 1998. "Censoring of outcomes and regressors due to survey nonresponse: Identification and estimation using weights and imputations," Journal of Econometrics, Elsevier, vol. 84(1), pages 37-58, May.
    10. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589819.
    11. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    12. Brownstone, David & Valletta, Robert G, 1996. "Modeling Earnings Measurement Error: A Multiple Imputation Approach," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 705-717, November.
    13. Ridder, Geert, 1992. "An empirical evaluation of some models for non-random attrition in panel data," Structural Change and Economic Dynamics, Elsevier, vol. 3(2), pages 337-355, December.
    14. Honore, Bo E, 1992. "Trimmed LAD and Least Squares Estimation of Truncated and Censored Regression Models with Fixed Effects," Econometrica, Econometric Society, vol. 60(3), pages 533-565, May.
    15. Nijman, T.E. & Verbeek, M.J.C.M., 1992. "Testing for selectivity in panel data models," Other publications TiSEM 7ec34a6c-1d84-4052-971c-d, Tilburg University, School of Economics and Management.
    16. repec:adr:anecst:y:1999:i:55-56:p:05 is not listed on IDEAS
    17. Wooldridge, Jeffrey M., 1995. "Selection corrections for panel data models under conditional mean independence assumptions," Journal of Econometrics, Elsevier, vol. 68(1), pages 115-132, July.
    18. Ekaterini Kyriazidou, 1997. "Estimation of a Panel Data Sample Selection Model," Econometrica, Econometric Society, vol. 65(6), pages 1335-1364, November.
    19. Albert, James H & Chib, Siddhartha, 1993. "Bayes Inference via Gibbs Sampling of Autoregressive Time Series Subject to Markov Mean and Variance Shifts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(1), pages 1-15, January.
    20. Francis Vella, 1998. "Estimating Models with Sample Selection Bias: A Survey," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 127-169.
    21. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589826.
    22. Tony Lancaster, 1995. "Exact Structural Inference in Optimal Job Search Models," Working Papers 95-3, Brown University, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicoletti, Cheti, 2006. "Nonresponse in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 132(2), pages 461-489, June.
    2. Badi Baltagi & Seuck Song, 2006. "Unbalanced panel data: A survey," Statistical Papers, Springer, vol. 47(4), pages 493-523, October.
    3. repec:hal:wpspec:info:hdl:2441/3vl5fe4i569nbr005tctlc8ll5 is not listed on IDEAS
    4. Michael Fertig & Stefanie Schurer, 2007. "Earnings Assimilation of Immigrants in Germany: The Importance of Heterogeneity and Attrition Bias," SOEPpapers on Multidisciplinary Panel Data Research 30, DIW Berlin, The German Socio-Economic Panel (SOEP).
    5. Shin, Jaeun & Moon, Sangho, 2006. "Fertility, relative wages, and labor market decisions: A case of female teachers," Economics of Education Review, Elsevier, vol. 25(6), pages 591-604, December.
    6. Hübler, Olaf, 2005. "Panel Data Econometrics: Modelling and Estimation," Hannover Economic Papers (HEP) dp-319, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    7. Jochmans, Koen, 2015. "Multiplicative-error models with sample selection," Journal of Econometrics, Elsevier, vol. 184(2), pages 315-327.
    8. repec:hal:spmain:info:hdl:2441/3vl5fe4i569nbr005tctlc8ll5 is not listed on IDEAS
    9. Leif Husted & Helena Skyt Nielsen & Michael Rosholm & Nina Smith, 2001. "Employment and wage assimilation of male first‐generation immigrants in Denmark," International Journal of Manpower, Emerald Group Publishing Limited, vol. 22(1/2), pages 39-71, February.
    10. Fertig, Michael & Schurer, Stefanie, 2007. "Labour Market Outcomes of Immigrants in Germany: The Importance of Heterogeneity and Attrition Bias," IZA Discussion Papers 2915, Institute of Labor Economics (IZA).
    11. Das, M., 2004. "Simple estimators for nonparametric panel data models with sample attrition," Journal of Econometrics, Elsevier, vol. 120(1), pages 159-180, May.
    12. Heitmueller, Axel & Inglis, Kirsty, 2004. "Carefree? Participation and Pay Differentials for Informal Carers in Britain," IZA Discussion Papers 1273, Institute of Labor Economics (IZA).
    13. E. Santarelli & H. T. Tran, 2013. "Diversification Strategies and Firm Performance: A Sample Selection Approach," Working Papers wp896, Dipartimento Scienze Economiche, Universita' di Bologna.
    14. Zimmer, David M., 2010. "The role of health insurance in labor supply decisions of divorced females," The Quarterly Review of Economics and Finance, Elsevier, vol. 50(2), pages 121-131, May.
    15. Albanese, Giuseppe & Cioffi, Marika & Tommasino, Pietro, 2019. "Legislators' behaviour and electoral rules: Evidence from an Italian reform," European Journal of Political Economy, Elsevier, vol. 59(C), pages 423-444.
    16. Van Ourti, Tom, 2003. "Socio-economic inequality in ill-health amongst the elderly: Should one use current or permanent income?," Journal of Health Economics, Elsevier, vol. 22(2), pages 219-241, March.
    17. D'Addio, Anna Cristina & De Greef, Isabelle & Rosholm, Michael, 2002. "Assessing Unemployment Traps in Belgium Using Panel Data Sample Selection Models," IZA Discussion Papers 669, Institute of Labor Economics (IZA).
    18. John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 251-299.
    19. Patrick Bajari & C. Lanier Benkard, 2001. "Demand Estimation With Heterogeneous Consumers and Unobserved Product Characteristics: A Hedonic Approach," NBER Technical Working Papers 0272, National Bureau of Economic Research, Inc.
    20. Wladimir Raymond & Pierre Mohnen & Franz Palm & Sybrand Schim van der Loeff, 2007. "The Behavior of the Maximum Likelihood Estimator of Dynamic Panel Data Sample Selection Models," CIRANO Working Papers 2007s-06, CIRANO.
    21. repec:zbw:rwirep:0020 is not listed on IDEAS
    22. Fernández-Val, Iván & Vella, Francis, 2011. "Bias corrections for two-step fixed effects panel data estimators," Journal of Econometrics, Elsevier, vol. 163(2), pages 144-162, August.
    23. Grace Lee, 2011. "Aggregate shocks decomposition for eight East Asian countries," Journal of the Asia Pacific Economy, Taylor & Francis Journals, vol. 16(2), pages 215-232.

    More about this item

    JEL classification:

    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberte:0230. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.