This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Combining Panel Data Sets with Attrition and Refreshment Samples

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Keisuke Hirano
Guido W. Imbens
Geert Ridder
Donald B. Rebin

Additional information is available for the following registered author(s):

Abstract

In many fields researchers wish to consider statistical models that allow for more complex relationships than can be inferred using only cross-sectional data. Panel or longitudinal data where the same units are observed repeatedly at different points in time can often provide the richer data needed for such models. Although such data allows researchers to identify more complex models than cross-sectional data, missing data problems can be more severe in panels. In particular, even units who respond in initial waves of the panel may drop out in subsequent waves, so that the subsample with complete data for all waves of the panel can be less representative of the population than the original sample. Sometimes, in the hope of mitigating the effects of attrition without losing the advantages of panel data over cross-sections, panel data sets are augmented by replacing units who have dropped out with new units randomly sampled from the original population. Following Ridder (1992), who used these replacement units to test some models for attrition, we call such additional samples refreshment samples. We explore the benefits of these samples for estimating models of attrition. We describe the manner in which the presence of refreshment samples allows the researcher to test various models for attrition in panel data, including models based on the assumption that missing data are missing at random (MAR, Rubin, 1976; Little and Rubin, 1987). The main result in the paper makes precise the extent to which refreshment samples are informative about the attrition process; a class of non-ignorable missing data models can be identified without making strong distributional or functional form assumptions if refreshment samples are available.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.nber.org/papers/t0230.pdf
File Format: application/pdf
File Function:
Download Restriction: Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html.

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Publisher Info
Paper provided by National Bureau of Economic Research, Inc in its series NBER Technical Working Papers with number 0230.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Apr 1998
Date of revision:
Handle: RePEc:nbr:nberte:0230

Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Phone: 617-868-3900
Email:
Web page: http://www.nber.org
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: ().

Related research
Keywords:

Other versions of this item:

This paper has been announced in the following NEP Reports: References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. John Fitzgerald & Peter Gottschalk & Robert Moffit, 1999. "Sample Attrition in Panel Data: The Role of Selection on Observables," Annales d'Economie et de Statistique, ADRES, issue 55-56, pages 06, Juillet-D. [Downloadable!]
  2. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-73, March. [Downloadable!] (restricted)
  3. John M. Abowd & Bruno Crepon & Francis Kramarz & Alain Trognon, 1995. "A La Recherche des Moments Perdus: Covariance Models for Unbalanced Panels with Endogenous Death," NBER Technical Working Papers 0180, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  4. Heckman, James J, 1979. "Sample Selection Bias as a Specification Error," Econometrica, Econometric Society, vol. 47(1), pages 153-61, January. [Downloadable!] (restricted)
  5. Ekaterini Kyriazidou, 1997. "Estimation of a Panel Data Sample Selection Model," Econometrica, Econometric Society, vol. 65(6), pages 1335-1364, November.
  6. Albert, James H & Chib, Siddhartha, 1993. "Bayes Inference via Gibbs Sampling of Autoregressive Time Series Subject to Markov Mean and Variance Shifts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(1), pages 1-15, January.
  7. Claire Chambolle & Keisuke Hirano, 1999. "Predictive Distributions based on Longitudinal Earnings Data," Annales d'Economie et de Statistique, ADRES, issue 55-56, pages 09, Juillet-D. [Downloadable!]
  8. Ridder, Geert, 1992. "An empirical evaluation of some models for non-random attrition in panel data," Structural Change and Economic Dynamics, Elsevier, vol. 3(2), pages 337-355, December. [Downloadable!] (restricted)
  9. repec:att:wimass:199217 is not listed on IDEAS
  10. Brownstone, David & Valletta, Robert G, 1996. "Modeling Earnings Measurement Error: A Multiple Imputation Approach," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 705-17, November. [Downloadable!] (restricted)
  11. Tony Lancaster, 1995. "Exact Structural Inference in Optimal Job Search Models," Working Papers 95-3, Brown University, Department of Economics.
  12. J. Fitzgerald & P. Gottschalk & R. Moffitt, . "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Institute for Research on Poverty Discussion Papers 1156-98, University of Wisconsin Institute for Research on Poverty. [Downloadable!]
    Other versions:
  13. Honore, Bo E, 1992. "Trimmed LAD and Least Squares Estimation of Truncated and Censored Regression Models with Fixed Effects," Econometrica, Econometric Society, vol. 60(3), pages 533-65, May. [Downloadable!] (restricted)
  14. Verbeek, Marno & Nijman, Theo, 1992. "Testing for Selectivity Bias in Panel Data Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(3), pages 681-703, August. [Downloadable!] (restricted)
    Other versions:
  15. Chamberlain, Gary, 1984. "Panel data," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 22, pages 1247-1318 Elsevier. [Downloadable!] (restricted)
  16. Guido W. Imbens & Judith K. Hellerstein, 1996. "Imposing Moment Restrictions from Auxiliary Data by Weighting," NBER Technical Working Papers 0202, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  17. Wooldridge, Jeffrey M., 1995. "Selection corrections for panel data models under conditional mean independence assumptions," Journal of Econometrics, Elsevier, vol. 68(1), pages 115-132, July. [Downloadable!] (restricted)
  18. Baltagi, Badi H. & Boozer, Michael A., 1997. "Econometric Analysis of Panel Data," Econometric Theory, Cambridge University Press, vol. 13(05), pages 747-754, October. [Downloadable!]
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Joachim Inkmann, 2001. "Accounting for Nonresponse Heterogeneity in Panel Data," CoFE Discussion Paper 01-03, Center of Finance and Econometrics, University of Konstanz. [Downloadable!]
  2. Daniel Egel & Bryan S. Graham & Cristine Campos de Xavier Pinto, 2008. "Inverse Probability Tilting and Missing Data Problems," NBER Working Papers 13981, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  3. Seik Kim, . "Economic Assimilation of Foreign-Born Workers in the United States: An Overlapping Rotating Panel Analysis," Working Papers UWEC-2008-19, University of Washington, Department of Economics. [Downloadable!]
  4. John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," NBER Technical Working Papers 0220, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  5. Inkmann, Joachim, 2005. "Inverse probability weighted generalised empirical likelihood estimators : firm size and R&D revisited," Discussion Paper 131, Tilburg University, Center for Economic Research. [Downloadable!]
  6. Arie Kapteyn & Pierre-Carl Michaud & James Smith & Arthur van Soest, 2006. "Effects of Attrition and Non-Response in the Health and Retirement Study," IZA Discussion Papers 2246, Institute for the Study of Labor (IZA). [Downloadable!]
    Other versions:
  7. Tom Wansbeek & Erik Meijer, 2007. "Comments on: Panel data analysis—advantages and challenges," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer, vol. 16(1), pages 33-36, May. [Downloadable!] (restricted)
  8. Das, J.W.M. & Toepoel, V. & Soest, A.H.O. van, 2007. "Can I use a Panel? Panel Conditioning and Attrition Bias in panel Surveys," Discussion Paper 2007-56, Tilburg University, Center for Economic Research. [Downloadable!]
  9. Paul J. Devereux & Gautam Tripathi, 2008. "Optimally combining Censored and Uncensored Datasets," Working Papers 200820, School Of Economics, University College Dublin. [Downloadable!]
    Other versions:
  10. Seik Kim, . "Sample Attrition in the presence of Population Attrition," Working Papers UWEC-2009-02, University of Washington, Department of Economics. [Downloadable!]
  11. Honggao Cao & Daniel H. Hill, 2005. "Active versus Passive Sample Attrition: The Health and Retirement Study," Econometrics 0505006, EconWPA. [Downloadable!]
  12. John M. Abowd & Bruno Crepon & Francis Kramarz, 1997. "Moment Estimation with Attrition," NBER Technical Working Papers 0214, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  13. Aviv Nevo, 2001. "Using Weights to Adjust for Sample Selection When Auxiliary Information is Available," NBER Technical Working Papers 0275, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  14. Esmerelda A. Ramalho & Richard Smith, 2003. "Discrete choice non-response," CeMMAP working papers CWP07/03, Centre for Microdata Methods and Practice, Institute for Fiscal Studies. [Downloadable!]
Statistics
Access and download statistics

Did you know? Each page is provided with a technical contact, in case something is not right with the supplied information. See under "publisher info".

This page was last updated on 2009-11-19.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.