Adjusting imperfect data: overview and case studies
AbstractResearch users of large administrative have to adjust their data for quirks, problems, and issues that are inevitable when working with these kinds of datasets. Not all solutions to these problems are identical, and how they differ may affect how the data is to be interpreted. Some elements of the data, such as the unit of observation, remain fundamentally different, and it is important to keep that in mind when comparing data across countries. In this paper (written for Lazear and Shaw, 2007), we focus on the differences in the underlying data for a selection of country datasets. We describe two data elements that remain fundamentally different across countries -- the sampling or data collection methodology, and the basic unit of analysis (establishment or firm) -- and the extent to which they differ. We then proceed to document some of the problems that affect longitudinally linked administrative data in general, and we describe some of the solutions analysts and statistical agencies have implemented, and explore, through a select set of case studies, how each adjustment or absence thereof might affect the data.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Center for Economic Studies, U.S. Census Bureau in its series Longitudinal Employer-Household Dynamics Technical Papers with number 2004-05.
Length: 23 pages
Date of creation: Nov 2004
Date of revision:
Other versions of this item:
- Lars Vilhuber, 2009. "Adjusting Imperfect Data: Overview and Case Studies," NBER Chapters, in: The Structure of Wages: An International Comparison, pages 59-80 National Bureau of Economic Research, Inc.
- Lars Vilhuber, 2007. "Adjusting Imperfect Data: Overview and Case Studies," NBER Working Papers 12977, National Bureau of Economic Research, Inc.
- C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
- C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
- J0 - Labor and Demographic Economics - - General
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Louis S. Jacobson & Robert J. LaLonde & Daniel G. Sullivan, 1992.
"Earnings losses of displaced workers,"
Working Paper Series, Macroeconomic Issues
92-28, Federal Reserve Bank of Chicago.
- Abowd, John M. & Kramarz, Francis, 1999. "The analysis of labor markets using matched employer-employee data," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 40, pages 2629-2710 Elsevier.
- Roberto Leombruni & Roberto Quaranta, 2002. "The Unemployment Route to Versatility," LABORatorio R. Revelli Working Papers Series 16, LABORatorio R. Revelli, Centre for Employment Studies.
- Gary Benedetto & John Haltiwanger & Julia Lane & Kevin McKinney, 2003. "Using Worker Flows in the Analysis of the Firm," Longitudinal Employer-Household Dynamics Technical Papers 2003-09, Center for Economic Studies, U.S. Census Bureau, revised May 2004.
- Parent, Daniel, 2000. "Industry-Specific Capital and the Wage Profile: Evidence from the National Longitudinal Survey of Youth and the Panel Study of Income Dynamics," Journal of Labor Economics, University of Chicago Press, vol. 18(2), pages 306-23, April.
- John M. Abowd & Patrick Corbel & Francis Kramarz, 1999.
"The Entry And Exit Of Workers And The Growth Of Employment: An Analysis Of French Establishments,"
The Review of Economics and Statistics,
MIT Press, vol. 81(2), pages 170-187, May.
- John M. Abowd & Patrick Corbel & Francis Kramarz, 1996. "The Entry and Exit of Workers and the Growth of Employment: An Analysis of French Establishments," NBER Working Papers 5551, National Bureau of Economic Research, Inc.
- Abowd, John M & Corbel, Patrick & Kramarz, Francis, 1997. "The Entry and Exit of Workers and the Growth of Employment: An Analysis of French Establishments," CEPR Discussion Papers 1765, C.E.P.R. Discussion Papers.
- Abowd, John M & Zellner, Arnold, 1985. "Estimating Gross Labor-Force Flows," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 254-83, June.
- Anderson, Patricia M. & Meyer, Bruce D., 2000. "The effects of the unemployment insurance payroll tax on wages, employment, claims and denials," Journal of Public Economics, Elsevier, vol. 78(1-2), pages 81-106, October.
- John M. Abowd & Kevin L. McKinney & Lars Vilhuber, 2009. "The Link between Human Capital, Mass Layoffs, and Firm Deaths," NBER Chapters, in: Producer Dynamics: New Evidence from Micro Data, pages 447-472 National Bureau of Economic Research, Inc.
- Chiara Criscuolo & Peter N. Gal & Carlo Menon, 2014.
"The Dynamics of Employment Growth: New Evidence from 18 Countries,"
CEP Discussion Papers
dp1274, Centre for Economic Performance, LSE.
- Chiara Criscuolo & Peter N. Gal & Carlo Menon, 2014. "The Dynamics of Employment Growth: New Evidence from 18 Countries," OECD Science, Technology and Industry Policy Papers 14, OECD Publishing.
- Tanja Hethey-Maier & Johannes F. Schmieder, 2013.
"Does the Use of Worker Flows Improve the Analysis of Establishment Turnover? Evidence from German Administrative Data,"
NBER Working Papers
19730, National Bureau of Economic Research, Inc.
- Hethey-Maier, Tanja & Schmieder, Johannes F., 2013. "Does the Use of Worker Flows Improve the Analysis of Establishment Turnover? Evidence from German Administrative Data," IZA Discussion Papers 7672, Institute for the Study of Labor (IZA).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Erika McEntarfer).
If references are entirely missing, you can add them using this form.