Adjusting Imperfect Data: Overview and Case Studies
AbstractResearch users of large administrative have to adjust their data for quirks, problems, and issues that are inevitable when working with these kinds of datasets. Not all solutions to these problems are identical, and how they differ may affect how the data is to be interpreted. Some elements of the data, such as the unit of observation, remain fundamentally different, and it is important to keep that in mind when comparing data across countries. In this paper (written for Lazear and Shaw, 2007), we focus on the differences in the underlying data for a selection of country datasets. We describe two data elements that remain fundamentally different across countries -- the sampling or data collection methodology, and the basic unit of analysis (establishment or firm) -- and the extent to which they differ. We then proceed to document some of the problems that affect longitudinally linked administrative data in general, and we describe some of the solutions analysts and statistical agencies have implemented, and explore, through a select set of case studies, how each adjustment or absence thereof might affect the data.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by National Bureau of Economic Research, Inc in its series NBER Working Papers with number 12977.
Date of creation: Mar 2007
Date of revision:
Publication status: published as Lars Vilhuber. "Adjusting Imperfect Data: Overview and Case Studies," in Edward P. Lazear and Kathryn L. Shaw, editors, "The Structure of Wages: An International Comparison" University of Chicago Press (2008)
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Web page: http://www.nber.org
More information through EDIRC
Other versions of this item:
- Lars Vilhuber, 2009. "Adjusting Imperfect Data: Overview and Case Studies," NBER Chapters, in: The Structure of Wages: An International Comparison, pages 59-80 National Bureau of Economic Research, Inc.
- Lars Vilhuber, 2004. "Adjusting imperfect data: overview and case studies," Longitudinal Employer-Household Dynamics Technical Papers 2004-05, Center for Economic Studies, U.S. Census Bureau.
- C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
- C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
- J0 - Labor and Demographic Economics - - General
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Abowd, John M & Zellner, Arnold, 1985. "Estimating Gross Labor-Force Flows," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 254-83, June.
- Jacobson, Louis S & LaLonde, Robert J & Sullivan, Daniel G, 1993.
"Earnings Losses of Displaced Workers,"
American Economic Review,
American Economic Association, vol. 83(4), pages 685-709, September.
- Louis S. Jacobson & Robert J. LaLonde & Daniel G. Sullivan, 1992. "Earnings losses of displaced workers," Working Paper Series, Macroeconomic Issues 92-28, Federal Reserve Bank of Chicago.
- Louis S. Jacobson & Robert J. LaLonde & Daniel Sullivan, 1992. "Earnings Losses of Displaced Workers," Upjohn Working Papers and Journal Articles 92-11, W.E. Upjohn Institute for Employment Research.
- Parent, Daniel, 2000. "Industry-Specific Capital and the Wage Profile: Evidence from the National Longitudinal Survey of Youth and the Panel Study of Income Dynamics," Journal of Labor Economics, University of Chicago Press, vol. 18(2), pages 306-23, April.
- Abowd, John M. & Kramarz, Francis, 1999. "The analysis of labor markets using matched employer-employee data," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 40, pages 2629-2710 Elsevier.
- Abowd, John M & Corbel, Patrick & Kramarz, Francis, 1997.
"The Entry and Exit of Workers and the Growth of Employment: An Analysis of French Establishments,"
CEPR Discussion Papers
1765, C.E.P.R. Discussion Papers.
- John M. Abowd & Patrick Corbel & Francis Kramarz, 1999. "The Entry And Exit Of Workers And The Growth Of Employment: An Analysis Of French Establishments," The Review of Economics and Statistics, MIT Press, vol. 81(2), pages 170-187, May.
- John M. Abowd & Patrick Corbel & Francis Kramarz, 1996. "The Entry and Exit of Workers and the Growth of Employment: An Analysis of French Establishments," NBER Working Papers 5551, National Bureau of Economic Research, Inc.
- Gary Benedetto & John Haltiwanger & Julia Lane & Kevin McKinney, 2003. "Using Worker Flows in the Analysis of the Firm," Longitudinal Employer-Household Dynamics Technical Papers 2003-09, Center for Economic Studies, U.S. Census Bureau, revised May 2004.
- Anderson, Patricia M. & Meyer, Bruce D., 2000. "The effects of the unemployment insurance payroll tax on wages, employment, claims and denials," Journal of Public Economics, Elsevier, vol. 78(1-2), pages 81-106, October.
- Roberto Leombruni & Roberto Quaranta, 2002. "The Unemployment Route to Versatility," LABORatorio R. Revelli Working Papers Series 16, LABORatorio R. Revelli, Centre for Employment Studies.
- Hethey-Maier, Tanja & Schmieder, Johannes F., 2013.
"Does the Use of Worker Flows Improve the Analysis of Establishment Turnover? Evidence from German Administrative Data,"
IZA Discussion Papers
7672, Institute for the Study of Labor (IZA).
- Tanja Hethey-Maier & Johannes F. Schmieder, 2013. "Does the Use of Worker Flows Improve the Analysis of Establishment Turnover? Evidence from German Administrative Data," NBER Working Papers 19730, National Bureau of Economic Research, Inc.
- John M. Abowd & Kevin L. McKinney & Lars Vilhuber, 2009. "The Link between Human Capital, Mass Layoffs, and Firm Deaths," NBER Chapters, in: Producer Dynamics: New Evidence from Micro Data, pages 447-472 National Bureau of Economic Research, Inc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.