IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/12977.html
   My bibliography  Save this paper

Adjusting Imperfect Data: Overview and Case Studies

Author

Listed:
  • Lars Vilhuber

Abstract

Research users of large administrative have to adjust their data for quirks, problems, and issues that are inevitable when working with these kinds of datasets. Not all solutions to these problems are identical, and how they differ may affect how the data is to be interpreted. Some elements of the data, such as the unit of observation, remain fundamentally different, and it is important to keep that in mind when comparing data across countries. In this paper (written for Lazear and Shaw, 2007), we focus on the differences in the underlying data for a selection of country datasets. We describe two data elements that remain fundamentally different across countries -- the sampling or data collection methodology, and the basic unit of analysis (establishment or firm) -- and the extent to which they differ. We then proceed to document some of the problems that affect longitudinally linked administrative data in general, and we describe some of the solutions analysts and statistical agencies have implemented, and explore, through a select set of case studies, how each adjustment or absence thereof might affect the data.

Suggested Citation

  • Lars Vilhuber, 2007. "Adjusting Imperfect Data: Overview and Case Studies," NBER Working Papers 12977, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:12977
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w12977.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jacobson, Louis S & LaLonde, Robert J & Sullivan, Daniel G, 1993. "Earnings Losses of Displaced Workers," American Economic Review, American Economic Association, vol. 83(4), pages 685-709, September.
    2. Anderson, Patricia M. & Meyer, Bruce D., 2000. "The effects of the unemployment insurance payroll tax on wages, employment, claims and denials," Journal of Public Economics, Elsevier, vol. 78(1-2), pages 81-106, October.
    3. John M. Abowd & Patrick Corbel & Francis Kramarz, 1999. "The Entry And Exit Of Workers And The Growth Of Employment: An Analysis Of French Establishments," The Review of Economics and Statistics, MIT Press, vol. 81(2), pages 170-187, May.
    4. Gary Benedetto & John Haltiwanger & Julia Lane & Kevin McKinney, 2003. "Using Worker Flows in the Analysis of the Firm," Longitudinal Employer-Household Dynamics Technical Papers 2003-09, Center for Economic Studies, U.S. Census Bureau, revised May 2004.
    5. Abowd, John M & Zellner, Arnold, 1985. "Estimating Gross Labor-Force Flows," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 254-283, June.
    6. Abowd, John M. & Kramarz, Francis, 1999. "The analysis of labor markets using matched employer-employee data," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 40, pages 2629-2710, Elsevier.
    7. Roberto Leombruni & Roberto Quaranta, 2002. "The Unemployment Route to Versatility," LABORatorio R. Revelli Working Papers Series 16, LABORatorio R. Revelli, Centre for Employment Studies.
    8. Bruno Contini & Claudia Villosio, 2003. "Worker Mobility, Job Displacement and Wage Dynamics: Italy 1985-91," LABORatorio R. Revelli Working Papers Series 24, LABORatorio R. Revelli, Centre for Employment Studies.
    9. Parent, Daniel, 2000. "Industry-Specific Capital and the Wage Profile: Evidence from the National Longitudinal Survey of Youth and the Panel Study of Income Dynamics," Journal of Labor Economics, University of Chicago Press, vol. 18(2), pages 306-323, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hijzen, Alexander & Martins, Pedro S. & Schank, Thorsten & Upward, Richard, 2013. "Foreign-owned firms around the world: A comparative analysis of wages and employment at the micro-level," European Economic Review, Elsevier, vol. 60(C), pages 170-188.
    2. Tanja Hethey-Maier & Johannes F. Schmieder, 2013. "Does the Use of Worker Flows Improve the Analysis of Establishment Turnover? Evidence from German Administrative Data," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 133(4), pages 477-510.
    3. Chiara Criscuolo & Peter N. Gal & Carlo Menon, 2014. "The Dynamics of Employment Growth: New Evidence from 18 Countries," CEP Discussion Papers dp1274, Centre for Economic Performance, LSE.
    4. repec:iab:iabfme:201006(en is not listed on IDEAS
    5. John M. Abowd & Kevin L. McKinney & Lars Vilhuber, 2009. "The Link between Human Capital, Mass Layoffs, and Firm Deaths," NBER Chapters, in: Producer Dynamics: New Evidence from Micro Data, pages 447-472, National Bureau of Economic Research, Inc.
    6. Hethey, Tanja & Schmieder, Johannes F., 2010. "Using worker flows in the analysis of establishment turnover : evidence from German administrative data," FDZ Methodenreport 201006_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philip Jung & Moritz Kuhn, 2019. "Earnings Losses and Labor Mobility Over the Life Cycle," Journal of the European Economic Association, European Economic Association, vol. 17(3), pages 678-724.
    2. Till von Wachter & Stefan Bender, 2008. "Do Initial Conditions Persist between Firms? An Analysis of Firm-Entry Cohort Effects and Job Losers Using Matched Employer-Employee Data," NBER Chapters, in: The Analysis of Firms and Employees: Quantitative and Qualitative Approaches, pages 135-162, National Bureau of Economic Research, Inc.
    3. Abowd, John M. & Vilhuber, Lars, 2011. "National estimates of gross employment and job flows from the Quarterly Workforce Indicators with demographic and industry detail," Journal of Econometrics, Elsevier, vol. 161(1), pages 82-99, March.
    4. Kevin McKinney & Lars Vilhuber, 2006. "Using linked employer-employee data to investigate the speed of adjustments in downsizing firms," Longitudinal Employer-Household Dynamics Technical Papers 2006-03, Center for Economic Studies, U.S. Census Bureau.
    5. Ronald Bachmann & Peggy Bechara, 2019. "The Importance of Two‐Sided Heterogeneity for the Cyclicality of Labour Market Dynamics," Manchester School, University of Manchester, vol. 87(6), pages 794-820, December.
    6. Steven J. Davis & John Haltiwanger, 1998. "Measuring Gross Worker and Job Flows," NBER Chapters, in: Labor Statistics Measurement Issues, pages 77-122, National Bureau of Economic Research, Inc.
    7. Carlos Henrique Corseuil, 2007. "Testing The Connection Between Replacement And Job Flows," Anais do XXXV Encontro Nacional de Economia [Proceedings of the 35th Brazilian Economics Meeting] 132, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    8. Bognanno, Michael & Kambayashi, Ryo, 2013. "Trends in worker displacement penalties in Japan: 1991–2005," Japan and the World Economy, Elsevier, vol. 27(C), pages 41-57.
    9. David Hummels & Jakob R. Munch & Chong Xiang, 2018. "Offshoring and Labor Markets," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 981-1028, September.
    10. Joseph G. Altonji & Anthony A. Smith Jr. & Ivan Vidangos, 2013. "Modeling Earnings Dynamics," Econometrica, Econometric Society, vol. 81(4), pages 1395-1454, July.
    11. Morten Henningsen & Torbjørn Hægeland, 2008. "Downsizing as a sorting device. Are low-productive workers more likely to leave downsizing firms?," Discussion Papers 543, Statistics Norway, Research Department.
    12. Hethey, Tanja & Schmieder, Johannes F., 2010. "Using worker flows in the analysis of establishment turnover : evidence from German administrative data," FDZ Methodenreport 201006_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    13. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 125(1), pages 175-214.
    14. Yamamura, Eiji & Ohtake, Fumio, 2021. "Firm-specific human capital in different market conditions: Evidence from the Japanese football league," Japan and the World Economy, Elsevier, vol. 58(C).
    15. Sullivan, Paul, 2010. "Empirical evidence on occupation and industry specific human capital," Labour Economics, Elsevier, vol. 17(3), pages 567-580, June.
    16. repec:iab:iabfme:201006(en is not listed on IDEAS
    17. Paul Sullivan, 2009. "Estimation of an Occupational Choice Model when Occupations are Misclassified," Journal of Human Resources, University of Wisconsin Press, vol. 44(2).
    18. Judith K. Hellerstein, 2009. "Comment on "Ownership Change, Productivity, and Human Capital: New Evidence from Matched Employer-Employee Data"," NBER Chapters, in: Producer Dynamics: New Evidence from Micro Data, pages 443-445, National Bureau of Economic Research, Inc.
    19. Fujita, Shigeru, 2018. "Declining labor turnover and turbulence," Journal of Monetary Economics, Elsevier, vol. 99(C), pages 1-19.
    20. Jacob Rubæk Holm & Christian Richter Østergaard & Thomas Roslyng Olesen, 2017. "Destruction And Reallocation Of Skills Following Large Company Closures," Journal of Regional Science, Wiley Blackwell, vol. 57(2), pages 245-265, March.
    21. Stefan Bender & Till von Wachter, 2006. "In the Right Place at the Wrong Time: The Role of Firms and Luck in Young Workers' Careers," American Economic Review, American Economic Association, vol. 96(5), pages 1679-1705, December.

    More about this item

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • J0 - Labor and Demographic Economics - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:12977. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.