IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v53y2019i1d10.1007_s11135-018-0764-z.html
   My bibliography  Save this article

Comparing survey data and administrative records on gross earnings: nonreporting, misreporting, interviewer presence and earnings inequality

Author

Listed:
  • Peter Valet

    (University of Bamberg)

  • Jule Adriaans

    (Socio-economic Panel Study (SOEP) at German Institute for Economic Research (DIW Berlin))

  • Stefan Liebig

    (Socio-economic Panel Study (SOEP) at German Institute for Economic Research (DIW Berlin))

Abstract

Research on earnings inequality mostly relies on survey data, but these data may not be accurate. Survey data on earnings might be biased as research indicates that some respondents are likely to avoid reporting their gross earnings and others are likely to misreport them. In addition, the mode of data collection might affect responses to sensitive questions such as those on earnings. Given these three possibilities for bias, researchers’ conclusions on the degree of earnings inequality might be systematically biased as well. By comparing survey and linked administrative data, we looked for the nonreporting and misreporting biases suggested by the literature, investigated the presence of an interviewer as another source of non- and misreporting, and compared how nonreporting, misreporting, and the mode of data collection affected conclusions on earnings inequality. The analyses drew on a German employee survey and linked administrative data from the Federal Employment Agency. Using the administrative data as a benchmark, we found that respondents at the lower and upper end of the earnings distribution were more likely to not report and to misreport their earnings. Interviewer presence led to higher nonreporting but had no effect on misreporting. All these processes and especially nonreporting and interviewer presence led to an underestimation of earnings inequality based on survey data. We relate the relevance of these results to research on inequality and survey methodology and conclude that linking survey data to administrative records could be an avenue for safeguarding conclusions on earnings inequality.

Suggested Citation

  • Peter Valet & Jule Adriaans & Stefan Liebig, 2019. "Comparing survey data and administrative records on gross earnings: nonreporting, misreporting, interviewer presence and earnings inequality," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(1), pages 471-491, January.
  • Handle: RePEc:spr:qualqt:v:53:y:2019:i:1:d:10.1007_s11135-018-0764-z
    DOI: 10.1007/s11135-018-0764-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-018-0764-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-018-0764-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anthony B. Atkinson & Thomas Piketty & Emmanuel Saez, 2011. "Top Incomes in the Long Run of History," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 3-71, March.
    2. Lillard, Lee & Smith, James P & Welch, Finis, 1986. "What Do We Really Know about Wages? The Importance of Nonreporting and Census Imputation," Journal of Political Economy, University of Chicago Press, vol. 94(3), pages 489-506, June.
    3. Ivar Krumpal, 2013. "Determinants of social desirability bias in sensitive surveys: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2025-2047, June.
    4. Christopher R. Bollinger & Barry T. Hirsch, 2013. "Is Earnings Nonresponse Ignorable?," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 407-416, May.
    5. Stephen P. Jenkins, 2017. "Pareto Models, Top Incomes and Recent Trends in UK Income Inequality," Economica, London School of Economics and Political Science, vol. 84(334), pages 261-289, April.
    6. Regina Riphahn & Oliver Serfling, 2005. "Item non-response on income and wealth questions," Empirical Economics, Springer, vol. 30(2), pages 521-538, September.
    7. Peter T. Gottschalk & Minh Huynh, 2005. "Validation Study of Earnings Data in the SIPP – Do Older Workers Have Larger Measurement Error?," Working Papers, Center for Retirement Research at Boston College wp2005-7, Center for Retirement Research, revised May 2005.
    8. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    9. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    10. Hadas Mandel & Moshe Semyonov, 2014. "Gender Pay Gap and Employment Sector: Sources of Earnings Disparities in the United States, 1970–2010," Demography, Springer;Population Association of America (PAA), vol. 51(5), pages 1597-1618, October.
    11. Peter Gottschalk & Minh Huynh, 2010. "Are Earnings Inequality and Mobility Overstated? The Impact of Nonclassical Measurement Error," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 302-315, May.
    12. Charles Hokayem & Christopher Bollinger & James P. Ziliak, 2015. "The Role of CPS Nonresponse in the Measurement of Poverty," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 935-945, September.
    13. Patrick Burauel & Marco Caliendo & Alexandra Fedorets & Markus M. Grabka & Carsten Schröder & Jürgen Schupp & Linda Wittbrodt, 2017. "Minimum Wage Not yet for Everyone: On the Compensation of Eligible Workers before and after the Minimum Wage Reform from the Perspective of Employees," DIW Economic Bulletin, DIW Berlin, German Institute for Economic Research, vol. 7(49), pages 509-522.
    14. Denise Hawkes & Ian Plewis, 2006. "Modelling non‐response in the National Child Development Study," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 479-491, July.
    15. Metzing, Maria & Bartels, Charlotte, 2016. "An integrated approach for top-corrected Ginis," VfS Annual Conference 2016 (Augsburg): Demographic Change 145818, Verein für Socialpolitik / German Economic Association.
    16. Wiji Arulampalam & Alison L. Booth & Mark L. Bryan, 2007. "Is There a Glass Ceiling over Europe? Exploring the Gender Pay Gap across the Wage Distribution," ILR Review, Cornell University, ILR School, vol. 60(2), pages 163-186, January.
    17. Peter Jacobebbinghaus & Stefan Seth, 2007. "European Data Watch: The German Integrated Employment Biographies Sample IEBS," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(2), pages 335-342.
    18. Arie Kapteyn & Jelmer Y. Ypma, 2007. "Measurement Error and Misclassification: A Comparison of Survey and Administrative Data," Journal of Labor Economics, University of Chicago Press, vol. 25(3), pages 513-551.
    19. Ferrer-i-Carbonell, Ada, 2005. "Income and well-being: an empirical analysis of the comparison income effect," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 997-1019, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Babette Bühler & Katja Möhring & Andreas P. Weiland, 2022. "Assessing dissimilarity of employment history information from survey and administrative data using sequence analysis techniques," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4747-4774, December.
    2. Jenkins, Stephen P. & Rios-Avila, Fernando, 2021. "Reconciling Reports: Modelling Employment Earnings and Measurement Errors Using Linked Survey and Administrative Data," IZA Discussion Papers 14405, Institute of Labor Economics (IZA).
    3. Jule Adriaans & Peter Valet & Stefan Liebig, 2020. "Comparing administrative and survey data: Is information on education from administrative records of the German Institute for Employment Research consistent with survey self-reports?," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(1), pages 3-25, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. ChangHwan Kim & Christopher R. Tamborini, 2014. "Response Error in Earnings," Sociological Methods & Research, , vol. 43(1), pages 39-72, February.
    2. Bollinger, Christopher R. & Hirsch, Barry & Hokayem, Charles M. & Ziliak, James P., 2018. "Trouble in the Tails? What We Know about Earnings Nonresponse Thirty Years after Lillard, Smith, and Welch," IZA Discussion Papers 11710, Institute of Labor Economics (IZA).
    3. Michele Lalla & Patrizio Frederic & Daniela Mantovani, 2022. "The inextricable association of measurement errors and tax evasion as examined through a microanalysis of survey data matched with fiscal data: a case study," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(5), pages 1375-1401, December.
    4. Michele Lalla & Maddalena Cavicchioli, 2020. "Nonresponse and measurement errors in income: matching individual survey data with administrative tax data," Department of Economics 0170, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    5. Brunori, Paolo & Salas-Rojo, Pedro & Verme, Paolo, 2022. "Estimating Inequality with Missing Incomes," GLO Discussion Paper Series 1138, Global Labor Organization (GLO).
    6. Dean R. Hyslop & Wilbur Townsend, 2020. "Earnings Dynamics and Measurement Error in Matched Survey and Administrative Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 457-469, April.
    7. Stefan Angel & Richard Heuberger & Nadja Lamei, 2018. "Differences Between Household Income from Surveys and Registers and How These Affect the Poverty Headcount: Evidence from the Austrian SILC," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(2), pages 575-603, July.
    8. Jule Adriaans & Peter Valet & Stefan Liebig, 2020. "Comparing administrative and survey data: Is information on education from administrative records of the German Institute for Employment Research consistent with survey self-reports?," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(1), pages 3-25, February.
    9. Xavier Jara & Nicolás Oliva, 2018. "Top income adjustments and tax reforms in Ecuador," WIDER Working Paper Series wp-2018-165, World Institute for Development Economic Research (UNU-WIDER).
    10. Meyer, Bruce D. & Mittag, Nikolas, 2017. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," IZA Discussion Papers 10943, Institute of Labor Economics (IZA).
    11. Adam Bee & Joshua Mitchell & Nikolas Mittag & Jonathan Rothbaum & Carl Sanders & Lawrence Schmidt & Matthew Unrath, 2023. "National Experimental Wellbeing Statistics - Version 1," Working Papers 23-04, Center for Economic Studies, U.S. Census Bureau.
    12. Bart H. H. Golsteyn & Stefa Hirsch, 2019. "Are estimates of intergenerational mobility biased by non-response? Evidence from the Netherlands," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 52(1), pages 29-63, January.
    13. Bruce Meyer & Nikolas Mittag, 2017. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," Working Papers 2017-075, Human Capital and Economic Opportunity Working Group.
    14. Maddalena Cavicchioli & Michele Lalla, 2022. "Evidences from survey data and fiscal data: nonresponse and measurement errors in annual incomes," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(3), pages 587-615, September.
    15. H. Xavier Jara & Nicolás Oliva, 2018. "Top income adjustments and tax reforms in Ecuador," WIDER Working Paper Series 165, World Institute for Development Economic Research (UNU-WIDER).
    16. Mathias Silva, 2023. "Parametric models of income distributions integrating misreporting and non-response mechanisms," AMSE Working Papers 2311, Aix-Marseille School of Economics, France.
    17. Vladimir Hlasny & Paolo Verme, 2022. "The Impact of Top Incomes Biases on the Measurement of Inequality in the United States," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(4), pages 749-788, August.
    18. Meyer, Bruce D. & Mittag, Nikolas, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," IZA Discussion Papers 12266, Institute of Labor Economics (IZA).
    19. Fisher, Jonathan D. & Houseworth, Christina A., 2013. "Occupation inflation in the Current Population Survey," Journal of Economic and Social Measurement, IOS Press, issue 3, pages 243-261.
    20. Christopher R. Bollinger & Barry T. Hirsch, 2010. "GDP & Beyond – die europäische Perspektive," RatSWD Working Papers 165, German Data Forum (RatSWD).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:53:y:2019:i:1:d:10.1007_s11135-018-0764-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.