IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19539.html
   My bibliography  Save this paper

Measuring the Accuracy of Survey Responses using Administrative Register Data: Evidence from Denmark

Author

Listed:
  • Claus Thustrup Kreiner
  • David Dreyer Lassen
  • Søren Leth-Petersen

Abstract

This paper shows how Danish administrative register data can be combined with survey data at the person level and be used to validate information collected in the survey. Register data are collected by automatic third party reporting and the potential errors associated with the two data sources are therefore plausibly orthogonal. Two examples are given to illustrate the potential of combining survey and register data. In the first example expenditure survey records with information about total expenditure are merged with income tax records holding information about income and wealth. Income and wealth data are used to impute total expenditure which is then compared to the survey measure. Results suggest that the two measures match each other well on average. In the second example we compare responses to a one-shot recall question about total gross personal income (collected in another survey) with tax records. Tax records hold detailed information about different types of income and this makes it possible to test if errors in the survey response are related to the reporting of particular types of income. Results show bias in the mean and that the survey error has substantial variance. Results also show that the errors are correlated with conventional covariates suggesting that the errors are not of the classical type. The latter example illustrates how Denmark can be used as a "laboratory" for future validation studies. Tax records with detailed information about different types of income are available for the entire Danish population and can be readily merged to survey data. This makes it possible to test the ability of respondents to accurately report different types of income using different interviewing techniques and questions. The examples presented in this paper are based on cross section data. However, the possibility to issue surveys repeatedly to the same persons and linking up to longitudinal tax records provides an opportunity to learn more about the time series properties of measurement errors, a subject about which little evidence exist, in the future.

Suggested Citation

  • Claus Thustrup Kreiner & David Dreyer Lassen & Søren Leth-Petersen, 2013. "Measuring the Accuracy of Survey Responses using Administrative Register Data: Evidence from Denmark," NBER Working Papers 19539, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:19539
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19539.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fagereng, Andreas & Onshuus, Helene & Torstensen, Kjersti N., 2024. "The consumption expenditure response to unemployment: Evidence from Norwegian households," Journal of Monetary Economics, Elsevier, vol. 146(C).
    2. Francesco D’Acunto & Daniel Hoang & Michael Weber, 2022. "Managing Households’ Expectations with Unconventional Policies," The Review of Financial Studies, Society for Financial Studies, vol. 35(4), pages 1597-1642.
    3. Elinder, Mikael & Erixson, Oscar & Waldenström, Daniel, 2018. "Inheritance and wealth inequality: Evidence from population registers," Journal of Public Economics, Elsevier, vol. 165(C), pages 17-30.
    4. Fagereng, Andreas & Halvorsen, Elin, 2017. "Imputing consumption from Norwegian income and wealth registry data," Journal of Economic and Social Measurement, IOS Press, issue 1, pages 67-100.
    5. Buda, Gergely & Carvalho, Vasco & Hansen, Stephen & Ortiz, Alvaro & Rodrigo, Tomasa & Rodríguez Mora, José V, 2022. "National Accounts in a World of Naturally Occurring Data: A Proof of Concept for Consumption," CEPR Discussion Papers 17519, C.E.P.R. Discussion Papers.
    6. Kolsrud, Jonas & Landais, Camille & Spinnewijn, Johannes, 2020. "The value of registry data for consumption analysis: An application to health shocks," Journal of Public Economics, Elsevier, vol. 189(C).
    7. Tomas Lichard & Jan Hanousek & Randall K. Filer, 2012. "Measuring the Shadow Economy: Endogenous Switching Regression with Unobserved Separation," Economics Working Paper Archive at Hunter College 438, Hunter College Department of Economics.
    8. Li, Feng & Wang, Xintao, 2024. "Misreporting in household income and expenditure: Evidence from the Chinese Household Income Project," Economics Letters, Elsevier, vol. 237(C).
    9. Christopher D. Carroll, 2014. "Representing Consumption and Saving without a Representative Consumer," NBER Chapters, in: Measuring Economic Sustainability and Progress, pages 115-134, National Bureau of Economic Research, Inc.
    10. Burt S. Barnow & David Greenberg, 2015. "Do Estimated Impacts on Earnings Depend on the Source of the Data Used to Measure Them? Evidence From Previous Social Experiments," Evaluation Review, , vol. 39(2), pages 179-228, April.
    11. Janet Hua Jiang & Rupal Kamdar & Kelin Lu & Daniela Puzzello, 2024. "How Do Households Respond to Expected Inflation? An Investigation of Transmission Mechanisms," CAEPR Working Papers 2024-004 Classification-D, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    12. Alain Galli & Rina Rosenblatt-Wisch, 2022. "Analysing households' consumption and saving patterns using tax data," Working Papers 2022-03, Swiss National Bank.
    13. Landais, Camille & Kolsrud, Jonas & Spinnewijn, Johannes, 2017. "Studying Consumption Patterns using Registry Data: Lessons From Swedish Administrative Data," CEPR Discussion Papers 12402, C.E.P.R. Discussion Papers.
    14. Hanousek, Jan & Lichard, Tomáš & Torosyan, Karine, 2016. "‘Flattening’ the Tax Evasion: Evidence from the Post-Communist Natural Experiment," CEPR Discussion Papers 11229, C.E.P.R. Discussion Papers.
    15. Yvonne McCarthy & Kieran McQuinn, 2016. "Attenuation Bias, Recall Error and the Housing Wealth Effect," Kyklos, Wiley Blackwell, vol. 69(3), pages 492-517, August.
    16. Martin Browning & Thomas F. Crossley & Joachim Winter, 2014. "The Measurement of Household Consumption Expenditures," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 475-501, August.
    17. Fink Simonsen, Nicolai & Kjær, Trine, 2021. "New Evidence of Health State Dependent Utility of Consumption: A combined survey and register study," DaCHE discussion papers 2021:2, University of Southern Denmark, Dache - Danish Centre for Health Economics.
    18. Stefan Angel & Richard Heuberger & Nadja Lamei, 2018. "Differences Between Household Income from Surveys and Registers and How These Affect the Poverty Headcount: Evidence from the Austrian SILC," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(2), pages 575-603, July.
    19. Tomáš Lichard & Jan Hanousek & Randall K. Filer, 2021. "Hidden in plain sight: using household data to measure the shadow economy," Empirical Economics, Springer, vol. 60(3), pages 1449-1476, March.
    20. Ana Cinta G. Cabral & Norman Gemmell & Nazila Alinaghi, 2021. "Are survey-based self-employment income underreporting estimates biased? New evidence from matched register and survey data," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 28(2), pages 284-322, April.
    21. Randall K. Filer & Jan Hanousek & Tomáš Lichard & Karine Torosyan, 2019. "‘Flattening’ tax evasion? : Evidence from the post‐communist natural experiment," The Economics of Transition, The European Bank for Reconstruction and Development, vol. 27(1), pages 223-246, January.
    22. Cabral, Ana Cinta G. & Gemmell, Norman, 2018. "Estimating Self-Employment Income-Gaps from Register and Survey Data: Evidence for New Zealand," Working Paper Series 7625, Victoria University of Wellington, Chair in Public Finance.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laisney, François & Pohlmeier, Winfried & Staat, Matthias, 1991. "Estimation of labour supply functions using panel data: a survey," ZEW Discussion Papers 91-05, ZEW - Leibniz Centre for European Economic Research.
    2. John Abowd & Martha Stinson, 2011. "Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data," Working Papers 11-20, Center for Economic Studies, U.S. Census Bureau.
    3. Kemp, Gordon C.R. & Santos Silva, J.M.C., 2012. "Regression towards the mode," Journal of Econometrics, Elsevier, vol. 170(1), pages 92-101.
    4. Liran Einav & Ephraim Leibtag & Aviv Nevo, 2010. "Recording discrepancies in Nielsen Homescan data: Are they present and do they matter?," Quantitative Marketing and Economics (QME), Springer, vol. 8(2), pages 207-239, June.
    5. Steven J. Haider & David S. Loughran, 2008. "The Effect of the Social Security Earnings Test on Male Labor Supply: New Evidence from Survey and Administrative Data," Journal of Human Resources, University of Wisconsin Press, vol. 43(1).
    6. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, Institute of Labor Economics (IZA).
    7. Rolf Aaberge & Anders Björklund & Markus Jäntti & Mårten Palme & Peder J. Pedersen & Nina Smith & Tom Wennemo, 2002. "Income Inequality and Income Mobility in the Scandinavian Countries Compared to the United States," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 48(4), pages 443-469, December.
    8. Peter Gottschalk & Minh Huynh, 2010. "Are Earnings Inequality and Mobility Overstated? The Impact of Nonclassical Measurement Error," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 302-315, May.
    9. Richard Blundell & Luigi Pistaferri & Itay Saporta-Eksten, 2016. "Consumption Inequality and Family Labor Supply," American Economic Review, American Economic Association, vol. 106(2), pages 387-435, February.
    10. Andrew C. Johnston & Carla Johnston, 2021. "Is Compassion a Good Career Move?: Nonprofit Earnings Differentials from Job Changes," Journal of Human Resources, University of Wisconsin Press, vol. 56(4), pages 1226-1253.
    11. Stella Martin & Kevin Stabenow & Mark Trede, 2024. "Measurement Error in Earnings," CQE Working Papers 10824, Center for Quantitative Economics (CQE), University of Muenster.
    12. Shiu, Ji-Liang & Hu, Yingyao, 2013. "Identification and estimation of nonlinear dynamic panel data models with unobserved covariates," Journal of Econometrics, Elsevier, vol. 175(2), pages 116-131.
    13. repec:osf:socarx:6vmws_v1 is not listed on IDEAS
    14. Michael A. Clemens & Claudio Montenegro & Lant Pritchett, 2016. "Bounding the Price Equivalent of Migration Barriers," Growth Lab Working Papers 67, Harvard's Growth Lab.
    15. Manuel Hernandez & Danilo Trupkin, 2021. "Asset maintenance as hidden investment among the poor and rich: Application to housing," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 40, pages 128-145, April.
    16. Bruce Fallick & Michael Lettau & William L. Wascher, 2016. "Downward Nominal Wage Rigidity in the United States during and after the Great Recession," Working Papers (Old Series) 1602, Federal Reserve Bank of Cleveland.
    17. Abdurrahman Aydemir & George J. Borjas, 2011. "Attenuation Bias in Measuring the Wage Impact of Immigration," Journal of Labor Economics, University of Chicago Press, vol. 29(1), pages 69-113, January.
    18. Raj Chetty & Nathaniel Hendren & Patrick Kline & Emmanuel Saez, 2014. "Where is the land of Opportunity? The Geography of Intergenerational Mobility in the United States," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1553-1623.
    19. Colleen Carey, 2017. "Technological Change and Risk Adjustment: Benefit Design Incentives in Medicare Part D," American Economic Journal: Economic Policy, American Economic Association, vol. 9(1), pages 38-73, February.
    20. Smith, Jennifer C., 2002. "Pay Cuts And Morale : A Test Of Downward Nominal Rigidity," The Warwick Economics Research Paper Series (TWERPS) 649, University of Warwick, Department of Economics.
    21. Hyslop, Dean & Stillman, Steven, 2007. "Youth minimum wage reform and the labour market in New Zealand," Labour Economics, Elsevier, vol. 14(2), pages 201-230, April.

    More about this item

    JEL classification:

    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19539. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.