IDEAS home Printed from https://ideas.repec.org/p/cen/cpaper/2014-08.html
   My bibliography  Save this paper

The Nature of the Bias When Studying Only Linkable Person Records: Evidence from the American Community Survey

Author

Listed:
  • Brittany Bond
  • J. David Brown
  • Adela Luque
  • Amy O’Hara

Abstract

Record linkage across survey and administrative records sources can greatly enrich data and improve their quality. The linkage can reduce respondent burden and nonresponse follow-up costs. This is particularly important in an era of declining survey response rates and tight budgets. Record linkage also creates statistical bias, however. The U.S. Census Bureau links person records through its Person Identification Validation System (PVS), assigning each record a Protected Identification Key (PIK). It is not possible to reliably assign a PIK to every record, either due to insufficient identifying information or because the information does not uniquely match any of the administrative records used in the person validation process. Non-random ability to assign a PIK can potentially inject bias into statistics using linked data. This paper studies the nature of this bias using the 2009 and 2010 American Community Survey (ACS). The ACS is well-suited for this analysis, as it contains a rich set of person characteristics that can describe the bias. We estimate probit models for whether a record is assigned a PIK. The results suggest that young children, minorities, residents of group quarters, immigrants, recent movers, low-income individuals, and non-employed individuals are less likely to receive a PIK using 2009 ACS. Changes to the PVS process in 2010 significantly addressed the young children deficit, attenuated the other biases, and increased the validated records share from 88.1 to 92.6 percent (person-weighted).

Suggested Citation

  • Brittany Bond & J. David Brown & Adela Luque & Amy O’Hara, 2014. "The Nature of the Bias When Studying Only Linkable Person Records: Evidence from the American Community Survey," CARRA Working Papers 2014-08, Center for Economic Studies, U.S. Census Bureau.
  • Handle: RePEc:cen:cpaper:2014-08
    as

    Download full text from publisher

    File URL: https://www.census.gov/content/dam/Census/library/working-papers/2014/adrm/carra-wp-2014-08.pdf
    File Function: First version, 2014
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bruce Meyer & Robert Goerge, 2011. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," Working Papers 11-14, Center for Economic Studies, U.S. Census Bureau.
    2. Meyer, Bruce D. & Goerge, Robert M., 2011. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," Contractor and Cooperator Reports 312394, United States Department of Agriculture, Economic Research Service.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Renuka Bhaskar & James Noon & Brett O'Hara & Victoria Velkoff, 2016. "Medicare Coverage and Reporting," CARRA Working Papers 2016-12, Center for Economic Studies, U.S. Census Bureau.
    2. Raj Chetty & John N. Friedman & Nathaniel Hendren & Maggie R. Jones & Sonya R. Porter, 2018. "The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility," Working Papers 18-42, Center for Economic Studies, U.S. Census Bureau.
    3. Randall Akee & Maggie R. Jones & Sonya R. Porter, 2019. "Race Matters: Income Shares, Income Inequality, and Income Mobility for All U.S. Races," Demography, Springer;Population Association of America (PAA), vol. 56(3), pages 999-1021, June.
    4. Erik Scherpf & Benjamin Cerf, 2019. "Local Labor Demand and Program Participation Dynamics: Evidence from New York SNAP Administrative Records," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 38(2), pages 394-425, March.
    5. Carolyn A. Liebler & Renuka Bhaskar & Sonya Rastogi, 2014. "Dynamics of Race: Joining, Leaving, and Staying in the American Indian/Alaska Native Race Category between 2000 and 2010," CARRA Working Papers 2014-10, Center for Economic Studies, U.S. Census Bureau.
    6. David Splinter & Jeff Larrimore & Jacob Mortenson, 2017. "Whose Child Is This? Shifting of Dependents among EITC Claimants within the Same Household," National Tax Journal, National Tax Association;National Tax Journal, vol. 70(4), pages 737-758, December.
    7. Zachary H. Seeskin, 2016. "Evaluating the Use of Commercial Data to Improve Survey Estimates of Property Taxes," CARRA Working Papers 2016-06, Center for Economic Studies, U.S. Census Bureau.
    8. Randall Akee & Maggie R. Jones & Sonya R. Porter, 2017. "Racial Disparity in an Era of Increasing Income Inequality," CARRA Working Papers 2017-01, Center for Economic Studies, U.S. Census Bureau.
    9. Leticia Fernandez & Rachel Shattuck & James Noon, 2018. "The Use of Administrative Records and the American Community Survey to Study the Characteristics of Undercounted Young Children in the 2010 Census," CARRA Working Papers 2018-05, Center for Economic Studies, U.S. Census Bureau.
    10. Renuka Bhaskar & Rachel M. Shattuck & James Noon, 2018. "Reporting of Indian Health Service Coverage in the American Community Survey," CARRA Working Papers 2018-04, Center for Economic Studies, U.S. Census Bureau.
    11. Jeff Larrimore & Jacob Mortenson & David Splinter, 2021. "Household Incomes in Tax Data: Using Addresses to Move from Tax-Unit to Household Income Distributions," Journal of Human Resources, University of Wisconsin Press, vol. 56(2), pages 600-631.
    12. J. David Brown & Misty L. Heggeness & Suzanne M. Dorinski & Lawrence Warren & Moises Yi, 2019. "Predicting the Effect of Adding a Citizenship Question to the 2020 Census," Demography, Springer;Population Association of America (PAA), vol. 56(4), pages 1173-1194, August.
    13. Benjamin Cerf Harris, 2015. "Likely Transgender Individuals in U.S. Federal Administrative Records and the 2010 Census," CARRA Working Papers 2015-03, Center for Economic Studies, U.S. Census Bureau.
    14. Randall Akee & Maggie R. Jones, 2019. "Foreign vs. U.S. Graduate Degrees: The Impact on Earnings Assimilation and Return Migration for the Foreign Born," Working Papers 19-17, Center for Economic Studies, U.S. Census Bureau.
    15. Maggie R. Jones, 2014. "The EITC over the business cycle: Who benefits?," CARRA Working Papers 2014-15, Center for Economic Studies, U.S. Census Bureau.
    16. Randall Akee & Maggie R. Jones, 2019. "Immigrants’ Earnings Growth and Return Migration from the U.S.: Examining their Determinants using Linked Survey and Administrative Data," NBER Working Papers 25639, National Bureau of Economic Research, Inc.
    17. Mark A. Leach & Jennifer Van Hook & James D. Bachmeier, 2018. "Using Linked Data to Investigate True Intergenerational Change: Three Generations Over Seven Decades," CARRA Working Papers 2018-09, Center for Economic Studies, U.S. Census Bureau.
    18. Catherine G. Massey & Amy O'Hara, 2014. "Person Matching in Historical Files using the Census Bureau’s Person Validation System," CARRA Working Papers 2014-11, Center for Economic Studies, U.S. Census Bureau.
    19. Erik Scherpf & Benjamin Cerf, 2016. "Local Labor Demand and Program Participation Dynamics," CARRA Working Papers 2016-10, Center for Economic Studies, U.S. Census Bureau.
    20. Adela Luque & Renuka Bhaskar & James Noon & Kevin Rinz & Victoria Udalova, 2019. "Nonemployer Statistics by Demographics (NES-D): Using Administrative and Census Records Data in Business Statistics," Working Papers 19-01, Center for Economic Studies, U.S. Census Bureau.
    21. Leticia Fernández & Sonya R. Porter & Sharon R. Ennis & Renuka Bhaskar, 2018. "Factors that Influence Change in Hispanic Identification: Evidence from Linked Decennial Census and American Community Survey Data," Working Papers 18-45, Center for Economic Studies, U.S. Census Bureau.
    22. Renuka Bhaskar & Leticia Fernandez & Sonya Rastogi, 2015. "Assimilation and Coverage of the Foreign-Born Population in Administrative Records," CARRA Working Papers 2015-02, Center for Economic Studies, U.S. Census Bureau.
    23. Adam Bee & Joshua Mitchell & Nikolas Mittag & Jonathan Rothbaum & Carl Sanders & Lawrence Schmidt & Matthew Unrath, 2023. "National Experimental Wellbeing Statistics - Version 1," Working Papers 23-04, Center for Economic Studies, U.S. Census Bureau.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    2. Peter R. Mueser & Colleen M. Heflin, 2013. "Aid to Jobless Workers in Florida in the Face of the Great Recession: The Interaction of Unemployment Insurance and the Supplemental Nutritional Assistance Program," Working Papers 1318, Department of Economics, University of Missouri.
    3. Kyung Min Kang & Robert A. Moffitt, 2019. "The Effect of SNAP and School Food Programs on Food Security, Diet Quality, and Food Spending: Sensitivity to Program Reporting Error," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 156-201, July.
    4. Tiehen, Laura & Jolliffe, Dean & Gundersen, Craig, 2012. "Alleviating Poverty in the United States: The Critical Role of SNAP Benefits," Economic Research Report 262233, United States Department of Agriculture, Economic Research Service.
    5. Bruckmeier, Kerstin & Riphahn, Regina T. & Wiemers, Jürgen, 2019. "Benefit underreporting in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," IAB-Discussion Paper 201906, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    6. Benjamin Cerf Harris, 2014. "Within and Across County Variation in SNAP Misreporting: Evidence from Linked ACS and Administrative Records," CARRA Working Papers 2014-05, Center for Economic Studies, U.S. Census Bureau.
    7. Zachary H. Seeskin, 2016. "Evaluating the Use of Commercial Data to Improve Survey Estimates of Property Taxes," CARRA Working Papers 2016-06, Center for Economic Studies, U.S. Census Bureau.
    8. Reimer, Jeffrey J. & Weerasooriya, Senal & West, Tyler T., 2015. "How Does the Supplemental Nutrition Assistance Program Affect the U.S. Economy?," Agricultural and Resource Economics Review, Cambridge University Press, vol. 44(3), pages 233-252, December.
    9. Coleman-Jensen, Alisha & Rabbitt, Matthew P & Gregory, Christian A & Singh, Anita, 2021. "Household Food Security in the United States in 2020," Economic Research Report 327186, United States Department of Agriculture, Economic Research Service.
    10. Elina T Page & Elizabeth Larimore & John A Kirlin & Mark Denbaly, 2019. "The National Household Food Acquisition and Purchase Survey: Innovations and Research Insights," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 41(2), pages 215-234, June.
    11. Hudak, Katelin M. & Racine, Elizabeth F., 2021. "Do additional SNAP benefits matter for child weight?: Evidence from the 2009 benefit increase," Economics & Human Biology, Elsevier, vol. 41(C).
    12. Coleman-Jensen, Alisha & Rabbitt, Matthew P & Gregory, Christian A & Singh, Anita, 2020. "Household Food Security in the United States in 2019," Economic Research Report 327207, United States Department of Agriculture, Economic Research Service.
    13. Lorenzo Almada & Ian McCarthy & Rusty Tchernis, 2016. "What Can We Learn about the Effects of Food Stamps on Obesity in the Presence of Misreporting?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(4), pages 997-1017.
    14. Julia Lane, 2018. "Building an Infrastructure to Support the Use of Government Administrative Data for Program Performance and Social Science Research," The ANNALS of the American Academy of Political and Social Science, , vol. 675(1), pages 240-252, January.
    15. Rabbitt, Matthew P. & Hales, Laura J. & Burke, Michael P. & Coleman-Jensen, Alisha, 2023. "Household Food Security in the United States in 2022," Economic Research Report 338945, United States Department of Agriculture, Economic Research Service.
    16. Robert M. Goerge, 2018. "Barriers to Accessing State Data and Approaches to Addressing Them," The ANNALS of the American Academy of Political and Social Science, , vol. 675(1), pages 122-137, January.
    17. Fayaz Farkhad, Bita & Meyerhoefer, Chad D. & Dearden, James A., 2017. "The within-month pattern of medical utilization among SNAP participants," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258361, Agricultural and Applied Economics Association.
    18. Andrew S. Green, 2017. "Hours Off the Clock," Working Papers 17-44, Center for Economic Studies, U.S. Census Bureau.
    19. Bilal Habib, 2018. "How CBO Adjusts for Survey Underreporting of Transfer Income in Its Distributional Analyses: Working Paper 2018-07," Working Papers 54234, Congressional Budget Office.
    20. Scherpf, Erik & Newman, Constance & Prell, Mark, 2014. "Targeting of Supplemental Nutrition Assistance Program Benefits: Evidence from the ACS and NY SNAP Administrative Records," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 174295, Agricultural and Applied Economics Association.

    More about this item

    Keywords

    ACS; person level; PIK; PVS;
    All these keywords.

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cen:cpaper:2014-08. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dawn Anderson (email available below). General contact details of provider: https://edirc.repec.org/data/cesgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.