IDEAS home Printed from https://ideas.repec.org/a/bla/jregsc/v62y2022i1p57-80.html
   My bibliography  Save this article

Measurement error in US regional economic data

Author

Listed:
  • Craig Wesley Carpenter
  • Anders Van Sandt
  • Scott Loveridge

Abstract

Estimates of publicly suppressed and unrevised regional economic data produce error and potentially bias statistical inference. This article estimates measurement error in suppressed cell estimated data sets (SCEDs) relative to unsuppressed federal administrative data. In a cross section, coefficient estimates based on relatively aggregated SCEDs are attenuated by about 31%, increasing to 50% in panel data. Coefficient estimates based on less‐aggregated SCEDs are not generally reliable. A review of the limited options for identification emphasizes both the systemic limitations suppression places on research inference and the value of retrospective revisions in confidential data, highlighting the importance of confidential data access and use.

Suggested Citation

  • Craig Wesley Carpenter & Anders Van Sandt & Scott Loveridge, 2022. "Measurement error in US regional economic data," Journal of Regional Science, Wiley Blackwell, vol. 62(1), pages 57-80, January.
    • Handle: RePEc:bla:jregsc:v:62:y:2022:i:1:p:57-80
    DOI: 10.1111/jors.12551
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/jors.12551
    Download Restriction: no
    File URL: https://libkey.io/10.1111/jors.12551?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Cassey, Andrew J. & Smith, Ben O., 2014. "Simulating confidence for the Ellison–Glaeser index," Journal of Urban Economics, Elsevier, vol. 81(C), pages 85-103.
    2. Philippe Aghion & Antonin Bergeaud & Timo Boppart & Peter J. Klenow & Huiyu Li, 2019. "Missing Growth from Creative Destruction," American Economic Review, American Economic Association, vol. 109(8), pages 2795-2822, August.
    3. Catherine Buffington & Benjamin Cerf & Christina Jones & Bruce A. Weinberg, 2016. "STEM Training and Early Career Outcomes of Female and Male Graduate Students: Evidence from UMETRICS Data Linked to the 2010 Census," American Economic Review, American Economic Association, vol. 106(5), pages 333-338, May.
    4. Dan S. Rickman & Mouhcine Guettabi, 2015. "The Great Recession And Nonmetropolitan America," Journal of Regional Science, Wiley Blackwell, vol. 55(1), pages 93-112, January.
    5. John M. Abowd & Ian M. Schmutte, 2015. "Economic Analysis and Statistical Disclosure Limitation," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 50(1 (Spring), pages 221-293.
    6. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    7. Raj Chetty & John N. Friedman, 2019. "A Practical Method to Reduce Privacy Loss When Disclosing Statistics Based on Small Samples," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 414-420, May.
    8. McCallum, B T, 1972. "Relative Asymptotic Bias from Errors of Omission and Measurement," Econometrica, Econometric Society, vol. 40(4), pages 757-758, July.
    9. Vera Rocha & Anabela Carneiro & Celeste Varum, 2015. "Entry and exit dynamics of nascent business owners," Small Business Economics, Springer, vol. 45(1), pages 63-84, June.
    10. W. Reed Walker, 2013. "The Transitional Costs of Sectoral Reallocation: Evidence From the Clean Air Act and the Workforce," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1787-1835.
    11. Michael Porter, 2003. "The Economic Performance of Regions," Regional Studies, Taylor & Francis Journals, vol. 37(6-7), pages 549-578.
    12. Ann Markusen, 1996. "Sticky Places in Slippery Space: A Typology of Industrial Districts," Economic Geography, Taylor & Francis Journals, vol. 72(3), pages 293-313, July.
    13. Weinstein, Amanda L. & Partridge, Mark D. & Tsvetkova, Alexandra, 2018. "Follow the money: Aggregate, sectoral and spatial effects of an energy boom on local earnings," Resources Policy, Elsevier, vol. 55(C), pages 196-209.
    14. Annie Tubadji & Brian Osoba & Peter Nijkamp, 2015. "Culture-based development in the USA: culture as a factor for economic welfare and social well-being at a county level," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 39(3), pages 277-303, August.
    15. John M. Abowd & Ian M. Schmutte, 2019. "An Economic Analysis of Privacy Protection and Statistical Accuracy as Social Choices," American Economic Review, American Economic Association, vol. 109(1), pages 171-202, January.
    16. John M. Abowd & Ian M. Schmutte, 2015. "Economic Analysis and Statistical Disclosure Limitation," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 46(1 (Spring), pages 221-293.
    17. Billings, Stephen B. & Johnson, Erik B., 2016. "Agglomeration within an urban area," Journal of Urban Economics, Elsevier, vol. 91(C), pages 13-25.
    18. Rickman, Dan S. & Wang, Hongbo, 2018. "Two tales of two U.S. states: Regional fiscal austerity and economic performance," Regional Science and Urban Economics, Elsevier, vol. 68(C), pages 46-55.
    19. John G. Cragg, 1994. "Making Good Inferences from Bad Data," Canadian Journal of Economics, Canadian Economics Association, vol. 27(4), pages 776-800, November.
    20. John Haltiwanger & Ron S. Jarmin & Javier Miranda, 2013. "Who Creates Jobs? Small versus Large versus Young," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 347-361, May.
    21. Schott, Peter & Yang, Natalie & Eckert, Fabian & Fort, Teresa, 2020. "Imputing Missing Values in the US Census Bureau's County Business Patterns," CEPR Discussion Papers 14352, C.E.P.R. Discussion Papers.
    22. Luc Anselin & Attila Varga & Zoltan Acs, 2008. "Local Geographic Spillovers Between University Research and High Technology Innovations," Chapters, in: Entrepreneurship, Growth and Public Policy, chapter 9, pages 95-121, Edward Elgar Publishing.
    23. Jeffrey H. Dorfman & Mark D. Partridge & Hamilton Galloway, 2011. "Do Natural Amenities Attract High-tech Jobs? Evidence From a Smoothed Bayesian Spatial Model," Spatial Economic Analysis, Taylor & Francis Journals, vol. 6(4), pages 397-422, April.
    24. Glaeser, Edward L & Hedi D. Kallal & Jose A. Scheinkman & Andrei Shleifer, 1992. "Growth in Cities," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1126-1152, December.
      • Edward L. Glaeser & Hedi D. Kallal & Jose A. Scheinkman & Andrei Shleifer, 1991. "Growth in Cities," NBER Working Papers 3787, National Bureau of Economic Research, Inc.
      • Glaeser, Edward Ludwig & Kallal, Hedi D. & Scheinkman, Jose A. & Shleifer, Andrei, 1992. "Growth in Cities," Scholarly Articles 3451309, Harvard University Department of Economics.
    25. Partridge, Mark D. & Tsvetkova, Alexandra, 2018. "Local ability to "rewire" and socioeconomic performance: Evidence from US counties before and after the Great Recession," MPRA Paper 89313, University Library of Munich, Germany.
    26. J. Reid Cummings & Donald R. Epley, 2014. "A Total Requirements View of a Tourism and Hospitality Market is More Accurate Than Traditional Location Quotients," Tourism Economics, , vol. 20(3), pages 473-492, June.
    27. Raj Chetty & Nathaniel Hendren & Patrick Kline & Emmanuel Saez, 2014. "Where is the land of Opportunity? The Geography of Intergenerational Mobility in the United States," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1553-1623.
    28. Zhang, Sumei & Guldmann, Jean-Michel, 2009. "Estimating suppressed data in regional economic databases: A goal-programming approach," European Journal of Operational Research, Elsevier, vol. 192(2), pages 521-537, January.
    29. Bound, John & Brown, Charles & Duncan, Greg J & Rodgers, Willard L, 1994. "Evidence on the Validity of Cross-Sectional and Longitudinal Labor Market Data," Journal of Labor Economics, University of Chicago Press, vol. 12(3), pages 345-368, July.
    30. Richard A. Dunn & Brent Hueth, 2017. "Food and Agricultural Industries: Opportunities for Improving Measurement and Reporting," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(2), pages 510-523.
    31. Ryan Decker & John Haltiwanger & Ron Jarmin & Javier Miranda, 2014. "The Role of Entrepreneurship in US Job Creation and Economic Dynamism," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 3-24, Summer.
    32. Xavier Giroud & Holger M. Mueller, 2019. "Firms' Internal Networks and Local Economic Shocks," American Economic Review, American Economic Association, vol. 109(10), pages 3617-3649, October.
    33. Ron S Jarmin & Javier Miranda, 2002. "The Longitudinal Business Database," Working Papers 02-17, Center for Economic Studies, U.S. Census Bureau.
    34. Levi, Maurice D, 1973. "Errors in the Variables Bias in the Presence of Correctly Measured Variables," Econometrica, Econometric Society, vol. 41(5), pages 985-986, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Braathen, Christian & Thorsen, Inge & Ubøe, Jan, 2022. "Adjusting for Cell Suppression in Commuting Trip Data," Discussion Papers 2022/13, Norwegian School of Economics, Department of Business and Management Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Craig W. Carpenter & Anders Van Sandt & Rebekka Dudensing & Scott Loveridge, 2022. "Profit Pools and Determinants of Potential County-Level Manufacturing Growth," International Regional Science Review, , vol. 45(2), pages 188-224, March.
    2. Carlino, Gerald & Kerr, William R., 2015. "Agglomeration and Innovation," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 349-404, Elsevier.
    3. Delgado, Mercedes & Porter, Michael E. & Stern, Scott, 2014. "Clusters, convergence, and economic performance," Research Policy, Elsevier, vol. 43(10), pages 1785-1799.
    4. Haifeng Qian, 2018. "Knowledge-Based Regional Economic Development: A Synthetic Review of Knowledge Spillovers, Entrepreneurship, and Entrepreneurial Ecosystems," Economic Development Quarterly, , vol. 32(2), pages 163-176, May.
    5. Braathen, Christian & Thorsen, Inge & Ubøe, Jan, 2022. "Adjusting for Cell Suppression in Commuting Trip Data," Discussion Papers 2022/13, Norwegian School of Economics, Department of Business and Management Science.
    6. Michler, Jeffrey D. & Josephson, Anna & Kilic, Talip & Murray, Siobhan, 2022. "Privacy protection, measurement error, and the integration of remote sensing and socioeconomic survey data," Journal of Development Economics, Elsevier, vol. 158(C).
    7. Vilhuber, Lars, 2023. "Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor," Journal of Econometrics, Elsevier, vol. 235(2), pages 2285-2294.
    8. Feld, Lars P. & Schmidt, Christoph M. & Schnabel, Isabel & Truger, Achim & Wieland, Volker, 2019. "Den Strukturwandel meistern. Jahresgutachten 2019/20 [Dealing with Structural Change. Annual Report 2019/20]," Annual Economic Reports / Jahresgutachten, German Council of Economic Experts / Sachverständigenrat zur Begutachtung der gesamtwirtschaftlichen Entwicklung, volume 127, number 201920.
    9. Gary A. Wagner & Jamie Bologna Pavlik, 2020. "Patent intensity and concentration: The effect of institutional quality on MSA patent activity," Papers in Regional Science, Wiley Blackwell, vol. 99(4), pages 857-898, August.
    10. Rui Baptista & Joana Mendonça, 2010. "Proximity to knowledge sources and the location of knowledge-based start-ups," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 45(1), pages 5-29, August.
    11. Matthias Firgo & Peter Mayerhofer, 2015. "Wissens-Spillovers und regionale Entwicklung - welche strukturpolitische Ausrichtung optimiert des Wachstum?," Working Paper Reihe der AK Wien - Materialien zu Wirtschaft und Gesellschaft 144, Kammer für Arbeiter und Angestellte für Wien, Abteilung Wirtschaftswissenschaft und Statistik.
    12. Alon, Titan & Berger, David & Dent, Robert & Pugsley, Benjamin, 2018. "Older and slower: The startup deficit’s lasting effects on aggregate productivity growth," Journal of Monetary Economics, Elsevier, vol. 93(C), pages 68-85.
    13. Tania Babina & Sabrina T. Howell, 2018. "Entrepreneurial Spillovers from Corporate R&D," NBER Working Papers 25360, National Bureau of Economic Research, Inc.
    14. Geurts, Karen & Van Biesebroeck, Johannes, 2016. "Firm creation and post-entry dynamics of de novo entrants," International Journal of Industrial Organization, Elsevier, vol. 49(C), pages 59-104.
    15. Xiang Ding & Teresa C. Fort & Stephen J. Redding & Peter K. Schott, 2019. "Structural Change Within Versus Across Firms: Evidence from the United States," Working Papers 2019-9, Princeton University. Economics Department..
    16. Raj Chetty & John N. Friedman & Nathaniel Hendren & Maggie R. Jones & Sonya R. Porter, 2018. "The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility," Working Papers 18-42, Center for Economic Studies, U.S. Census Bureau.
    17. Hamidi, Shima & Zandiatashbar, Ahoura & Bonakdar, Ahmad, 2019. "The relationship between regional compactness and regional innovation capacity (RIC): Empirical evidence from a national study," Technological Forecasting and Social Change, Elsevier, vol. 142(C), pages 394-402.
    18. Beaudry, Catherine & Schiffauerova, Andrea, 2009. "Who's right, Marshall or Jacobs? The localization versus urbanization debate," Research Policy, Elsevier, vol. 38(2), pages 318-337, March.
    19. Matthias Firgo & Peter Mayerhofer, 2015. "Wissensintensive Unternehmensdienste, Wissens-Spillovers und regionales Wachstum. Teilprojekt 1: Wissens-Spillovers und regionale Entwicklung – Welche strukturpolitische Ausrichtung optimiert das Wach," WIFO Studies, WIFO, number 58342, April.
    20. Raj Chetty & John N. Friedman, 2019. "A Practical Method to Reduce Privacy Loss When Disclosing Statistics Based on Small Samples," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 414-420, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jregsc:v:62:y:2022:i:1:p:57-80. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0022-4146 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.