IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2305.14478.html
   My bibliography  Save this paper

Reproducibility and Transparency versus Privacy and Confidentiality: Reflections from a Data Editor

Author

Listed:
  • Lars Vilhuber

Abstract

Transparency and reproducibility are often seen in opposition to privacy and confidentiality. Data that need to be kept confidential are seen as an impediment to reproducibility, and privacy would seem to inhibit transparency. I bring a more nuanced view to the discussion, and show, using examples from over 1,000 reproducibility assessments, that confidential data can very well be used in reproducible and transparent research. The key insight is that access to most confidential data, while tedious, is open to hundreds if not thousands of researchers. In cases where few researchers can consider accessing such data in the future, reproducibility services, such as those provided by some journals, can provide some evidence for effective reproducibility even when the same data may not be available for future research.

Suggested Citation

  • Lars Vilhuber, 2023. "Reproducibility and Transparency versus Privacy and Confidentiality: Reflections from a Data Editor," Papers 2305.14478, arXiv.org.
  • Handle: RePEc:arx:papers:2305.14478
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2305.14478
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Lars Vilhuber, 2024. "Report of the AEA Data Editor," AEA Papers and Proceedings, American Economic Association, vol. 114, pages 878-890, May.
    2. Angela Zheng, 2022. "The Valuation of Local School Quality under School Choice," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 509-537, May.
    3. Raj Chetty & John N. Friedman, 2019. "A Practical Method to Reduce Privacy Loss When Disclosing Statistics Based on Small Samples," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 414-420, May.
    4. Dominic Coey & Bradley J. Larsen & Brennan C. Platt, 2020. "Discounts and Deadlines in Consumer Search," American Economic Review, American Economic Association, vol. 110(12), pages 3748-3785, December.
    5. Benjamin A. Olken, 2015. "Promises and Perils of Pre-analysis Plans," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 61-80, Summer.
    6. Jordan Awan & Aleksandra Slavković, 2021. "Structure and Sensitivity in Differential Privacy: Comparing K-Norm Mechanisms," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 935-954, April.
    7. Randi Hjalmarsson & Matthew J. Lindquist, 2022. "The Health Effects of Prison," American Economic Journal: Applied Economics, American Economic Association, vol. 14(4), pages 234-270, October.
    8. Anita Mukherjee, 2021. "Impacts of Private Prison Contracting on Inmate Time Served and Recidivism," American Economic Journal: Economic Policy, American Economic Association, vol. 13(2), pages 408-438, May.
    9. John M. Abowd & Ian M. Schmutte, 2019. "An Economic Analysis of Privacy Protection and Statistical Accuracy as Social Choices," American Economic Review, American Economic Association, vol. 109(1), pages 171-202, January.
    10. Andrew Foote & Ashwin Machanavajjhala & Kevin McKinney, 2019. "Releasing Earnings Distributions using Differential Privacy: Disclosure Avoidance System For Post Secondary Employment Outcomes (PSEO)," Working Papers 19-13, Center for Economic Studies, U.S. Census Bureau.
    11. John M. Abowd & Ian M. Schmutte, 2015. "Economic Analysis and Statistical Disclosure Limitation," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 50(1 (Spring), pages 221-293.
    12. Magne Mogstad & Alexander Torgovitsky & Christopher R. Walters, 2021. "The Causal Interpretation of Two-Stage Least Squares with Multiple Instrumental Variables," American Economic Review, American Economic Association, vol. 111(11), pages 3663-3698, November.
    13. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2019. "A Distributional Framework for Matched Employer Employee Data," Econometrica, Econometric Society, vol. 87(3), pages 699-739, May.
    14. Daniel Weinberg & John Abowd & Sandra Rowland & Philip Steel & Laura Zayatz, 2007. "Access Methods for United States Microdata," Working Papers 07-25, Center for Economic Studies, U.S. Census Bureau.
    15. John M. Abowd & Ian M. Schmutte, 2015. "Economic Analysis and Statistical Disclosure Limitation," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 46(1 (Spring), pages 221-293.
    16. Jin Soo Han & Jean-François Houde & Arthur A. van Benthem & Jose Miguel Abito, 2021. "When Does Regulation Distort Costs? Lessons from Fuel Procurement in US Electricity Generation: Comment," American Economic Review, American Economic Association, vol. 111(4), pages 1356-1372, April.
    17. Abhishek Nagaraj & Esther Shears & Mathijs de Vaan, 2020. "Improving data access democratizes and diversifies science," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(38), pages 23490-23498, September.
    18. John M. Abowd & Bryce E. Stephens & Lars Vilhuber & Fredrik Andersson & Kevin L. McKinney & Marc Roemer & Simon Woodcock, 2009. "The LEHD Infrastructure Files and the Creation of the Quarterly Workforce Indicators," NBER Chapters, in: Producer Dynamics: New Evidence from Micro Data, pages 149-230, National Bureau of Economic Research, Inc.
    19. Leslie Jeng & Josh Lerner, 2016. "Making Private Data Accessible in an Opaque Industry: The Experience of the Private Capital Research Institute," American Economic Review, American Economic Association, vol. 106(5), pages 157-160, May.
    20. Arthur Seibold, 2021. "Reference Points for Retirement Behavior: Evidence from German Pension Discontinuities," American Economic Review, American Economic Association, vol. 111(4), pages 1126-1165, April.
    21. John M. Abowd & Ian M. Schmutte & William N. Sexton & Lars Vilhuber, 2019. "Why the Economics Profession Must Actively Participate in the Privacy Protection Debate," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 397-402, May.
    22. Paul Piveteau, 2021. "An Empirical Dynamic Model of Trade with Consumer Accumulation," American Economic Journal: Microeconomics, American Economic Association, vol. 13(4), pages 23-63, November.
    23. Steve Cicala, 2021. "When Does Regulation Distort Costs? Lessons from Fuel Procurement in US Electricity Generation: Reply," American Economic Review, American Economic Association, vol. 111(4), pages 1373-1381, April.
    24. Ivan Rudik, 2020. "Optimal Climate Policy When Damages Are Unknown," American Economic Journal: Economic Policy, American Economic Association, vol. 12(2), pages 340-373, May.
    25. Robert MacCoun & Saul Perlmutter, 2015. "Blind analysis: Hide results to seek the truth," Nature, Nature, vol. 526(7572), pages 187-189, October.
    26. John M. Abowd & Hampton Finer & Frances Kramarz, 1999. "Individual and Firm Heterogeneity in Compensation: An Analysis of Matched Longitudinal Employer-Employee Data for the State of Washington," Contributions to Economic Analysis, in: The Creation and Analysis of Employer-Employee Matched Data, pages 3-24, Emerald Group Publishing Limited.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michler, Jeffrey D. & Josephson, Anna & Kilic, Talip & Murray, Siobhan, 2022. "Privacy protection, measurement error, and the integration of remote sensing and socioeconomic survey data," Journal of Development Economics, Elsevier, vol. 158(C).
    2. Braathen, Christian & Thorsen, Inge & Ubøe, Jan, 2022. "Adjusting for Cell Suppression in Commuting Trip Data," Discussion Papers 2022/13, Norwegian School of Economics, Department of Business and Management Science.
    3. Craig Wesley Carpenter & Anders Van Sandt & Scott Loveridge, 2022. "Measurement error in US regional economic data," Journal of Regional Science, Wiley Blackwell, vol. 62(1), pages 57-80, January.
    4. Raj Chetty & John N. Friedman, 2019. "A Practical Method to Reduce Privacy Loss When Disclosing Statistics Based on Small Samples," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 414-420, May.
    5. John M. Abowd & Robert Ashmead & Ryan Cumings-Menon & Simson Garfinkel & Micah Heineck & Christine Heiss & Robert Johns & Daniel Kifer & Philip Leclerc & Ashwin Machanavajjhala & Brett Moran & William, 2022. "The 2020 Census Disclosure Avoidance System TopDown Algorithm," Papers 2204.08986, arXiv.org.
    6. Jahangir Alam M. & Dostie Benoit & Drechsler Jörg & Vilhuber Lars, 2020. "Applying data synthesis for longitudinal business data across three countries," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 212-236, August.
    7. John M. Abowd & Ian M. Schmutte & William N. Sexton & Lars Vilhuber, 2019. "Why the Economics Profession Must Actively Participate in the Privacy Protection Debate," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 397-402, May.
    8. Ian M. Schmutte & Nathan Yoder, 2022. "Information Design for Differential Privacy," Papers 2202.05452, arXiv.org, revised Jul 2024.
    9. Rasmus Lentz & Jean Marc Robin & Suphanit Piyapromdee, 2018. "On Worker and Firm Heterogeneity in Wages and Employment Mobility: Evidence from Danish Register Data," 2018 Meeting Papers 469, Society for Economic Dynamics.
    10. Kevin L. McKinney & John M. Abowd & John Sabelhaus, 2021. "United States Earnings Dynamics: Inequality, Mobility, and Volatility," NBER Chapters, in: Measuring Distribution and Mobility of Income and Wealth, pages 69-104, National Bureau of Economic Research, Inc.
    11. Raj Chetty & John N. Friedman & Nathaniel Hendren & Maggie R. Jones & Sonya R. Porter, 2018. "The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility," Working Papers 18-42, Center for Economic Studies, U.S. Census Bureau.
    12. Ron S. Jarmin & John M. Abowd & Robert Ashmead & Ryan Cumings-Menon & Nathan Goldschlag & Michael B. Hawes & Sallie Ann Keller & Daniel Kifer & Philip Leclerc & Jerome P. Reiter & Rolando A. Rodrígue, 2023. "An in-depth examination of requirements for disclosure risk assessment," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(43), pages 2220558120-, October.
    13. Tania Babina & Wenting Ma & Christian Moser & Paige Ouimet & Rebecca Zarutskie, 2019. "Pay, Employment, and Dynamics of Young Firms," Working Papers 19-23, Center for Economic Studies, U.S. Census Bureau.
    14. John M Abowd & Michael B Hawes, 2022. "Confidentiality Protection in the 2020 US Census of Population and Housing," Papers 2206.03524, arXiv.org, revised Dec 2022.
    15. John M. Abowd & Ian M. Schmutte, 2017. "Revisiting the Economics of Privacy: Population Statistics and Confidentiality Protection as Public Goods," Working Papers 17-37, Center for Economic Studies, U.S. Census Bureau.
    16. Katharine G. Abraham & Ron S. Jarmin & Brian C. Moyer & Matthew D. Shapiro, 2020. "Introduction: Big Data for Twenty-First-Century Economic Statistics: The Future Is Now," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 1-22, National Bureau of Economic Research, Inc.
    17. E. Mark Curtis & Daniel G. Garrett & Eric C. Ohrn & Kevin A. Roberts & Juan Carlos Suárez Serrato, 2021. "Capital Investment and Labor Demand," NBER Working Papers 29485, National Bureau of Economic Research, Inc.
    18. John M. Abowd & Ian M. Schmutte & Lars Vilhuber, 2018. "Disclosure Limitation and Confidentiality Protection in Linked Data," Working Papers 18-07, Center for Economic Studies, U.S. Census Bureau.
    19. Volker Grossmann & Johannes Schünemann & Holger Strulik, 2024. "Fair Pension Policies with Occupation-Specific Ageing," The Economic Journal, Royal Economic Society, vol. 134(663), pages 2835-2875.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2305.14478. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.