IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v235y2023i2p2285-2294.html
   My bibliography  Save this article

Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor

Author

Listed:
  • Vilhuber, Lars

Abstract

Transparency and reproducibility are often seen in opposition to privacy and confidentiality. Data that need to be kept confidential are seen as an impediment to reproducibility, and privacy would seem to inhibit transparency. I bring a more nuanced view to the discussion, and show, using examples from over 1,000 reproducibility assessments, that confidential data can very well be used in reproducible and transparent research. The key insight is that access to most confidential data, while tedious, is open to hundreds if not thousands of researchers. In cases where few researchers can consider accessing such data in the future, reproducibility services, such as those provided by some journals, can provide some evidence for effective reproducibility even when the same data may not be available for future research.

Suggested Citation

  • Vilhuber, Lars, 2023. "Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor," Journal of Econometrics, Elsevier, vol. 235(2), pages 2285-2294.
  • Handle: RePEc:eee:econom:v:235:y:2023:i:2:p:2285-2294
    DOI: 10.1016/j.jeconom.2023.05.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407623001471
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2023.05.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Paul Piveteau, 2021. "An Empirical Dynamic Model of Trade with Consumer Accumulation," American Economic Journal: Microeconomics, American Economic Association, vol. 13(4), pages 23-63, November.
    2. Lars Vilhuber, 2023. "Report of the AEA Data Editor," AEA Papers and Proceedings, American Economic Association, vol. 113, pages 850-863, May.
    3. Angela Zheng, 2022. "The Valuation of Local School Quality under School Choice," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 509-537, May.
    4. Raj Chetty & John N. Friedman, 2019. "A Practical Method to Reduce Privacy Loss When Disclosing Statistics Based on Small Samples," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 414-420, May.
    5. Dominic Coey & Bradley J. Larsen & Brennan C. Platt, 2020. "Discounts and Deadlines in Consumer Search," American Economic Review, American Economic Association, vol. 110(12), pages 3748-3785, December.
    6. Benjamin A. Olken, 2015. "Promises and Perils of Pre-analysis Plans," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 61-80, Summer.
    7. Jordan Awan & Aleksandra Slavković, 2021. "Structure and Sensitivity in Differential Privacy: Comparing K-Norm Mechanisms," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 935-954, April.
    8. Randi Hjalmarsson & Matthew J. Lindquist, 2022. "The Health Effects of Prison," American Economic Journal: Applied Economics, American Economic Association, vol. 14(4), pages 234-270, October.
    9. Anita Mukherjee, 2021. "Impacts of Private Prison Contracting on Inmate Time Served and Recidivism," American Economic Journal: Economic Policy, American Economic Association, vol. 13(2), pages 408-438, May.
    10. John M. Abowd & Bryce E. Stephens & Lars Vilhuber & Fredrik Andersson & Kevin L. McKinney & Marc Roemer & Simon Woodcock, 2009. "The LEHD Infrastructure Files and the Creation of the Quarterly Workforce Indicators," NBER Chapters, in: Producer Dynamics: New Evidence from Micro Data, pages 149-230, National Bureau of Economic Research, Inc.
    11. John M. Abowd & Ian M. Schmutte, 2019. "An Economic Analysis of Privacy Protection and Statistical Accuracy as Social Choices," American Economic Review, American Economic Association, vol. 109(1), pages 171-202, January.
    12. John M. Abowd & Ian M. Schmutte & William N. Sexton & Lars Vilhuber, 2019. "Why the Economics Profession Must Actively Participate in the Privacy Protection Debate," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 397-402, May.
    13. Andrew Foote & Ashwin Machanavajjhala & Kevin McKinney, 2019. "Releasing Earnings Distributions using Differential Privacy: Disclosure Avoidance System For Post Secondary Employment Outcomes (PSEO)," Working Papers 19-13, Center for Economic Studies, U.S. Census Bureau.
    14. John M. Abowd & Ian M. Schmutte, 2015. "Economic Analysis and Statistical Disclosure Limitation," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 50(1 (Spring), pages 221-293.
    15. Magne Mogstad & Alexander Torgovitsky & Christopher R. Walters, 2021. "The Causal Interpretation of Two-Stage Least Squares with Multiple Instrumental Variables," American Economic Review, American Economic Association, vol. 111(11), pages 3663-3698, November.
    16. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2019. "A Distributional Framework for Matched Employer Employee Data," Econometrica, Econometric Society, vol. 87(3), pages 699-739, May.
    17. Steve Cicala, 2021. "When Does Regulation Distort Costs? Lessons from Fuel Procurement in US Electricity Generation: Reply," American Economic Review, American Economic Association, vol. 111(4), pages 1373-1381, April.
    18. Daniel Weinberg & John Abowd & Sandra Rowland & Philip Steel & Laura Zayatz, 2007. "Access Methods for United States Microdata," Working Papers 07-25, Center for Economic Studies, U.S. Census Bureau.
    19. John M. Abowd & Ian M. Schmutte, 2015. "Economic Analysis and Statistical Disclosure Limitation," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 46(1 (Spring), pages 221-293.
    20. Ivan Rudik, 2020. "Optimal Climate Policy When Damages Are Unknown," American Economic Journal: Economic Policy, American Economic Association, vol. 12(2), pages 340-373, May.
    21. Jin Soo Han & Jean-François Houde & Arthur A. van Benthem & Jose Miguel Abito, 2021. "When Does Regulation Distort Costs? Lessons from Fuel Procurement in US Electricity Generation: Comment," American Economic Review, American Economic Association, vol. 111(4), pages 1356-1372, April.
    22. Abhishek Nagaraj & Esther Shears & Mathijs de Vaan, 2020. "Improving data access democratizes and diversifies science," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(38), pages 23490-23498, September.
    23. Leslie Jeng & Josh Lerner, 2016. "Making Private Data Accessible in an Opaque Industry: The Experience of the Private Capital Research Institute," American Economic Review, American Economic Association, vol. 106(5), pages 157-160, May.
    24. Robert MacCoun & Saul Perlmutter, 2015. "Blind analysis: Hide results to seek the truth," Nature, Nature, vol. 526(7572), pages 187-189, October.
    25. John M. Abowd & Hampton Finer & Frances Kramarz, 1999. "Individual and Firm Heterogeneity in Compensation: An Analysis of Matched Longitudinal Employer-Employee Data for the State of Washington," Contributions to Economic Analysis, in: The Creation and Analysis of Employer-Employee Matched Data, pages 3-24, Emerald Group Publishing Limited.
    26. Arthur Seibold, 2021. "Reference Points for Retirement Behavior: Evidence from German Pension Discontinuities," American Economic Review, American Economic Association, vol. 111(4), pages 1126-1165, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michler, Jeffrey D. & Josephson, Anna & Kilic, Talip & Murray, Siobhan, 2022. "Privacy protection, measurement error, and the integration of remote sensing and socioeconomic survey data," Journal of Development Economics, Elsevier, vol. 158(C).
    2. Braathen, Christian & Thorsen, Inge & Ubøe, Jan, 2022. "Adjusting for Cell Suppression in Commuting Trip Data," Discussion Papers 2022/13, Norwegian School of Economics, Department of Business and Management Science.
    3. Craig Wesley Carpenter & Anders Van Sandt & Scott Loveridge, 2022. "Measurement error in US regional economic data," Journal of Regional Science, Wiley Blackwell, vol. 62(1), pages 57-80, January.
    4. Raj Chetty & John N. Friedman, 2019. "A Practical Method to Reduce Privacy Loss When Disclosing Statistics Based on Small Samples," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 414-420, May.
    5. John M. Abowd & Robert Ashmead & Ryan Cumings-Menon & Simson Garfinkel & Micah Heineck & Christine Heiss & Robert Johns & Daniel Kifer & Philip Leclerc & Ashwin Machanavajjhala & Brett Moran & William, 2022. "The 2020 Census Disclosure Avoidance System TopDown Algorithm," Papers 2204.08986, arXiv.org.
    6. John M. Abowd & Ian M. Schmutte & William N. Sexton & Lars Vilhuber, 2019. "Why the Economics Profession Must Actively Participate in the Privacy Protection Debate," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 397-402, May.
    7. Jahangir Alam M. & Dostie Benoit & Drechsler Jörg & Vilhuber Lars, 2020. "Applying data synthesis for longitudinal business data across three countries," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 212-236, August.
    8. Ian M. Schmutte & Nathan Yoder, 2022. "Information Design for Differential Privacy," Papers 2202.05452, arXiv.org, revised Dec 2022.
    9. Ron S. Jarmin & John M. Abowd & Robert Ashmead & Ryan Cumings-Menon & Nathan Goldschlag & Michael B. Hawes & Sallie Ann Keller & Daniel Kifer & Philip Leclerc & Jerome P. Reiter & Rolando A. Rodrígue, 2023. "An in-depth examination of requirements for disclosure risk assessment," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(43), pages 2220558120-, October.
    10. Babina, Tania & Ma, Wenting & Moser, Christian & Ouimet, Paige & Zarutskie, Rebecca, 2019. "Pay, Employment, and Dynamics of Young Firms," MPRA Paper 95382, University Library of Munich, Germany.
    11. John M. Abowd & Ian M. Schmutte, 2017. "Revisiting the Economics of Privacy: Population Statistics and Confidentiality Protection as Public Goods," Working Papers 17-37, Center for Economic Studies, U.S. Census Bureau.
    12. E. Mark Curtis & Daniel G. Garrett & Eric C. Ohrn & Kevin A. Roberts & Juan Carlos Suárez Serrato, 2021. "Capital Investment and Labor Demand," NBER Working Papers 29485, National Bureau of Economic Research, Inc.
    13. Rasmus Lentz & Jean Marc Robin & Suphanit Piyapromdee, 2018. "On Worker and Firm Heterogeneity in Wages and Employment Mobility: Evidence from Danish Register Data," 2018 Meeting Papers 469, Society for Economic Dynamics.
    14. Kevin L. McKinney & John M. Abowd & John Sabelhaus, 2021. "United States Earnings Dynamics: Inequality, Mobility, and Volatility," NBER Chapters, in: Measuring Distribution and Mobility of Income and Wealth, pages 69-104, National Bureau of Economic Research, Inc.
    15. Raj Chetty & John N. Friedman & Nathaniel Hendren & Maggie R. Jones & Sonya R. Porter, 2018. "The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility," Working Papers 18-42, Center for Economic Studies, U.S. Census Bureau.
    16. John M Abowd & Michael B Hawes, 2022. "Confidentiality Protection in the 2020 US Census of Population and Housing," Papers 2206.03524, arXiv.org, revised Dec 2022.
    17. Katharine G. Abraham & Ron S. Jarmin & Brian C. Moyer & Matthew D. Shapiro, 2020. "Introduction: Big Data for Twenty-First-Century Economic Statistics: The Future Is Now," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 1-22, National Bureau of Economic Research, Inc.
    18. John M. Abowd & Ian M. Schmutte & Lars Vilhuber, 2018. "Disclosure Limitation and Confidentiality Protection in Linked Data," Working Papers 18-07, Center for Economic Studies, U.S. Census Bureau.
    19. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.

    More about this item

    Keywords

    Privacy; Big data; Consent; Economics;
    All these keywords.

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:235:y:2023:i:2:p:2285-2294. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.