IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/26631.html
   My bibliography  Save this paper

Transparency in Structural Research

Author

Listed:
  • Isaiah Andrews
  • Matthew Gentzkow
  • Jesse M. Shapiro

Abstract

We propose a formal definition of transparency in empirical research and apply it to structural estimation in economics. We discuss how some existing practices can be understood as attempts to improve transparency, and we suggest ways to improve current practice, emphasizing approaches that impose a minimal computational burden on the researcher. We illustrate with examples.

Suggested Citation

  • Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Transparency in Structural Research," NBER Working Papers 26631, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:26631
    Note: IO TWP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w26631.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    2. Keith Head & Thierry Mayer, 2019. "Brands in Motion: How Frictions Shape Multinational Production," American Economic Review, American Economic Association, vol. 109(9), pages 3073-3124, September.
    3. Gregory S. Crawford & Robin S. Lee & Michael D. Whinston & Ali Yurukoglu, 2018. "The Welfare Effects of Vertical Integration in Multichannel Television Markets," Econometrica, Econometric Society, vol. 86(3), pages 891-954, May.
    4. Stefano DellaVigna & John A. List & Ulrike Malmendier, 2012. "Testing for Altruism and Social Pressure in Charitable Giving," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 1-56.
    5. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    6. Patrick Kline & Andres Santos, 2013. "Sensitivity to missing data assumptions: Theory and an evaluation of the U.S. wage structure," Quantitative Economics, Econometric Society, vol. 4(2), pages 231-267, July.
    7. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    8. Zvi Eckstein & Michael Keane & Osnat Lifshitz, 2019. "Career and Family Decisions: Cohorts Born 1935–1975," Econometrica, Econometric Society, vol. 87(1), pages 217-253, January.
    9. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    10. Boris Nikolov & Toni M. Whited, 2014. "Agency Conflicts and Cash: Estimates from a Dynamic Model," Journal of Finance, American Finance Association, vol. 69(5), pages 1883-1921, October.
    11. Horowitz, Joel L & Manski, Charles F, 1995. "Identification and Robustness with Contaminated and Corrupted Data," Econometrica, Econometric Society, vol. 63(2), pages 281-302, March.
    12. Mariacristina De Nardi & Eric French & John B. Jones, 2010. "Why Do the Elderly Save? The Role of Medical Expenses," Journal of Political Economy, University of Chicago Press, vol. 118(1), pages 39-75, February.
    13. Joel M. David & Venky Venkateswaran, 2019. "The Sources of Capital Misallocation," American Economic Review, American Economic Association, vol. 109(7), pages 2531-2567, July.
    14. Peter Harasztosi & Attila Lindner, 2019. "Who Pays for the Minimum Wage?," American Economic Review, American Economic Association, vol. 109(8), pages 2693-2727, August.
    15. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    16. Andrew B. Bernard & Andreas Moxnes & Yukiko U. Saito, 2019. "Production Networks, Geography, and Firm Performance," Journal of Political Economy, University of Chicago Press, vol. 127(2), pages 639-688.
    17. Daniel K. Fetter & Lee M. Lockwood, 2018. "Government Old-Age Support and Labor Supply: Evidence from the Old Age Assistance Program," American Economic Review, American Economic Association, vol. 108(8), pages 2174-2211, August.
    18. Ronald L. Goettler & Brett R. Gordon, 2011. "Does AMD Spur Intel to Innovate More?," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1141-1200.
    19. Orazio P. Attanasio & Costas Meghir & Ana Santiago, 2012. "Education Choices in Mexico: Using a Structural Model and a Randomized Experiment to Evaluate PROGRESA," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(1), pages 37-66.
    20. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2019. "A Distributional Framework for Matched Employer Employee Data," Econometrica, Econometric Society, vol. 87(3), pages 699-739, May.
    21. Pierre‐André Chiappori & Bernard Salanié & François Salanié & Amit Gandhi, 2019. "From Aggregate Betting Data to Individual Risk Preferences," Econometrica, Econometric Society, vol. 87(1), pages 1-36, January.
    22. Emi Nakamura & Jón Steinsson, 2018. "Identification in Macroeconomics," Journal of Economic Perspectives, American Economic Association, vol. 32(3), pages 59-86, Summer.
    23. Nathaniel Hendren, 2013. "Private Information and Insurance Rejections," Econometrica, Econometric Society, vol. 81(5), pages 1713-1762, September.
    24. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    25. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    26. Sumit Agarwal & Souphala Chomsisengphet & Neale Mahoney & Johannes Stroebel, 2018. "Do Banks Pass through Credit Expansions to Consumers Who want to Borrow?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 129-190.
    27. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    28. repec:feb:framed:0087 is not listed on IDEAS
    29. Matthew Gentzkow & Jesse M. Shapiro & Michael Sinkinson, 2014. "Competition and Ideological Diversity: Historical Evidence from US Newspapers," American Economic Review, American Economic Association, vol. 104(10), pages 3073-3114, October.
    30. Guillaume R. Fréchette & Alessandro Lizzeri & Tobias Salz, 2019. "Frictions in a Competitive, Regulated Market: Evidence from Taxis," American Economic Review, American Economic Association, vol. 109(8), pages 2954-2992, August.
    31. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    32. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    33. David Autor & Andreas Kostøl & Magne Mogstad & Bradley Setzler, 2019. "Disability Benefits, Consumption Insurance, and Household Labor Supply," American Economic Review, American Economic Association, vol. 109(7), pages 2613-2654, July.
    34. Hunt Allcott & Rebecca Diamond & Jean-Pierre Dubé & Jessie Handbury & Ilya Rahkovsky & Molly Schnell, 2019. "Food Deserts and the Causes of Nutritional Inequality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 1793-1844.
    35. Pierre-Olivier Gourinchas & Jonathan A. Parker, 2002. "Consumption Over the Life Cycle," Econometrica, Econometric Society, vol. 70(1), pages 47-89, January.
    36. Chao Fu & Jesse Gregory, 2019. "Estimation of an Equilibrium Model With Externalities: Post‐Disaster Neighborhood Rebuilding," Econometrica, Econometric Society, vol. 87(2), pages 387-421, March.
    37. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    38. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    39. Dridi, Ramdan & Guay, Alain & Renault, Eric, 2007. "Indirect inference and calibration of dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 136(2), pages 397-430, February.
    40. repec:hal:spmain:info:hdl:2441/mlkvtnbqe9pg8nsvf612mcnbs is not listed on IDEAS
    41. Maria Polyakova, 2016. "Regulation of Insurance with Adverse Selection and Switching Costs: Evidence from Medicare Part D," American Economic Journal: Applied Economics, American Economic Association, vol. 8(3), pages 165-195, July.
    42. Stefano DellaVigna, 2018. "Structural Behavioral Economics," NBER Working Papers 24797, National Bureau of Economic Research, Inc.
    43. Martin B. Hackmann, 2019. "Incentivizing Better Quality of Care: The Role of Medicaid and Competition in the Nursing Home Industry," American Economic Review, American Economic Association, vol. 109(5), pages 1684-1716, May.
    44. Rosa L. Matzkin, 2013. "Nonparametric Identification in Structural Economic Models," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 457-486, May.
    45. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    46. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    47. Nikhil Agarwal & Paulo Somaini, 2018. "Demand Analysis Using Strategic Reports: An Application to a School Choice Mechanism," Econometrica, Econometric Society, vol. 86(2), pages 391-444, March.
    48. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    49. Leamer, Edward E, 1981. "Sets of Estimates of Location," Econometrica, Econometric Society, vol. 49(1), pages 193-204, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christina Korting & Carl Lieberman & Jordan Matsudaira & Zhuan Pei & Yi Shen, 2023. "Visual Inference and Graphical Representation in Regression Discontinuity Designs," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(3), pages 1977-2019.
    2. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Reply to: Comments on “On the Informativeness of Descriptive Statistics for Structural Estimates”," Econometrica, Econometric Society, vol. 88(6), pages 2277-2279, November.
    3. Victor Duarte & Diogo Duarte & Dejanir H. Silva, 2024. "Machine Learning for Continuous-Time Finance," CESifo Working Paper Series 10909, CESifo.
    4. Isaiah Andrews & Jesse M. Shapiro, 2021. "A Model of Scientific Communication," Econometrica, Econometric Society, vol. 89(5), pages 2117-2142, September.
    5. Marco Stenborg Petterson & David Seim & Jesse M. Shapiro, 2023. "Bounds on a Slope from Size Restrictions on Economic Shocks," American Economic Journal: Microeconomics, American Economic Association, vol. 15(3), pages 552-572, August.
    6. Roberto Dell’Anno, 2023. "Measuring the unobservable: estimating informal economy by a structural equation modeling approach," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 30(1), pages 247-277, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Working Papers 2020-06, Brown University, Department of Economics.
    2. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    3. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    4. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    5. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    6. Nicolai V. Kuminoff & V. Kerry Smith & Christopher Timmins, 2010. "The New Economics of Equilibrium Sorting and its Transformational Role for Policy Evaluation," NBER Working Papers 16349, National Bureau of Economic Research, Inc.
    7. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Isaiah Andrews & Jesse M. Shapiro, 2021. "A Model of Scientific Communication," Econometrica, Econometric Society, vol. 89(5), pages 2117-2142, September.
    9. Nathan Canen & Kristopher Ramsay, 2023. "Quantifying Theory in Politics: Identification, Interpretation and the Role of Structural Methods," Papers 2302.01897, arXiv.org.
    10. Thomas H. Jørgensen, 2023. "Sensitivity to Calibrated Parameters," The Review of Economics and Statistics, MIT Press, vol. 105(2), pages 474-481, March.
    11. Vitor Possebom, 2021. "Crime and Mismeasured Punishment: Marginal Treatment Effect with Misclassification," Papers 2106.00536, arXiv.org, revised Jul 2023.
    12. Jorge Rodriguez, 2017. "Understanding the Effects of Income and Child Care Subsidies on Children's Academic Achievement," 2017 Papers pro1077, Job Market Papers.
    13. de Bresser, Jochem, 2021. "Evaluating the Accuracy of Counterfactuals The Role of Heterogeneous Expectations in Life Cycle Models," Other publications TiSEM a7e2b4d8-fed0-4e86-926f-d, Tilburg University, School of Economics and Management.
    14. Gizem Koşar & Cormac O'Dea, 2022. "Expectations Data in Structural Microeconomic Models," NBER Working Papers 30094, National Bureau of Economic Research, Inc.
    15. de Bresser, Jochem, 2021. "Evaluating the Accuracy of Counterfactuals The Role of Heterogeneous Expectations in Life Cycle Models," Discussion Paper 2021-034, Tilburg University, Center for Economic Research.
    16. Sung Jae Jun & Sokbae Lee, 2023. "Identifying the Effect of Persuasion," Journal of Political Economy, University of Chicago Press, vol. 131(8), pages 2032-2058.
    17. Tetyana Balyuk, 2023. "FinTech Lending and Bank Credit Access for Consumers," Management Science, INFORMS, vol. 69(1), pages 555-575, January.
    18. Toni M. Whited, 2022. "Integrating Structural and Reduced-Form Methods in Empirical Finance," Papers 2205.01175, arXiv.org.
    19. Iaria, Alessandro & ,, 2020. "Identification and Estimation of Demand for Bundles," CEPR Discussion Papers 14363, C.E.P.R. Discussion Papers.
    20. Hiroaki Kaido & Jiaxuan Li & Marc Rysman, 2018. "Moment Inequalities in the Context of Simulated and Predicted Variables," Papers 1804.03674, arXiv.org.

    More about this item

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:26631. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.