IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/26631.html
   My bibliography  Save this paper

Transparency in Structural Research

Author

Listed:
  • Isaiah Andrews
  • Matthew Gentzkow
  • Jesse M. Shapiro

Abstract

We propose a formal definition of transparency in empirical research and apply it to structural estimation in economics. We discuss how some existing practices can be understood as attempts to improve transparency, and we suggest ways to improve current practice, emphasizing approaches that impose a minimal computational burden on the researcher. We illustrate with examples.

Suggested Citation

  • Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Transparency in Structural Research," NBER Working Papers 26631, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:26631
    Note: IO TWP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w26631.pdf
    Download Restriction: Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html. Free access is also available to older working papers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    2. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    3. Keith Head & Thierry Mayer, 2019. "Brands in Motion: How Frictions Shape Multinational Production," American Economic Review, American Economic Association, vol. 109(9), pages 3073-3124, September.
    4. Gregory S. Crawford & Robin S. Lee & Michael D. Whinston & Ali Yurukoglu, 2018. "The Welfare Effects of Vertical Integration in Multichannel Television Markets," Econometrica, Econometric Society, vol. 86(3), pages 891-954, May.
    5. David Autor & Andreas Kostøl & Magne Mogstad & Bradley Setzler, 2019. "Disability Benefits, Consumption Insurance, and Household Labor Supply," American Economic Review, American Economic Association, vol. 109(7), pages 2613-2654, July.
    6. Stefano DellaVigna & John A. List & Ulrike Malmendier, 2012. "Testing for Altruism and Social Pressure in Charitable Giving," The Quarterly Journal of Economics, Oxford University Press, vol. 127(1), pages 1-56.
    7. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    8. Cl'ement de Chaisemartin & Xavier D'Haultf{oe}uille, 2018. "Two-way fixed effects estimators with heterogeneous treatment effects," Papers 1803.08807, arXiv.org, revised Mar 2020.
    9. Patrick Kline & Andres Santos, 2013. "Sensitivity to missing data assumptions: Theory and an evaluation of the U.S. wage structure," Quantitative Economics, Econometric Society, vol. 4(2), pages 231-267, July.
    10. repec:hrv:faseco:34728615 is not listed on IDEAS
    11. Hunt Allcott & Rebecca Diamond & Jean-Pierre Dubé & Jessie Handbury & Ilya Rahkovsky & Molly Schnell, 2019. "Food Deserts and the Causes of Nutritional Inequality," The Quarterly Journal of Economics, Oxford University Press, vol. 134(4), pages 1793-1844.
    12. Nathaniel Hendren, 2013. "Private Information and Insurance Rejections," Econometrica, Econometric Society, vol. 81(5), pages 1713-1762, September.
    13. Zvi Eckstein & Michael Keane & Osnat Lifshitz, 2019. "Career and Family Decisions: Cohorts Born 1935–1975," Econometrica, Econometric Society, vol. 87(1), pages 217-253, January.
    14. Pierre-Olivier Gourinchas & Jonathan A. Parker, 2002. "Consumption Over the Life Cycle," Econometrica, Econometric Society, vol. 70(1), pages 47-89, January.
    15. Chao Fu & Jesse Gregory, 2019. "Estimation of an Equilibrium Model With Externalities: Post‐Disaster Neighborhood Rebuilding," Econometrica, Econometric Society, vol. 87(2), pages 387-421, March.
    16. Boris Nikolov & Toni M. Whited, 2014. "Agency Conflicts and Cash: Estimates from a Dynamic Model," Journal of Finance, American Finance Association, vol. 69(5), pages 1883-1921, October.
    17. Horowitz, Joel L & Manski, Charles F, 1995. "Identification and Robustness with Contaminated and Corrupted Data," Econometrica, Econometric Society, vol. 63(2), pages 281-302, March.
    18. Ronald L. Goettler & Brett R. Gordon, 2011. "Does AMD Spur Intel to Innovate More?," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1141-1200.
    19. Pierre‐André Chiappori & Bernard Salanié & François Salanié & Amit Gandhi, 2019. "From Aggregate Betting Data to Individual Risk Preferences," Econometrica, Econometric Society, vol. 87(1), pages 1-36, January.
    20. Orazio P. Attanasio & Costas Meghir & Ana Santiago, 2012. "Education Choices in Mexico: Using a Structural Model and a Randomized Experiment to Evaluate PROGRESA," Review of Economic Studies, Oxford University Press, vol. 79(1), pages 37-66.
    21. Mariacristina De Nardi & Eric French & John B. Jones, 2010. "Why Do the Elderly Save? The Role of Medical Expenses," Journal of Political Economy, University of Chicago Press, vol. 118(1), pages 39-75, February.
    22. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    23. Sumit Agarwal & Souphala Chomsisengphet & Neale Mahoney & Johannes Stroebel, 2018. "Do Banks Pass through Credit Expansions to Consumers Who want to Borrow?," The Quarterly Journal of Economics, Oxford University Press, vol. 133(1), pages 129-190.
    24. Joel M. David & Venky Venkateswaran, 2019. "The Sources of Capital Misallocation," American Economic Review, American Economic Association, vol. 109(7), pages 2531-2567, July.
    25. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, Oxford University Press, vol. 132(4), pages 1553-1592.
    26. Dridi, Ramdan & Guay, Alain & Renault, Eric, 2007. "Indirect inference and calibration of dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 136(2), pages 397-430, February.
    27. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    28. Maria Polyakova, 2016. "Regulation of Insurance with Adverse Selection and Switching Costs: Evidence from Medicare Part D," American Economic Journal: Applied Economics, American Economic Association, vol. 8(3), pages 165-195, July.
    29. Stefano DellaVigna, 2018. "Structural Behavioral Economics," NBER Working Papers 24797, National Bureau of Economic Research, Inc.
    30. Peter Harasztosi & Attila Lindner, 2019. "Who Pays for the Minimum Wage?," American Economic Review, American Economic Association, vol. 109(8), pages 2693-2727, August.
    31. Matthew Gentzkow & Jesse M. Shapiro & Michael Sinkinson, 2014. "Competition and Ideological Diversity: Historical Evidence from US Newspapers," American Economic Review, American Economic Association, vol. 104(10), pages 3073-3114, October.
    32. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    33. Andrew B. Bernard & Andreas Moxnes & Yukiko U. Saito, 2019. "Production Networks, Geography, and Firm Performance," Journal of Political Economy, University of Chicago Press, vol. 127(2), pages 639-688.
    34. Daniel K. Fetter & Lee M. Lockwood, 2018. "Government Old-Age Support and Labor Supply: Evidence from the Old Age Assistance Program," American Economic Review, American Economic Association, vol. 108(8), pages 2174-2211, August.
    35. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2019. "A Distributional Framework for Matched Employer Employee Data," Econometrica, Econometric Society, vol. 87(3), pages 699-739, May.
    36. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    37. Timothy B. Armstrong & Michal Kolesár, 2018. "Sensitivity Analysis using Approximate Moment Condition Models," Cowles Foundation Discussion Papers 2158R, Cowles Foundation for Research in Economics, Yale University, revised Feb 2019.
    38. Martin B. Hackmann, 2019. "Incentivizing Better Quality of Care: The Role of Medicaid and Competition in the Nursing Home Industry," American Economic Review, American Economic Association, vol. 109(5), pages 1684-1716, May.
    39. Rosa L. Matzkin, 2013. "Nonparametric Identification in Structural Economic Models," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 457-486, May.
    40. Athey, Susan & Imbens, Guido W., 2018. "Design-based Analysis in Difference-In-Differences Settings with Staggered Adoption," Research Papers 3712, Stanford University, Graduate School of Business.
    41. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    42. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    43. Timothy B. Armstrong & Michal Koles'ar, 2018. "Sensitivity Analysis using Approximate Moment Condition Models," Papers 1808.07387, arXiv.org, revised Jul 2020.
    44. Nikhil Agarwal & Paulo Somaini, 2018. "Demand Analysis Using Strategic Reports: An Application to a School Choice Mechanism," Econometrica, Econometric Society, vol. 86(2), pages 391-444, March.
    45. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    46. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    47. Leamer, Edward E, 1981. "Sets of Estimates of Location," Econometrica, Econometric Society, vol. 49(1), pages 193-204, January.
    48. Emi Nakamura & Jón Steinsson, 2018. "Identification in Macroeconomics," Journal of Economic Perspectives, American Economic Association, vol. 32(3), pages 59-86, Summer.
    49. repec:feb:framed:0087 is not listed on IDEAS
    50. Guillaume R. Fréchette & Alessandro Lizzeri & Tobias Salz, 2019. "Frictions in a Competitive, Regulated Market: Evidence from Taxis," American Economic Review, American Economic Association, vol. 109(8), pages 2954-2992, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Reply to: Comments on “On the Informativeness of Descriptive Statistics for Structural Estimates”," Econometrica, Econometric Society, vol. 88(6), pages 2277-2279, November.
    2. Isaiah Andrews & Jesse M. Shapiro, 2020. "A Model of Scientific Communication," NBER Working Papers 26824, National Bureau of Economic Research, Inc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    2. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, Oxford University Press, vol. 132(4), pages 1553-1592.
    3. Jorge Rodriguez, 2017. "Understanding the Effects of Income and Child Care Subsidies on Children's Academic Achievement," 2017 Papers pro1077, Job Market Papers.
    4. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    5. Iaria, Alessandro & WANG, Ao, 2020. "Identification and Estimation of Demand for Bundles," CEPR Discussion Papers 14363, C.E.P.R. Discussion Papers.
    6. Friberg, Richard & Romahn, André, 2015. "Divestiture requirements as a tool for competition policy: A case from the Swedish beer market," International Journal of Industrial Organization, Elsevier, vol. 42(C), pages 1-18.
    7. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust decision-making under risk and ambiguity," Papers 2104.12573, arXiv.org.
    8. Mariacristina De Nardi & Eric French & John Bailey Jones, 2016. "Savings After Retirement: A Survey," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 177-204, October.
    9. Rösner, Anja & Haucap, Justus & Heimeshoff, Ulrich, 2020. "The impact of consumer protection in the digital age: Evidence from the European Union," International Journal of Industrial Organization, Elsevier, vol. 73(C).
    10. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    11. Jungbin Hwang & Byunghoon Kang & Seojeong Lee, 2019. "A Doubly Corrected Robust Variance Estimator for Linear GMM," Papers 1908.07821, arXiv.org, revised May 2020.
    12. Amitabh Chandra & Courtney Coile & Corina Mommaerts, 2020. "What Can Economics Say About Alzheimer's Disease?," NBER Working Papers 27760, National Bureau of Economic Research, Inc.
    13. Dagsvik, John K., 2018. "Invariance axioms and functional form restrictions in structural models," Mathematical Social Sciences, Elsevier, vol. 91(C), pages 85-95.
    14. Manuel Arellano & Stéphane Bonhomme, 2017. "Nonlinear Panel Data Methods for Dynamic Heterogeneous Agent Models," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 471-496, September.
    15. David I. Stern, 2011. "From Correlation to Granger Causality," Crawford School Research Papers 1113, Crawford School of Public Policy, The Australian National University.
    16. Eric French & John Bailey Jones & Elaine Kelly & Jeremy McCauley, 2018. "End-of-Life Medical Expenses," Working Paper 18-18, Federal Reserve Bank of Richmond.
    17. Jiaming Mao & Jingzhi Xu, 2020. "Ensemble Learning with Statistical and Structural Models," Papers 2006.05308, arXiv.org.
    18. Thoresen, Thor O. & Vattø, Trine E., 2015. "Validation of the discrete choice labor supply model by methods of the new tax responsiveness literature," Labour Economics, Elsevier, vol. 37(C), pages 38-53.
    19. Javier Donna & Andre Trindade & Pedro Pereira & Tiago Pires, 2018. "Measuring the Welfare of Intermediation in Vertical Markets," 2018 Meeting Papers 984, Society for Economic Dynamics.
    20. de Bresser, Jochem, 2019. "The Role of Heterogeneous Expectations in Life Cycle Models : Evaluating the Accuracy of Counterfactuals," Other publications TiSEM 25d04a47-1020-47eb-ba94-4, Tilburg University, School of Economics and Management.

    More about this item

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:26631. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.