IDEAS home Printed from https://ideas.repec.org/a/wly/emetrp/v91y2023i1p263-298.html
   My bibliography  Save this article

Counterfactual Sensitivity and Robustness

Author

Listed:
  • Timothy Christensen
  • Benjamin Connault

Abstract

We propose a framework for analyzing the sensitivity of counterfactuals to parametric assumptions about the distribution of latent variables in structural models. In particular, we derive bounds on counterfactuals as the distribution of latent variables spans nonparametric neighborhoods of a given parametric specification while other “structural” features of the model are maintained. Our approach recasts the infinite‐dimensional problem of optimizing the counterfactual with respect to the distribution of latent variables (subject to model constraints) as a finite‐dimensional convex program. We also develop an MPEC version of our method to further simplify computation in models with endogenous parameters (e.g., value functions) defined by equilibrium constraints. We propose plug‐in estimators of the bounds and two methods for inference. We also show that our bounds converge to the sharp nonparametric bounds on counterfactuals as the neighborhood size becomes large. To illustrate the broad applicability of our procedure, we present empirical applications to matching models with transferable utility and dynamic discrete choice models.

Suggested Citation

  • Timothy Christensen & Benjamin Connault, 2023. "Counterfactual Sensitivity and Robustness," Econometrica, Econometric Society, vol. 91(1), pages 263-298, January.
  • Handle: RePEc:wly:emetrp:v:91:y:2023:i:1:p:263-298
    DOI: 10.3982/ECTA17232
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/ECTA17232
    Download Restriction: no

    File URL: https://libkey.io/10.3982/ECTA17232?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    2. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    3. Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, September.
    4. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    5. Dagsvik, John K, 2000. "Aggregation in Matching Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(1), pages 27-57, February.
    6. Steven T. Berry & Philip A. Haile, 2014. "Identification in Differentiated Products Markets Using Market Level Data," Econometrica, Econometric Society, vol. 82(5), pages 1749-1797, September.
    7. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Reply to: Comments on “On the Informativeness of Descriptive Statistics for Structural Estimates”," Econometrica, Econometric Society, vol. 88(6), pages 2277-2279, November.
    8. Che‐Lin Su & Kenneth L. Judd, 2012. "Constrained Optimization Approaches to Estimation of Structural Models," Econometrica, Econometric Society, vol. 80(5), pages 2213-2230, September.
    9. Paul L. E. Grieco, 2014. "Discrete games with flexible information structures: an application to local grocery markets," RAND Journal of Economics, RAND Corporation, vol. 45(2), pages 303-340, June.
    10. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    11. Susanne M. Schennach, 2014. "Entropic Latent Variable Integration via Simulation," Econometrica, Econometric Society, vol. 82(1), pages 345-385, January.
    12. repec:hal:spmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4ao8ocg is not listed on IDEAS
    13. Berry, Steven T, 1992. "Estimation of a Model of Entry in the Airline Industry," Econometrica, Econometric Society, vol. 60(4), pages 889-917, July.
    14. Ivar Ekeland & Alfred Galichon & Marc Henry, 2010. "Optimal transportation and the falsifiability of incompletely specified economic models," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(2), pages 355-374, February.
    15. Cristina Gualdani & Shruti Sinha, 2019. "Partial Identification in Matching Models for the Marriage Market," Papers 1902.05610, arXiv.org, revised Jul 2022.
    16. Myrto Kalouptsidi & Yuichi Kitamura & Lucas Lima & Eduardo Souza-Rodrigues, 2020. "Partial Identification and Inference for Dynamic Models and Counterfactuals," Working Papers tecipa-655, University of Toronto, Department of Economics.
    17. Pierre-André Chiappori & Bernard Salanié & Yoram Weiss, 2017. "Partner Choice, Investment in Children, and the Marital College Premium," American Economic Review, American Economic Association, vol. 107(8), pages 2109-2167, August.
    18. Myrto Kalouptsidi & Yuichi Kitamura & Lucas Lima & Eduardo Souza-Rodrigues, 2020. "Partial Identification and Inference for Dynamic Models and Counterfactuals," Cowles Foundation Discussion Papers 2221, Cowles Foundation for Research in Economics, Yale University.
    19. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    20. Alfred Galichon & Marc Henry, 2011. "Set Identification in Models with Multiple Equilibria," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(4), pages 1264-1298.
    21. Kalouptsidi, Myrto & Kitamura, Yuichi & Souza-Rodrigues, Eduardo & Lima, Lucas, 2020. "Partial Identification and Inference for Dynamic Models and Counterfactuals," CEPR Discussion Papers 14402, C.E.P.R. Discussion Papers.
    22. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    23. Yaroslav Mukhin, 2018. "Sensitivity of Regular Estimators," Papers 1805.08883, arXiv.org.
    24. Zheng Fang & Andres Santos, 2019. "Inference on Directionally Differentiable Functions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 377-412.
    25. Xiaohong Chen & Timothy M. Christensen & Elie Tamer, 2018. "Monte Carlo Confidence Sets for Identified Sets," Econometrica, Econometric Society, vol. 86(6), pages 1965-2018, November.
    26. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4ao8ocg is not listed on IDEAS
    27. Elie Tamer, 2003. "Incomplete Simultaneous Discrete Response Model with Multiple Equilibria," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(1), pages 147-165.
    28. Fabio Maccheroni & Massimo Marinacci & Aldo Rustichini, 2006. "Ambiguity Aversion, Robustness, and the Variational Representation of Preferences," Econometrica, Econometric Society, vol. 74(6), pages 1447-1498, November.
    29. Yuichi Kitamura & Taisuke Otsu & Kirill Evdokimov, 2013. "Robustness, Infinitesimal Neighborhoods, and Moment Restrictions," Econometrica, Econometric Society, vol. 81(3), pages 1185-1201, May.
    30. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    31. Charles F. Manski, 2014. "Identification of income–leisure preferences and evaluation of income tax policy," Quantitative Economics, Econometric Society, vol. 5, pages 145-174, March.
    32. Raffaella Giacomini & Toru Kitagawa & Harald Uhlig, 2019. "Estimation Under Ambiguity," CeMMAP working papers CWP24/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    33. Myrto Kalouptsidi & Yuichi Kitamura & Lucas Lima & Eduardo A. Souza-Rodrigues, 2020. "Partial Identification and Inference for Dynamic Models and Counterfactuals," NBER Working Papers 26761, National Bureau of Economic Research, Inc.
    34. Myrto Kalouptsidi & Yuichi Kitamura & Lucas Lima & Eduardo Souza-Rodrigues, 2020. "Partial Identi?cation and Inference for Dynamic Models and Counterfactuals," CeMMAP working papers CWP6/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    35. Komunjer, Ivana & Ragusa, Giuseppe, 2016. "Existence And Characterization Of Conditional Density Projections," Econometric Theory, Cambridge University Press, vol. 32(4), pages 947-987, August.
    36. Leamer, Edward E, 1985. "Sensitivity Analyses Would Help," American Economic Review, American Economic Association, vol. 75(3), pages 308-313, June.
    37. Ivar Ekeland & Alfred Galichon & Marc Henry, 2010. "Optimal transportation and the falsifiability of incompletely specified economic models," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(2), pages 355-374, February.
    38. Bresnahan, Timothy F. & Reiss, Peter C., 1991. "Empirical models of discrete games," Journal of Econometrics, Elsevier, vol. 48(1-2), pages 57-81.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Philipp Eisenhauer & Lena Janys & Christopher Walsh & Janós Gabler, 2023. "Structural Models for Policy-Making," CRC TR 224 Discussion Paper Series crctr224_2023_484, University of Bonn and University of Mannheim, Germany.
    2. David Muller & Emerson Melo & Ruben Schlotter, 2023. "A Distributionally Robust Random Utility Model," Papers 2303.05888, arXiv.org.
    3. Maximilian Blesch & Philipp Eisenhauer, 2023. "Robust Decision-Making under Risk and Ambiguity," Rationality and Competition Discussion Paper Series 463, CRC TRR 190 Rationality and Competition.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven T Berry & Giovanni Compiani, 2023. "An Instrumental Variable Approach to Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(4), pages 1724-1758.
    2. Victor Aguirregabiria & Allan Collard-Wexler & Stephen P. Ryan, 2021. "Dynamic Games in Empirical Industrial Organization," NBER Working Papers 29291, National Bureau of Economic Research, Inc.
    3. Paul S. Koh, 2022. "Estimating Discrete Games of Complete Information: Bringing Logit Back in the Game," Papers 2205.05002, arXiv.org, revised Jun 2022.
    4. Jun, Sung Jae & Pinkse, Joris, 2020. "Counterfactual prediction in complete information games: Point prediction under partial identification," Journal of Econometrics, Elsevier, vol. 216(2), pages 394-429.
    5. Alexander Torgovitsky, 2019. "Partial identification by extending subdistributions," Quantitative Economics, Econometric Society, vol. 10(1), pages 105-144, January.
    6. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    7. Christian Bontemps & Raquel Menezes Bezerra Sampaio, 2020. "Entry games for the airline industry," Post-Print hal-02137358, HAL.
    8. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Ho, Kate & Rosen, Adam M., 2015. "Partial Identification in Applied Research: Benefits and Challenges," CEPR Discussion Papers 10883, C.E.P.R. Discussion Papers.
    10. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    11. Aradillas-López, Andrés & Rosen, Adam M., 2022. "Inference in ordered response games with complete information," Journal of Econometrics, Elsevier, vol. 226(2), pages 451-476.
    12. Bontemps, Christian & Kumar, Rohit, 2020. "A geometric approach to inference in set-identified entry games," Journal of Econometrics, Elsevier, vol. 218(2), pages 373-389.
    13. Shuowen Chen & Hiroaki Kaido, 2022. "Robust Tests of Model Incompleteness in the Presence of Nuisance Parameters," Papers 2208.11281, arXiv.org, revised Sep 2023.
    14. Sasaki, Yuya & Takahashi, Yuya & Xin, Yi & Hu, Yingyao, 2023. "Dynamic discrete choice models with incomplete data: Sharp identification," Journal of Econometrics, Elsevier, vol. 236(1).
    15. Thomas M. Russell, 2020. "Policy Transforms and Learning Optimal Policies," Papers 2012.11046, arXiv.org.
    16. Jeremy T. Fox, 2018. "Estimating matching games with transfers," Quantitative Economics, Econometric Society, vol. 9(1), pages 1-38, March.
    17. Raffaella Giacomini & Toru Kitagawa & Harald Uhlig, 2019. "Estimation Under Ambiguity," CeMMAP working papers CWP24/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Victor Aguirregabiria & Victor Aguirregabiria & Aviv Nevo & Aviv Nevo, 2010. "Recent Developments in Empirical IO: Dynamic Demand and Dynamic Games," Working Papers tecipa-419, University of Toronto, Department of Economics.
    19. Paul B. Ellickson & Sanjog Misra, 2011. "Structural Workshop Paper --Estimating Discrete Games," Marketing Science, INFORMS, vol. 30(6), pages 997-1010, November.
    20. Maximilian Blesch & Philipp Eisenhauer, 2023. "Robust Decision-Making under Risk and Ambiguity," Rationality and Competition Discussion Paper Series 463, CRC TRR 190 Rationality and Competition.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:emetrp:v:91:y:2023:i:1:p:263-298. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.