IDEAS home Printed from https://ideas.repec.org/a/wly/japmet/v36y2021i4p416-436.html
   My bibliography  Save this article

Counterfactual analysis under partial identification using locally robust refinement

Author

Listed:
  • Nathan Canen
  • Kyungchul Song

Abstract

Structural models that admit multiple reduced forms, such as game‐theoretic models with multiple equilibria, pose challenges in practice, especially when parameters are set identified and the identified set is large. In such cases, researchers often choose to focus on a particular subset of equilibria for counterfactual analysis, but this choice can be hard to justify. This paper shows that some parameter values can be more “desirable” than others for counterfactual analysis, even if they are empirically equivalent given the data. In particular, within the identified set, some counterfactual predictions can exhibit more robustness than others against local perturbations of the reduced forms (e.g., the equilibrium selection rule). We provide a representation of this subset, which can be used to simplify the implementation. We illustrate our message using moment inequality models and provide an empirical application based on a model with top coded data.

Suggested Citation

  • Nathan Canen & Kyungchul Song, 2021. "Counterfactual analysis under partial identification using locally robust refinement," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(4), pages 416-436, June.
  • Handle: RePEc:wly:japmet:v:36:y:2021:i:4:p:416-436
    DOI: 10.1002/jae.2819
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/jae.2819
    Download Restriction: no

    File URL: https://libkey.io/10.1002/jae.2819?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
    2. Victor Aguirregabiria & Victor Aguirregabiria & Aviv Nevo & Aviv Nevo, 2010. "Recent Developments in Empirical IO: Dynamic Demand and Dynamic Games," Working Papers tecipa-419, University of Toronto, Department of Economics.
    3. Aviv Nevo & Adam M. Rosen, 2012. "Identification With Imperfect Instruments," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 659-671, August.
    4. Richard W. Blundell & James L. Powell, 2004. "Endogeneity in Semiparametric Binary Response Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 71(3), pages 655-679.
    5. James J. Heckman & John Eric Humphries & Gregory Veramendi, 2018. "Returns to Education: The Causal Effects of Education on Earnings, Health, and Smoking," Journal of Political Economy, University of Chicago Press, vol. 126(S1), pages 197-246.
    6. Gaurab Aryal & Dong-Hyuk Kim, 2013. "A Point Decision for Partially Identified Auction Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(4), pages 384-397, October.
    7. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    8. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    9. Matthew A. Masten & Alexandre Poirier, 2018. "Identification of Treatment Effects Under Conditional Partial Independence," Econometrica, Econometric Society, vol. 86(1), pages 317-351, January.
    10. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    11. Daniel A. Ackerberg & Gautam Gowrisankaran, 2006. "Quantifying equilibrium network externalities in the ACH banking industry," RAND Journal of Economics, RAND Corporation, vol. 37(3), pages 738-761, September.
    12. Drew Fudenberg & David M. Kreps & David K. Levine, 2008. "On the Robustness of Equilibrium Refinements," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 5, pages 67-93, World Scientific Publishing Co. Pte. Ltd..
    13. repec:cwl:cwldpp:1840rr is not listed on IDEAS
    14. Elie Tamer, 2003. "Incomplete Simultaneous Discrete Response Model with Multiple Equilibria," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(1), pages 147-165.
    15. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    16. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    17. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    18. Daniel Ackerberg & Gautam Gowrisankaran, 2006. "Quantifying Equilibrium Network Externalities in the ACH Banking Industry," RAND Journal of Economics, The RAND Corporation, vol. 37(3), pages 738-761, Autumn.
    19. James W. Roberts & Andrew Sweeting, 2013. "When Should Sellers Use Auctions?," American Economic Review, American Economic Association, vol. 103(5), pages 1830-1861, August.
    20. Andrews, Donald W.K. & Shi, Xiaoxia, 2014. "Nonparametric inference based on conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 179(1), pages 31-45.
    21. Philip A. Haile & Elie Tamer, 2003. "Inference with an Incomplete Model of English Auctions," Journal of Political Economy, University of Chicago Press, vol. 111(1), pages 1-51, February.
    22. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    23. Bresnahan, Timothy F. & Reiss, Peter C., 1991. "Empirical models of discrete games," Journal of Econometrics, Elsevier, vol. 48(1-2), pages 57-81.
    24. Song, Kyungchul, 2014. "Point Decisions For Interval–Identified Parameters," Econometric Theory, Cambridge University Press, vol. 30(2), pages 334-356, April.
    25. Lars Peter Hansen & Thomas J Sargent, 2014. "Robust Control and Model Uncertainty," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 5, pages 145-154, World Scientific Publishing Co. Pte. Ltd..
    26. Charles F. Manski & Elie Tamer, 2002. "Inference on Regressions with Interval Data on a Regressor or Outcome," Econometrica, Econometric Society, vol. 70(2), pages 519-546, March.
    27. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Reply to: Comments on “On the Informativeness of Descriptive Statistics for Structural Estimates”," Econometrica, Econometric Society, vol. 88(6), pages 2277-2279, November.
    28. Hansen, Bruce E., 2005. "Challenges For Econometric Model Selection," Econometric Theory, Cambridge University Press, vol. 21(1), pages 60-68, February.
    29. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    30. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    31. Philip Oreopoulos & Uros Petronijevic, 2013. "Making College Worth It: A Review of Research on the Returns to Higher Education," NBER Working Papers 19053, National Bureau of Economic Research, Inc.
    32. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    33. Lisa Barrow & Cecilia Elena Rouse, 2005. "Do Returns to Schooling Differ by Race and Ethnicity?," American Economic Review, American Economic Association, vol. 95(2), pages 83-87, May.
    34. Alon Eizenberg, 2014. "Upstream Innovation and Product Variety in the U.S. Home PC Market," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1003-1045.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shuowen Chen & Hiroaki Kaido, 2022. "Robust Tests of Model Incompleteness in the Presence of Nuisance Parameters," Papers 2208.11281, arXiv.org, revised Sep 2023.
    2. Ho, Kate & Rosen, Adam M., 2015. "Partial Identification in Applied Research: Benefits and Challenges," CEPR Discussion Papers 10883, C.E.P.R. Discussion Papers.
    3. Larry G. Epstein & Hiroaki Kaido & Kyoungwon Seo, 2016. "Robust Confidence Regions for Incomplete Models," Econometrica, Econometric Society, vol. 84, pages 1799-1838, September.
    4. Magnac, Thierry, 2013. "Identification partielle : méthodes et conséquences pour les applications empiriques," L'Actualité Economique, Société Canadienne de Science Economique, vol. 89(4), pages 233-258, Décembre.
    5. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    6. Bontemps, Christian & Kumar, Rohit, 2020. "A geometric approach to inference in set-identified entry games," Journal of Econometrics, Elsevier, vol. 218(2), pages 373-389.
    7. Tsunao Okumura & Emiko Usui, 2014. "Concave‐monotone treatment response and monotone treatment selection: With an application to the returns to schooling," Quantitative Economics, Econometric Society, vol. 5, pages 175-194, March.
    8. Shi, Xiaoxia, 2015. "Model selection tests for moment inequality models," Journal of Econometrics, Elsevier, vol. 187(1), pages 1-17.
    9. Francesca Molinari, 2020. "Microeconometrics with Partial Identification," Papers 2004.11751, arXiv.org.
    10. Isaiah Andrews & Jonathan Roth & Ariel Pakes, 2023. "Inference for Linear Conditional Moment Inequalities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(6), pages 2763-2791.
    11. Christian Bontemps & Rohit Kumar, 2019. "A Geometric Approach to Inference in Set-Identified Entry Games," Working Papers hal-02137356, HAL.
    12. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Kojevnikov, Denis & Song, Kyungchul, 2023. "Econometric inference on a large Bayesian game with heterogeneous beliefs," Journal of Econometrics, Elsevier, vol. 237(1).
    14. Christian Bontemps & Raquel Menezes Bezerra Sampaio, 2020. "Entry games for the airline industry," Post-Print hal-02137358, HAL.
    15. Yuan Liao & Anna Simoni, 2012. "Semi-parametric Bayesian Partially Identified Models based on Support Function," Papers 1212.3267, arXiv.org, revised Nov 2013.
    16. Aradillas-López, Andrés & Rosen, Adam M., 2022. "Inference in ordered response games with complete information," Journal of Econometrics, Elsevier, vol. 226(2), pages 451-476.
    17. repec:cwl:cwldpp:1761rr is not listed on IDEAS
    18. Lee, Sokbae & Song, Kyungchul & Whang, Yoon-Jae, 2018. "Testing For A General Class Of Functional Inequalities," Econometric Theory, Cambridge University Press, vol. 34(5), pages 1018-1064, October.
    19. Thomas M. Russell, 2020. "Policy Transforms and Learning Optimal Policies," Papers 2012.11046, arXiv.org.
    20. Victor Chernozhukov & Whitney K. Newey & Andres Santos, 2023. "Constrained Conditional Moment Restriction Models," Econometrica, Econometric Society, vol. 91(2), pages 709-736, March.
    21. Andrew Chesher & Adam Rosen, 2018. "Generalized instrumental variable models, methods, and applications," CeMMAP working papers CWP43/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:japmet:v:36:y:2021:i:4:p:416-436. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.