IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2020-34.html
   My bibliography  Save this paper

Decomposing Identification Gains and Evaluating Instrument Identification Power for Partially Identified Average Treatment Effects

Author

Listed:
  • Lina Zhang
  • David T. Frazier
  • Don S. Poskitt
  • Xueyan Zhao

Abstract

This paper studies the instrument identification power for the average treatment effect (ATE) in partially identified binary outcome models with an endogenous binary treatment. We propose a novel approach to measure the instrument identification power by their ability to reduce the width of the ATE bounds. We show that instrument strength, as determined by the extreme values of the conditional propensity score, and its interplays with the degree of endogeneity and the exogenous covariates all play a role in bounding the ATE. We decompose the ATE identification gains into a sequence of measurable components, and construct a standardized quantitative measure for the instrument identification power (IIP). The decomposition and the IIP evaluation are illustrated with finite-sample simulation studies and an empirical example of childbearing and women's labor supply. Our simulations show that the IIP is a useful tool for detecting irrelevant instruments.

Suggested Citation

  • Lina Zhang & David T. Frazier & Don S. Poskitt & Xueyan Zhao, 2020. "Decomposing Identification Gains and Evaluating Instrument Identification Power for Partially Identified Average Treatment Effects," Monash Econometrics and Business Statistics Working Papers 34/20, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2020-34
    as

    Download full text from publisher

    File URL: https://www.monash.edu/business/ebs/research/publications/ebs/wp34-2020.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    2. Mourifié, Ismael, 2015. "Sharp bounds on treatment effects in a binary triangular system," Journal of Econometrics, Elsevier, vol. 187(1), pages 74-81.
    3. Mourifié, Ismael & Méango, Romuald, 2014. "A note on the identification in two equations probit model with dummy endogenous regressor," Economics Letters, Elsevier, vol. 125(3), pages 360-363.
    4. Sukjin Han & Sungwon Lee, 2019. "Estimation in a generalization of bivariate probit models with dummy endogenous regressors," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(6), pages 994-1015, September.
    5. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    6. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    7. Charles F. Manski & Elie Tamer, 2002. "Inference on Regressions with Interval Data on a Regressor or Outcome," Econometrica, Econometric Society, vol. 70(2), pages 519-546, March.
    8. Nathan Nunn & Nancy Qian, 2014. "US Food Aid and Civil Conflict," American Economic Review, American Economic Association, vol. 104(6), pages 1630-1666, June.
    9. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    10. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    11. Maddala,G. S., 1986. "Limited-Dependent and Qualitative Variables in Econometrics," Cambridge Books, Cambridge University Press, number 9780521338257.
    12. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    13. Machado, Cecilia & Shaikh, Azeem M. & Vytlacil, Edward J., 2019. "Instrumental variables and the sign of the average treatment effect," Journal of Econometrics, Elsevier, vol. 212(2), pages 522-555.
    14. Takuya Ura, 2018. "Heterogeneous treatment effects with mismeasured endogenous treatment," Quantitative Economics, Econometric Society, vol. 9(3), pages 1335-1370, November.
    15. Azeem M. Shaikh & Edward J. Vytlacil, 2011. "Partial Identification in Triangular Systems of Equations With Binary Dependent Variables," Econometrica, Econometric Society, vol. 79(3), pages 949-955, May.
    16. Heckman, James J, 1978. "Dummy Endogenous Variables in a Simultaneous Equation System," Econometrica, Econometric Society, vol. 46(4), pages 931-959, July.
    17. Nava Ashraf & Erica Field & Jean Lee, 2014. "Household Bargaining and Excess Fertility: An Experimental Study in Zambia," American Economic Review, American Economic Association, vol. 104(7), pages 2210-2237, July.
    18. Anirban Basu & James J. Heckman & Salvador Navarro‐Lozano & Sergio Urzua, 2007. "Use of instrumental variables in the presence of heterogeneity and self‐selection: an application to treatments of breast cancer patients," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1133-1157, November.
    19. Francesca Molinari, 2020. "Microeconometrics with Partial Identification," Papers 2004.11751, arXiv.org.
    20. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    21. Andrew Chesher, 2005. "Nonparametric Identification under Discrete Variation," Econometrica, Econometric Society, vol. 73(5), pages 1525-1550, September.
    22. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    23. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    24. David T. Frazier & Eric Renault & Lina Zhang & Xueyan Zhao, 2020. "Weak Identification in Discrete Choice Models," Papers 2011.06753, arXiv.org, revised Jan 2021.
    25. Hansen, Lars Peter & Heaton, John & Luttmer, Erzo G J, 1995. "Econometric Evaluation of Asset Pricing Models," Review of Financial Studies, Society for Financial Studies, vol. 8(2), pages 237-274.
    26. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    27. Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-318, May.
    28. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    29. Andrew Chesher & Adam Rosen, 2020. "Econometric Modeling of Interdependent Discrete Choice with Applications to Market Structure," CeMMAP working papers CWP25/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    30. Chiburis, Richard C., 2010. "Semiparametric bounds on treatment effects," Journal of Econometrics, Elsevier, vol. 159(2), pages 267-275, December.
    31. Toru Kitagawa, 2009. "Identification region of the potential outcome distributions under instrument independence," CeMMAP working papers CWP30/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    32. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    33. Li, Chuhui & Poskitt, D.S. & Zhao, Xueyan, 2019. "The bivariate probit model, maximum likelihood estimation, pseudo true parameters and partial identification," Journal of Econometrics, Elsevier, vol. 209(1), pages 94-113.
    34. Breusch, Trevor & Qian, Hailong & Schmidt, Peter & Wyhowski, Donald, 1999. "Redundancy of moment conditions," Journal of Econometrics, Elsevier, vol. 91(1), pages 89-111, July.
    35. Angrist, Joshua D & Evans, William N, 1998. "Children and Their Parents' Labor Supply: Evidence from Exogenous Variation in Family Size," American Economic Review, American Economic Association, vol. 88(3), pages 450-477, June.
    36. Sonja A. Swanson & Miguel A. Hernán & Matthew Miller & James M. Robins & Thomas S. Richardson, 2018. "Partial Identification of the Average Treatment Effect Using Instrumental Variables: Review of Methods for Binary Instruments, Treatments, and Outcomes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 933-947, April.
    37. Alastair R. Hall & Fernanda P. M. Peixe, 2003. "A Consistent Method for the Selection of Relevant Instruments," Econometric Reviews, Taylor & Francis Journals, vol. 22(3), pages 269-287, January.
    38. Ahn, Hyungtaik & Powell, James L., 1993. "Semiparametric estimation of censored selection models with a nonparametric selection mechanism," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 3-29, July.
    39. Anirban Basu & James J. Heckman & Salvador Navarro-Lozano & Sergio Urzua, 2007. "Use of instrumental variables in the presence of heterogeneity and self-selection: an application to treatments of breast cancer patients," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1133-1157.
    40. Andrew Chesher, 2010. "Instrumental Variable Models for Discrete Outcomes," Econometrica, Econometric Society, vol. 78(2), pages 575-601, March.
    41. Carlos A. Flores & Xuan Chen, 2018. "Average Treatment Effect Bounds with an Instrumental Variable: Theory and Practice," Springer Books, Springer, number 978-981-13-2017-0, November.
    42. Neal, Derek, 1997. "The Effects of Catholic Secondary Schooling on Educational Achievement," Journal of Labor Economics, University of Chicago Press, vol. 15(1), pages 98-123, January.
    43. Wilde, Joachim, 2000. "Identification of multiple equation probit models with endogenous dummy regressors," Economics Letters, Elsevier, vol. 69(3), pages 309-312, December.
    44. Jay Bhattacharya & Azeem M. Shaikh & Edward Vytlacil, 2008. "Treatment Effect Bounds under Monotonicity Assumptions: An Application to Swan-Ganz Catheterization," American Economic Review, American Economic Association, vol. 98(2), pages 351-356, May.
    45. Sukjin Han & Shenshen Yang, 2020. "A Computational Approach to Identification of Treatment Effects for Policy Evaluation," Papers 2009.13861, arXiv.org, revised Aug 2023.
    46. Azeem Shaikh & Edward Vytlacil, 2005. "Threshold Crossing Models and Bounds on Treatment Effects: A Nonparametric Analysis," NBER Technical Working Papers 0307, National Bureau of Economic Research, Inc.
    47. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    48. Aakvik, Arild & Heckman, James J. & Vytlacil, Edward J., 2005. "Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 15-51.
    49. Bhattacharya, Jay & Shaikh, Azeem M. & Vytlacil, Edward, 2012. "Treatment effect bounds: An application to Swan–Ganz catheterization," Journal of Econometrics, Elsevier, vol. 168(2), pages 223-243.
    50. Edward Vytlacil & Nese Yildiz, 2007. "Dummy Endogenous Variables in Weakly Separable Models," Econometrica, Econometric Society, vol. 75(3), pages 757-779, May.
    51. repec:wly:soecon:v:82:4:y:2016:p:1106-1122 is not listed on IDEAS
    52. Anirban Basu & James J. Heckman & Salvador Navarro-Lozano & Sergio Urzua, 2007. "Use of instrumental variables in the presence of heterogeneity and self-selection: An application in breast cancer patients," Health, Econometrics and Data Group (HEDG) Working Papers 07/07, HEDG, c/o Department of Economics, University of York.
    53. Hall, Alastair R. & Inoue, Atsushi & Jana, Kalidas & Shin, Changmock, 2007. "Information in generalized method of moments estimation and entropy-based moment selection," Journal of Econometrics, Elsevier, vol. 138(2), pages 488-512, June.
    54. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    55. Han, Sukjin & Vytlacil, Edward J., 2017. "Identification in a generalization of bivariate probit models with dummy endogenous regressors," Journal of Econometrics, Elsevier, vol. 199(1), pages 63-73.
    56. Joshua Angrist & Ivan Fernandez-Val, 2010. "ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework," NBER Working Papers 16566, National Bureau of Economic Research, Inc.
    57. Rebecca L. Thornton, 2008. "The Demand for, and Impact of, Learning HIV Status," American Economic Review, American Economic Association, vol. 98(5), pages 1829-1863, December.
    58. Freedman, David A. & Sekhon, Jasjeet S., 2010. "Endogeneity in Probit Response Models," Political Analysis, Cambridge University Press, vol. 18(2), pages 138-150, April.
    59. Quang Vuong & Haiqing Xu, 2017. "Counterfactual mapping and individual treatment effects in nonseparable models with binary endogeneity," Quantitative Economics, Econometric Society, vol. 8(2), pages 589-610, July.
    60. Edward Vytlacil, 2002. "Independence, Monotonicity, and Latent Index Models: An Equivalence Result," Econometrica, Econometric Society, vol. 70(1), pages 331-341, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kitagawa, Toru, 2021. "The identification region of the potential outcome distributions under instrument independence," Journal of Econometrics, Elsevier, vol. 225(2), pages 231-253.
    2. Chen, Xuan & Flores, Carlos A. & Flores-Lagunes, Alfonso, 2015. "Going Beyond LATE: Bounding Average Treatment Effects of Job Corps Training," IZA Discussion Papers 9511, Institute of Labor Economics (IZA).
    3. Chiburis, Richard C., 2010. "Semiparametric bounds on treatment effects," Journal of Econometrics, Elsevier, vol. 159(2), pages 267-275, December.
    4. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Bhattacharya, Jay & Shaikh, Azeem M. & Vytlacil, Edward, 2012. "Treatment effect bounds: An application to Swan–Ganz catheterization," Journal of Econometrics, Elsevier, vol. 168(2), pages 223-243.
    6. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    7. Possebom, Vitor, 2018. "Sharp bounds on the MTE with sample selection," MPRA Paper 89785, University Library of Munich, Germany.
    8. Gu, Jiaying & Russell, Thomas M., 2023. "Partial identification in nonseparable binary response models with endogenous regressors," Journal of Econometrics, Elsevier, vol. 235(2), pages 528-562.
    9. Matthew A. Masten & Alexandre Poirier, 2021. "Salvaging Falsified Instrumental Variable Models," Econometrica, Econometric Society, vol. 89(3), pages 1449-1469, May.
    10. Alexander Torgovitsky, 2019. "Partial identification by extending subdistributions," Quantitative Economics, Econometric Society, vol. 10(1), pages 105-144, January.
    11. Donald S. Poskitt & Xueyan Zhao, 2023. "Bootstrap Hausdorff Confidence Regions for Average Treatment Effect Identified Sets," Monash Econometrics and Business Statistics Working Papers 9/23, Monash University, Department of Econometrics and Business Statistics.
    12. Wooyoung Kim & Koohyun Kwon & Soonwoo Kwon & Sokbae Lee, 2018. "The identification power of smoothness assumptions in models with counterfactual outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 617-642, July.
    13. Magne Mogstad & Andres Santos & Alexander Torgovitsky, 2018. "Using Instrumental Variables for Inference About Policy Relevant Treatment Parameters," Econometrica, Econometric Society, vol. 86(5), pages 1589-1619, September.
    14. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    15. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    16. Santiago Acerenza & Otávio Bartalotti & Désiré Kédagni, 2023. "Testing identifying assumptions in bivariate probit models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 407-422, April.
    17. Lukáš Lafférs, 2019. "Identification in Models with Discrete Variables," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 657-696, February.
    18. Wooyoung Kim & Koohyun Kwon & Soonwoo Kwon & Sokbae (Simon) Lee, 2014. "The identification power of smoothness assumptions in models with counterfactual outcomes," CeMMAP working papers 17/14, Institute for Fiscal Studies.
    19. Balat, Jorge F. & Han, Sukjin, 2023. "Multiple treatments with strategic substitutes," Journal of Econometrics, Elsevier, vol. 234(2), pages 732-757.
    20. Li, Chuhui & Poskitt, D.S. & Zhao, Xueyan, 2019. "The bivariate probit model, maximum likelihood estimation, pseudo true parameters and partial identification," Journal of Econometrics, Elsevier, vol. 209(1), pages 94-113.

    More about this item

    Keywords

    binary dependent variables; average treatment effect; instrument identification power; instrument relevance; endogeneity; partial identification;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions
    • C36 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Instrumental Variables (IV) Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2020-34. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.