IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v65y2023i6d10.1007_s00181-023-02441-7.html
   My bibliography  Save this article

When to use matching and weighting or regression in instrumental variable estimation? Evidence from college proximity and returns to college

Author

Listed:
  • Stefan Tübbicke

    (Institute for Employment Research (IAB))

Abstract

Standard two-stage least squares (2SLS) regression remains dominant in instrumental variables estimation of causal effects even though the literature has shown that 2SLS may be inconsistent when effects are heterogenous and the instrument is only valid when conditioning on covariates. To show that this is not merely a hypothetical threat, this paper re-estimates the returns to college using college proximity as an instrument based on the data from Card (Aspects of labour market behavior: essays in honour of John Vanderkamp, University of Toronto Press, Toronto, 1995). The results show that 2SLS yields systematically larger estimates of the returns to college than more flexible estimators based on the instrument propensity score. In the full sample, differences amount to about 50 to 100%. This is due to the implicit conditional-variance weighting performed by 2SLS. Moreover, in line with the theoretical prediction by Sloczynski (When should we (not) interpret linear IV estimands as LATE? IZA discussion papers 14349, Institute of Labor Economics (IZA), 2021), findings suggest that the impact of the conditional-variance weighting is larger when instrument groups are not roughly the same size. Thus, it is advised to use 2SLS with caution and use estimators based on the instrument propensity score instead when groups are of different size and covariates are predictive of the instrument.

Suggested Citation

  • Stefan Tübbicke, 2023. "When to use matching and weighting or regression in instrumental variable estimation? Evidence from college proximity and returns to college," Empirical Economics, Springer, vol. 65(6), pages 2979-2999, December.
  • Handle: RePEc:spr:empeco:v:65:y:2023:i:6:d:10.1007_s00181-023-02441-7
    DOI: 10.1007/s00181-023-02441-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-023-02441-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-023-02441-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Heiler, Phillip & Kazak, Ekaterina, 2021. "Valid inference for treatment effect parameters under irregular identification and many extreme propensity scores," Journal of Econometrics, Elsevier, vol. 222(2), pages 1083-1108.
    2. Sasaki, Yuya & Ura, Takuya, 2022. "Estimation And Inference For Moments Of Ratios With Robustness Against Large Trimming Bias," Econometric Theory, Cambridge University Press, vol. 38(1), pages 66-112, February.
    3. Markus Frlich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
    4. Matias Busso & John DiNardo & Justin McCrary, 2014. "New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 885-897, December.
    5. Thomas MaCurdy & Xiaohong Chen & Han Hong, 2011. "Flexible Estimation of Treatment Effect Parameters," American Economic Review, American Economic Association, vol. 101(3), pages 544-551, May.
    6. Ismael Mourifié & Yuanyuan Wan, 2017. "Testing Local Average Treatment Effect Assumptions," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 305-313, May.
    7. Tymon Sloczynski, 2021. "When Should We (Not) Interpret Linear IV Estimands as LATE?," CESifo Working Paper Series 9064, CESifo.
    8. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    9. Frolich, Markus, 2007. "Nonparametric IV estimation of local average treatment effects with covariates," Journal of Econometrics, Elsevier, vol. 139(1), pages 35-75, July.
    10. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    11. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    12. Tymon Słoczyński & S. Derya Uysal & Jeffrey M. Wooldridge, 2025. "Abadie’s Kappa and Weighting Estimators of the Local Average Treatment Effect," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 43(1), pages 164-177, January.
    13. Tan, Zhiqiang, 2006. "Regression and Weighting Methods for Causal Inference Using Instrumental Variables," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1607-1618, December.
    14. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    15. Sloczynski, Tymon & Uysal, Derya & Wooldridge, Jeffrey M., 2022. "Abadie's Kappa and Weighting Estimators of the Local Average Treatment Effect," IZA Discussion Papers 15241, Institute of Labor Economics (IZA).
    16. Jonathan Smith & Joshua Goodman & Michael Hurwitz, 2020. "The Economic Impact of Access to Public Four-Year Colleges," NBER Working Papers 27177, National Bureau of Economic Research, Inc.
    17. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    18. Seth D. Zimmerman, 2014. "The Returns to College Admission for Academically Marginal Students," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 711-754.
    19. Martin E Andresen & Martin Huber, 2021. "Instrument-based estimation with binarised treatments: issues and tests for the exclusion restriction," The Econometrics Journal, Royal Economic Society, vol. 24(3), pages 536-558.
    20. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    21. repec:adr:anecst:y:2008:i:91-92:p:10 is not listed on IDEAS
    22. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    23. Blackburn, McKinley L & Neumark, David, 1993. "Omitted-Ability Bias and the Increase in the Return to Schooling," Journal of Labor Economics, University of Chicago Press, vol. 11(3), pages 521-544, July.
    24. Donald, Stephen G. & Hsu, Yu-Chin & Lieli, Robert P., 2014. "Inverse probability weighted estimation of local average treatment effects: A higher order MSE expansion," Statistics & Probability Letters, Elsevier, vol. 95(C), pages 132-138.
    25. Jose C. Galdo & Jeffrey Smith & Dan Black, 2008. "Bandwidth Selection and the Estimation of Treatment Effects with Unbalanced Data," Annals of Economics and Statistics, GENES, issue 91-92, pages 189-216.
    26. Mark Hoekstra, 2009. "The Effect of Attending the Flagship State University on Earnings: A Discontinuity-Based Approach," The Review of Economics and Statistics, MIT Press, vol. 91(4), pages 717-724, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tymon Słoczyński & S. Derya Uysal & Jeffrey M. Wooldridge, 2025. "Abadie’s Kappa and Weighting Estimators of the Local Average Treatment Effect," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 43(1), pages 164-177, January.
    2. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    3. Sloczynski, Tymon & Uysal, Derya & Wooldridge, Jeffrey M., 2022. "Abadie's Kappa and Weighting Estimators of the Local Average Treatment Effect," IZA Discussion Papers 15241, Institute of Labor Economics (IZA).
    4. Hans Fricke & Markus Frölich & Martin Huber & Michael Lechner, 2020. "Endogeneity and non‐response bias in treatment evaluation – nonparametric identification of causal effects by instruments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 481-504, August.
    5. Michael C. Knaus, 2024. "Treatment Effect Estimators as Weighted Outcomes," Papers 2411.11559, arXiv.org, revised Dec 2024.
    6. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    7. Markus Frölich & Martin Huber, 2017. "Direct and indirect treatment effects–causal chains and mediation analysis with instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1645-1666, November.
    8. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    9. Hugo Bodory & Martin Huber & Michael Lechner, 2024. "The Finite Sample Performance of Instrumental Variable-Based Estimators of the Local Average Treatment Effect When Controlling for Covariates," Computational Economics, Springer;Society for Computational Economics, vol. 64(4), pages 2053-2078, October.
    10. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    11. Jan Priebe, 2020. "Quasi-experimental evidence for the causal link between fertility and subjective well-being," Journal of Population Economics, Springer;European Society for Population Economics, vol. 33(3), pages 839-882, July.
    12. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    13. Sloczynski, Tymon, 2021. "When Should We (Not) Interpret Linear IV Estimands as LATE?," IZA Discussion Papers 14349, Institute of Labor Economics (IZA).
    14. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    15. Phillip Heiler, 2022. "Efficient Covariate Balancing for the Local Average Treatment Effect," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1569-1582, October.
    16. Nadja van 't Hoff, 2023. "Identifying Causal Effects of Discrete, Ordered and ContinuousTreatments using Multiple Instrumental Variables," Papers 2311.17575, arXiv.org, revised Oct 2024.
    17. Schmieder, Julia, 2021. "Fertility as a driver of maternal employment," Labour Economics, Elsevier, vol. 72(C).
    18. Yinchu Zhu, 2021. "Phase transition of the monotonicity assumption in learning local average treatment effects," Papers 2103.13369, arXiv.org.
    19. Marco Caliendo & Stefan Tübbicke, 2020. "New evidence on long-term effects of start-up subsidies: matching estimates and their robustness," Empirical Economics, Springer, vol. 59(4), pages 1605-1631, October.
    20. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.

    More about this item

    Keywords

    Instrumental variables; Semi- and nonparametric methods; Returns to education;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:65:y:2023:i:6:d:10.1007_s00181-023-02441-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.