IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/9708.html
   My bibliography  Save this paper

Treatment Effect Heterogeneity in Theory and Practice

Author

Listed:
  • Joshua D. Angrist

Abstract

Instrumental Variables (IV) methods identify internally valid causal effects for individuals whose treatment status is manipulable by the instrument at hand. Inference for other populations requires some sort of homogeneity assumption. This paper outlines a theoretical framework that nests all possible homogeneity assumptions for a causal treatment-effects model with a binary instrument. The framework suggests strategies for using IV estimates for extrapolation, while making it clear that efforts to go from local average treatment effects (LATE) to population average treatment effects are inherently speculative. These ideas are illustrated in an application using sibling-sex composition to estimate the effect of child-bearing on economic and marital outcomes for mothers with two or more children. The application is motivated by welfare reform, which penalizes further childbearing by welfare mothers on the grounds that more children make continued poverty and welfare receipt more likely. The empirical results generally support the notion of reduced labor supply and increased poverty rates as a consequence of additional childbearing, but evidence on the impact of childbearing on marital stability and welfare use is more tenuous. Another interesting finding is that for the sample of teen mothers, LATE is essentially equal to the population average treatment effect.

Suggested Citation

  • Joshua D. Angrist, 2003. "Treatment Effect Heterogeneity in Theory and Practice," NBER Working Papers 9708, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:9708
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w9708.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    2. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    3. Howard S. Bloom, 1984. "Accounting for No-Shows in Experimental Evaluation Designs," Evaluation Review, , vol. 8(2), pages 225-246, April.
    4. Wooldridge, Jeffrey M., 2003. "Further results on instrumental variables estimation of average treatment effects in the correlated random coefficient model," Economics Letters, Elsevier, vol. 79(2), pages 185-191, May.
    5. Arellano, Manuel, 2002. "Sargan's Instrumental Variables Estimation and the Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 450-459, October.
    6. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    7. Angrist, J.D. & Imbens, G.W., 1991. "Sources of Identifying Information in Evaluation Models," Harvard Institute of Economic Research Working Papers 1568, Harvard - Institute of Economic Research.
    8. Angrist, Joshua D, 2001. "Estimations of Limited Dependent Variable Models with Dummy Endogenous Regressors: Simple Strategies for Empirical Practice," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 2-16, January.
    9. Becker, Gary S & Landes, Elisabeth M & Michael, Robert T, 1977. "An Economic Analysis of Marital Instability," Journal of Political Economy, University of Chicago Press, vol. 85(6), pages 1141-1187, December.
    10. Melissa Schettini Kearney, 2004. "Is There an Effect of Incremental Welfare Benefits on Fertility Behavior?: A Look at the Family Cap," Journal of Human Resources, University of Wisconsin Press, vol. 39(2).
    11. Jeff Grogger & Stephen G. Bronars, 2001. "The Effect of Welfare Payments on the Marriage and Fertility Behavior of Unwed Mothers: Results from a Twins Experiment," Journal of Political Economy, University of Chicago Press, vol. 109(3), pages 529-545, June.
    12. Frolich, Markus, 2007. "Nonparametric IV estimation of local average treatment effects with covariates," Journal of Econometrics, Elsevier, vol. 139(1), pages 35-75, July.
    13. V. Joseph Hotz & Guido W. Imbens & Jacob A. Klerman, 2000. "The Long-Term Gains from GAIN: A Re-Analysis of the Impacts of the California GAIN Program," NBER Working Papers 8007, National Bureau of Economic Research, Inc.
    14. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    15. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    16. Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-318, May.
    17. James J. Heckman & Edward J. Vytlacil, 2000. "Local Instrumental Variables," NBER Technical Working Papers 0252, National Bureau of Economic Research, Inc.
    18. Moffitt, Robert A., 1999. "New developments in econometric methods for labor market analysis," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 24, pages 1367-1397, Elsevier.
    19. Andrew Cherlin, 1977. "The effect of children on marital dissolution," Demography, Springer;Population Association of America (PAA), vol. 14(3), pages 265-272, August.
    20. Bronars, Stephen G & Grogger, Jeff, 1994. "The Economic Consequences of Unwed Motherhood: Using Twin Births as a Natural Experiment," American Economic Review, American Economic Association, vol. 84(5), pages 1141-1156, December.
    21. Phillips, Peter C.B., 2003. "Vision And Influence In Econometrics: John Denis Sargan," Econometric Theory, Cambridge University Press, vol. 19(3), pages 495-511, June.
    22. Angrist, Joshua D & Evans, William N, 1998. "Children and Their Parents' Labor Supply: Evidence from Exogenous Variation in Family Size," American Economic Review, American Economic Association, vol. 88(3), pages 450-477, June.
    23. Chamberlain, Gary, 1986. "Asymptotic efficiency in semi-parametric models with censoring," Journal of Econometrics, Elsevier, vol. 32(2), pages 189-218, July.
    24. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    25. Rebecca M. Blank, 2002. "Evaluating Welfare Reform in the United States," Journal of Economic Literature, American Economic Association, vol. 40(4), pages 1105-1166, December.
    26. James Heckman & Justin L. Tobias & Edward Vytlacil, 2001. "Four Parameters of Interest in the Evaluation of Social Programs," Southern Economic Journal, Southern Economic Association, vol. 68(2), pages 210-223, October.
    27. Joshua D. Angrist, 1991. "Instrumental Variables Estimation of Average Treatment Effects in Econometrics and Epidemiology," NBER Technical Working Papers 0115, National Bureau of Economic Research, Inc.
    28. Wooldridge, Jeffrey M., 1997. "On two stage least squares estimation of the average treatment effect in a random coefficient model," Economics Letters, Elsevier, vol. 56(2), pages 129-133, October.
    29. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    30. Tim Heaton, 1990. "Marital stability throughout the child-rearing years," Demography, Springer;Population Association of America (PAA), vol. 27(1), pages 55-63, February.
    31. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    32. J.D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    3. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    4. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    5. Guillermo Cruces & Sebastian Galiani, 2003. "Generalizing the Causal Effect of Fertility on Female Labor Supply," Labor and Demography 0310002, University Library of Munich, Germany.
    6. Aassve, Arnstein & Arpino, Bruno, 2008. "Estimation of causal effects of fertility on economic wellbeing: evidence from rural Vietnam," ISER Working Paper Series 2007-27, Institute for Social and Economic Research.
    7. Markus Frölich & Martin Huber, 2017. "Direct and indirect treatment effects–causal chains and mediation analysis with instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1645-1666, November.
    8. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    9. Cockx, Bart & Bardoulat, Isabelle, 1999. "Vocational Training: Does it speed up the Transition Rate out of Unemployment ?," LIDAM Discussion Papers IRES 1999032, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    10. Mingliang Li & Dale J. Poirier & Justin L. Tobias, 2004. "Do dropouts suffer from dropping out? Estimation and prediction of outcome gains in generalized selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(2), pages 203-225.
    11. Bryan S. Graham & James Powell, 2008. "Identification and Estimation of 'Irregular' Correlated Random Coefficient Models," NBER Working Papers 14469, National Bureau of Economic Research, Inc.
    12. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    13. David S. Lee, 2002. "Trimming for Bounds on Treatment Effects with Missing Outcomes," NBER Technical Working Papers 0277, National Bureau of Economic Research, Inc.
    14. Hidehiko Ichimura & Christopher R. Taber, 2000. "Direct Estimation of Policy Impacts," NBER Technical Working Papers 0254, National Bureau of Economic Research, Inc.
    15. Yu-Chin Hsu & Ta-Cheng Huang & Haiqing Xu, 2018. "Testing for unobserved heterogeneous treatment effects in a nonseparable model with endogenous selection," Papers 1803.07514, arXiv.org.
    16. Huber, Martin & Mellace, Giovanni, 2012. "Relaxing monotonicity in the identification of local average treatment effects," Economics Working Paper Series 1212, University of St. Gallen, School of Economics and Political Science.
    17. Chernozhukov, Victor & Hansen, Christian, 2006. "Instrumental quantile regression inference for structural and treatment effect models," Journal of Econometrics, Elsevier, vol. 132(2), pages 491-525, June.
    18. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    19. Elizabeth O. Ananat & Guy Michaels, 2008. "The Effect of Marital Breakup on the Income Distribution of Women with Children," Journal of Human Resources, University of Wisconsin Press, vol. 43(3), pages 611-629.
    20. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.

    More about this item

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • J12 - Labor and Demographic Economics - - Demographic Economics - - - Marriage; Marital Dissolution; Family Structure

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:9708. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.