IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22363.html
   My bibliography  Save this paper

Doing More When You're Running LATE: Applying Marginal Treatment Effect Methods to Examine Treatment Effect Heterogeneity in Experiments

Author

Listed:
  • Amanda E. Kowalski

Abstract

I examine treatment effect heterogeneity within an experiment to inform external validity. The local average treatment effect (LATE) gives an average treatment effect for compliers. I bound and estimate average treatment effects for always takers and never takers by extending marginal treatment effect methods. I use these methods to separate selection from treatment effect heterogeneity, generalizing the comparison of OLS to LATE. Applying these methods to the Oregon Health Insurance Experiment, I find that the treatment effect of insurance on emergency room utilization decreases from always takers to compliers to never takers. Previous utilization explains a large share of the treatment effect heterogeneity. Extrapolations show that other expansions could increase or decrease utilization.

Suggested Citation

  • Amanda E. Kowalski, 2016. "Doing More When You're Running LATE: Applying Marginal Treatment Effect Methods to Examine Treatment Effect Heterogeneity in Experiments," NBER Working Papers 22363, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22363
    Note: AG EH LS PE TWP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22363.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part II: Using the Marginal Treatment Effect to Organize Alternative Econometric Estimators to Evaluate Social Programs, and to Forecast their Effects in New," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 71, Elsevier.
    2. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    3. Liran Einav & Amy Finkelstein & Stephen P. Ryan & Paul Schrimpf & Mark R. Cullen, 2013. "Selection on Moral Hazard in Health Insurance," American Economic Review, American Economic Association, vol. 103(1), pages 178-219, February.
    4. Chernozhukov, Victor & Fernández-Val, Iván & Kowalski, Amanda E., 2015. "Quantile regression with censoring and endogeneity," Journal of Econometrics, Elsevier, vol. 186(1), pages 201-221.
    5. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    6. Marinho Bertanha & Guido W. Imbens, 2020. "External Validity in Fuzzy Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 593-612, July.
    7. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    8. Kolstad, Jonathan T. & Kowalski, Amanda E., 2012. "The impact of health care reform on hospital and preventive care: Evidence from Massachusetts," Journal of Public Economics, Elsevier, vol. 96(11), pages 909-929.
    9. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    10. Amy Finkelstein & James Poterba, 2014. "Testing for Asymmetric Information Using “Unused Observables” in Insurance Markets: Evidence from the U.K. Annuity Market," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 81(4), pages 709-734, December.
    11. Joshua D. Angrist, 2004. "Treatment effect heterogeneity in theory and practice," Economic Journal, Royal Economic Society, vol. 114(494), pages 52-83, March.
    12. Martin B. Hackmann & Jonathan T. Kolstad & Amanda E. Kowalski, 2015. "Adverse Selection and an Individual Mandate: When Theory Meets Practice," American Economic Review, American Economic Association, vol. 105(3), pages 1030-1066, March.
    13. Liran Einav & Amy Finkelstein & Mark R. Cullen, 2010. "Estimating Welfare in Insurance Markets Using Variation in Prices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 877-921.
    14. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    15. Sylvain Chassang & Gerard Padro I Miquel & Erik Snowberg, 2012. "Selective Trials: A Principal-Agent Approach to Randomized Controlled Experiments," American Economic Review, American Economic Association, vol. 102(4), pages 1279-1309, June.
    16. Michael Anderson & Carlos Dobkin & Tal Gross, 2012. "The Effect of Health Insurance Coverage on the Use of Medical Services," American Economic Journal: Economic Policy, American Economic Association, vol. 4(1), pages 1-27, February.
    17. Amanda Kowalski, 2016. "Censored Quantile Instrumental Variable Estimates of the Price Elasticity of Expenditure on Medical Care," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(1), pages 107-117, January.
    18. Miller, Sarah, 2012. "The effect of insurance on emergency room visits: An analysis of the 2006 Massachusetts health reform," Journal of Public Economics, Elsevier, vol. 96(11), pages 893-908.
    19. Pierre-Andre Chiappori & Bernard Salanie, 2000. "Testing for Asymmetric Information in Insurance Markets," Journal of Political Economy, University of Chicago Press, vol. 108(1), pages 56-78, February.
    20. Lawrence F. Katz & Jeffrey R. Kling & Jeffrey B. Liebman, 2001. "Moving to Opportunity in Boston: Early Results of a Randomized Mobility Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 607-654.
    21. Martin Huber & Giovanni Mellace, 2010. "Sharp IV bounds on average treatment effects under endogeneity and noncompliance," University of St. Gallen Department of Economics working paper series 2010 2010-31, Department of Economics, University of St. Gallen.
    22. Michael L. Anderson & Carlos Dobkin & Tal Gross, 2014. "The Effect of Health Insurance on Emergency Department Visits: Evidence from an Age-Based Eligibility Threshold," The Review of Economics and Statistics, MIT Press, vol. 96(1), pages 189-195, March.
    23. Donald B. Rubin, 1977. "Assignment to Treatment Group on the Basis of a Covariate," Journal of Educational and Behavioral Statistics, , vol. 2(1), pages 1-26, March.
    24. Amy Finkelstein & Nathaniel Hendren & Erzo F. P. Luttmer, 2019. "The Value of Medicaid: Interpreting Results from the Oregon Health Insurance Experiment," Journal of Political Economy, University of Chicago Press, vol. 127(6), pages 2836-2874.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amanda E. Kowalski, 2016. "Doing More When You're Running LATE: Applying Marginal Treatment Effect Methods to Examine Treatment Effect Heterogeneity in Experiments for the Young and Privately Insured"," Cowles Foundation Discussion Papers 2045, Cowles Foundation for Research in Economics, Yale University.
    2. Amanda E. Kowalski, 2018. "Extrapolation using Selection and Moral Hazard Heterogeneity from within the Oregon Health Insurance Experiment," Cowles Foundation Discussion Papers 2135, Cowles Foundation for Research in Economics, Yale University.
    3. Amanda E Kowalski, 2023. "Behaviour within a Clinical Trial and Implications for Mammography Guidelines," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 432-462.
    4. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    5. Domenico Depalo, 2020. "Explaining the causal effect of adherence to medication on cholesterol through the marginal patient," Health Economics, John Wiley & Sons, Ltd., vol. 29(S1), pages 110-126, October.
    6. Mark Duggan & Atul Gupta & Emilie Jackson, 2022. "The Impact of the Affordable Care Act: Evidence from California's Hospital Sector," American Economic Journal: Economic Policy, American Economic Association, vol. 14(1), pages 111-151, February.
    7. Kowalski, Amanda E., 2015. "Estimating the tradeoff between risk protection and moral hazard with a nonlinear budget set model of health insurance," International Journal of Industrial Organization, Elsevier, vol. 43(C), pages 122-135.
    8. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    9. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    10. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    11. Martin Gaynor & Kate Ho & Robert J. Town, 2015. "The Industrial Organization of Health-Care Markets," Journal of Economic Literature, American Economic Association, vol. 53(2), pages 235-284, June.
    12. Denni Tommasi & Arthur Lewbel & Rossella Calvi, 2017. "LATE with Mismeasured or Misspecified Treatment: An application to Women's Empowerment in India," Working Papers ECARES ECARES 2017-27, ULB -- Universite Libre de Bruxelles.
    13. Gunnsteinsson, Snaebjorn, 2020. "Experimental identification of asymmetric information: Evidence on crop insurance in the Philippines," Journal of Development Economics, Elsevier, vol. 144(C).
    14. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    15. Nathaniel Hendren & Camille Landais & Johannes Spinnewijn, 2021. "Choice in Insurance Markets: A Pigouvian Approach to Social Insurance Design," Annual Review of Economics, Annual Reviews, vol. 13(1), pages 457-486, August.
    16. Thomas Buchmueller & John C. Ham & Lara D. Shore-Sheppard, 2015. "The Medicaid Program," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 1, pages 21-136, National Bureau of Economic Research, Inc.
    17. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    18. Robert A. Moffitt & Matthew V. Zahn, 2019. "The Marginal Labor Supply Disincentives of Welfare: Evidence from Administrative Barriers to Participation," NBER Working Papers 26028, National Bureau of Economic Research, Inc.
    19. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    20. Pereda-Fernández, Santiago, 2023. "Identification and estimation of triangular models with a binary treatment," Journal of Econometrics, Elsevier, vol. 234(2), pages 585-623.

    More about this item

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • H4 - Public Economics - - Publicly Provided Goods
    • I13 - Health, Education, and Welfare - - Health - - - Health Insurance, Public and Private

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.