IDEAS home Printed from https://ideas.repec.org/p/ran/wpaper/wr-109-nichd-nia.html
   My bibliography  Save this paper

What Mean Impacts Miss Distributional Effects of Welfare Reform Experiments

Author

Listed:
  • Marianne P. Bitler
  • Jonah Gelbach
  • Hilary Hoynes

Abstract

Labor supply theory predicts systematic heterogeneity in the impact of recent welfare reforms on earnings, transfers, and income. Yet most welfare reform research focuses on mean impacts. We investigate the importance of heterogeneity using random-assignment data from Connecticut's Jobs First waiver, which features key elements of post-1996 welfare programs. Estimated quantile treatment effects exhibit the substantial heterogeneity predicted by labor supply theory. Thus mean impacts miss a great deal. Looking separately at samples of dropouts and other women does not improve the performance of mean impacts. We conclude that welfare reform's effects are likely both more varied and more extensive than has been recognized.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Marianne P. Bitler & Jonah Gelbach & Hilary Hoynes, 2004. "What Mean Impacts Miss Distributional Effects of Welfare Reform Experiments," Working Papers WR-109-NICHD/NIA, RAND Corporation.
    • Handle: RePEc:ran:wpaper:wr-109-nichd/nia
    as

    Download full text from publisher

    File URL: https://www.rand.org/content/dam/rand/pubs/working_papers/2005/RAND_WR109.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Moffitt, Robert, 1992. "Incentive Effects of the U.S. Welfare System: A Review," Journal of Economic Literature, American Economic Association, vol. 30(1), pages 1-61, March.
    2. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    3. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, January.
    4. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    5. Robert F. Schoeni & Rebecca M. Blank, 2000. "What has Welfare Reform Accomplished? Impacts on Welfare Participation, Employment, Income, Poverty, and Family Structure," NBER Working Papers 7627, National Bureau of Economic Research, Inc.
    6. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    7. Rebecca M. Blank & David Card & Philip K. Robins, 1999. "Financial Incentives for Increasing Work and Income Among Low- Income Families," HEW 9902002, University Library of Munich, Germany.
    8. Jeffrey Grogger, 2003. "The Effects of Time Limits, the EITC, and Other Policy Changes on Welfare Use, Work, and Income among Female-Headed Families," The Review of Economics and Statistics, MIT Press, vol. 85(2), pages 394-408, May.
    9. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    10. Besley, Timothy & Coate, Stephen, 1992. "Workfare versus Welfare Incentive Arguments for Work Requirements in Poverty-Alleviation Programs," American Economic Review, American Economic Association, vol. 82(1), pages 249-261, March.
    11. Jonathan Gruber, 1996. "Cash Welfare as a Consumption Smoothing Mechanism for Single Mothers," NBER Working Papers 5738, National Bureau of Economic Research, Inc.
    12. Leora Friedberg, 2000. "The Labor Supply Effects of the Social Security Earnings Test," The Review of Economics and Statistics, MIT Press, vol. 82(1), pages 48-63, February.
    13. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 487-535.
    14. Neil G. Bennett & Hsien-Hen Lu & Younghwan Song, 2002. "Welfare Reform and Changes in the Economic Well-Being of Children," NBER Working Papers 9399, National Bureau of Economic Research, Inc.
    15. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    16. Moffitt, Robert A., 2002. "Welfare programs and labor supply," Handbook of Public Economics, in: A. J. Auerbach & M. Feldstein (ed.), Handbook of Public Economics, edition 1, volume 4, chapter 34, pages 2393-2430, Elsevier.
    17. Daniel Friedlander & Philip K. Robins, 1997. "The Distributional Impacts of Social Programs," Evaluation Review, , vol. 21(5), pages 531-553, October.
    18. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    19. Melvin Stephens Jr., 2003. ""3rd of tha Month": Do Social Security Recipients Smooth Consumption Between Checks?," American Economic Review, American Economic Association, vol. 93(1), pages 406-422, March.
    20. Rebecca M. Blank, 2002. "Evaluating Welfare Reform in the United States," Journal of Economic Literature, American Economic Association, vol. 40(4), pages 1105-1166, December.
    21. Nada Eissa & Jeffrey B. Liebman, 1996. "Labor Supply Response to the Earned Income Tax Credit," The Quarterly Journal of Economics, Oxford University Press, vol. 111(2), pages 605-637.
    22. Jeffrey Grogger & Charles Michalopoulos, 2003. "Welfare Dynamics under Time Limits," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 530-554, June.
    23. Hilary W. Hoynes & Kenneth Y. Chay & Dean Hyslop, 2004. "True State Dependence In Monthly Welfare Participation:A Nonexperimental Analysis," Working Papers 533, University of California, Davis, Department of Economics.
    24. Schoeni, R.F. & Blank, R.M., 2000. "What Has Welfare Reform Accomplished? Impacts on Welfare Participation, Employment, Income, Poverty, and Family Structure," Papers 00-02, RAND - Labor and Population Program.
    25. Terra McKinnish & Seth Sanders & Jeffrey Smith, 1999. "Estimates of Effective Guarantees and Tax Rates in the AFDC Program for the Post-OBRA Period," Journal of Human Resources, University of Wisconsin Press, vol. 34(2), pages 312-345.
    26. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    27. Gruber, Jonathan, 2000. "Cash welfare as a consumption smoothing mechanism for divorced mothers," Journal of Public Economics, Elsevier, vol. 75(2), pages 157-182, February.
    28. Hilary W. Hoynes & Kenneth Y. Chay & Dean Hyslop, 2004. "True State Dependence In Monthly Welfare Participation:A Nonexperimental Analysis," Working Papers 2, University of California, Davis, Department of Economics.
    29. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    30. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2003. "Some Evidence on Race, Welfare Reform, and Household Income," American Economic Review, American Economic Association, vol. 93(2), pages 293-298, May.
    31. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    32. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
    33. Thomas Fraker & Robert Moffitt & Douglas Wolf, 1985. "Effective Tax Rates and Guarantees in the AFDC Program, 1967-1982," Journal of Human Resources, University of Wisconsin Press, vol. 20(2), pages 251-263.
    34. Robert A. Moffitt, 1999. "The Effect of Pre-PRWORA Waivers on AFDC Caseloads and Female Earnings, Income, and Labor Force Behavior," JCPR Working Papers 89, Northwestern University/University of Chicago Joint Center for Poverty Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Mazzolari, Francesca & Ragusa, Giuseppe, 2012. "Time Limits: The Effects on Welfare Use and Other Consumption-Smoothing Mechanisms," IZA Discussion Papers 6993, Institute of Labor Economics (IZA).
    4. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
    5. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
    6. Rebecca M. Blank, 2002. "Evaluating Welfare Reform in the United States," Journal of Economic Literature, American Economic Association, vol. 40(4), pages 1105-1166, December.
    7. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    8. Ozkan Eren & Serkan Ozbeklik, 2014. "Who Benefits From Job Corps? A Distributional Analysis Of An Active Labor Market Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 586-611, June.
    9. Melanie Guldi & Lucie Schmidt, 2017. "Taxes, Transfers, and Women’s Labor Supply in the United States," Working Papers 2017-01, University of Central Florida, Department of Economics.
    10. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    11. Steven F. Lehrer & R. Vincent Pohl & Kyungchul Song, 2016. "Targeting Policies: Multiple Testing and Distributional Treatment Effects," NBER Working Papers 22950, National Bureau of Economic Research, Inc.
    12. Sakos, Grayson & Cerulli, Giovanni & Garbero, Alessandra, 2021. "Beyond the ATE: Idiosyncratic Effect Estimation to Uncover Distributional Impacts Results from 17 Impact Evaluations," 2021 Annual Meeting, August 1-3, Austin, Texas 314017, Agricultural and Applied Economics Association.
    13. Maier, Michael, 2011. "Tests for distributional treatment effects under unconfoundedness," Economics Letters, Elsevier, vol. 110(1), pages 49-51, January.
    14. Gregory Acs & Eric Toder, 2007. "Should we subsidize work? Welfare reform, the earned income tax credit and optimal transfers," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 14(3), pages 327-343, June.
    15. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    16. Adam Looney, 2005. "The effects of welfare reform and related policies on single mothers' welfare use and employment," Finance and Economics Discussion Series 2005-45, Board of Governors of the Federal Reserve System (U.S.).
    17. Steven F. Lehrer & R. Vincent Pohl & Kyungchul Song, 2022. "Multiple Testing and the Distributional Effects of Accountability Incentives in Education," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1552-1568, October.
    18. Hartley, Robert Paul & Lamarche, Carlos, 2018. "Behavioral responses and welfare reform: Evidence from a randomized experiment," Labour Economics, Elsevier, vol. 54(C), pages 135-151.
    19. Sørensen, Kenneth Lykke, 2016. "Heterogeneous impacts on earnings from an early effort in labor market programs," Labour Economics, Elsevier, vol. 41(C), pages 266-279.
    20. Pedro H. C. Sant'Anna, 2016. "Program Evaluation with Right-Censored Data," Papers 1604.02642, arXiv.org.

    More about this item

    JEL classification:

    • J2 - Labor and Demographic Economics - - Demand and Supply of Labor
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • H53 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Welfare Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ran:wpaper:wr-109-nichd/nia. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benson Wong (email available below). General contact details of provider: https://edirc.repec.org/data/lpranus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.