IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/6542.html
   My bibliography  Save this paper

Evaluating the Welfare State

Author

Listed:
  • James J. Heckman
  • Jeffrey A. Smith

Abstract

A variety of criteria are relevant for evaluating alternative policies in democratic societies composed of persons with diverse values and perspectives. In this paper, we consider alternative criteria for evaluating the welfare state, and the data required to operationalize them. We examine sets of identifying assumptions that bound, or exactly produce, these alternative criteria given the availability of various types of data. We consider the economic questions addressed by two widely-used econometric evaluation estimators and relate them to the requirements of a comprehensive cost-benefit analysis. We present evidence on how the inference from the most commonly used econometric evaluation estimator is modified when the direct costs of a program are fully assessed, including the welfare costs of the taxes required to support the program. Finally, we present evidence of the empirical inconsistency of alternative criteria derived from evaluations based on on self-selection and attrition decisions, and on self-reported evaluations from questionnaires when applied to a prototypical job training program.

Suggested Citation

  • James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:6542
    Note: PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w6542.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    2. Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-1149, September.
    3. Arulampalam, W. & Robin A. Naylor & Jeremy P. Smith, 2002. "University of Warwick," Royal Economic Society Annual Conference 2002 9, Royal Economic Society.
    4. Couch, Kenneth A, 1992. "New Evidence on the Long-Term Effects of Employment Training Programs," Journal of Labor Economics, University of Chicago Press, vol. 10(4), pages 380-388, October.
    5. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    6. Heckman, James J, 1974. "Effects of Child-Care Programs on Women's Work Effort," Journal of Political Economy, University of Chicago Press, vol. 82(2), pages 136-163, Part II, .
    7. Heckman, James J, 1978. "Dummy Endogenous Variables in a Simultaneous Equation System," Econometrica, Econometric Society, vol. 46(4), pages 931-959, July.
    8. John S. Chipman & James C. Moore, 1976. "Why An Increase In Gnp Need Not Imply An Improvement In Potential Welfare," Kyklos, Wiley Blackwell, vol. 29(3), pages 391-418, January.
    9. John C. Harsanyi, 1955. "Cardinal Welfare, Individualistic Ethics, and Interpersonal Comparisons of Utility," Journal of Political Economy, University of Chicago Press, vol. 63(4), pages 309-309.
    10. Harberger, Arnold C, 1971. "Three Basic Postulates for Applied Welfare Economics: An Interpretive Essay," Journal of Economic Literature, American Economic Association, vol. 9(3), pages 785-797, September.
    11. Heckman, James J, 1996. "Randomization as an Instrumental Variable: Notes," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 336-341, May.
    12. Heckman, James J, 1974. "Shadow Prices, Market Wages, and Labor Supply," Econometrica, Econometric Society, vol. 42(4), pages 679-694, July.
    13. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    14. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    2. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    3. James J. Heckman, 2005. "Micro Data, Heterogeneity and the Evaluation of Public Policy Part 2," The American Economist, Sage Publications, vol. 49(1), pages 16-44, March.
    4. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    5. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    6. Carolyn Heinrich & Jeffrey Wenger, 2002. "The Economic Contributions of James J. Heckman and Daniel L. McFadden," Review of Political Economy, Taylor & Francis Journals, vol. 14(1), pages 69-89.
    7. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    8. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    9. Gordon B. Dahl, 2002. "Mobility and the Return to Education: Testing a Roy Model with Multiple Markets," Econometrica, Econometric Society, vol. 70(6), pages 2367-2420, November.
    10. Markus Frölich, 2004. "Programme Evaluation with Multiple Treatments," Journal of Economic Surveys, Wiley Blackwell, vol. 18(2), pages 181-224, April.
    11. Bernd Fitzenberger & Stefan Speckesser, 2007. "Employment effects of the provision of specific professional skills and techniques in Germany," Empirical Economics, Springer, vol. 32(2), pages 529-573, May.
    12. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    13. Hansen, Karsten T. & Heckman, James J. & Mullen, K.J.Kathleen J., 2004. "The effect of schooling and ability on achievement test scores," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 39-98.
    14. Markus Frölich, 2006. "Statistical Treatment Choice: An Application to Active Labour Market Programmes," University of St. Gallen Department of Economics working paper series 2006 2006-14, Department of Economics, University of St. Gallen.
    15. V. Joseph Hotz & Guido W. Imbens & Jacob A. Klerman, 2006. "Evaluating the Differential Effects of Alternative Welfare-to-Work Training Components: A Reanalysis of the California GAIN Program," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 521-566, July.
    16. Fajnzylber, Pablo & Maloney, William F. & Rojas, Gabriel V. Montes, 2006. "Releasing constraints to growth or pushing on a string ? the impact of credit, training, business associations, and taxes on the performance of Mexican micro-firms," Policy Research Working Paper Series 3807, The World Bank.
    17. Thomas Brodaty & Bruno Crépon & Denis Fougère, 2007. "Les méthodes micro-économétriques d'évaluation et leurs applications aux politiques actives de l'emploi," Economie & Prévision, La Documentation Française, vol. 0(1), pages 93-118.
    18. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    19. Jalan, Jyotsna & Ravallion, Martin, 2003. "Estimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 19-30, January.
    20. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.

    More about this item

    JEL classification:

    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:6542. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.