IDEAS home Printed from https://ideas.repec.org/p/nbr/nberte/0254.html
   My bibliography  Save this paper

Direct Estimation of Policy Impacts

Author

Listed:
  • Hidehiko Ichimura
  • Christopher R. Taber

Abstract

This paper specifies a general set of conditions under which the impacts of a policy can be identified using data generated under a different policy regime. We show that some of the policy impacts can be identified under relatively weak conditions on the data and structure of a model. Based on the identification results we develop estimators of policy impacts. We discuss a nonparametric method to implement the estimation but also discuss semiparametric methods in order to reduce the conditioning dimension. We then provide an empirical example of the impact of tuition subsidies using the ideas. While the framework used in this paper is fairly narrow, we believe this approach can be applied to a broad set of problems.

Suggested Citation

  • Hidehiko Ichimura & Christopher R. Taber, 2000. "Direct Estimation of Policy Impacts," NBER Technical Working Papers 0254, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberte:0254
    Note: TWP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/t0254.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    2. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    3. Angrist, J.D. & Imbens, G.W., 1991. "Sources of Identifying Information in Evaluation Models," Harvard Institute of Economic Research Working Papers 1568, Harvard - Institute of Economic Research.
    4. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    5. Thomas J. Kane & Cecilia Rouse, 1993. "Labor Market Returns to Two- And Four-Year College: Is A Credit a Credit And Do Degrees Matter?," Working Papers 690, Princeton University, Department of Economics, Industrial Relations Section..
    6. Heckman, James J & Lochner, Lance & Taber, Christopher, 1998. "General-Equilibrium Treatment Effects: A Study of Tuition Policy," American Economic Review, American Economic Association, vol. 88(2), pages 381-386, May.
    7. Chamberlain, Gary, 1986. "Asymptotic efficiency in semi-parametric models with censoring," Journal of Econometrics, Elsevier, vol. 32(2), pages 189-218, July.
    8. repec:fth:prinin:311 is not listed on IDEAS
    9. Thomas J. Kane & Cecilia E. Rouse, 1993. "Labor Market Returns to Two- and Four-Year Colleges: Is a Credit a Credit and Do Degrees Matter?," NBER Working Papers 4268, National Bureau of Economic Research, Inc.
    10. Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-1149, September.
    11. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    12. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    13. Joshua D. Angrist & Kathryn Graddy & Guido W. Imbens, 2000. "The Interpretation of Instrumental Variables Estimators in Simultaneous Equations Models with an Application to the Demand for Fish," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(3), pages 499-527.
    14. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    15. Joshua D. Angrist & Guido W. Imbens, 1999. "Comment on James J. Heckman, "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations"," Journal of Human Resources, University of Wisconsin Press, vol. 34(4), pages 823-827.
    16. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    17. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    18. Thomas J. Kane & Cecilia E. Rouse, 1993. "Labor Market Returns to Two- And Four-Year College: Is a Credit a Credit And Do Degrees Matter?," Working Papers 690, Princeton University, Department of Economics, Industrial Relations Section..
    19. James J. Heckman, 2000. "Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 45-97.
    20. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," NBER Working Papers 4483, National Bureau of Economic Research, Inc.
    21. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    22. Christopher A. Sims, 1982. "Policy Analysis with Econometric Models," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 13(1), pages 107-164.
    23. James J. Heckman, 1999. "Instrumental Variables: Response to Angrist and Imbens," Journal of Human Resources, University of Wisconsin Press, vol. 34(4), pages 828-837.
    24. Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-318, May.
    25. James J. Heckman & Edward J. Vytlacil, 2000. "Local Instrumental Variables," NBER Technical Working Papers 0252, National Bureau of Economic Research, Inc.
    26. Flinn, C. & Heckman, J., 1982. "New methods for analyzing structural models of labor force dynamics," Journal of Econometrics, Elsevier, vol. 18(1), pages 115-168, January.
    27. Bjorklund, Anders & Moffitt, Robert, 1987. "The Estimation of Wage Gains and Welfare Gains in Self-selection," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 42-49, February.
    28. Ichimura, H., 1991. "Semiparametric Least Squares (sls) and Weighted SLS Estimation of Single- Index Models," Papers 264, Minnesota - Center for Economic Research.
    29. Manski, C.F. & Nagin, D.S., 1995. "Bounding Disagreements About Treatment Effects: A Case Study of Sentencing and Recidivism," Working papers 9526, Wisconsin Madison - Social Systems.
    30. James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pedro Carneiro & Michael Lokshin & Nithin Umapathi, 2017. "Average and Marginal Returns to Upper Secondary Schooling in Indonesia," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 16-36, January.
    2. Abbring, Jaap H., 2003. "Dynamic Econometric Program Evaluation," IZA Discussion Papers 804, Institute of Labor Economics (IZA).
    3. Hidehiko Ichimura & Christopher Taber, 2002. "Semiparametric Reduced-Form Estimation of Tuition Subsidies," American Economic Review, American Economic Association, vol. 92(2), pages 286-292, May.
    4. Birol, Ekin & Asare-Marfo, Dorene & Ayele, Gezahegn & Mensa-Bonsu, Akwasi & Ndirangu, Lydia & Okpukpara, Benjamin & Roy, Devesh & Yakhshilikov, Yorbol, 2010. "Investigating the role of poultry in livelihoods and the impact of avian flu on livelihoods outcomes in Africa: Evidence from Ethiopia, Ghana, Kenya, and Nigeria," IFPRI discussion papers 1011, International Food Policy Research Institute (IFPRI).
    5. Birol, Ekin & Asare-Marfo, Dorene & Ayele, Gezahegn & Mensah-Bonsu, Akwasi & Ndirangu, Lydia & Okpukpara, Benjamin & Roy, Devesh & Yakhshilikov, Yorbol, 2013. "The impact of avian flu on livelihood outcomes in Africa: evidence from Ethiopia, Ghana, Kenya and Nigeria," African Journal of Agricultural and Resource Economics, African Association of Agricultural Economists, vol. 8(4), pages 1-14, October.
    6. Schorfheide, Frank & Wolpin, Kenneth I., 2016. "To hold out or not to hold out," Research in Economics, Elsevier, vol. 70(2), pages 332-345.
    7. Myrto Kalouptsidi & Paul T. Scott & Eduardo Souza‐Rodrigues, 2021. "Identification of counterfactuals in dynamic discrete choice models," Quantitative Economics, Econometric Society, vol. 12(2), pages 351-403, May.
    8. Christopher Ferrall, 2002. "Estimation And Inference In Social Experiments," Working Paper 1008, Economics Department, Queen's University.
    9. Carneiro, Pedro & Lee, Sokbae, 2009. "Estimating distributions of potential outcomes using local instrumental variables with an application to changes in college enrollment and wage inequality," Journal of Econometrics, Elsevier, vol. 149(2), pages 191-208, April.
    10. Ranjeeta Thomas, 2012. "Conditional Cash Transfers To Improve Education And Health: An Ex Ante Evaluation Of Red De Protección Social, Nicaragua," Health Economics, John Wiley & Sons, Ltd., vol. 21(10), pages 1136-1154, October.
    11. Petra E. Todd & Kenneth I. Wolpin, 2008. "Ex Ante Evaluation of Social Programs," Annals of Economics and Statistics, GENES, issue 91-92, pages 263-291.
    12. Thomas, R, 2011. "Using a Semiparametric Estimator to Forecast Education Outcomes in Nicaragua's Red de Proteccion Social," Health, Econometrics and Data Group (HEDG) Working Papers 11/02, HEDG, c/o Department of Economics, University of York.
    13. Sasaki, Yuya & Ura, Takuya, 2023. "Estimation and inference for policy relevant treatment effects," Journal of Econometrics, Elsevier, vol. 234(2), pages 394-450.
    14. Otto Toivanen & Lotta Väänänen, 2016. "Education and Invention," The Review of Economics and Statistics, MIT Press, vol. 98(2), pages 382-396, May.
    15. Birol, Ekin & Ndirangu, Lydia & Roy, Devesh & Yakhshilikov, Yorbol, 2011. "Assessing the livelihood impacts of a livestock disease outbreak: An alternative approach," IFPRI discussion papers 1081, International Food Policy Research Institute (IFPRI).
    16. Nicholas-James Clavet & Jean-Yves Duclos & Guy Lacroix, 2012. "Fighting Poverty: Assessing the Effect of a Guaranteed Minimum Income Proposal in Québec," CIRANO Working Papers 2012s-36, CIRANO.
    17. Zantomio, Francesca, 2008. "The route to take-up: raising incentives or lowering barriers?," ISER Working Paper Series 2008-35, Institute for Social and Economic Research.
    18. Edward Vytlacil & James J. Heckman, 2001. "Policy-Relevant Treatment Effects," American Economic Review, American Economic Association, vol. 91(2), pages 107-111, May.
    19. Yuya Sasaki & Takuya Ura, 2018. "Estimation and Inference for Policy Relevant Treatment Effects," Papers 1805.11503, arXiv.org, revised Jul 2020.
    20. Thomas M. Russell, 2020. "Policy Transforms and Learning Optimal Policies," Papers 2012.11046, arXiv.org.
    21. Pablo Vidueira & José M. Díaz-Puente & María Rivera, 2014. "Socioeconomic Impact Assessment in Ex Ante Evaluations," Evaluation Review, , vol. 38(4), pages 309-335, August.
    22. Francesca Zantomio & Stephen Pudney & Ruth Hancock, 2010. "Estimating the Impact of a Policy Reform on Benefit Take‐up: The 2001 extension to the Minimum Income Guarantee for UK Pensioners," Economica, London School of Economics and Political Science, vol. 77(306), pages 234-254, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James J. Heckman, 2005. "Micro Data, Heterogeneity and the Evaluation of Public Policy Part 2," The American Economist, Sage Publications, vol. 49(1), pages 16-44, March.
    2. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Aakvik, Arild & Heckman, James J. & Vytlacil, Edward J., 2005. "Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 15-51.
    5. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    6. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    7. Arild Aakvik & James J. Heckman & Edward J. Vytlacil, 2000. "Treatment Effects for Discrete Outcomes when Responses to Treatment Vary Among Observationally Identical Persons: An Application to Norwegian ..," NBER Technical Working Papers 0262, National Bureau of Economic Research, Inc.
    8. Heckman, James J. & Lochner, Lance J. & Todd, Petra E., 2006. "Earnings Functions, Rates of Return and Treatment Effects: The Mincer Equation and Beyond," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 7, pages 307-458, Elsevier.
    9. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    10. Thomas Brodaty & Bruno Crépon & Denis Fougère, 2007. "Les méthodes micro-économétriques d'évaluation et leurs applications aux politiques actives de l'emploi," Economie & Prévision, La Documentation Française, vol. 0(1), pages 93-118.
    11. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    12. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    13. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    14. Mingliang Li & Dale J. Poirier & Justin L. Tobias, 2004. "Do dropouts suffer from dropping out? Estimation and prediction of outcome gains in generalized selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(2), pages 203-225.
    15. Pedro Carneiro & Sokbae (Simon) Lee, 2005. "Ability, sorting and wage inequality," CeMMAP working papers CWP16/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    17. Nikolov, Plamen & Jimi, Nusrat & Chang, Jerray, 2020. "The Importance of Cognitive Domains and the Returns to Schooling in South Africa: Evidence from Two Labor Surveys," Labour Economics, Elsevier, vol. 65(C).
    18. Markus Frölich, 2004. "Programme Evaluation with Multiple Treatments," Journal of Economic Surveys, Wiley Blackwell, vol. 18(2), pages 181-224, April.
    19. Flores, Carlos A. & Mitnik, Oscar A., 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," IZA Discussion Papers 4451, Institute of Labor Economics (IZA).
    20. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberte:0254. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.