IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v26y2002i5p545-572.html
   My bibliography  Save this article

Addressing Self-Selection Bias in Quasi-Experimental Evaluations of Whole-School Reform

Author

Listed:
  • Robert Bifulco

    (Duke University)

Abstract

This article discusses potential sources of self-selection bias in quasi-experimental evaluations of whole-school reform models and considers how individual student-level data might be used to provide valid impact estimates. Although repeated pretreatment and posttreatment measures of student performance can provide unbiased estimates under relatively weak assumptions, such data are difficult to obtain. The article develops an instrumental variable strategy that can be used to improve on common value-added estimators when only posttreatment measures of performance are available. Using data from New York City, the author shows that the instrumental variable strategy can provide estimates of model impacts similar to those provided by a difference-in-differences estimator provided that appropriate instruments are used.

Suggested Citation

  • Robert Bifulco, 2002. "Addressing Self-Selection Bias in Quasi-Experimental Evaluations of Whole-School Reform," Evaluation Review, , vol. 26(5), pages 545-572, October.
    • Handle: RePEc:sae:evarev:v:26:y:2002:i:5:p:545-572
    DOI: 10.1177/019384102236523
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/019384102236523
    Download Restriction: no
    File URL: https://libkey.io/10.1177/019384102236523?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Pufahl & Christoph R. Weiss, 2009. "Evaluating the effects of farm programmes: results from propensity score matching," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(1), pages 79-101, March.
    2. Gautier, Pieter & van Vuuren, Aico & Siegmann, Arjen, 2007. "The Effect of the Theo van Gogh Murder on House Prices in Amsterdam," CEPR Discussion Papers 6175, C.E.P.R. Discussion Papers.
    3. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    4. Belot, Michèle & James, Jonathan, 2014. "A new perspective on the issue of selection bias in randomized controlled field experiments," Economics Letters, Elsevier, vol. 124(3), pages 326-328.
    5. Nicola Pavoni & G. L. Violante, 2007. "Optimal Welfare-to-Work Programs," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(1), pages 283-318.
    6. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    7. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    8. Barbara Sianesi, 2002. "Swedish active labour market programmes in the 1990s: overall effectiveness and differential performance," IFS Working Papers W02/03, Institute for Fiscal Studies.
    9. Bronwyn Hall & Alessandro Maffioli, 2008. "Evaluating the impact of technology development funds in emerging economies: evidence from Latin America," The European Journal of Development Research, Taylor and Francis Journals, vol. 20(2), pages 172-198.
    10. Brian Graversen & Brian Larsen, 2013. "Is there a threat effect of mandatory activation programmes for the long-term unemployed?," Empirical Economics, Springer, vol. 44(2), pages 1031-1051, April.
    11. Yokoyama, Izumi & Kodama, Naomi & Higuchi, Yoshio, 2019. "Effects of state-sponsored human capital investment on the selection of training type," Japan and the World Economy, Elsevier, vol. 49(C), pages 40-49.
    12. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    13. Peter Z. Schochet & Ronald D'Amico & Jillian Berk & Sarah Dolfin & Nathan Wozny, "undated". "Estimated Impacts for Participants in the Trade Adjustment Assistance (TAA) Program Under the 2002 Amendments," Mathematica Policy Research Reports 582d8723f6884d4eb7a3f95a4, Mathematica Policy Research.
    14. Hämäläinen, Kari & Ollikainen, Virve, 2004. "Differential Effects of Active Labour Market Programmes in the Early Stages of Young People's Unemployment," Research Reports 115, VATT Institute for Economic Research.
    15. Abbring, Jaap H. & van den Berg, Gerard J., 2003. "A Simple Procedure for the Evaluation of Treatment Effects on Duration Variables," IZA Discussion Papers 810, Institute of Labor Economics (IZA).
    16. Anders Stenberg & Xavier Luna & Olle Westerlund, 2012. "Can adult education delay retirement from the labour market?," Journal of Population Economics, Springer;European Society for Population Economics, vol. 25(2), pages 677-696, January.
    17. Eliason, Marcus, 2011. "Assistant and auxiliary nurses in crisis times: earnings and employment following public sector job loss in the 1990s," Working Paper Series 2011:1, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    18. Anita Alves Pena, 2015. "The effect of continuing education participation on outcomes of male and female agricultural workers in the USA," Education Economics, Taylor & Francis Journals, vol. 23(6), pages 751-776, December.
    19. Rüdiger Wapler & Daniel Werner & Katja Wolf, 2018. "Active labour market policies in Germany: do regional labour markets benefit?," Applied Economics, Taylor & Francis Journals, vol. 50(51), pages 5561-5578, November.
    20. Bolwig, Simon & Gibbon, Peter & Jones, Sam, 2009. "The Economics of Smallholder Organic Contract Farming in Tropical Africa," World Development, Elsevier, vol. 37(6), pages 1094-1104, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:26:y:2002:i:5:p:545-572. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.