IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Evaluating the impact of Mexico's quality schools program : the pitfalls of using nonexperimental data

  • Skoufias, Emmanuel
  • Shapiro, Joseph

The authors evaluate whether increasing school resources and decentralizing management decisions at the school level improves learning in a developing country. Mexico's Quality Schools Program (PEC), following many other countries and U.S. states, offers US$15,000 grants for public schools to implement five-year improvement plans that the school's staff and community design. Using a three-year panel of 74,700 schools, the authors estimate the impact of the PEC on dropout, repetition, and failure using two common nonexperimental methods-regression analysis and propensity score matching. The methods provide similar but nonidentical results. The preferred estimator, difference-in-differences with matching, reveals that participation in the PEC decreases dropout by 0.24 percentage points, failure by 0.24 percentage points, and repetition by 0.31 percentage points-an economically small but statistically significant impact. The PEC lacks measurable impact on outcomes in indigenous schools. The results suggest that a combination of increased resources and local management can produce small improvements in school outcomes, though perhaps not in the most troubled school systems.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www-wds.worldbank.org/servlet/WDSContentServer/WDSP/IB/2006/10/12/000016406_20061012150223/Rendered/PDF/wps4036.pdf
Download Restriction: no

Paper provided by The World Bank in its series Policy Research Working Paper Series with number 4036.

as
in new window

Length:
Date of creation: 01 Oct 2006
Date of revision:
Handle: RePEc:wbk:wbrwps:4036
Contact details of provider: Postal: 1818 H Street, N.W., Washington, DC 20433
Phone: (202) 477-1234
Web page: http://www.worldbank.org/
Email:


More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Jerik Hanushek & Dennis Kimko, 2006. "Schooling, Labor-force Quality, and the Growth of Nations," Educational Studies, Higher School of Economics, issue 1, pages 154-193.
  2. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366 Elsevier.
  3. Glewwe, Paul & Kremer, Michael, 2006. "Schools, Teachers, and Education Outcomes in Developing Countries," Handbook of the Economics of Education, Elsevier.
  4. Eskeland, Gunnar S. & Filmer, Deon, 2002. "Autonomy, participation, and learning in Argentine schools - findings andtheir implications for decentralization," Policy Research Working Paper Series 2766, The World Bank.
  5. Besley, Timothy J. & Coate, Stephen, 2000. "Centralized versus Decentralized Provision of Local Public Goods: a Political Economy Analysis," CEPR Discussion Papers 2495, C.E.P.R. Discussion Papers.
  6. Alan Krueger, 1997. "Experimental Estimates of Education Production Functions," Working Papers 758, Princeton University, Department of Economics, Industrial Relations Section..
  7. Alberto Abadie & Guido W. Imbens, 2006. "On the Failure of the Bootstrap for Matching Estimators," NBER Technical Working Papers 0325, National Bureau of Economic Research, Inc.
  8. Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 605-54, October.
  9. Anne Case & Angus Deaton, 1999. "School Inputs And Educational Outcomes In South Africa," The Quarterly Journal of Economics, MIT Press, vol. 114(3), pages 1047-1084, August.
  10. Richard J. Murnane & John B. Willett & Frank Levy, 1995. "The Growing Importance of Cognitive Skills in Wage Determination," NBER Working Papers 5076, National Bureau of Economic Research, Inc.
  11. Heckman, James J & Ichimura, Hidehiko & Todd, Petra, 1998. "Matching as an Econometric Evaluation Estimator," Review of Economic Studies, Wiley Blackwell, vol. 65(2), pages 261-94, April.
  12. Kenneth Chay & Patrick J. McEwan & Miguel Urquiola, 2003. "The Central Role of Noise in Evaluating Interventions that Use Test Scores to Rank Schools," Discussion Papers 0304-10, Columbia University, Department of Economics.
  13. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097 Elsevier.
  14. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-in-Differences Estimates?," The Quarterly Journal of Economics, MIT Press, vol. 119(1), pages 249-275, February.
  15. James J. Heckman, 1989. "Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower Training," NBER Working Papers 2861, National Bureau of Economic Research, Inc.
  16. Murnane, Richard J. & Willett, John B. & Braatz, M. Jay & Duhaldeborde, Yves, 2001. "Do different dimensions of male high school students' skills predict labor market success a decade later? Evidence from the NLSY," Economics of Education Review, Elsevier, vol. 20(4), pages 311-320, August.
  17. Neal, Derek A & Johnson, William R, 1996. "The Role of Premarket Factors in Black-White Wage Differences," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 869-95, October.
  18. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
  19. Alan B. Krueger, 2003. "Economic Considerations and Class Size," Economic Journal, Royal Economic Society, vol. 113(485), pages F34-F63, February.
  20. Murphy, Kevin M & Welch, Finis, 1992. "The Structure of Wages," The Quarterly Journal of Economics, MIT Press, vol. 107(1), pages 285-326, February.
  21. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
  22. Alderman, Harold, 2002. "Do local officials know something we don't? Decentralization of targeted transfers in Albania," Journal of Public Economics, Elsevier, vol. 83(3), pages 375-404, March.
  23. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule To Estimate The Effect Of Class Size On Scholastic Achievement," The Quarterly Journal of Economics, MIT Press, vol. 114(2), pages 533-575, May.
  24. Jimenez, Emmanuel & Sawada, Yasuyuki, 1999. "Do Community-Managed Schools Work? An Evaluation of El Salvador's EDUCO Program," World Bank Economic Review, World Bank Group, vol. 13(3), pages 415-41, September.
  25. Robert J. Barro, 2001. "Human Capital and Growth," American Economic Review, American Economic Association, vol. 91(2), pages 12-17, May.
  26. O'Neill, June, 1990. "The Role of Human Capital in Earnings Differences between Black and White Men," Journal of Economic Perspectives, American Economic Association, vol. 4(4), pages 25-45, Fall.
  27. Richard Blundell & Monica Costa Dias, 2000. "Evaluation methods for non-experimental data," Fiscal Studies, Institute for Fiscal Studies, vol. 21(4), pages 427-468, January.
  28. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:4036. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Roula I. Yazigi)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.