IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Evaluating the impact of Mexico's quality schools program : the pitfalls of using nonexperimental data

  • Skoufias, Emmanuel
  • Shapiro, Joseph

The authors evaluate whether increasing school resources and decentralizing management decisions at the school level improves learning in a developing country. Mexico's Quality Schools Program (PEC), following many other countries and U.S. states, offers US$15,000 grants for public schools to implement five-year improvement plans that the school's staff and community design. Using a three-year panel of 74,700 schools, the authors estimate the impact of the PEC on dropout, repetition, and failure using two common nonexperimental methods-regression analysis and propensity score matching. The methods provide similar but nonidentical results. The preferred estimator, difference-in-differences with matching, reveals that participation in the PEC decreases dropout by 0.24 percentage points, failure by 0.24 percentage points, and repetition by 0.31 percentage points-an economically small but statistically significant impact. The PEC lacks measurable impact on outcomes in indigenous schools. The results suggest that a combination of increased resources and local management can produce small improvements in school outcomes, though perhaps not in the most troubled school systems.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2006/10/12/000016406_20061012150223/Rendered/PDF/wps4036.pdf
Download Restriction: no

Paper provided by The World Bank in its series Policy Research Working Paper Series with number 4036.

as
in new window

Length:
Date of creation: 01 Oct 2006
Date of revision:
Handle: RePEc:wbk:wbrwps:4036
Contact details of provider: Postal:
1818 H Street, N.W., Washington, DC 20433

Phone: (202) 477-1234
Web page: http://www.worldbank.org/
Email:


More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Alan B. Krueger, 2003. "Economic Considerations and Class Size," Economic Journal, Royal Economic Society, vol. 113(485), pages F34-F63, February.
  2. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
  3. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
  4. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, Oxford University Press, vol. 119(1), pages 249-275.
  5. Derek A. Neal & William R. Johnson, 1995. "The Role of Pre-Market Factors in Black-White Wage Differences," NBER Working Papers 5124, National Bureau of Economic Research, Inc.
  6. Richard J. Murnane & John B. Willett & Frank Levy, 1995. "The Growing Importance of Cognitive Skills in Wage Determination," NBER Working Papers 5076, National Bureau of Economic Research, Inc.
  7. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
  8. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, Oxford University Press, vol. 114(2), pages 497-532.
  9. Dennis D. Kimko & Eric A. Hanushek, 2000. "Schooling, Labor-Force Quality, and the Growth of Nations," American Economic Review, American Economic Association, vol. 90(5), pages 1184-1208, December.
  10. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097 Elsevier.
  11. Jimenez, Emmanuel & Sawada, Yasuyuki, 1999. "Do Community-Managed Schools Work? An Evaluation of El Salvador's EDUCO Program," World Bank Economic Review, World Bank Group, vol. 13(3), pages 415-41, September.
  12. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
  13. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366 Elsevier.
  14. Kevin M. Murphy & Finis Welch, 1992. "The Structure of Wages," The Quarterly Journal of Economics, Oxford University Press, vol. 107(1), pages 285-326.
  15. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 114(2), pages 533-575.
  16. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
  17. Besley, Timothy J. & Coate, Stephen, 2000. "Centralized versus Decentralized Provision of Local Public Goods: a Political Economy Analysis," CEPR Discussion Papers 2495, C.E.P.R. Discussion Papers.
  18. Robert J. Barro, 2001. "Human Capital and Growth," American Economic Review, American Economic Association, vol. 91(2), pages 12-17, May.
  19. Richard Blundell & Monica Costa Dias, 2000. "Evaluation methods for non-experimental data," Fiscal Studies, Institute for Fiscal Studies, vol. 21(4), pages 427-468, January.
  20. Imbens, Guido & Abadie, Alberto, 2008. "On the Failure of the Bootstrap for Matching Estimators," Scholarly Articles 3043415, Harvard University Department of Economics.
  21. Glewwe, Paul & Kremer, Michael, 2006. "Schools, Teachers, and Education Outcomes in Developing Countries," Handbook of the Economics of Education, Elsevier.
  22. Anne Case & Angus Deaton, 1999. "School Inputs and Educational Outcomes in South Africa," The Quarterly Journal of Economics, Oxford University Press, vol. 114(3), pages 1047-1084.
  23. O'Neill, June, 1990. "The Role of Human Capital in Earnings Differences between Black and White Men," Journal of Economic Perspectives, American Economic Association, vol. 4(4), pages 25-45, Fall.
  24. Kenneth Y. Chay & Patrick J. McEwan & Miguel Urquiola, 2005. "The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools," American Economic Review, American Economic Association, vol. 95(4), pages 1237-1258, September.
  25. Eskeland, Gunnar S. & Filmer, Deon, 2002. "Autonomy, participation, and learning in Argentine schools - findings andtheir implications for decentralization," Policy Research Working Paper Series 2766, The World Bank.
  26. Murnane, Richard J. & Willett, John B. & Braatz, M. Jay & Duhaldeborde, Yves, 2001. "Do different dimensions of male high school students' skills predict labor market success a decade later? Evidence from the NLSY," Economics of Education Review, Elsevier, vol. 20(4), pages 311-320, August.
  27. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
  28. Alderman, Harold, 2002. "Do local officials know something we don't? Decentralization of targeted transfers in Albania," Journal of Public Economics, Elsevier, vol. 83(3), pages 375-404, March.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:4036. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Roula I. Yazigi)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.