IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/7203.html
   My bibliography  Save this paper

What really works to improve learning in developing countries ? an analysis of divergent findings in systematic reviews

Author

Listed:
  • Evans,David-000213993
  • Popova,Anna

Abstract

In the past two years alone, at least six systematic reviews or meta-analyses have examined the interventions that improve learning outcomes in low- and middle-income countries. However, these reviews have sometimes reached starkly different conclusions: reviews, in turn, recommend information technology, interventions that provide information about school quality, or even basic infrastructure (such as desks) to achieve the greatest improvements in student learning. This paper demonstrates that these divergent conclusions are largely driven by differences in the samples of research incorporated by each review. The top recommendations in a given review are often driven by the results of evaluations not included in other reviews. Of 227 studies with student learning results, the most inclusive review incorporates less than half of the total studies. Variance in classification also plays a role. Across the reviews, the three classes of programs that are recommended with some consistency (albeit under different names) are pedagogical interventions (including computer-assisted learning) that tailor teaching to student skills; repeated teacher training interventions, often linked to another pedagogical intervention; and improving accountability through contracts or performance incentives, at least in certain contexts. Future reviews will be most useful if they combine narrative review with meta-analysis, conduct more exhaustive searches, and maintain low aggregation of intervention categories.

Suggested Citation

  • Evans,David-000213993 & Popova,Anna, 2015. "What really works to improve learning in developing countries ? an analysis of divergent findings in systematic reviews," Policy Research Working Paper Series 7203, The World Bank.
  • Handle: RePEc:wbk:wbrwps:7203
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2015/02/26/090224b082b5cbf1/1_0/Rendered/PDF/What0really0wo0n0systematic0reviews.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Eric Hanushek & Ludger Woessmann, 2012. "Do better schools lead to more growth? Cognitive skills, economic outcomes, and causation," Journal of Economic Growth, Springer, vol. 17(4), pages 267-321, December.
    2. George Psacharopoulos, 1985. "Returns to Education: A Further International Update and Implications," Journal of Human Resources, University of Wisconsin Press, vol. 20(4), pages 583-604.
    3. Gérard Lassibille & Jee-Peng Tan & Cornelia Jesse & Trang Van Nguyen, 2010. "Managing for Results in Primary Education in Madagascar: Evaluating the Impact of Selected Workflow Interventions," The World Bank Economic Review, World Bank Group, vol. 24(2), pages 303-329, August.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, Oxford University Press, vol. 122(3), pages 1235-1264.
    5. Duflo, Esther & Dupas, Pascaline & Kremer, Michael, 2015. "School governance, teacher incentives, and pupil–teacher ratios: Experimental evidence from Kenyan primary schools," Journal of Public Economics, Elsevier, vol. 123(C), pages 92-110.
    6. George Psacharopoulos & Harry Anthony Patrinos, 2004. "Returns to investment in education: a further update," Education Economics, Taylor & Francis Journals, vol. 12(2), pages 111-134.
    7. Jamison, Eliot A. & Jamison, Dean T. & Hanushek, Eric A., 2007. "The effects of education quality on income growth and mortality decline," Economics of Education Review, Elsevier, vol. 26(6), pages 771-788, December.
    8. Rebelo, Sergio, 1991. "Long-Run Policy Analysis and Long-Run Growth," Journal of Political Economy, University of Chicago Press, vol. 99(3), pages 500-521, June.
    9. Robert J. Barro, 1991. "Economic Growth in a Cross Section of Countries," The Quarterly Journal of Economics, Oxford University Press, vol. 106(2), pages 407-443.
    10. Eric A. Hanushek & Ludger Woessmann, 2008. "The Role of Cognitive Skills in Economic Development," Journal of Economic Literature, American Economic Association, vol. 46(3), pages 607-668, September.
    11. Petrakis, P. E. & Stamatakis, D., 2002. "Growth and educational levels: a comparative analysis," Economics of Education Review, Elsevier, vol. 21(5), pages 513-521, October.
    12. Joshua Angrist & Eric Bettinger & Erik Bloom & Elizabeth King & Michael Kremer, 2002. "Vouchers for Private Schooling in Colombia: Evidence from a Randomized Natural Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1535-1558, December.
    13. Paqueo, Vicente & Lopez-Acevedo, Gladys, 2003. "Supply-side school improvement and the learning achievement of the poorest children in indigenous and rural schools - the case of PARE," Policy Research Working Paper Series 3172, The World Bank.
    14. M. Niaz Asadullah, 2005. "The effect of class size on student achievement: evidence from Bangladesh," Applied Economics Letters, Taylor & Francis Journals, vol. 12(4), pages 217-221.
    15. Glewwe, Paul & Kremer, Michael & Moulin, Sylvie & Zitzewitz, Eric, 2004. "Retrospective vs. prospective analyses of school inputs: the case of flip charts in Kenya," Journal of Development Economics, Elsevier, vol. 74(1), pages 251-268, June.
    16. Jere R. Behrman & Susan W. Parker & Petra E. Todd & Kenneth I. Wolpin, 2015. "Aligning Learning Incentives of Students and Teachers: Results from a Social Experiment in Mexican High Schools," Journal of Political Economy, University of Chicago Press, vol. 123(2), pages 325-364.
    17. Dante Contreras & Tomás Rau, 2012. "Tournament Incentives for Teachers: Evidence from a Scaled-Up Intervention in Chile," Economic Development and Cultural Change, University of Chicago Press, vol. 61(1), pages 219-246.
    18. Das, J. & Dercon, S. & Habyarimana, J. & Krishnan, P., 2004. "‘When Can School Inputs Improve Test Scores?’," Cambridge Working Papers in Economics 0437, Faculty of Economics, University of Cambridge.
    19. Karthik Muralidharan & Venkatesh Sundararaman, 2010. "The Impact of Diagnostic Feedback to Teachers on Student Learning: Experimental Evidence from India," Economic Journal, Royal Economic Society, vol. 120(546), pages 187-203, August.
    20. Ewald Walterskirchen & et al., 1998. "Exportgetragenes Wirtschaftswachstum. Österreichs Wirtschaft im Jahr 1997," WIFO Monatsberichte (monthly reports), WIFO, vol. 71(4), pages 239-280, April.
    21. Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan, 2007. "Teacher Shocks and Student Learning: Evidence from Zambia," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
    22. Sylvie Moulin & Michael Kremer & Paul Glewwe, 2009. "Many Children Left Behind? Textbooks and Test Scores in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 112-135, January.
    23. Dana Burde & Leigh L. Linden, 2012. "The Effect of Village-Based Schools: Evidence from a Randomized Controlled Trial in Afghanistan," NBER Working Papers 18039, National Bureau of Economic Research, Inc.
    24. Michael Kremer & Edward Miguel & Rebecca Thornton, 2009. "Incentives to Learn," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 437-456, August.
    25. Barrera-Osorio, Felipe & Linden, Leigh L., 2009. "The use and misuse of computers in education : evidence from a randomized experiment in Colombia," Policy Research Working Paper Series 4836, The World Bank.
    26. Kingdon, Geeta Gandhi & Teal, Francis, 2007. "Does performance related pay for teachers improve student performance? Some evidence from India," Economics of Education Review, Elsevier, vol. 26(4), pages 473-486, August.
    27. Robert J. Barro, 2001. "Human Capital and Growth," American Economic Review, American Economic Association, vol. 91(2), pages 12-17, May.
    28. Paul M. Romer, 1994. "The Origins of Endogenous Growth," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 3-22, Winter.
    29. Lucas, Robert Jr., 1988. "On the mechanics of economic development," Journal of Monetary Economics, Elsevier, vol. 22(1), pages 3-42, July.
    30. Gary S. Becker, 1962. "Investment in Human Capital: A Theoretical Analysis," NBER Chapters, in: Investment in Human Beings, pages 9-49, National Bureau of Economic Research, Inc.
    31. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    32. Elizabeth Asiedu & Boaz Nandwa, 2007. "The Impact of Foreign Aid in Education Growth: How Relevant is the Heterogeneity of Aid Flows and the Heterogeneity of Aid Recipients?," WIDER Working Paper Series RP2007-60, World Institute for Development Economic Research (UNU-WIDER).
    33. Galiani, Sebastian & Gertler, Paul & Schargrodsky, Ernesto, 2008. "School decentralization: Helping the good get better, but leaving the poor behind," Journal of Public Economics, Elsevier, vol. 92(10-11), pages 2106-2120, October.
    34. Michael Kremer & Alaka Holla, 2009. "Improving Education in the Developing World: What Have We Learned from Randomized Evaluations?," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 513-545, May.
    35. Benhabib, Jess & Spiegel, Mark M., 1994. "The role of human capital in economic development evidence from aggregate cross-country data," Journal of Monetary Economics, Elsevier, vol. 34(2), pages 143-173, October.
    36. Cristian Garcia Palomer & Ricardo Paredes, 2010. "Reducing the Educational Gap: Good Results in Vulnerable Groups," Journal of Development Studies, Taylor & Francis Journals, vol. 46(3), pages 535-555.
    37. Barrera-Osorio, Felipe, 2007. "The impact of private provision of public education : empirical evidence from Bogota's concession schools," Policy Research Working Paper Series 4121, The World Bank.
    38. Joshua Angrist & Eric Bettinger & Michael Kremer, 2006. "Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," American Economic Review, American Economic Association, vol. 96(3), pages 847-862, June.
    39. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 126(4), pages 1709-1753.
    40. Jerik Hanushek & Dennis Kimko, 2006. "Schooling, Labor-force Quality, and the Growth of Nations," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 154-193.
    41. Elizabeth Asiedu & Boaz Nandwa, 2007. "On the Impact of Foreign Aid in Education on Growth: How Relevant Is the Heterogeneity of Aid Flows and the Heterogeneity of Aid Recipients?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 143(4), pages 631-649, December.
    42. Laurini, Márcio Poletti & de Carvalho Andrade, Eduardo, 2012. "New evidence on the role of cognitive skill in economic development," Economics Letters, Elsevier, vol. 117(1), pages 123-126.
    43. Anand, Priyanka & Mizala, Alejandra & Repetto, Andrea, 2009. "Using school scholarships to estimate the effect of private education on the academic achievement of low-income students in Chile," Economics of Education Review, Elsevier, vol. 28(3), pages 370-381, June.
    44. Michael Kremer, 2003. "Randomized Evaluations of Educational Programs in Developing Countries: Some Lessons," American Economic Review, American Economic Association, vol. 93(2), pages 102-106, May.
    45. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    46. Paul Glewwe, 2002. "Schools and Skills in Developing Countries: Education Policies and Socioeconomic Outcomes," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 436-482, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Masino, Serena & Niño-Zarazúa, Miguel, 2016. "What works to improve the quality of student learning in developing countries?," International Journal of Educational Development, Elsevier, vol. 48(C), pages 53-65.
    2. Masino, Serena & Niño-Zarazúa, Miguel, 2016. "What works to improve the quality of student learning in developing countries?," International Journal of Educational Development, Elsevier, vol. 48(C), pages 53-65.
    3. Glewwe, Paul & Kremer, Michael, 2006. "Schools, Teachers, and Education Outcomes in Developing Countries," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 2, chapter 16, pages 945-1017, Elsevier.
    4. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    5. Alejandro J. Ganimian & Richard J. Murnane, 2014. "Improving Educational Outcomes in Developing Countries: Lessons from Rigorous Impact Evaluations," NBER Working Papers 20284, National Bureau of Economic Research, Inc.
    6. Francesca Marchetta & Tom Dilly, 2019. "Supporting Education in Africa: Opportunities and Challenges for an Impact Investor," Working Papers hal-02288103, HAL.
    7. Harounan Kazianga & Leigh Linden & Ali Protik & Matt Sloan, 2015. "Impact Evaluation of Burkina Faso's BRIGHT Program: Design Report," Mathematica Policy Research Reports c0250cd3f27d448ea70d909c3, Mathematica Policy Research.
    8. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    9. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    10. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    11. Hüseyin Taştan & Selin Erdoğan, 2018. "Cognitive skills and economic performance: evidence from the recent international student assessment tests," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 8(3), pages 417-449, December.
    12. Miguel Urquiola, 2015. "Progress and challenges in achieving an evidence-based education policy in Latin America and the Caribbean," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-30, December.
    13. Committee, Nobel Prize, 2019. "Understanding development and poverty alleviation," Nobel Prize in Economics documents 2019-2, Nobel Prize Committee.
    14. Vegas, E & Ganimian, A. J., 2013. "Theory and Evidence on Teacher Policies in Developed and Developing Countries," Working Paper 104291, Harvard University OpenScholar.
    15. Tan, Clifford, 2013. "The contribution of university rankings to country's GDP per capita," MPRA Paper 53900, University Library of Munich, Germany.
    16. Orazem, Peter F. & Glewwe, Paul & Patrinos, Harry, 2007. "The Benefits and Costs of Alternative Strategies to Improve Educational Outcomes," Working Papers 7352, Iowa State University, Department of Economics.
    17. Eric A. Hanushek, 2008. "Incentives for Efficiency and Equity in the School System," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(s1), pages 5-27, May.
    18. Lenkei, Balint & Mustafa, Ghulam & Vecchi, Michela, 2018. "Growth in emerging economies: Is there a role for education?," Economic Modelling, Elsevier, vol. 73(C), pages 240-253.
    19. Md. Rabiul Islam & James B. Ang & Jakob B. Madsen, 2014. "Quality-Adjusted Human Capital And Productivity Growth," Economic Inquiry, Western Economic Association International, vol. 52(2), pages 757-777, April.

    More about this item

    Keywords

    Education For All; Primary Education; Secondary Education; Tertiary Education; Effective Schools and Teachers;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:7203. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.