IDEAS home Printed from https://ideas.repec.org/a/oup/wbrobs/v31y2016i2p242-270..html
   My bibliography  Save this article

What Really Works to Improve Learning in Developing Countries? An Analysis of Divergent Findings in Systematic Reviews

Author

Listed:
  • David K. Evans
  • Anna Popova

Abstract

Over the course of just two years, at least six reviews have examined interventions that seek to improve learning outcomes in developing countries. Although the reviews ostensibly have the same objective, they reach sometimes starkly different conclusions. The first objective of this paper is to identify why reviews diverge in their conclusions and how future reviews can be more effective. The second objective is to identify areas of overlap in the recommendations of existing reviews of what works to improve learning. This paper demonstrates that divergence in the recommendations of learning reviews is largely driven by differences in the samples of research incorporated in each review. Of 229 studies with student learning results, the most inclusive review incorporates less than half of the total studies. Across the reviews, two classes of programs are recommended with some consistency. Pedagogical interventions that tailor teaching to student learning levels—either teacher-led or facilitated by adaptive learning software—are effective at improving student test scores, as are individualized, repeated teacher training interventions often associated with a specific task or tool. Future reviews will be most useful if they combine narrative review with meta-analysis, conduct more exhaustive searches, and maintain low aggregation of intervention categories.

Suggested Citation

  • David K. Evans & Anna Popova, 2016. "What Really Works to Improve Learning in Developing Countries? An Analysis of Divergent Findings in Systematic Reviews," World Bank Research Observer, World Bank Group, vol. 31(2), pages 242-270.
  • Handle: RePEc:oup:wbrobs:v:31:y:2016:i:2:p:242-270.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/wbro/lkw004
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Eric Hanushek & Ludger Woessmann, 2012. "Do better schools lead to more growth? Cognitive skills, economic outcomes, and causation," Journal of Economic Growth, Springer, vol. 17(4), pages 267-321, December.
    2. George Psacharopoulos, 1985. "Returns to Education: A Further International Update and Implications," Journal of Human Resources, University of Wisconsin Press, vol. 20(4), pages 583-604.
    3. Gérard Lassibille & Jee-Peng Tan & Cornelia Jesse & Trang Van Nguyen, 2010. "Managing for Results in Primary Education in Madagascar: Evaluating the Impact of Selected Workflow Interventions," World Bank Economic Review, World Bank Group, vol. 24(2), pages 303-329, August.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, Oxford University Press, vol. 122(3), pages 1235-1264.
    5. Duflo, Esther & Dupas, Pascaline & Kremer, Michael, 2015. "School governance, teacher incentives, and pupil–teacher ratios: Experimental evidence from Kenyan primary schools," Journal of Public Economics, Elsevier, vol. 123(C), pages 92-110.
    6. George Psacharopoulos & Harry Anthony Patrinos, 2004. "Returns to investment in education: a further update," Education Economics, Taylor & Francis Journals, vol. 12(2), pages 111-134.
    7. Jamison, Eliot A. & Jamison, Dean T. & Hanushek, Eric A., 2007. "The effects of education quality on income growth and mortality decline," Economics of Education Review, Elsevier, vol. 26(6), pages 771-788, December.
    8. Rebelo, Sergio, 1991. "Long-Run Policy Analysis and Long-Run Growth," Journal of Political Economy, University of Chicago Press, vol. 99(3), pages 500-521, June.
    9. Robert J. Barro, 1991. "Economic Growth in a Cross Section of Countries," The Quarterly Journal of Economics, Oxford University Press, vol. 106(2), pages 407-443.
    10. Eric A. Hanushek & Ludger Woessmann, 2008. "The Role of Cognitive Skills in Economic Development," Journal of Economic Literature, American Economic Association, vol. 46(3), pages 607-668, September.
    11. Petrakis, P. E. & Stamatakis, D., 2002. "Growth and educational levels: a comparative analysis," Economics of Education Review, Elsevier, vol. 21(5), pages 513-521, October.
    12. Joshua Angrist & Eric Bettinger & Erik Bloom & Elizabeth King & Michael Kremer, 2002. "Vouchers for Private Schooling in Colombia: Evidence from a Randomized Natural Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1535-1558, December.
    13. Paqueo, Vicente & Lopez-Acevedo, Gladys, 2003. "Supply-side school improvement and the learning achievement of the poorest children in indigenous and rural schools - the case of PARE," Policy Research Working Paper Series 3172, The World Bank.
    14. M. Niaz Asadullah, 2005. "The effect of class size on student achievement: evidence from Bangladesh," Applied Economics Letters, Taylor & Francis Journals, vol. 12(4), pages 217-221.
    15. Glewwe, Paul & Kremer, Michael & Moulin, Sylvie & Zitzewitz, Eric, 2004. "Retrospective vs. prospective analyses of school inputs: the case of flip charts in Kenya," Journal of Development Economics, Elsevier, vol. 74(1), pages 251-268, June.
    16. Jere R. Behrman & Susan W. Parker & Petra E. Todd & Kenneth I. Wolpin, 2015. "Aligning Learning Incentives of Students and Teachers: Results from a Social Experiment in Mexican High Schools," Journal of Political Economy, University of Chicago Press, vol. 123(2), pages 325-364.
    17. Karthik Muralidharan & Venkatesh Sundararaman, 2010. "The Impact of Diagnostic Feedback to Teachers on Student Learning: Experimental Evidence from India," Economic Journal, Royal Economic Society, vol. 120(546), pages 187-203, August.
    18. Ewald Walterskirchen & et al., 1998. "Exportgetragenes Wirtschaftswachstum. Österreichs Wirtschaft im Jahr 1997," WIFO Monatsberichte (monthly reports), WIFO, vol. 71(4), pages 239-280, April.
    19. Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan, 2007. "Teacher Shocks and Student Learning: Evidence from Zambia," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
    20. Sylvie Moulin & Michael Kremer & Paul Glewwe, 2009. "Many Children Left Behind? Textbooks and Test Scores in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 112-135, January.
    21. Dana Burde & Leigh L. Linden, 2012. "The Effect of Village-Based Schools: Evidence from a Randomized Controlled Trial in Afghanistan," NBER Working Papers 18039, National Bureau of Economic Research, Inc.
    22. Michael Kremer & Edward Miguel & Rebecca Thornton, 2009. "Incentives to Learn," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 437-456, August.
    23. Barrera-Osorio, Felipe & Linden, Leigh L., 2009. "The use and misuse of computers in education : evidence from a randomized experiment in Colombia," Policy Research Working Paper Series 4836, The World Bank.
    24. Kingdon, Geeta Gandhi & Teal, Francis, 2007. "Does performance related pay for teachers improve student performance? Some evidence from India," Economics of Education Review, Elsevier, vol. 26(4), pages 473-486, August.
    25. Robert J. Barro, 2001. "Human Capital and Growth," American Economic Review, American Economic Association, vol. 91(2), pages 12-17, May.
    26. Paul M. Romer, 1994. "The Origins of Endogenous Growth," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 3-22, Winter.
    27. Lucas, Robert Jr., 1988. "On the mechanics of economic development," Journal of Monetary Economics, Elsevier, vol. 22(1), pages 3-42, July.
    28. Gary S. Becker, 1962. "Investment in Human Capital: A Theoretical Analysis," NBER Chapters, in: Investment in Human Beings, pages 9-49, National Bureau of Economic Research, Inc.
    29. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    30. Elizabeth Asiedu & Boaz Nandwa, 2007. "The Impact of Foreign Aid in Education Growth: How Relevant is the Heterogeneity of Aid Flows and the Heterogeneity of Aid Recipients?," WIDER Working Paper Series RP2007-60, World Institute for Development Economic Research (UNU-WIDER).
    31. Galiani, Sebastian & Gertler, Paul & Schargrodsky, Ernesto, 2008. "School decentralization: Helping the good get better, but leaving the poor behind," Journal of Public Economics, Elsevier, vol. 92(10-11), pages 2106-2120, October.
    32. Michael Kremer & Alaka Holla, 2009. "Improving Education in the Developing World: What Have We Learned from Randomized Evaluations?," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 513-545, May.
    33. Benhabib, Jess & Spiegel, Mark M., 1994. "The role of human capital in economic development evidence from aggregate cross-country data," Journal of Monetary Economics, Elsevier, vol. 34(2), pages 143-173, October.
    34. Cristian Garcia Palomer & Ricardo Paredes, 2010. "Reducing the Educational Gap: Good Results in Vulnerable Groups," Journal of Development Studies, Taylor & Francis Journals, vol. 46(3), pages 535-555.
    35. Barrera-Osorio, Felipe, 2007. "The impact of private provision of public education : empirical evidence from Bogota's concession schools," Policy Research Working Paper Series 4121, The World Bank.
    36. Joshua Angrist & Eric Bettinger & Michael Kremer, 2006. "Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," American Economic Review, American Economic Association, vol. 96(3), pages 847-862, June.
    37. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 126(4), pages 1709-1753.
    38. Jerik Hanushek & Dennis Kimko, 2006. "Schooling, Labor-force Quality, and the Growth of Nations," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 154-193.
    39. Elizabeth Asiedu & Boaz Nandwa, 2007. "On the Impact of Foreign Aid in Education on Growth: How Relevant Is the Heterogeneity of Aid Flows and the Heterogeneity of Aid Recipients?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 143(4), pages 631-649, December.
    40. Laurini, Márcio Poletti & de Carvalho Andrade, Eduardo, 2012. "New evidence on the role of cognitive skill in economic development," Economics Letters, Elsevier, vol. 117(1), pages 123-126.
    41. Anand, Priyanka & Mizala, Alejandra & Repetto, Andrea, 2009. "Using school scholarships to estimate the effect of private education on the academic achievement of low-income students in Chile," Economics of Education Review, Elsevier, vol. 28(3), pages 370-381, June.
    42. Michael Kremer, 2003. "Randomized Evaluations of Educational Programs in Developing Countries: Some Lessons," American Economic Review, American Economic Association, vol. 93(2), pages 102-106, May.
    43. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    44. Paul Glewwe, 2002. "Schools and Skills in Developing Countries: Education Policies and Socioeconomic Outcomes," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 436-482, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Masino, Serena & Niño-Zarazúa, Miguel, 2016. "What works to improve the quality of student learning in developing countries?," International Journal of Educational Development, Elsevier, vol. 48(C), pages 53-65.
    2. Masino, Serena & Niño-Zarazúa, Miguel, 2016. "What works to improve the quality of student learning in developing countries?," International Journal of Educational Development, Elsevier, vol. 48(C), pages 53-65.
    3. Francesca Marchetta & Tom Dilly, 2019. "Supporting Education in Africa: Opportunities and Challenges for an Impact Investor," Working Papers hal-02288103, HAL.
    4. Alejandro J. Ganimian & Richard J. Murnane, 2014. "Improving Educational Outcomes in Developing Countries: Lessons from Rigorous Impact Evaluations," NBER Working Papers 20284, National Bureau of Economic Research, Inc.
    5. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    6. Miguel Urquiola, 2015. "Progress and challenges in achieving an evidence-based education policy in Latin America and the Caribbean," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-30, December.
    7. Glewwe, Paul & Kremer, Michael, 2006. "Schools, Teachers, and Education Outcomes in Developing Countries," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 2, chapter 16, pages 945-1017, Elsevier.
    8. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    9. Hüseyin Taştan & Selin Erdoğan, 2018. "Cognitive skills and economic performance: evidence from the recent international student assessment tests," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 8(3), pages 417-449, December.
    10. Harounan Kazianga & Leigh Linden & Ali Protik & Matt Sloan, 2015. "Impact Evaluation of Burkina Faso's BRIGHT Program: Design Report," Mathematica Policy Research Reports c0250cd3f27d448ea70d909c3, Mathematica Policy Research.
    11. Lenkei, Balint & Mustafa, Ghulam & Vecchi, Michela, 2018. "Growth in emerging economies: Is there a role for education?," Economic Modelling, Elsevier, vol. 73(C), pages 240-253.
    12. Committee, Nobel Prize, 2019. "Understanding development and poverty alleviation," Nobel Prize in Economics documents 2019-2, Nobel Prize Committee.
    13. Eric A. Hanushek & Ludger Woessmann, 2008. "The Role of Cognitive Skills in Economic Development," Journal of Economic Literature, American Economic Association, vol. 46(3), pages 607-668, September.
    14. Orazem, Peter & Glewwe, Paul & Patrinos, Harry, 2007. "The Benefits and Costs of Alternative Strategies to Improve Educational Outcomes," Staff General Research Papers Archive 12853, Iowa State University, Department of Economics.
    15. Md. Rabiul Islam & James B. Ang & Jakob B. Madsen, 2014. "Quality-Adjusted Human Capital And Productivity Growth," Economic Inquiry, Western Economic Association International, vol. 52(2), pages 757-777, April.
    16. Amavilah, Voxi Heinrich, 2014. "Knowledge = Technology + Human Capital and the Lucas and Romer Production Functions," MPRA Paper 58847, University Library of Munich, Germany.
    17. Tony Addison & Miguel Niño‐Zarazúa & Finn Tarp, 2015. "Aid, Social Policy and Development," Journal of International Development, John Wiley & Sons, Ltd., vol. 27(8), pages 1351-1365, November.
    18. Altinok, Nadir & Aydemir, Abdurrahman, 2017. "Does one size fit all? The impact of cognitive skills on economic growth," Journal of Macroeconomics, Elsevier, vol. 53(C), pages 176-190.
    19. Daren, Conrad, 2007. "Education and Economic Growth: Is There a Link?," MPRA Paper 18176, University Library of Munich, Germany, revised 2009.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:wbrobs:v:31:y:2016:i:2:p:242-270.. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/wrldbus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://edirc.repec.org/data/wrldbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.