IDEAS home Printed from https://ideas.repec.org/a/oup/wbecrv/v39y2025i2p473-496..html
   My bibliography  Save this article

Why Programs Fail: Lessons for Improving Public Service Quality from a Mixed-Methods Evaluation of an Unsuccessful Teacher Training Program in Nepal

Author

Listed:
  • Julie Schaffner
  • Paul Glewwe
  • Uttam Sharma

Abstract

This study demonstrates rigorously that an at-scale government training program for secondary teachers in Nepal had little or no impact on student learning. It then documents five sets of weaknesses related to training uptake, training-session management, teacher subject knowledge, teacher adoption of new classroom practices, and student knowledge of earlier-grade curriculum content, each of which plausibly explains some, but not all, of the program's failure. While weaknesses in trainer and teacher motivation may have contributed to the program's disappointing performance, the study argues that time, resource, and capacity constraints of both trainers and teachers, and a mismatch between policy design and student learning needs, also limited program success. These results highlight the need to broaden common accountability-focused conceptions of how to improve public service quality.

Suggested Citation

  • Julie Schaffner & Paul Glewwe & Uttam Sharma, 2025. "Why Programs Fail: Lessons for Improving Public Service Quality from a Mixed-Methods Evaluation of an Unsuccessful Teacher Training Program in Nepal," The World Bank Economic Review, World Bank, vol. 39(2), pages 473-496.
  • Handle: RePEc:oup:wbecrv:v:39:y:2025:i:2:p:473-496.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/wber/lhae028
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or

    for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sabrin Beg & Waqas Halim & Adrienne M. Lucas & Umar Saif, 2022. "Engaging Teachers with Technology Increased Achievement, Bypassing Teachers Did Not," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 61-90, May.
    2. Anna Popova & David K Evans & Mary E Breeding & Violeta Arancibia, 2022. "Teacher Professional Development around the World: The Gap between Evidence and Practice [Training to Teach Science: Experimental Evidence from Argentina]," The World Bank Research Observer, World Bank, vol. 37(1), pages 107-136.
    3. Prashant Loyalka & Anna Popova & Guirong Li & Zhaolei Shi, 2019. "Does Teacher Training Actually Work? Evidence from a Large-Scale Randomized Evaluation of a National Teacher Training Program," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 128-154, July.
    4. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukherji & Marc Shotland & Michael Walton, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level” in India," NBER Working Papers 22746, National Bureau of Economic Research, Inc.
    5. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    6. Renata Lemos & Karthik Muralidharan & Daniela Scur, 2024. "Personnel Management and School Productivity: Evidence from India," The Economic Journal, Royal Economic Society, vol. 134(661), pages 2071-2100.
    7. Gauri, Varun & Jamison, Julian C. & Mazar, Nina & Ozier, Owen, 2021. "Motivating bureaucrats through social recognition: External validity—A tale of two states," Organizational Behavior and Human Decision Processes, Elsevier, vol. 163(C), pages 117-131.
    8. Jacobus Cilliers & Brahm Fleisch & Cas Prinsloo & Stephen Taylor, 2020. "How to Improve Teaching Practice?: An Experimental Comparison of Centralized Training and In-Classroom Coaching," Journal of Human Resources, University of Wisconsin Press, vol. 55(3), pages 926-962.
    9. Abhijit Banerjee & Rukmini Banerji & Esther Duflo, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level†in India," Working Papers id:11419, eSocialSciences.
    10. Glewwe, P. & Muralidharan, K., 2016. "Improving Education Outcomes in Developing Countries," Handbook of the Economics of Education,, Elsevier.
    11. Habtamu Fuje & Prateek Tandon, 2018. "When do in‐service teacher training and books improve student achievement? Experimental evidence from Mongolia," Review of Development Economics, Wiley Blackwell, vol. 22(3), pages 1360-1383, August.
    12. World Bank, 2018. "World Development Report 2018 [Rapport sur le développement dans le monde 2018]," World Bank Publications - Books, The World Bank Group, number 28340, April.
    13. Macdonald,Kevin Alan David & Brinkman,Sally Anne & Jarvie,Wendy & Machuca-Sierra,Myrna & Mcdonall,Kristen Andrew & Messaoud-Galusi,Souhila & Tapueluelu,Siosiana & Vu,Binh Thanh, 2018. "Intervening at Home and Then at School : A Randomized Evaluation of Two Approaches to Improve Early Educational Outcomes in Tonga," Policy Research Working Paper Series 8682, The World Bank.
    14. Adrienne M. Lucas & Patrick J. McEwan & Moses Ngware & Moses Oketch, 2014. "Improving Early‐Grade Literacy In East Africa: Experimental Evidence From Kenya And Uganda," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(4), pages 950-976, September.
    15. Rosangela Bando & Emma Näslund-Hadley & Paul Gertler, 2019. "Effect of Inquiry and Problem Based Pedagogy on Learning: Evidence from 10 Field Experiments in Four Countries," NBER Working Papers 26280, National Bureau of Economic Research, Inc.
    16. Linxiu Zhang & Fang Lai & Xiaopeng Pang & Hongmei Yi & Scott Rozelle, 2013. "The impact of teacher training on teacher and student outcomes: evidence from a randomised experiment in Beijing migrant schools," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 5(3), pages 339-358, September.
    17. Asian Development Bank Institute, 2017. "Innovative Strategies in Higher Education for Accelerated Human Resource Development in South Asia: Nepal," Working Papers id:11816, eSocialSciences.
    18. Blimpo, Moussa P. & Pugatch, Todd, 2021. "Entrepreneurship education and teacher training in Rwanda," Journal of Development Economics, Elsevier, vol. 149(C).
    19. Cilliers, Jacobus & Fleisch, Brahm & Kotze, Janeli & Mohohlwane, Nompumelelo & Taylor, Stephen & Thulare, Tsegofatso, 2022. "Can virtual replace in-person coaching? Experimental evidence on teacher professional development and student learning," Journal of Development Economics, Elsevier, vol. 155(C).
    20. Annie Duflo & Jessica Kiessel & Adrienne Lucas, 2020. "Experimental Evidence on Alternative Policies to Increase Learning at Scale," NBER Working Papers 27298, National Bureau of Economic Research, Inc.
    21. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2010. "Teacher Credentials and Student Achievement in High School: A Cross-Subject Analysis with Student Fixed Effects," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    22. Piper, Benjamin & Simmons Zuilkowski, Stephanie & Dubeck, Margaret & Jepkemei, Evelyn & King, Simon J., 2018. "Identifying the essential ingredients to literacy and numeracy improvement: Teacher professional development and coaching, student textbooks, and structured teachers’ guides," World Development, Elsevier, vol. 106(C), pages 324-336.
    23. Berry, James & Kannan, Harini & Mukherji, Shobhini & Shotland, Marc, 2020. "Failure of frequent assessment: An evaluation of India’s continuous and comprehensive evaluation program," Journal of Development Economics, Elsevier, vol. 143(C).
    24. Bruns, Barbara & Costa, Leandro & Cunha, Nina, 2018. "Through the looking glass: Can classroom observation and coaching improve teacher performance in Brazil?," Economics of Education Review, Elsevier, vol. 64(C), pages 214-250.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Juan F. Castro & Paul Glewwe & Ricardo Montero, 2019. "Work With What You’ve Got: Improving Teachers’ Pedagogical Skills at Scale in Rural Peru," Working Papers 158, Peruvian Economic Association.
    2. Biswas, Kumar & de Galbert, Pierre & Sabarwal, Shwetlena & Glave, Carla Z. & Asaduzzaman, T.M., 2025. "Online training and financial incentives for teachers: Evidence from Bangladesh," Journal of Economic Behavior & Organization, Elsevier, vol. 229(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blimpo, Moussa P. & Pugatch, Todd, 2021. "Entrepreneurship education and teacher training in Rwanda," Journal of Development Economics, Elsevier, vol. 149(C).
    2. Johnston, Jamie & Ksoll, Christopher, 2022. "Effectiveness of interactive satellite-transmitted instruction: Experimental evidence from Ghanaian primary schools," Economics of Education Review, Elsevier, vol. 91(C).
    3. Cruz Aguayo, Yyannu & Carneiro, Pedro & Intriago, Ruthy & Ponce, Juan & Schady, Norbert & Schodt, Sarah, 2022. "When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country," IZA Discussion Papers 15021, Institute of Labor Economics (IZA).
    4. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    5. Buhl-Wiggers, Julie & Kerwin, Jason T. & Muñoz-Morales, Juan & Smith, Jeffrey & Thornton, Rebecca, 2024. "Some children left behind: Variation in the effects of an educational intervention," Journal of Econometrics, Elsevier, vol. 243(1).
    6. Juan F. Castro & Paul Glewwe & Ricardo Montero, 2019. "Work With What You’ve Got: Improving Teachers’ Pedagogical Skills at Scale in Rural Peru," Working Papers 158, Peruvian Economic Association.
    7. Bellue, Suzanne & Bouguen, Adrien & Gurgand, Marc & Munier, Valerie & Tricot, André, 2024. "When Effective teacher training falls short in the classroom: Evidence from an experiment in primary schools," Economics of Education Review, Elsevier, vol. 103(C).
    8. Blimpo, Moussa & Pugatch, Todd, 2023. "Unintended Consequences of Youth Entrepreneurship Programs: Experimental Evidence from Rwanda," IZA Discussion Papers 16489, Institute of Labor Economics (IZA).
    9. Juan F. Castro & Paul Glewwe & Alexandra Heredia‐Mayo & Stephanie Majerowicz & Ricardo Montero, 2025. "Can teaching be taught? Improving teachers' pedagogical skills at scale in rural Peru," Quantitative Economics, Econometric Society, vol. 16(1), pages 185-233, January.
    10. Angrist, Noam & de Barros, Andreas & Bhula, Radhika & Chakera, Shiraz & Cummiskey, Chris & DeStefano, Joseph & Floretta, John & Kaffenberger, Michelle & Piper, Benjamin & Stern, Jonathan, 2021. "Building back better to avert a learning catastrophe: Estimating learning loss from COVID-19 school shutdowns in Africa and facilitating short-term and long-term learning recovery," International Journal of Educational Development, Elsevier, vol. 84(C).
    11. Aymo Brunetti & Konstantin Büchel & Martina Jakob & Ben Jann & Daniel Steffen, 2021. "Inadequate Teacher Content Knowledge and What to Do About It: Evidence from El Salvador," University of Bern Social Sciences Working Papers 41, University of Bern, Department of Social Sciences.
    12. Hanushek, Eric A., 2021. "Addressing cross-national generalizability in educational impact evaluation," International Journal of Educational Development, Elsevier, vol. 80(C).
    13. Anand, Gautam & Atluri, Aishwarya & Crawfurd, Lee & Pugatch, Todd & Sheth, Ketki, 2023. "Improving school management in low and middle income countries: A systematic review," Economics of Education Review, Elsevier, vol. 97(C).
    14. Annie Duflo & Jessica Kiessel & Adrienne Lucas, 2020. "Experimental Evidence on Alternative Policies to Increase Learning at Scale," NBER Working Papers 27298, National Bureau of Economic Research, Inc.
    15. Emily Beam & Priya Mukherjee & Laia Navarro-Sola, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," Working Papers 2022-030, Human Capital and Economic Opportunity Working Group.
    16. Sabrin Beg & Waqas Halim & Adrienne M. Lucas & Umar Saif, 2022. "Engaging Teachers with Technology Increased Achievement, Bypassing Teachers Did Not," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 61-90, May.
    17. Yue-Yi Hwa & Clare Leaver, 2021. "Management in education systems," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 37(2), pages 367-391.
    18. Yasuyuki Sawada & Minhaj Mahmud & Mai Seki & Hikaru Kawarazaki, 2024. "Fighting the Learning Crisis in Developing Countries: A Randomized Experiment of Self-Learning at the Right Level," Economic Development and Cultural Change, University of Chicago Press, vol. 72(4), pages 1893-1921.
    19. Orozco Olvera,Victor Hugo & Rascon Ramirez,Ericka G., 2023. "Improving Enrollment and Learning through Videos and Mobiles : Experimental Evidence fromNorthern Nigeria," Policy Research Working Paper Series 10413, The World Bank.
    20. Jacobus Cilliers & Brahm Fleisch & Cas Prinsloo & Stephen Taylor, 2020. "How to Improve Teaching Practice?: An Experimental Comparison of Centralized Training and In-Classroom Coaching," Journal of Human Resources, University of Wisconsin Press, vol. 55(3), pages 926-962.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:wbecrv:v:39:y:2025:i:2:p:473-496.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://edirc.repec.org/data/wrldbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.