IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp15021.html
   My bibliography  Save this paper

When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country

Author

Listed:
  • Cruz-Aguayo, Yyannú

    (Inter-American Development Bank)

  • Carneiro, Pedro

    (University College London)

  • Intriago, Ruthy

    (Flacso)

  • Ponce, Juan

    (Flacso)

  • Schady, Norbert

    (World Bank)

  • Schodt, Sarah

Abstract

Children in developing countries have deep deficits in math and language. Personalized coaching for teachers has been proposed as a way of raising teacher quality and child achievement. We designed a coaching program that focused on one aspect of teacher quality—teacher-child interactions—that researchers in education and psychology have argued is critical for child development and learning. We implemented the coaching program in Ecuador, with 100 1st grade teachers randomly assigned to treatment and 100 to control. Coaching improved the quality of teacher-child interactions but reduced child achievement. Our results underline the importance of evaluating new forms of professional development for teachers, even those that follow best practice, before these interventions are taken to scale.

Suggested Citation

  • Cruz-Aguayo, Yyannú & Carneiro, Pedro & Intriago, Ruthy & Ponce, Juan & Schady, Norbert & Schodt, Sarah, 2022. "When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country," IZA Discussion Papers 15021, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp15021
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp15021.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    2. Gabriella Conti & James J. Heckman & Rodrigo Pinto, 2016. "The Effects of Two Influential Early Childhood Interventions on Health and Healthy Behaviour," Economic Journal, Royal Economic Society, vol. 126(596), pages 28-65, October.
    3. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    4. David K. Evans & Anna Popova, 2016. "What Really Works to Improve Learning in Developing Countries? An Analysis of Divergent Findings in Systematic Reviews," The World Bank Research Observer, World Bank, vol. 31(2), pages 242-270.
    5. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    6. Norbert Schady & Jere Behrman & Maria Caridad Araujo & Rodrigo Azuero & Raquel Bernal & David Bravo & Florencia Lopez-Boo & Karen Macours & Daniela Marshall & Christina Paxson & Renos Vakis, 2015. "Wealth Gradients in Early Childhood Cognitive Development in Five Latin American Countries," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 446-463.
    7. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    8. Anna Popova & David K Evans & Mary E Breeding & Violeta Arancibia, 2022. "Teacher Professional Development around the World: The Gap between Evidence and Practice [Training to Teach Science: Experimental Evidence from Argentina]," The World Bank Research Observer, World Bank, vol. 37(1), pages 107-136.
    9. Bold,Tessa & Filmer,Deon P. & Molina,Ezequiel & Svensson,Jakob, 2019. "The Lost Human Capital : Teacher Knowledge and Student Achievement in Africa," Policy Research Working Paper Series 8849, The World Bank.
    10. Glewwe, P. & Muralidharan, K., 2016. "Improving Education Outcomes in Developing Countries," Handbook of the Economics of Education,, Elsevier.
    11. Christina Paxson & Norbert Schady, 2007. "Cognitive Development among Young Children in Ecuador: The Roles of Wealth, Health, and Parenting," Journal of Human Resources, University of Wisconsin Press, vol. 42(1).
    12. James Heckman & Rodrigo Pinto & Peter Savelyev, 2013. "Understanding the Mechanisms through Which an Influential Early Childhood Program Boosted Adult Outcomes," American Economic Review, American Economic Association, vol. 103(6), pages 2052-2086, October.
    13. C. Kirabo Jackson & Jonah E. Rockoff & Douglas O. Staiger, 2014. "Teacher Effects and Teacher-Related Policies," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 801-825, August.
    14. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    15. Jorge Luis García & James J. Heckman & Duncan Ermini Leaf & María José Prados, 2020. "Quantifying the Life-Cycle Benefits of an Influential Early-Childhood Program," Journal of Political Economy, University of Chicago Press, vol. 128(7), pages 2502-2541.
    16. Omar Al-Ubaydli & John A. List & Dana L. Suskind, 2017. "What Can We Learn from Experiments? Understanding the Threats to the Scalability of Experimental Results," American Economic Review, American Economic Association, vol. 107(5), pages 282-286, May.
    17. Christina Paxson & Norbert Schady, 2010. "Does Money Matter? The Effects of Cash Transfers on Child Development in Rural Ecuador," Economic Development and Cultural Change, University of Chicago Press, vol. 59(1), pages 187-229, October.
    18. Kosuke Imai & Dustin Tingley & Teppei Yamamoto, 2013. "Experimental designs for identifying causal mechanisms," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 5-51, January.
    19. Gabriella Conti & James J. Heckman & Rodrigo Pinto, 2016. "The Effects of Two Influential Early Childhood Interventions on Health and Healthy Behaviour," Economic Journal, Royal Economic Society, vol. 126(596), pages 28-65, October.
    20. Prashant Loyalka & Anna Popova & Guirong Li & Zhaolei Shi, 2019. "Does Teacher Training Actually Work? Evidence from a Large-Scale Randomized Evaluation of a National Teacher Training Program," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 128-154, July.
    21. repec:idb:brikps:7259 is not listed on IDEAS
    22. M. Caridad Araujo & Marta Dormal & Norbert Schady, 2019. "Childcare Quality and Child Development," Journal of Human Resources, University of Wisconsin Press, vol. 54(3), pages 656-682.
    23. Busso, Matías & Cristia, Julian P. & Hincapie, Diana & Messina, Julián & Ripani, Laura, 2017. "Learning Better: Public Policy for Skills Development," IDB Publications (Books), Inter-American Development Bank, number 8495.
    24. Samuel Berlinski & Norbert Schady (ed.), 2015. "The Early Years," Palgrave Macmillan Books, Palgrave Macmillan, number 978-1-137-53649-5.
    25. Jacobus Cilliers & Brahm Fleisch & Cas Prinsloo & Stephen Taylor, 2020. "How to Improve Teaching Practice?: An Experimental Comparison of Centralized Training and In-Classroom Coaching," Journal of Human Resources, University of Wisconsin Press, vol. 55(3), pages 926-962.
    26. Anna, Petrenko, 2016. "Мaркування готової продукції як складова частина інформаційного забезпечення маркетингової діяльності підприємств овочепродуктового підкомплексу," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 2(1), March.
    27. María Caridad Araujo & Martín Ardanaz & Edna Armendáriz & Jere R. Behrman & Samuel Berlinski & Julian P. Cristia & Yyannu Cruz-Aguayo & Luca Flabbi & Diana Hincapie & Analía Jalmovich & Sharon Lynn Ka, 2015. "The Early Years: Child Well-being and the Role of Public Policy," IDB Publications (Books), Inter-American Development Bank, number 91496 edited by Samuel Berlinski & Norbert Schady, February.
    28. World Bank, 2018. "World Development Report 2018 [Rapport sur le développement dans le monde 2018]," World Bank Publications - Books, The World Bank Group, number 28340, December.
    29. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    30. Popova,Anna & Evans,David & Arancibia,Violeta, 2016. "Training teachers on the job : what works and how to measure it," Policy Research Working Paper Series 7834, The World Bank.
    31. Natalie Bau & Jishnu Das, 2020. "Teacher Value Added in a Low-Income Country," American Economic Journal: Economic Policy, American Economic Association, vol. 12(1), pages 62-96, February.
    32. Eric A. Hanushek & Steven G. Rivkin, 2012. "The Distribution of Teacher Quality and Implications for Policy," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 131-157, July.
    33. Araujo, María Caridad & Ardanaz, Martín & Armendáriz, Edna & Behrman, Jere R. & Berlinski, Samuel & Cristia, Julian P. & Flabbi, Luca & Hincapie, Diana & Jalmovich, Analía & Kagan, Sharon Lynn & Lopez, 2015. "The Early Years: Child Well-being and the Role of Public Policy," IDB Publications (Books), Inter-American Development Bank, number 7259.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    2. Hojman, Andrés & Lopez Boo, Florencia, 2022. "Public childcare benefits children and mothers: Evidence from a nationwide experiment in a developing country," Journal of Public Economics, Elsevier, vol. 212(C).
    3. Blimpo, Moussa P. & Pugatch, Todd, 2021. "Entrepreneurship education and teacher training in Rwanda," Journal of Development Economics, Elsevier, vol. 149(C).
    4. Cruz-Aguayo, Yyannú & Ibarrarán, Pablo & Schady, Norbert, 2017. "Do tests applied to teachers predict their effectiveness?," Economics Letters, Elsevier, vol. 159(C), pages 108-111.
    5. Araujo P., Maria Daniela & Quis, Johanna Sophie, 2021. "Parents can tell! Evidence on classroom quality differences in German primary schools," BERG Working Paper Series 172, Bamberg University, Bamberg Economic Research Group.
    6. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    7. Aymo Brunetti & Konstantin Büchel & Martina Jakob & Ben Jann & Daniel Steffen, 2021. "Inadequate Teacher Content Knowledge and What to Do About It: Evidence from El Salvador," University of Bern Social Sciences Working Papers 41, University of Bern, Department of Social Sciences.
    8. Huang, Wei & Li, Teng & Pan, Yinghao & Ren, Jinyang, 2023. "Teacher characteristics and student performance: Evidence from random teacher-student assignments in China," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 747-781.
    9. Samuel Berlinski & Norbert Schady, 2015. "Daycare Services: It’s All about Quality," Palgrave Macmillan Books, in: Samuel Berlinski & Norbert Schady (ed.), The Early Years, chapter 4, pages 91-119, Palgrave Macmillan.
    10. Filmer,Deon P. & Molina,Ezequiel & Wane,Waly, 2020. "Identifying Effective Teachers : Lessons from Four Classroom Observation Tools," Policy Research Working Paper Series 9365, The World Bank.
    11. Araujo P., María Daniela & Quis, Johanna Sophie, 2021. "Teacher Effects in Germany: Evidence from Elementary School," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242457, Verein für Socialpolitik / German Economic Association.
    12. Jason T. Kerwin & Rebecca L. Thornton, 2021. "Making the Grade: The Sensitivity of Education Program Effectiveness to Input Choices and Outcome Measures," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 251-264, May.
    13. Schaffner, Julie & Glewwe, Paul & Sharma, Uttam, 2021. "Why Programs Fail: Lessons for Improving Public Service Quality from a Mixed-Methods Evaluation of an Unsuccessful Teacher Training Program in Nepal," Staff Papers 316663, University of Minnesota, Department of Applied Economics.
    14. M. Caridad Araujo & Yyannu Cruz-Aguayo & Analia Jaimovich & Sharon Lynn Kagan, 2015. "Drawing Up an Institutional Architecture," IDB Publications (Book Chapters), in: Samuel Berlinski & Norbert Schady (ed.), The Early Years: Child Well-Being and the Role of Public Policy, edition 1, chapter 7, pages 179-202, Inter-American Development Bank.
    15. M. Caridad Araujo & Mariano Bosch & Norbert Schady, 2017. "Can Cash Transfers Help Households Escape an Intergenerational Poverty Trap?," NBER Chapters, in: The Economics of Poverty Traps, pages 357-382, National Bureau of Economic Research, Inc.
    16. World Bank, 2017. "Pre-Primary Education in Mongolia," World Bank Publications - Reports 26402, The World Bank Group.
    17. M. Caridad Araujo & Marta Dormal & Norbert Schady, 2019. "Childcare Quality and Child Development," Journal of Human Resources, University of Wisconsin Press, vol. 54(3), pages 656-682.
    18. Matteo Bobba & Tim Ederer & Gianmarco León-Ciliotta & Christopher A. Neilson & Marco Nieddu, 2021. "Teacher compensation and structural inequality: Evidence from centralized teacher school choice in Perú," Economics Working Papers 1788, Department of Economics and Business, Universitat Pompeu Fabra.
    19. Maria Daniela Araujo P., 2019. "Measuring the Effect of Competitive Teacher Recruitment on Student Achievement: Evidence from Ecuador," Documentos de Trabajo 17285, The Latin American and Caribbean Economic Association (LACEA).
    20. Juan F. Castro & Paul Glewwe & Ricardo Montero, 2019. "Work With What You’ve Got: Improving Teachers’ Pedagogical Skills at Scale in Rural Peru," Working Papers 158, Peruvian Economic Association.

    More about this item

    Keywords

    teacher quality; coaching;

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp15021. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.