IDEAS home Printed from https://ideas.repec.org/p/sza/wpaper/wpapers308.html
   My bibliography  Save this paper

How to improve teaching practice? Experimental comparison of centralized training and in-classroom coaching

Author

Listed:
  • Jacobus Cilliers

    (McCourt School of Public Policy, Georgetown University)

  • Brahm Fleisch

    (University of Witwatersrand’s School of Education, South Africa)

  • Cas Prinsloo

    (University of Witwatersrand’s School of Education, South Africa)

  • Stephen Taylor

    (Department of Basic Education, Government of South Africa and Research Associate of the Department of Economics, University of Stellenbosch)

Abstract

We experimentally compare two modes of in-service professional development for South African public primary school teachers. In both programs teachers received the same learning material and daily lesson plans, aligned to the official home language literacy curriculum. Pupils exposed to two years of the program improved their reading proficiency by 0.12 standard deviations if their teachers received centralized training, compared to 0.24 if their teachers received in-class coaching. Classroom observations reveal that teachers were more likely to split pupils into smaller reading groups, which enabled individualized attention and more opportunities to practice reading. Results vary by class size and baseline pupil reading proficiency.

Suggested Citation

  • Jacobus Cilliers & Brahm Fleisch & Cas Prinsloo & Stephen Taylor, 2018. "How to improve teaching practice? Experimental comparison of centralized training and in-classroom coaching," Working Papers 15/2018, Stellenbosch University, Department of Economics.
  • Handle: RePEc:sza:wpaper:wpapers308
    as

    Download full text from publisher

    File URL: https://www.ekon.sun.ac.za/wpapers/2018/wp152018/wp152018.1.pdf
    File Function: First version, 2018
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    3. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    4. Brian A. Jacob & Lars Lefgren, 2004. "The Impact of Teacher Training on Student Achievement: Quasi-Experimental Evidence from School Reform Efforts in Chicago," Journal of Human Resources, University of Wisconsin Press, vol. 39(1).
    5. Philip Oreopoulos & Uros Petronijevic, 2018. "Student Coaching: How Far Can Technology Go?," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 299-329.
    6. Fleisch, Brahm & Schöer, Volker & Roberts, Gareth & Thornton, Amy, 2016. "System-wide improvement of early-grade mathematics: New evidence from the Gauteng Primary Language and Mathematics Strategy," International Journal of Educational Development, Elsevier, vol. 49(C), pages 157-174.
    7. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    8. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    9. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    10. Adrienne M. Lucas & Patrick J. McEwan & Moses Ngware & Moses Oketch, 2014. "Improving Early‐Grade Literacy In East Africa: Experimental Evidence From Kenya And Uganda," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(4), pages 950-976, September.
    11. Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan, 2007. "Teacher Shocks and Student Learning: Evidence from Zambia," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
    12. Acharya, Avidit & Blackwell, Matthew & Sen, Maya, 2016. "Explaining Causal Findings Without Bias: Detecting and Assessing Direct Effects," American Political Science Review, Cambridge University Press, vol. 110(3), pages 512-529, August.
    13. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    14. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2010. "Teacher Credentials and Student Achievement in High School: A Cross-Subject Analysis with Student Fixed Effects," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    15. Piper, Benjamin & Simmons Zuilkowski, Stephanie & Dubeck, Margaret & Jepkemei, Evelyn & King, Simon J., 2018. "Identifying the essential ingredients to literacy and numeracy improvement: Teacher professional development and coaching, student textbooks, and structured teachers’ guides," World Development, Elsevier, vol. 106(C), pages 324-336.
    16. Stephen Taylor, 2011. "Uncovering indicators of effective school management in South Africa using the National School Effectiveness Study," Working Papers 10/2011, Stellenbosch University, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jason T. Kerwin & Rebecca L. Thornton, 2021. "Making the Grade: The Sensitivity of Education Program Effectiveness to Input Choices and Outcome Measures," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 251-264, May.
    2. Cilliers, Jacobus & Fleisch, Brahm & Kotze, Janeli & Mohohlwane, Mpumi & Taylor, Stephen, 2022. "The Challenge of Sustaining Effective Teaching: Spillovers, Fade-out, and the Cost-effectiveness of Teacher Development Programs," Economics of Education Review, Elsevier, vol. 87(C).
    3. Aymo Brunetti & Konstantin B chel & Martina Jakob & Ben Jann & Daniel Steffen, 2021. "Inadequate Teacher Content Knowledge and What to Do About It: Evidence from El Salvador," Diskussionsschriften dp2114, Universitaet Bern, Departement Volkswirtschaft.
    4. Blimpo, Moussa P. & Pugatch, Todd, 2021. "Entrepreneurship education and teacher training in Rwanda," Journal of Development Economics, Elsevier, vol. 149(C).
    5. Buhl-Wiggers, Julie & Kerwin, Jason & Muñoz-Morales, Juan S. & Smith, Jeffrey A. & Thornton, Rebecca L., 2020. "Some Children Left Behind: Variation in the Effects of an Educational Intervention," IZA Discussion Papers 13598, Institute of Labor Economics (IZA).
    6. Amaro Da Costa Luz Carneiro,Pedro Manuel & Cruz-Aguayo,Yyannu & Intriago,Ruthy & Ponce,Juan & Schady,Norbert Rudiger & Schodt,Sarah, 2022. "When Promising Interventions Fail : Personalized Coaching for Teachers in a Middle-Income Country," Policy Research Working Paper Series 9926, The World Bank.
    7. Jacobus Cilliers & Isaac M. Mbiti & Andrew Zeitlin, 2021. "Can Public Rankings Improve School Performance?: Evidence from a Nationwide Reform in Tanzania," Journal of Human Resources, University of Wisconsin Press, vol. 56(3), pages 655-685.
    8. Kotze, Janeli & Fleisch, Brahm & Taylor, Stephen, 2019. "Alternative forms of early grade instructional coaching: Emerging evidence from field experiments in South Africa," International Journal of Educational Development, Elsevier, vol. 66(C), pages 203-213.
    9. Tumen, Semih & Vlassopoulos, Michael & Wahba, Jackline, 2021. "Training Teachers for Diversity Awareness: Impact on School Attendance of Refugee Children," IZA Discussion Papers 14557, Institute of Labor Economics (IZA).
    10. Schaffner, Julie & Glewwe, Paul & Sharma, Uttam, 2021. "Why Programs Fail: Lessons for Improving Public Service Quality from a Mixed-Methods Evaluation of an Unsuccessful Teacher Training Program in Nepal," Staff Papers 316663, University of Minnesota, Department of Applied Economics.
    11. Juan F. Castro & Paul Glewwe & Ricardo Montero, 2019. "Work With What You’ve Got: Improving Teachers’ Pedagogical Skills at Scale in Rural Peru," Working Papers 158, Peruvian Economic Association.
    12. Rodriguez-Segura, Daniel, 2022. "A closer look at reading comprehension: Experimental evidence from Guatemala," International Journal of Educational Development, Elsevier, vol. 93(C).
    13. K. Kougias & E. Sardianou & A. Saiti, 2023. "Attitudes and Perceptions on Education for Sustainable Development," Circular Economy and Sustainability,, Springer.
    14. Fleisch, Brahm & Schöer, Volker, 2023. "Storybooks in hand: A randomised control trial of a classroom library model," International Journal of Educational Development, Elsevier, vol. 96(C).
    15. Kika,Jesal Chandrakant & Crouch,Luis A. & Dulvy,Elizabeth Ninan & Thulare,Tshegofatso Desdemona, 2022. "Early Grade Reading in South Africa," Policy Research Working Paper Series 172983, The World Bank.
    16. Bellue, Suzanne & Bouguen, Adrien & Gurgand, Marc & Munier, Valerie & Tricot, André, 2023. "When Effective Teacher Training Falls Short in the Classroom: Evidence from an Experiment in Primary Schools," IZA Discussion Papers 16398, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wedel, Katharina, 2021. "Instruction time and student achievement: The moderating role of teacher qualifications," Economics of Education Review, Elsevier, vol. 85(C).
    2. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    3. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    4. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    5. Lombardi, María, 2019. "Is the remedy worse than the disease? The impact of teacher remediation on teacher and student performance in Chile," Economics of Education Review, Elsevier, vol. 73(C).
    6. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    7. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," Working Papers halshs-01993616, HAL.
    8. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    9. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    10. Filmer,Deon P. & Molina,Ezequiel & Wane,Waly, 2020. "Identifying Effective Teachers : Lessons from Four Classroom Observation Tools," Policy Research Working Paper Series 9365, The World Bank.
    11. repec:hal:spmain:info:hdl:2441/1jgbspo1909q48svne93o55rca is not listed on IDEAS
    12. Jennifer King Rice, 2013. "Learning from Experience? Evidence on the Impact and Distribution of Teacher Experience and the Implications for Teacher Policy," Education Finance and Policy, MIT Press, vol. 8(3), pages 332-348, July.
    13. María Lombardi, 2019. "Is the Remedy Worse Than the Disease? The Impact of Teacher Remediation on Teacher and Student Performance in Chile," School of Government Working Papers wp_gob_2019_4, Universidad Torcuato Di Tella.
    14. Elacqua, Gregory & Marotta, Luana, 2020. "Is working one job better than many? Assessing the impact of multiple school jobs on teacher performance in Rio de Janeiro," Economics of Education Review, Elsevier, vol. 78(C).
    15. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    16. Christopher Neilson & Sebastian Gallegos & Franco Calle, 2019. "Screening and Recruiting Talent At Teacher Colleges Using Pre-College Academic Achievement," Working Papers 636, Princeton University, Department of Economics, Industrial Relations Section..
    17. Alexis Le Chapelain, 2014. "Market for Education and Student Achievement," Sciences Po publications info:hdl:2441/1jgbspo1909, Sciences Po.
    18. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    19. Sancassani, Pietro, 2023. "The effect of teacher subject-specific qualifications on student science achievement," Labour Economics, Elsevier, vol. 80(C).
    20. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    21. Michael Bates & Michael Dinerstein & Andrew C. Johnston & Isaac Sorkin, 2022. "Teacher Labor Market Equilibrium and Student Achievement," CESifo Working Paper Series 9551, CESifo.

    More about this item

    Keywords

    South African Education; Randomised Experiment; Teacher coaching and training; Early Grade Reading Study;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sza:wpaper:wpapers308. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Melt van Schoor (email available below). General contact details of provider: https://edirc.repec.org/data/desunza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.