IDEAS home Printed from https://ideas.repec.org/p/bss/wpaper/36.html

The Relative Effectiveness of Teachers and Learning Software: Evidence from a Field Experiment in El Salvador

Author

Listed:
  • Konstantin Büchel

  • Martina Jakob

  • Christoph Kühnhanss

  • Daniel Steffen

  • Aymo Brunetti

Abstract

This study provides novel evidence on the relative effectiveness of computer-assisted learning (CAL) software and traditional teaching. Based on a randomized controlled trial in Salvadoran primary schools, we evaluate three interventions that aim to improve learning outcomes in mathematics: (i) teacher-led classes, (ii) CAL classes monitored by a technical supervisor, and (iii) CAL classes instructed by a teacher. As all three interventions involve the same amount of additional mathematics lessons, we can directly compare the productivity of the three teaching methods. CAL lessons lead to larger improvements in students' mathematics skills than traditional teacher-centered classes. In addition, teachers add little to the effectiveness of learning software. Overall, our results highlight the value of CAL approaches in an environment with poorly qualified teachers.

Suggested Citation

  • Konstantin Büchel & Martina Jakob & Christoph Kühnhanss & Daniel Steffen & Aymo Brunetti, 2020. "The Relative Effectiveness of Teachers and Learning Software: Evidence from a Field Experiment in El Salvador," University of Bern Social Sciences Working Papers 36, University of Bern, Department of Social Sciences.
    • Handle: RePEc:bss:wpaper:36
    as

    Download full text from publisher

    File URL: https://repec.sowi.unibe.ch/files/wp36/Buechel_etal_2020_CAL.pdf
    File Function: First version, 2020
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Simon Heß, 2017. "Randomization inference with Stata: A guide and software," Stata Journal, StataCorp LLC, vol. 17(3), pages 630-651, September.
    2. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 4, number 4, June.
    3. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    4. Sacerdote, Bruce, 2011. "Peer Effects in Education: How Might They Work, How Big Are They and How Much Do We Know Thus Far?," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 4, pages 249-277, Elsevier.
    5. Bold,Tessa & Filmer,Deon P. & Martin,Gayle & Molina,Ezequiel & Rockmore,Christophe & Stacy,Brian William & Svensson,Jakob & Wane,Waly, 2017. "What do teachers know and do ? does it matter ? evidence from primary schools in Africa," Policy Research Working Paper Series 7956, The World Bank.
    6. Isaac M. Mbiti, 2016. "The Need for Accountability in Education in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 109-132, Summer.
    7. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    8. Aymo Brunetti & Konstantin Büchel & Martina Jakob & Ben Jann & Christoph Kühnhanss & Daniel Steffen, 2020. "Teacher Content Knowledge in Developing Countries: Evidence from a Math Assessment in El Salvador," University of Bern Social Sciences Working Papers 34, University of Bern, Department of Social Sciences.
    9. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2015. "Designing Experiments to Measure Spillover Effects, Second Version," PIER Working Paper Archive 15-021, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Jun 2015.
    10. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    11. Glewwe, P. & Muralidharan, K., 2016. "Improving Education Outcomes in Developing Countries," Handbook of the Economics of Education,, Elsevier.
    12. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    13. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    14. World Bank, 2018. "World Development Report 2018 [Rapport sur le développement dans le monde 2018]," World Bank Publications - Books, The World Bank Group, number 28340, April.
    15. Isaac Mbiti & Karthik Muralidharan & Mauricio Romero & Youdi Schipper & Constantine Manda & Rakesh Rajani, 2019. "Inputs, Incentives, and Complementarities in Education: Experimental Evidence from Tanzania," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1627-1673.
    16. Lai, Fang & Luo, Renfu & Zhang, Linxiu & Huang, Xinzhe & Rozelle, Scott, 2015. "Does computer-assisted learning improve learning outcomes? Evidence from a randomized experiment in migrant schools in Beijing," Economics of Education Review, Elsevier, vol. 47(C), pages 34-48.
    17. Rachel Glennerster & Kudzai Takavarasha, 2013. "Running Randomized Evaluations: A Practical Guide," Economics Books, Princeton University Press, edition 1, number 10085.
    18. Carrillo, Paul E. & Onofa, Mercedes & Ponce, Juan, 2010. "Information Technology and Student Achievement: Evidence from a Randomized Experiment in Ecuador," IDB Publications (Working Papers) 3094, Inter-American Development Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aymo Brunetti & Konstantin Büchel & Martina Jakob & Ben Jann & Christoph Kühnhanss & Daniel Steffen, 2020. "Teacher Content Knowledge in Developing Countries: Evidence from a Math Assessment in El Salvador," University of Bern Social Sciences Working Papers 34, University of Bern, Department of Social Sciences.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Konstantin Buechel & Martina Jakob & Daniel Steffen & Christoph Kuehnhanss & Aymo Brunetti, 2020. "The Relative Effectiveness of Teachers and Learning Software: Evidence from a Field Experiment in El Salvador," Diskussionsschriften dp2006, Universitaet Bern, Departement Volkswirtschaft.
    2. Aymo Brunetti & Konstantin Buechel & Martina Jakob & Ben Jann & Christoph Kuehnhanss & Daniel Steffen, 2020. "Teacher Content Knowledge in Developing Countries: Evidence from a Math Assessment in El Salvador," Diskussionsschriften dp2005, Universitaet Bern, Departement Volkswirtschaft.
    3. Sabrin Beg & Waqas Halim & Adrienne M. Lucas & Umar Saif, 2022. "Engaging Teachers with Technology Increased Achievement, Bypassing Teachers Did Not," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 61-90, May.
    4. Aymo Brunetti & Konstantin Büchel & Martina Jakob & Ben Jann & Daniel Steffen, 2021. "Inadequate Teacher Content Knowledge and What to Do About It: Evidence from El Salvador," University of Bern Social Sciences Working Papers 41, University of Bern, Department of Social Sciences.
    5. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    6. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    7. Isaac Mbiti & Mauricio Romero & Youdi Schipper, 2023. "Designing Effective Teacher Performance Pay Programs: Experimental Evidence from Tanzania," The Economic Journal, Royal Economic Society, vol. 133(653), pages 1968-2000.
    8. Clare Leaver & Owen Ozier & Pieter Serneels & Andrew Zeitlin, 2021. "Recruitment, Effort, and Retention Effects of Performance Contracts for Civil Servants: Experimental Evidence from Rwandan Primary Schools," American Economic Review, American Economic Association, vol. 111(7), pages 2213-2246, July.
    9. Ferman, Bruno & Finamor, Lucas & Lima, Lycia, 2019. "Are Public Schools Ready to Integrate Math Classes with Khan Academy?," MPRA Paper 94736, University Library of Munich, Germany.
    10. Naik, Gopal & Chitre, Chetan & Bhalla, Manaswini & Rajan, Jothsna, 2020. "Impact of use of technology on student learning outcomes: Evidence from a large-scale experiment in India," World Development, Elsevier, vol. 127(C).
    11. Bold, Tessa & Kimenyi, Mwangi & Mwabu, Germano & Ng’ang’a, Alice & Sandefur, Justin, 2018. "Experimental evidence on scaling up education reforms in Kenya," Journal of Public Economics, Elsevier, vol. 168(C), pages 1-20.
    12. Nobel Prize Committee, 2019. "Understanding development and poverty alleviation," Nobel Prize in Economics documents 2019-2, Nobel Prize Committee.
    13. Piza, Caio & Zwager, Astrid & Ruzzante, Matteo & Dantas, Rafael & Loureiro, Andre, 2024. "Teacher-led innovations to improve education outcomes: Experimental evidence from Brazil," Journal of Public Economics, Elsevier, vol. 234(C).
    14. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    15. Anand, Gautam & Atluri, Aishwarya & Crawfurd, Lee & Pugatch, Todd & Sheth, Ketki, 2023. "Improving school management in low and middle income countries: A systematic review," Economics of Education Review, Elsevier, vol. 97(C).
    16. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    17. Blimpo,Moussa Pouguinimpo & Gajigo,Ousman & Owusu,Solomon & Tomita,Ryoko & Xu,Yanbin, 2020. "Technology in the Classroom and Learning in Secondary Schools," Policy Research Working Paper Series 9288, The World Bank.
    18. Jason T. Kerwin & Rebecca L. Thornton, 2021. "Making the Grade: The Sensitivity of Education Program Effectiveness to Input Choices and Outcome Measures," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 251-264, May.
    19. Islam, Asad, 2019. "Parent–teacher meetings and student outcomes: Evidence from a developing country," European Economic Review, Elsevier, vol. 111(C), pages 273-304.
    20. Martina Jakob, Konstantin Buechel, Daniel Steffen, Aymo Brunetti, 2023. "Participatory Teaching Improves Learning Outcomes: Evidence from a Field Experiment in Tanzania," Diskussionsschriften dp2310, Universitaet Bern, Departement Volkswirtschaft.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bss:wpaper:36. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ben Jann (email available below). General contact details of provider: https://www.sowi.unibe.ch/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.