IDEAS home Printed from https://ideas.repec.org/p/cgd/wpaper/591.html
   My bibliography  Save this paper

Live Tutoring Calls Did Not Improve Learning during the COVID-19 Pandemic in Sierra Leone

Author

Listed:
  • Lee Crawfurd

    (Center for Global Development)

  • David K. Evans

    (Center for Global Development)

  • Susannah Hares

    (Center for Global Development)

  • Justin Sandefur

    (Center for Global Development)

Abstract

Education systems regularly face unexpected school closures, whether due to disease outbreaks, natural disasters, or other adverse shocks. In low-income countries where internet access is scarce, distance learning—the most common educational solution—is often passive, via TV or radio, with little opportunity for teacher-student interaction. In this paper we evaluate the effectiveness of live tutoring calls from teachers, designed to supplement radio instruction during the 2020 school closures prompted by the COVID-19 pandemic. We do this with a randomised controlled trial with 4,399 primary school students in Sierra Leone. Tutoring calls led to some limited increase in educational activity, but had no effect on mathematics or language test scores, whether for girls or boys, and whether provided by public or private school teachers. Even having received tutoring calls, one in three children reported not listening to educational radio at all, so limited take-up may partly explain our results.

Suggested Citation

  • Lee Crawfurd & David K. Evans & Susannah Hares & Justin Sandefur, 2021. "Live Tutoring Calls Did Not Improve Learning during the COVID-19 Pandemic in Sierra Leone," Working Papers 591, Center for Global Development, revised 01 Jun 2023.
  • Handle: RePEc:cgd:wpaper:591
    as

    Download full text from publisher

    File URL: https://www.cgdev.org/publication/live-tutoring-calls-did-not-improve-learning-during-covid-19-pandemic-sierra-leone?utm_source=repec&utm_medium=referral&utm_campaign=repec
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Edward Asiedu & Dean Karlan & Monica Lambon-Quayefio & Christopher Udry, 2021. "A call for structured ethics appendices in social science papers," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 118(29), pages 2024570118-, July.
    2. Noam Angrist & Peter Bergman & David K. Evans & Susannah Hares & Matthew C. H. Jukes & Thato Letsomo, 2020. "Practical Lessons for Phone-Based Assessments of Learning," Working Papers 534, Center for Global Development, revised 10 Jul 2020.
    3. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    5. Kofi Mangesi, 2007. "Survey of ICT and Education in Africa : Sierra Leone Country Report," World Bank Publications - Reports 10657, The World Bank Group.
    6. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    7. Jason T. Kerwin & Rebecca L. Thornton, 2021. "Making the Grade: The Sensitivity of Education Program Effectiveness to Input Choices and Outcome Measures," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 251-264, May.
    8. Christopher J. Doss & Erin M. Fahle & Susanna Loeb & Benjamin N. York, 2018. "More than Just a Nudge: Supporting Kindergarten Parents with Differentiated and Personalized Text-Messages," NBER Working Papers 24450, National Bureau of Economic Research, Inc.
    9. Bold, Tessa & Kimenyi, Mwangi & Mwabu, Germano & Ng’ang’a, Alice & Sandefur, Justin, 2018. "Experimental evidence on scaling up education reforms in Kenya," Journal of Public Economics, Elsevier, vol. 168(C), pages 1-20.
    10. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    11. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2021. "Telementoring and homeschooling during school closures: A randomized experiment in rural Bangladesh," Munich Papers in Political Economy 13, Munich School of Politics and Public Policy and the School of Management at the Technical University of Munich.
    12. Angrist, Noam & Bergman, Peter & Matsheng, Moitshepi, 2020. "School's Out: Experimental Evidence on Limiting Learning Loss Using "Low-Tech" in a Pandemic," IZA Discussion Papers 14009, Institute of Labor Economics (IZA).
    13. Samuel Berlinski & Matias Busso & Taryn Dinkelman & Claudia Martínez A., 2021. "Reducing Parent-School Information Gaps and Improving Education Outcomes: Evidence from High-Frequency Text Messages," NBER Working Papers 28581, National Bureau of Economic Research, Inc.
    14. Mo, Di & Luo, Renfu & Liu, Chengfang & Zhang, Huiping & Zhang, Linxiu & Medina, Alexis & Rozelle, Scott, 2014. "Text Messaging and its Impacts on the Health and Education of the Poor: Evidence from a Field Experiment in Rural China," World Development, Elsevier, vol. 64(C), pages 766-780.
    15. Barrera,Oscar & Macours,Karen & Premand,Patrick & Vakis,Renos, 2020. "Texting Parents about Early Child Development : Behavioral Changes and Unintended Social Effects," Policy Research Working Paper Series 9492, The World Bank.
    16. Mauricio Romero & Justin Sandefur & Wayne Aaron Sandholtz, 2020. "Outsourcing Education: Experimental Evidence from Liberia," American Economic Review, American Economic Association, vol. 110(2), pages 364-400, February.
    17. Kraft, Matthew A. & Rogers, Todd, 2015. "The underutilized potential of teacher-to-parent communication: Evidence from a field experiment," Economics of Education Review, Elsevier, vol. 47(C), pages 49-63.
    18. Rodriguez-Segura, Daniel & Schueler, Beth E., 2022. "Can learning be measured by phone? Evidence from Kenya," Economics of Education Review, Elsevier, vol. 90(C).
    19. Natalie Bau & Jishnu Das, 2020. "Teacher Value Added in a Low-Income Country," American Economic Journal: Economic Policy, American Economic Association, vol. 12(1), pages 62-96, February.
    20. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    21. Mauricio Romero & Justin Sandefur, 2022. "Beyond Short-Term Learning Gains: the Impact of Outsourcing Schools in Liberia After Three Years," The Economic Journal, Royal Economic Society, vol. 132(644), pages 1600-1619.
    22. Das, Jishnu & Zajonc, Tristan, 2010. "India shining and Bharat drowning: Comparing two Indian states to the worldwide distribution in mathematics achievement," Journal of Development Economics, Elsevier, vol. 92(2), pages 175-187, July.
    23. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    24. Caeyers, Bet & Chalmers, Neil & De Weerdt, Joachim, 2012. "Improving consumption measurement and other survey data through CAPI: Evidence from a randomized experiment," Journal of Development Economics, Elsevier, vol. 98(1), pages 19-33.
    25. Guilherme Lichand & Julien Christen, 2020. "Behavioral nudges prevent student dropouts in the pandemic," ECON - Working Papers 363, Department of Economics - University of Zurich, revised Apr 2021.
    26. Robert Garlick & Kate Orkin & Simon Quinn, 2020. "Call Me Maybe: Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys," The World Bank Economic Review, World Bank, vol. 34(2), pages 418-443.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2021. "Telementoring and homeschooling during school closures: A randomized experiment in rural Bangladesh," Munich Papers in Political Economy 13, Munich School of Politics and Public Policy and the School of Management at the Technical University of Munich.
    2. Jakubowski,Maciej Jan & Gajderowicz,Tomasz Janusz & Patrinos,Harry Anthony, 2024. "COVID-19, School Closures, and Student Learning Outcomes : New Global Evidence from PISA," Policy Research Working Paper Series 10666, The World Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abhijeet Singh & Mauricio Romero & Karthik Muralidharan, 2022. "Covid-19 Learning Loss and Recovery: Panel Data Evidence from India," NBER Working Papers 30552, National Bureau of Economic Research, Inc.
    2. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    3. Matteo Bobba & Tim Ederer & Gianmarco León-Ciliotta & Christopher A. Neilson & Marco Nieddu, 2021. "Teacher compensation and structural inequality: Evidence from centralized teacher school choice in Perú," Economics Working Papers 1788, Department of Economics and Business, Universitat Pompeu Fabra.
    4. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    5. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    6. Maruyama, Takao & Kurosaki, Takashi, 2021. "Do remedial activities using math workbooks improve student learning? Empirical evidence from scaled-up interventions in Niger," World Development, Elsevier, vol. 148(C).
    7. Seth Gershenson & Cassandra M. D. Hart & Joshua Hyman & Constance A. Lindsay & Nicholas W. Papageorge, 2022. "The Long-Run Impacts of Same-Race Teachers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 300-342, November.
    8. David K. Evans & Fei Yuan & Deon Filmer, 2020. "Are Teachers in Africa Poorly Paid? Evidence from 15 Countries," Working Papers 538, Center for Global Development.
    9. Evans, David K. & Yuan, Fei & Filmer, Deon, 2022. "Teacher pay in Africa: Evidence from 15 countries," World Development, Elsevier, vol. 155(C).
    10. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    11. Cruz-Aguayo, Yyannú & Carneiro, Pedro & Intriago, Ruthy & Ponce, Juan & Schady, Norbert & Schodt, Sarah, 2022. "When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country," IZA Discussion Papers 15021, Institute of Labor Economics (IZA).
    12. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    13. Emily Beam & Priya Mukherjee & Laia Navarro-Sola, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," Working Papers 2022-030, Human Capital and Economic Opportunity Working Group.
    14. Stephen Machin & Sandra McNally & Martina Viarengo, 2018. "Changing How Literacy Is Taught: Evidence on Synthetic Phonics," American Economic Journal: Economic Policy, American Economic Association, vol. 10(2), pages 217-241, May.
    15. Sun, Yucheng & Zhou, Xianbo, 2022. "The effect of teacher's concurrent administrative position on students' academic outcomes: Evidence and mechanisms," China Economic Review, Elsevier, vol. 71(C).
    16. Ajzenman, Nicolás & Elacqua, Gregory & Marotta, Luana & Westh Olsen, Anne Sofie, 2021. "Order Effects and Employment Decisions: Experimental Evidence from a Nationwide Program," IDB Publications (Working Papers) 11541, Inter-American Development Bank.
    17. Agostinelli, Francesco & Avitabile, Ciro & Bobba, Matteo, 2021. "Enhancing Human Capital in Children: A Case Study on Scaling," TSE Working Papers 21-1196, Toulouse School of Economics (TSE), revised Oct 2023.
    18. Ferreira, Francisco H. G. & Galasso, Emanuela & Negre, Mario, 2018. "Shared Prosperity: Concepts, Data, and Some Policy Examples," IZA Discussion Papers 11571, Institute of Labor Economics (IZA).
    19. Lee Crawfurd & Todd Pugatch, 2020. "Teacher Labor Markets in Developing Countries," Working Papers 546, Center for Global Development.
    20. Jason T. Kerwin & Rebecca L. Thornton, 2021. "Making the Grade: The Sensitivity of Education Program Effectiveness to Input Choices and Outcome Measures," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 251-264, May.

    More about this item

    Keywords

    Education; COVID; distance learning; teachers;
    All these keywords.

    JEL classification:

    • I10 - Health, Education, and Welfare - - Health - - - General
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cgd:wpaper:591. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Publications Manager (email available below). General contact details of provider: https://edirc.repec.org/data/cgdevus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.