IDEAS home Printed from https://ideas.repec.org/a/wly/jpamgt/v42y2023i2p552-570.html
   My bibliography  Save this article

Diminishing Marginal Returns to Computer‐Assisted Learning

Author

Listed:
  • Eric Bettinger
  • Robert Fairlie
  • Anastasia Kapuza
  • Elena Kardanova
  • Prashant Loyalka
  • Andrey Zakharov

Abstract

The previous expansion of EdTech as a substitute for traditional learning around the world, the recent full‐scale substitution due to COVID‐19, and potential future shifts to blended approaches suggest that it is imperative to understand input substitutability between in‐person and online learning. We explore input substitutability in education by employing a novel randomized controlled trial that varies dosage of computer‐assisted learning (CAL) as a substitute for traditional learning through homework. Moving from zero to a low level of CAL, we find positive substitutability of CAL for traditional learning. Moving from a lower to a higher level of CAL, substitutability changes and is either neutral or even negative. The estimates suggest that a blended approach of CAL and traditional learning is optimal. The findings have direct implications for the rapidly expanding use of educational technology worldwide prior to, during, and after the pandemic.

Suggested Citation

  • Eric Bettinger & Robert Fairlie & Anastasia Kapuza & Elena Kardanova & Prashant Loyalka & Andrey Zakharov, 2023. "Diminishing Marginal Returns to Computer‐Assisted Learning," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(2), pages 552-570, March.
  • Handle: RePEc:wly:jpamgt:v:42:y:2023:i:2:p:552-570
    DOI: 10.1002/pam.22442
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/pam.22442
    Download Restriction: no

    File URL: https://libkey.io/10.1002/pam.22442?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Fang Lai & Linxiu Zhang & Xiao Hu & Qinghe Qu & Yaojiang Shi & Yajie Qiao & Matthew Boswell & Scott Rozelle, 2013. "Computer assisted learning as extracurricular tutor? Evidence from a randomised experiment in rural boarding schools in Shaanxi," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 5(2), pages 208-231, June.
    2. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    3. Robert W. Fairlie & Rebecca A. London, 2012. "The Effects of Home Computers on Educational Outcomes: Evidence from a Field Experiment with Community College Students," Economic Journal, Royal Economic Society, vol. 122(561), pages 727-753, June.
    4. George Bulman & Robert W. Fairlie, 2015. "Technology and Education: Computers, Software, and the Internet," CESifo Working Paper Series 5570, CESifo.
    5. Di Mo & Linxiu Zhang & Renfu Luo & Qinghe Qu & Weiming Huang & Jiafu Wang & Yajie Qiao & Matthew Boswell & Scott Rozelle, 2014. "Integrating computer-assisted learning into a regular curriculum: evidence from a randomised experiment in rural schools in Shaanxi," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(3), pages 300-323, September.
    6. Julian Cristia & Pablo Ibarrarán & Santiago Cueto & Ana Santiago & Eugenio Severín, 2017. "Technology and Child Development: Evidence from the One Laptop per Child Program," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 295-320, July.
    7. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    8. Yanguas, Maria Lucia, 2020. "Technology and educational choices: Evidence from a one-laptop-per-child program," Economics of Education Review, Elsevier, vol. 76(C).
    9. Thomas Fuchs & Ludger Wossmann, 2004. "Computers and student learning: bivariate and multivariate evidence on the availability and use of computers at home and at school," Brussels Economic Review, ULB -- Universite Libre de Bruxelles, vol. 47(3-4), pages 359-386.
    10. Fairlie Robert W., 2016. "Do Boys and Girls Use Computers Differently, and Does It Contribute to Why Boys do Worse in School Than Girls?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 16(1), pages 59-96, January.
    11. Schmitt, John & Wadsworth, Jonathan, 2006. "Is there an impact of household computer ownership on children's educational attainment in Britain?," Economics of Education Review, Elsevier, vol. 25(6), pages 659-673, December.
    12. Lai, Fang & Luo, Renfu & Zhang, Linxiu & Huang, Xinzhe & Rozelle, Scott, 2015. "Does computer-assisted learning improve learning outcomes? Evidence from a randomized experiment in migrant schools in Beijing," Economics of Education Review, Elsevier, vol. 47(C), pages 34-48.
    13. Glewwe, Paul (ed.), 2013. "Education Policy in Developing Countries," University of Chicago Press Economics Books, University of Chicago Press, number 9780226078687, September.
    14. Mo, Di & Huang, Weiming & Shi, Yaojiang & Zhang, Linxiu & Boswell, Matthew & Rozelle, Scott, 2015. "Computer technology in education: Evidence from a pooled study of computer assisted learning programs among rural students in China," China Economic Review, Elsevier, vol. 36(C), pages 131-145.
    15. Robert W. Fairlie & Jonathan Robinson, 2013. "Experimental Evidence on the Effects of Home Computers on Academic Achievement among Schoolchildren," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 211-240, July.
    16. de Melo Gioia & Machado Alina & Miranda Alfonso, 2014. "The Impact of a One Laptop per Child Program on Learning: Evidence from Uruguay," Working Papers 2014-22, Banco de México.
    17. Oliver Falck & Constantin Mang & Ludger Woessmann, 2018. "Virtually No Effect? Different Uses of Classroom Computers and their Effect on Student Achievement," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(1), pages 1-38, February.
    18. Fiorini, M., 2010. "The effect of home computer use on children's cognitive and non-cognitive skills," Economics of Education Review, Elsevier, vol. 29(1), pages 55-72, February.
    19. Carrillo, Paul E. & Onofa, Mercedes & Ponce, Juan, 2010. "Information Technology and Student Achievement: Evidence from a Randomized Experiment in Ecuador," IDB Publications (Working Papers) 3094, Inter-American Development Bank.
    20. Auriol, Emmanuelle & Warlters, Michael, 2012. "The marginal cost of public funds and tax reform in Africa," Journal of Development Economics, Elsevier, vol. 97(1), pages 58-72.
    21. Maja Schling & Paul Winters, 2018. "Computer-Assisted Instruction for Child Development: Evidence from an Educational Programme in Rural Zambia," Journal of Development Studies, Taylor & Francis Journals, vol. 54(7), pages 1121-1136, July.
    22. Yue Ma & Robert W. Fairlie & Prashant Loyalka & Scott Rozelle, 2020. "Isolating the "Tech" from EdTech: Experimental Evidence on Computer Assisted Learning in China," CESifo Working Paper Series 8186, CESifo.
    23. repec:mpr:mprres:6181 is not listed on IDEAS
    24. Ofer Malamud & Cristian Pop-Eleches, 2011. "Home Computer Use and the Development of Human Capital," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 987-1027.
    25. Bulman, G. & Fairlie, R.W., 2016. "Technology and Education," Handbook of the Economics of Education,, Elsevier.
    26. Stephen Machin & Sandra McNally & Olmo Silva, 2007. "New Technology in Schools: Is There a Payoff?," Economic Journal, Royal Economic Society, vol. 117(522), pages 1145-1167, July.
    27. John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 439-457, November.
    28. George Bulman & Robert Fairlie, 2022. "The Impact of COVID-19 on Community College Enrollment and Student Success: Evidence from California Administrative Data," Education Finance and Policy, MIT Press, vol. 17(4), pages 745-764, Fall.
    29. Joshua Angrist & Victor Lavy, 2002. "New Evidence on Classroom Computers and Pupil Learning," Economic Journal, Royal Economic Society, vol. 112(482), pages 735-765, October.
    30. Rouse, Cecilia Elena & Krueger, Alan B., 2004. "Putting computerized instruction to the test: a randomized evaluation of a "scientifically based" reading program," Economics of Education Review, Elsevier, vol. 23(4), pages 323-338, August.
    31. Lisa Barrow & Lisa Markman & Cecilia Elena Rouse, 2009. "Technology's Edge: The Educational Benefits of Computer-Aided Instruction," American Economic Journal: Economic Policy, American Economic Association, vol. 1(1), pages 52-74, February.
    32. Hull, Marie C. & Duch, Katherine, 2017. "One-To-One Technology and Student Outcomes," IZA Discussion Papers 10886, Institute of Labor Economics (IZA).
    33. Malamud, Ofer & Cueto, Santiago & Cristia, Julian & Beuermann, Diether W., 2019. "Do children benefit from internet access? Experimental evidence from Peru," Journal of Development Economics, Elsevier, vol. 138(C), pages 41-56.
    34. repec:mpr:mprres:5414 is not listed on IDEAS
    35. Caroline M. Hoxby, 2000. "The Effects of Class Size on Student Achievement: New Evidence from Population Variation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(4), pages 1239-1285.
    36. Diether W. Beuermann & Julian Cristia & Santiago Cueto & Ofer Malamud & Yyannu Cruz-Aguayo, 2015. "One Laptop per Child at Home: Short-Term Impacts from a Randomized Experiment in Peru," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 53-80, April.
    37. Paul Carrillo & Mercedes Onofa & Juan Ponce, 2010. "Information Technology and Student Achievement: Evidence from a Randomized Experiment in Ecuador," IDB Publications (Working Papers) 37758, Inter-American Development Bank.
    38. Mo, Di & Swinnen, Johan & Zhang, Linxiu & Yi, Hongmei & Qu, Qinghe & Boswell, Matthew & Rozelle, Scott, 2013. "Can One-to-One Computing Narrow the Digital Divide and the Educational Gap in China? The Case of Beijing Migrant Schools," World Development, Elsevier, vol. 46(C), pages 14-29.
    39. Naik, Gopal & Chitre, Chetan & Bhalla, Manaswini & Rajan, Jothsna, 2020. "Impact of use of technology on student learning outcomes: Evidence from a large-scale experiment in India," World Development, Elsevier, vol. 127(C).
    40. Blimpo,Moussa Pouguinimpo & Gajigo,Ousman & Owusu,Solomon & Tomita,Ryoko & Xu,Yanbin, 2020. "Technology in the Classroom and Learning in Secondary Schools," Policy Research Working Paper Series 9288, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ferman, Bruno & Lima, Lycia & Riva, Flávio, 2021. "Artificial Intelligence, Teacher Tasks and Individualized Pedagogy," SocArXiv qw249, Center for Open Science.
    2. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    3. Bin Tang & Te-Tien Ting & Chyi-In Wu & Yue Ma & Di Mo & Wei-Ting Hung & Scott Rozelle, 2020. "The Impact of Online Computer Assisted Learning at Home for Disadvantaged Children in Taiwan: Evidence from a Randomized Experiment," Sustainability, MDPI, vol. 12(23), pages 1-16, December.
    4. Ferman, Bruno & Lima, Lycia & Riva, Flavio, 2020. "Experimental Evidence on Artificial Intelligence in the Classroom," MPRA Paper 103934, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yue Ma & Robert W. Fairlie & Prashant Loyalka & Scott Rozelle, 2020. "Isolating the “Tech” from EdTech: Experimental Evidence on Computer Assisted Learning in China," NBER Working Papers 26953, National Bureau of Economic Research, Inc.
    2. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    3. George Bulman & Robert W. Fairlie, 2015. "Technology and Education: Computers, Software, and the Internet," CESifo Working Paper Series 5570, CESifo.
    4. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    5. Rosa Sanchis-Guarner & José Montalbán & Felix Weinhardt, 2021. "Home Broadband and Human Capital Formation," CESifo Working Paper Series 8846, CESifo.
    6. Nerea Gómez-Fernández & Mauro Mediavilla, 2018. "Do information and communication technologies (ICT) improve educational outcomes? Evidence for Spain in PISA 2015," Working Papers 2018/20, Institut d'Economia de Barcelona (IEB).
    7. Denis Fougère & Ghazala Azmat & Alexis Lermite & Clémence Lobut, 2022. "L’impact du numérique sur les apprentissages des élèves : évaluation d’une politique d’équipement à grande échelle. Ensemble des résultats au cycle 4," SciencePo Working papers Main halshs-03915750, HAL.
    8. Gómez-Fernández, Nerea & Mediavilla, Mauro, 2021. "Exploring the relationship between Information and Communication Technologies (ICT) and academic performance: A multilevel analysis for Spain," Socio-Economic Planning Sciences, Elsevier, vol. 77(C).
    9. Robert W. Fairlie & Jonathan Robinson, 2013. "Experimental Evidence on the Effects of Home Computers on Academic Achievement among Schoolchildren," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 211-240, July.
    10. Naik, Gopal & Chitre, Chetan & Bhalla, Manaswini & Rajan, Jothsna, 2020. "Impact of use of technology on student learning outcomes: Evidence from a large-scale experiment in India," World Development, Elsevier, vol. 127(C).
    11. Derksen, Laura & Michaud-Leclerc, Catherine & Souza, Pedro C.L., 2022. "Restricted access: How the internet can be used to promote reading and learning," Journal of Development Economics, Elsevier, vol. 155(C).
    12. NAKAMURO Makiko & ITO Hirotake, 2020. "The Effect of Computer Assisted Learning on Children's Cognitive and Noncognitive Skills: Evidence from a Randomized Experiment in Cambodia," Discussion papers 20074, Research Institute of Economy, Trade and Industry (RIETI).
    13. Benjamin Faber & Rosa Sanchis-Guarner & Felix Weinhardt, 2015. "ICT and Education: Evidence from Student Home Addresses," SERC Discussion Papers 0186, Centre for Economic Performance, LSE.
    14. Derksen, Laura & Leclerc, Catherine Michaud & Souza, Pedro CL, 2019. "Searching for Answers : The Impact of Student Access to Wikipedia," The Warwick Economics Research Paper Series (TWERPS) 1236, University of Warwick, Department of Economics.
    15. Julian Cristia & Pablo Ibarrarán & Santiago Cueto & Ana Santiago & Eugenio Severín, 2017. "Technology and Child Development: Evidence from the One Laptop per Child Program," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 295-320, July.
    16. Comi, Simona Lorena & Argentin, Gianluca & Gui, Marco & Origo, Federica & Pagani, Laura, 2017. "Is it the way they use it? Teachers, ICT and student achievement," Economics of Education Review, Elsevier, vol. 56(C), pages 24-39.
    17. Derksen, Laura & Leclerc, Catherine Michaud & Souza, Pedro CL, 2019. "Searching for Answers: The Impact of Student Access to Wikipedia," CAGE Online Working Paper Series 450, Competitive Advantage in the Global Economy (CAGE).
    18. Peter Bergman, 2020. "Nudging Technology Use: Descriptive and Experimental Evidence from School Information Systems," Education Finance and Policy, MIT Press, vol. 15(4), pages 623-647, Fall.
    19. Fairlie, Robert W. & Bahr, Peter Riley, 2018. "The effects of computers and acquired skills on earnings, employment and college enrollment: Evidence from a field experiment and California UI earnings records," Economics of Education Review, Elsevier, vol. 63(C), pages 51-63.
    20. Bin Tang & Te-Tien Ting & Chyi-In Wu & Yue Ma & Di Mo & Wei-Ting Hung & Scott Rozelle, 2020. "The Impact of Online Computer Assisted Learning at Home for Disadvantaged Children in Taiwan: Evidence from a Randomized Experiment," Sustainability, MDPI, vol. 12(23), pages 1-16, December.

    More about this item

    JEL classification:

    • F63 - International Economics - - Economic Impacts of Globalization - - - Economic Development
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jpamgt:v:42:y:2023:i:2:p:552-570. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/journal/34787/home .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.