IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v58y2017icp175-187.html
   My bibliography  Save this article

The effect of adaptive versus static practicing on student learning - evidence from a randomized field experiment

Author

Listed:
  • van Klaveren, Chris
  • Vonk, Sebastiaan
  • Cornelisz, Ilja

Abstract

Schools and governments are increasingly investing in adaptive practice software. To date, the evidence whether adaptivity improves learning outcomes is limited and mixed. A large-scale randomized control trial is conducted in Dutch secondary schools to evaluate the effectiveness of an adaptive practice program relative to a static program. Learning theories predict that adaptive practicing is more effective, but this experimental evaluation provides a more nuanced picture. Relative to the static software environment, students working in the adaptive software environment receive more difficult exercises, practice longer and answer fewer questions correctly. Takeup and usage of the software program is, overall, modest, but varies considerably within and between classrooms. The outcome differences between both environments are more pronounced in classrooms with higher practice intensity. On average, no test score effects are found, but static practicing does improve test scores for higher ability students (0.08σ). Caution is thus warranted when adaptive practice software is implemented to address individual learning needs, as static formative test preparation can be more effective in improving test scores.

Suggested Citation

  • van Klaveren, Chris & Vonk, Sebastiaan & Cornelisz, Ilja, 2017. "The effect of adaptive versus static practicing on student learning - evidence from a randomized field experiment," Economics of Education Review, Elsevier, vol. 58(C), pages 175-187.
  • Handle: RePEc:eee:ecoedu:v:58:y:2017:i:c:p:175-187
    DOI: 10.1016/j.econedurev.2017.04.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775716303387
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econedurev.2017.04.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    2. George Bulman & Robert W. Fairlie, 2015. "Technology and Education: Computers, Software, and the Internet," CESifo Working Paper Series 5570, CESifo.
    3. repec:mpr:mprres:5414 is not listed on IDEAS
    4. Lisa Barrow & Lisa Markman & Cecilia Elena Rouse, 2009. "Technology's Edge: The Educational Benefits of Computer-Aided Instruction," American Economic Journal: Economic Policy, American Economic Association, vol. 1(1), pages 52-74, February.
    5. Rouse, Cecilia Elena & Krueger, Alan B., 2004. "Putting computerized instruction to the test: a randomized evaluation of a "scientifically based" reading program," Economics of Education Review, Elsevier, vol. 23(4), pages 323-338, August.
    6. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    7. Stephen Machin & Sandra McNally & Olmo Silva, 2007. "New Technology in Schools: Is There a Payoff?," Economic Journal, Royal Economic Society, vol. 117(522), pages 1145-1167, July.
    8. Edwin Leuven & Mikael Lindahl & Hessel Oosterbeek & Dinand Webbink, 2007. "The Effect of Extra Funding for Disadvantaged Pupils on Achievement," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 721-736, November.
    9. Joshua Angrist & Victor Lavy, 2002. "New Evidence on Classroom Computers and Pupil Learning," Economic Journal, Royal Economic Society, vol. 112(482), pages 735-765, October.
    10. repec:mpr:mprres:6181 is not listed on IDEAS
    11. Larissa Campuzano & Mark Dynarski & Roberto Agodini & Kristina Rall, "undated". "Effectiveness of Reading and Mathematics Software Products: Findings from Two Student Cohorts," Mathematica Policy Research Reports c6255408bda44f82910991c48, Mathematica Policy Research.
    12. repec:feb:artefa:0087 is not listed on IDEAS
    13. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yue Ma & Robert W. Fairlie & Prashant Loyalka & Scott Rozelle, 2020. "Isolating the “Tech” from EdTech: Experimental Evidence on Computer Assisted Learning in China," NBER Working Papers 26953, National Bureau of Economic Research, Inc.
    2. Christopher J. Doss & Erin M. Fahle & Susanna Loeb & Benjamin N. York, 2018. "More than Just a Nudge: Supporting Kindergarten Parents with Differentiated and Personalized Text-Messages," NBER Working Papers 24450, National Bureau of Economic Research, Inc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    2. Eric Bettinger & Robert Fairlie & Anastasia Kapuza & Elena Kardanova & Prashant Loyalka & Andrey Zakharov, 2023. "Diminishing Marginal Returns to Computer‐Assisted Learning," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(2), pages 552-570, March.
    3. Aaron K. Chatterji, 2017. "Innovation and American K-12 Education," NBER Chapters, in: Innovation Policy and the Economy, Volume 18, pages 27-51, National Bureau of Economic Research, Inc.
    4. Comi, Simona Lorena & Argentin, Gianluca & Gui, Marco & Origo, Federica & Pagani, Laura, 2017. "Is it the way they use it? Teachers, ICT and student achievement," Economics of Education Review, Elsevier, vol. 56(C), pages 24-39.
    5. Aaron Chatterji, 2017. "Innovation and American K-12 Education," NBER Working Papers 23531, National Bureau of Economic Research, Inc.
    6. Naik, Gopal & Chitre, Chetan & Bhalla, Manaswini & Rajan, Jothsna, 2020. "Impact of use of technology on student learning outcomes: Evidence from a large-scale experiment in India," World Development, Elsevier, vol. 127(C).
    7. Peter Bergman, 2020. "Nudging Technology Use: Descriptive and Experimental Evidence from School Information Systems," Education Finance and Policy, MIT Press, vol. 15(4), pages 623-647, Fall.
    8. Bulman, George & Fairlie, Robert W, 2015. "Technology and Education: Computers, Software, and the Internet," Santa Cruz Department of Economics, Working Paper Series qt5265z87t, Department of Economics, UC Santa Cruz.
    9. Nerea Gómez-Fernández & Mauro Mediavilla, 2018. "Do information and communication technologies (ICT) improve educational outcomes? Evidence for Spain in PISA 2015," Working Papers 2018/20, Institut d'Economia de Barcelona (IEB).
    10. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    11. Bianchi, Nicola & Lu, Yi & Song, Hong, 2022. "The effect of computer-assisted learning on students’ long-term development," Journal of Development Economics, Elsevier, vol. 158(C).
    12. Rosa Sanchis-Guarner & José Montalbán & Felix Weinhardt, 2021. "Home Broadband and Human Capital Formation," CESifo Working Paper Series 8846, CESifo.
    13. Rodrigo Belo & Pedro Ferreira & Rahul Telang, 2014. "Broadband in School: Impact on Student Performance," Management Science, INFORMS, vol. 60(2), pages 265-282, February.
    14. Marchionni, Mariana & Pinto, Florencia & Vazquez, Emmanuel, 2013. "Determinantes de la desigualdad en el desempeño educativo en la Argentina [Determinants of the inequality in PISA test scores in Argentina]," MPRA Paper 56421, University Library of Munich, Germany.
    15. Gómez-Fernández, Nerea & Mediavilla, Mauro, 2021. "Exploring the relationship between Information and Communication Technologies (ICT) and academic performance: A multilevel analysis for Spain," Socio-Economic Planning Sciences, Elsevier, vol. 77(C).
    16. Marchionni, Mariana & Vazquez, Emmanuel & Pinto, Florencia, 2012. "Desigualdad educativa en la Argentina. Análisis en base a los datos PISA 2009 [Education Inequality in Argentina. An analysis based on PISA 2009 data]," MPRA Paper 56420, University Library of Munich, Germany.
    17. Blimpo,Moussa Pouguinimpo & Gajigo,Ousman & Owusu,Solomon & Tomita,Ryoko & Xu,Yanbin, 2020. "Technology in the Classroom and Learning in Secondary Schools," Policy Research Working Paper Series 9288, The World Bank.
    18. NAKAMURO Makiko & ITO Hirotake, 2020. "The Effect of Computer Assisted Learning on Children's Cognitive and Noncognitive Skills: Evidence from a Randomized Experiment in Cambodia," Discussion papers 20074, Research Institute of Economy, Trade and Industry (RIETI).
    19. Bet, German & Cristia, Julián P. & Ibarrarán, Pablo, 2014. "The Effects of Shared School Technology Access on Students Digital Skills in Peru," IZA Discussion Papers 7954, Institute of Labor Economics (IZA).
    20. Bergman, Peter & Rogers, Todd, 2017. "The Impact of Defaults on Technology Adoption, and Its Underappreciation by Pollicymakers," Working Paper Series rwp17-021, Harvard University, John F. Kennedy School of Government.

    More about this item

    Keywords

    Personalized education; Adaptive practice software; Field experiment;
    All these keywords.

    JEL classification:

    • A20 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:58:y:2017:i:c:p:175-187. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.