IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2310.10850.html
   My bibliography  Save this paper

Digital interventions and habit formation in educational technology

Author

Listed:
  • Keshav Agrawal
  • Susan Athey
  • Ayush Kanodia
  • Emil Palikot

Abstract

As online educational technology products have become increasingly prevalent, rich evidence indicates that learners often find it challenging to establish regular learning habits and complete their programs. Concurrently, online products geared towards entertainment and social interactions are sometimes so effective in increasing user engagement and creating frequent usage habits that they inadvertently lead to digital addiction, especially among youth. In this project, we carry out a contest-based intervention, common in the entertainment context, on an educational app for Indian children learning English. Approximately ten thousand randomly selected learners entered a 100-day reading contest. They would win a set of physical books if they ranked sufficiently high on a leaderboard based on the amount of educational content consumed. Twelve weeks after the end of the contest, when the treatment group had no additional incentives to use the app, they continued their engagement with it at a rate 75\% higher than the control group, indicating a successful formation of a reading habit. In addition, we observed a 6\% increase in retention within the treatment group. These results underscore the potential of digital interventions in fostering positive engagement habits with educational technology products, ultimately enhancing users' long-term learning outcomes.

Suggested Citation

  • Keshav Agrawal & Susan Athey & Ayush Kanodia & Emil Palikot, 2023. "Digital interventions and habit formation in educational technology," Papers 2310.10850, arXiv.org, revised Jan 2024.
    • Handle: RePEc:arx:papers:2310.10850
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2310.10850
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Roland G. Fryer, 2011. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1755-1798.
    2. Eric P. Bettinger, 2012. "Paying to Learn: The Effect of Financial Incentives on Elementary School Test Scores," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 686-698, August.
    3. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    4. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    5. Ni Huang & Jiayin Zhang & Gordon Burtch & Xitong Li & Peiyu Chen, 2021. "Combating Procrastination on Massive Online Open Courses via Optimal Calls to Action," Information Systems Research, INFORMS, vol. 32(2), pages 301-317, June.
    6. List, John A. & Livingston, Jeffrey A. & Neckermann, Susanne, 2018. "Do financial incentives crowd out intrinsic motivation to perform on standardized tests?," Economics of Education Review, Elsevier, vol. 66(C), pages 125-136.
    7. Luis M. Romero-Rodríguez & María Soledad Ramírez-Montoya & Ignacio Aguaded, 2020. "Determining Factors in MOOCs Completion Rates: Application Test in Energy Sustainability Courses," Sustainability, MDPI, vol. 12(7), pages 1-11, April.
    8. Keshav Agrawal & Susan Athey & Ayush Kanodia & Emil Palikot, 2022. "Personalized Recommendations in EdTech: Evidence from a Randomized Controlled Trial," Papers 2208.13940, arXiv.org, revised Dec 2022.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    2. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    3. James Berry, 2015. "Child Control in Education Decisions: An Evaluation of Targeted Incentives to Learn in India," Journal of Human Resources, University of Wisconsin Press, vol. 50(4), pages 1051-1080.
    4. Visaria, Sujata & Dehejia, Rajeev & Chao, Melody M. & Mukhopadhyay, Anirban, 2016. "Unintended consequences of rewards for student attendance: Results from a field experiment in Indian classrooms," Economics of Education Review, Elsevier, vol. 54(C), pages 173-184.
    5. Damien de Walque & Christine Valente, 2023. "Incentivizing School Attendance in the Presence of Parent-Child Information Frictions," American Economic Journal: Economic Policy, American Economic Association, vol. 15(3), pages 256-285, August.
    6. Bach, Maximilian & Fischer, Mira, 2020. "Understanding the Response to High-Stakes Incentives in Primary Education," Rationality and Competition Discussion Paper Series 261, CRC TRR 190 Rationality and Competition.
    7. Ersoy, Fulya, 2023. "Effects of perceived productivity on study effort: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 207(C), pages 376-391.
    8. Guryan, Jonathan & Kim, James S. & Park, Kyung H., 2016. "Motivation and incentives in education: Evidence from a summer reading experiment," Economics of Education Review, Elsevier, vol. 55(C), pages 1-20.
    9. Åslund, Olof & Engdahl, Mattias, 2018. "The value of earning for learning: Performance bonuses in immigrant language training," Economics of Education Review, Elsevier, vol. 62(C), pages 192-204.
    10. Koch, Alexander & Nafziger, Julia & Nielsen, Helena Skyt, 2015. "Behavioral economics of education," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 3-17.
    11. Kugler Franziska & Schwerdt Guido & Wößmann Ludger, 2014. "Ökonometrische Methoden zur Evaluierung kausaler Effekte der Wirtschaftspolitik," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 15(2), pages 105-132, June.
    12. Jalava, Nina & Joensen, Juanna Schrøter & Pellas, Elin, 2015. "Grades and rank: Impacts of non-financial incentives on test performance," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 161-196.
    13. Fischer, Mira & Wagner, Valentin, 2018. "Effects of timing and reference frame of feedback: Evidence from a field experiment," Discussion Papers, Research Unit: Market Behavior SP II 2018-206, WZB Berlin Social Science Center.
    14. Gong, Jie & Liu, Tracy Xiao & Tang, Jie, 2021. "How monetary incentives improve outcomes in MOOCs: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 905-921.
    15. Rodriguez, Viviana, 2023. "Student effort response to shifts in university admission policies," Economics of Education Review, Elsevier, vol. 93(C).
    16. Wagner, Valentin & Riener, Gerhard, 2015. "Peers or parents? On non-monetary incentives in schools," DICE Discussion Papers 203, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    17. Martorell, Paco & Miller, Trey & Santibañez, Lucrecia & Augustine, Catherine H., 2016. "Can incentives for parents and students change educational inputs? Experimental evidence from summer school," Economics of Education Review, Elsevier, vol. 50(C), pages 113-126.
    18. Melody M. Chao & Rajeev Dehejia & Anirban Mukhopadhyay & Sujata Visaria, 2015. "Unintended Negative Consequences of Rewards for Student Attendance: Results from a Field Experiment in Indian Classrooms," HKUST IEMS Working Paper Series 2015-22, HKUST Institute for Emerging Market Studies, revised Apr 2015.
    19. Adam M. Lavecchia & Heidi Liu & Philip Oreopoulos, 2014. "Behavioral Economics of Education: Progress and Possibilities," NBER Working Papers 20609, National Bureau of Economic Research, Inc.
    20. List, John A. & Livingston, Jeffrey A. & Neckermann, Susanne, 2018. "Do financial incentives crowd out intrinsic motivation to perform on standardized tests?," Economics of Education Review, Elsevier, vol. 66(C), pages 125-136.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2310.10850. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.