IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v190y2021icp905-921.html
   My bibliography  Save this article

How monetary incentives improve outcomes in MOOCs: Evidence from a field experiment

Author

Listed:
  • Gong, Jie
  • Liu, Tracy Xiao
  • Tang, Jie

Abstract

In this study, we examine the impact of monetary incentives on user engagement and learning outcomes in massive open online courses (MOOCs). While MOOCs offer high-quality interactive educational resources to users worldwide, maintaining user engagement and enthusiasm on these platforms is a challenge. To address this issue, we conduct a field experiment in which users are given monetary incentives to engage in online learning. Our results show that those given a monetary incentive are more likely to submit homework and to gain higher homework grades. We further find that the effect persists even after we remove the monetary incentives and that it spills over into learning behavior in other courses in the same and subsequent semester. Overall, our findings suggest that monetary incentives counteract engagement decay and may help online users form persistent learning habits.

Suggested Citation

  • Gong, Jie & Liu, Tracy Xiao & Tang, Jie, 2021. "How monetary incentives improve outcomes in MOOCs: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 905-921.
  • Handle: RePEc:eee:jeborg:v:190:y:2021:i:c:p:905-921
    DOI: 10.1016/j.jebo.2021.06.029
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268121002687
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2021.06.029?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Heather Royer & Mark Stehr & Justin Sydnor, 2015. "Incentives, Commitments, and Habit Formation in Exercise: Evidence from a Field Experiment with Workers at a Fortune-500 Company," American Economic Journal: Applied Economics, American Economic Association, vol. 7(3), pages 51-84, July.
    2. Roland G. Fryer, 2011. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1755-1798.
    3. Damon Clark & David Gill & Victoria Prowse & Mark Rush, 2020. "Using Goals to Motivate College Students: Theory and Evidence From Field Experiments," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 648-663, October.
    4. Tanjim Hossain & John A. List, 2012. "The Behavioralist Visits the Factory: Increasing Productivity Using Simple Framing Manipulations," Management Science, INFORMS, vol. 58(12), pages 2151-2167, December.
    5. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.
    6. Roland Fryer & Steven Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," Framed Field Experiments 00591, The Field Experiments Website.
    7. Edwin Leuven & Hessel Oosterbeek & Bas van der Klaauw, 2010. "The Effect of Financial Rewards on Students' Achievement: Evidence from a Randomized Experiment," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1243-1265, December.
    8. Edwin Leuven & Hessel Oosterbeek & Bas van der Klaauw, 2010. "The Effect of Financial Rewards on Students' Achievement: Evidence from a Randomized Experiment," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1243-1265, December.
    9. Eric P. Bettinger, 2012. "Paying to Learn: The Effect of Financial Incentives on Elementary School Test Scores," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 686-698, August.
    10. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    11. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    12. George A. Akerlof & Rachel E. Kranton, 2005. "Identity and the Economics of Organizations," Journal of Economic Perspectives, American Economic Association, vol. 19(1), pages 9-32, Winter.
    13. Patterson, Richard W., 2018. "Can behavioral tools improve online student outcomes? Experimental evidence from a massive open online course," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 293-321.
    14. James Andreoni, 1995. "Warm-Glow versus Cold-Prickle: The Effects of Positive and Negative Framing on Cooperation in Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 1-21.
    15. Joshua Angrist & Eric Bettinger & Erik Bloom & Elizabeth King & Michael Kremer, 2002. "Vouchers for Private Schooling in Colombia: Evidence from a Randomized Natural Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1535-1558, December.
    16. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    17. Hong, Fuhai & Hossain, Tanjim & List, John A., 2015. "Framing manipulations in contests: A natural field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 118(C), pages 372-382.
    18. Masset, Edoardo & García-Hombrados, Jorge & Acharya, Arnab, 2020. "Aiming high and falling low: The SADA-Northern Ghana Millennium Village Project," Journal of Development Economics, Elsevier, vol. 143(C).
    19. George A. Akerlof & Rachel E. Kranton, 2008. "Identity, Supervision, and Work Groups," American Economic Review, American Economic Association, vol. 98(2), pages 212-217, May.
    20. Steven D. Levitt & John A. List & Sally Sadoff, 2016. "The Effect of Performance-Based Incentives on Educational Achievement: Evidence from a Randomized Experiment," NBER Working Papers 22107, National Bureau of Economic Research, Inc.
    21. Stephan Meier, 2007. "Do Subsidies Increase Charitable Giving in the Long Run? Matching Donations in a Field Experiment," Journal of the European Economic Association, MIT Press, vol. 5(6), pages 1203-1222, December.
    22. Yan Chen & Joseph Konstan, 2015. "Online field experiments: a selective survey of methods," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 29-42, July.
    23. Abhijit V. Banerjee & Esther Duflo, 2014. "(Dis)organization and Success in an Economics MOOC," American Economic Review, American Economic Association, vol. 104(5), pages 514-518, May.
    24. Dennis J. Zhang & Gad Allon & Jan A. Van Mieghem, 2017. "Does Social Interaction Improve Learning Outcomes? Evidence from Field Experiments on Massive Open Online Courses," Manufacturing & Service Operations Management, INFORMS, vol. 19(3), pages 347-367, July.
    25. Gary Charness & Uri Gneezy, 2009. "Incentives to Exercise," Econometrica, Econometric Society, vol. 77(3), pages 909-931, May.
    26. Roland G. Fryer, 2011. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," NBER Working Papers 16850, National Bureau of Economic Research, Inc.
    27. Uri Gneezy & John A List, 2006. "Putting Behavioral Economics to Work: Testing for Gift Exchange in Labor Markets Using Field Experiments," Econometrica, Econometric Society, vol. 74(5), pages 1365-1384, September.
    28. Daron Acemoglu & David Laibson & John A. List, 2014. "Equalizing Superstars: The Internet and the Democratization of Education," American Economic Review, American Economic Association, vol. 104(5), pages 523-527, May.
    29. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," Review of Economic Studies, Oxford University Press, vol. 76(2), pages 451-469.
    30. Reshmaan Hussam & Atonu Rabbani & Giovanni Reggiani & Natalia Rigol, 2017. "Habit Formation and Rational Addiction: A Field Experiment in Handwashing," Harvard Business School Working Papers 18-030, Harvard Business School.
    31. Jalava, Nina & Joensen, Juanna Schrøter & Pellas, Elin, 2015. "Grades and rank: Impacts of non-financial incentives on test performance," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 161-196.
    32. George A. Akerlof & Rachel E. Kranton, 2000. "Economics and Identity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 715-753.
    33. Maria De Paola & Vincenzo Scoppa & Rosanna Nisticò, 2012. "Monetary Incentives and Student Achievement in a Depressed Labor Market: Results from a Randomized Experiment," Journal of Human Capital, University of Chicago Press, vol. 6(1), pages 56-85.
    34. Mobius, Markus & Rosenblat, Tanya & Wang, Qiqi, 2016. "Ethnic discrimination: Evidence from China," European Economic Review, Elsevier, vol. 90(C), pages 165-177.
    35. M Paula Cacault & Christian Hildebrand & Jérémy Laurent-Lucchetti & Michele Pellizzari, 2021. "Distance Learning in Higher Education: Evidence from a Randomized Experiment [A Randomized Assessment of Online Learning]," Journal of the European Economic Association, European Economic Association, vol. 19(4), pages 2322-2372.
    36. Joshua Angrist & Eric Bettinger & Michael Kremer, 2006. "Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," American Economic Review, American Economic Association, vol. 96(3), pages 847-862, June.
    37. Jen Shang & Rachel Croson, 2009. "A Field Experiment in Charitable Contribution: The Impact of Social Information on the Voluntary Provision of Public Goods," Economic Journal, Royal Economic Society, vol. 119(540), pages 1422-1439, October.
    38. Dean Karlan & Margaret McConnell & Sendhil Mullainathan & Jonathan Zinman, 2016. "Getting to the Top of Mind: How Reminders Increase Saving," Management Science, INFORMS, vol. 62(12), pages 3393-3411, December.
    39. David J. Deming & Claudia Goldin & Lawrence F. Katz & Noam Yuchtman, 2015. "Can Online Learning Bend the Higher Education Cost Curve?," American Economic Review, American Economic Association, vol. 105(5), pages 496-501, May.
    40. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    41. Edmonds, Eric & Theoharides, Caroline, 2020. "The short term impact of a productive asset transfer in families with child labor: Experimental evidence from the Philippines," Journal of Development Economics, Elsevier, vol. 146(C).
    42. Chen, Yan & Li, Sherry Xin & Liu, Tracy Xiao & Shih, Margaret, 2014. "Which hat to wear? Impact of natural identities on coordination and cooperation," Games and Economic Behavior, Elsevier, vol. 84(C), pages 58-86.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    2. Islam, Asad & Kwon, Sungoh & Masood, Eema & Prakash, Nishith & Sabarwal, Shwetlena & Saraswat, Deepak, 2020. "When Goal-Setting Forges Ahead but Stops Short," GLO Discussion Paper Series 526, Global Labor Organization (GLO).
    3. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    4. Åslund, Olof & Engdahl, Mattias, 2018. "The value of earning for learning: Performance bonuses in immigrant language training," Economics of Education Review, Elsevier, vol. 62(C), pages 192-204.
    5. Adam M. Lavecchia & Heidi Liu & Philip Oreopoulos, 2014. "Behavioral Economics of Education: Progress and Possibilities," NBER Working Papers 20609, National Bureau of Economic Research, Inc.
    6. Damon Clark & David Gill & Victoria Prowse & Mark Rush, 2020. "Using Goals to Motivate College Students: Theory and Evidence From Field Experiments," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 648-663, October.
    7. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    8. Bach, Maximilian & Fischer, Mira, 2020. "Understanding the response to high-stakes incentives in primary education," ZEW Discussion Papers 20-066, ZEW - Leibniz Centre for European Economic Research.
    9. Herranz-Zarzoso, Noemí & Sabater-Grande, Gerardo, 2018. "Monetary incentives and self-chosen goals in academic performance: An experimental study," International Review of Economics Education, Elsevier, vol. 27(C), pages 34-44.
    10. Manuela Angelucci & Silvia Prina & Heather Royer & Anya Samek, 2015. "When Incentives Backfire: Spillover Effects in Food Choice," NBER Working Papers 21481, National Bureau of Economic Research, Inc.
    11. Maria De Paola & Vincenzo Scoppa & Rosanna Nisticò, 2012. "Monetary Incentives and Student Achievement in a Depressed Labor Market: Results from a Randomized Experiment," Journal of Human Capital, University of Chicago Press, vol. 6(1), pages 56-85.
    12. Koch, Alexander & Nafziger, Julia & Nielsen, Helena Skyt, 2015. "Behavioral economics of education," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 3-17.
    13. Andreas Ostermaier, 2018. "Incentives for students: effects of certificates and deadlines on student performance," Journal of Business Economics, Springer, vol. 88(1), pages 65-96, January.
    14. Guryan, Jonathan & Kim, James S. & Park, Kyung H., 2016. "Motivation and incentives in education: Evidence from a summer reading experiment," Economics of Education Review, Elsevier, vol. 55(C), pages 1-20.
    15. Fenella Carpena & Shawn Cole & Jeremy Shapiro & Bilal Zia, 2019. "The ABCs of Financial Education: Experimental Evidence on Attitudes, Behavior, and Cognitive Biases," Management Science, INFORMS, vol. 65(1), pages 346-369, January.
    16. Kugler Franziska & Schwerdt Guido & Wößmann Ludger, 2014. "Ökonometrische Methoden zur Evaluierung kausaler Effekte der Wirtschaftspolitik," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 15(2), pages 105-132, June.
    17. Joshua Angrist & Philip Oreopoulos & Tyler Williams, 2014. "When Opportunity Knocks, Who Answers?: New Evidence on College Achievement Awards," Journal of Human Resources, University of Wisconsin Press, vol. 49(3), pages 572-610.
    18. Wagner, Valentin & Riener, Gerhard, 2015. "Peers or parents? On non-monetary incentives in schools," DICE Discussion Papers 203, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    19. Berry, James & Kim, Hyuncheol Bryant & Son, Hyuk Harry, 2022. "When student incentives do not work: Evidence from a field experiment in Malawi," Journal of Development Economics, Elsevier, vol. 158(C).
    20. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:190:y:2021:i:c:p:905-921. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.