IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v103y2024ics0272775724000888.html
   My bibliography  Save this article

All pain and no gain: When goal setting leads to more effort but no gains in test scores

Author

Listed:
  • Islam, Asad
  • Kwon, Sungoh
  • Masood, Eema
  • Prakash, Nishith
  • Sabarwal, Shwetlena
  • Saraswat, Deepak

Abstract

We conducted an at-scale randomized control trial among 18,281 secondary students in Tanzania to examine the effects of self-set academic goals on students’ efforts and academic outcomes. We also tested the impact of combining goal setting with non-financial rewards. We found that goal-setting had a significant positive effect on self-reported student time use, study effort, and self-discipline, along with a positive but statistically insignificant impact on test performance. We also found that combining goal setting with recognition awards for achieving the goals did not demonstrate any complementary effects. Heterogeneity analysis suggested that goal-setting had a higher impact on test performance for students in the middle of the distribution of baseline learning levels. We also found that the impact of the treatment did not vary significantly across students’ gender, socioeconomic background, or type of chosen goals.

Suggested Citation

  • Islam, Asad & Kwon, Sungoh & Masood, Eema & Prakash, Nishith & Sabarwal, Shwetlena & Saraswat, Deepak, 2024. "All pain and no gain: When goal setting leads to more effort but no gains in test scores," Economics of Education Review, Elsevier, vol. 103(C).
    • Handle: RePEc:eee:ecoedu:v:103:y:2024:i:c:s0272775724000888
    DOI: 10.1016/j.econedurev.2024.102594
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775724000888
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econedurev.2024.102594?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    2. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    3. Esther Duflo, 2001. "Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment," American Economic Review, American Economic Association, vol. 91(4), pages 795-813, September.
    4. Jean Tirole & Roland Bénabou, 2006. "Incentives and Prosocial Behavior," American Economic Review, American Economic Association, vol. 96(5), pages 1652-1678, December.
    5. Damon Clark & David Gill & Victoria Prowse & Mark Rush, 2020. "Using Goals to Motivate College Students: Theory and Evidence From Field Experiments," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 648-663, October.
    6. Michael Kosfeld & Susanne Neckermann, 2011. "Getting More Work for Nothing? Symbolic Awards and Worker Performance," American Economic Journal: Microeconomics, American Economic Association, vol. 3(3), pages 86-99, August.
    7. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    8. David Hirshleifer & Angie Low & Siew Hong Teoh, 2012. "Are Overconfident CEOs Better Innovators?," Journal of Finance, American Finance Association, vol. 67(4), pages 1457-1498, August.
    9. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    10. Karthik Muralidharan & Nishith Prakash, 2017. "Cycling to School: Increasing Secondary School Enrollment for Girls in India," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 321-350, July.
    11. Karthik Muralidharan & Venkatesh Sundararaman, 2013. "Contract Teachers: Experimental Evidence from India," NBER Working Papers 19440, National Bureau of Economic Research, Inc.
    12. repec:osf:socarx:zs9aq_v1 is not listed on IDEAS
    13. Gary Charness & David Masclet & Marie-Claire Villeval, 2010. "Competitive Preferences and Status as an Incentive : Experimental Evidence," Working Papers 1016, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    14. Sylvie Moulin & Michael Kremer & Paul Glewwe, 2009. "Many Children Left Behind? Textbooks and Test Scores in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 112-135, January.
    15. Ashraf, Nava & Bandiera, Oriana & Lee, Scott S., 2014. "Awards unbundled: Evidence from a natural field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 100(C), pages 44-63.
    16. Heckman, James J., 2011. "Integrating Personality Psychology into Economics," IZA Discussion Papers 5950, Institute of Labor Economics (IZA).
    17. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    18. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    19. Max van Lent & Michiel Souverijn, 2017. "Goal Setting and Raising the Bar: A Field Experiment," Tinbergen Institute Discussion Papers 17-001/VII, Tinbergen Institute.
    20. Philip Oreopoulos & Uros Petronijevic, 2019. "The Remarkable Unresponsiveness of College Students to Nudging And What We Can Learn from It," NBER Working Papers 26059, National Bureau of Economic Research, Inc.
    21. World Bank, 2012. "Service Delivery Indicators : Tanzania," World Bank Publications - Reports 20126, The World Bank Group.
    22. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    23. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    24. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    25. Isaac Mbiti & Karthik Muralidharan & Mauricio Romero & Youdi Schipper & Constantine Manda & Rakesh Rajani, 2019. "Inputs, Incentives, and Complementarities in Education: Experimental Evidence from Tanzania," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1627-1673.
    26. Almlund, Mathilde & Duckworth, Angela Lee & Heckman, James & Kautz, Tim, 2011. "Personality Psychology and Economics," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 4, chapter 0, pages 1-181, Elsevier.
    27. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    28. Bruno S. Frey, 1994. "How Intrinsic Motivation is Crowded out and in," Rationality and Society, , vol. 6(3), pages 334-352, July.
    29. Islam, Asad, 2019. "Parent–teacher meetings and student outcomes: Evidence from a developing country," European Economic Review, Elsevier, vol. 111(C), pages 273-304.
    30. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    31. Sule Alan & Teodora Boneva & Seda Ertac, 2019. "Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1121-1162.
    32. Huillery, Elise & Bouguen, Adrien & Charpentier, Axelle & Algan, Yann & Chevallier, Coralie, 2021. "The Role of Mindset in Education : A Large-Scale Field Experiment in Disadvantaged Schools," SocArXiv zs9aq, Center for Open Science.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Islam, Asad & Kwon, Sungoh & Masood, Eema & Prakash, Nishith & Sabarwal, Shwetlena & Saraswat, Deepak, 2020. "When Goal-Setting Forges Ahead but Stops Short," GLO Discussion Paper Series 526, Global Labor Organization (GLO).
    2. David J. Deming, 2022. "Four Facts about Human Capital," Journal of Economic Perspectives, American Economic Association, vol. 36(3), pages 75-102, Summer.
    3. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    4. Kumar, G. Naveen, 2023. "Improving public school productivity: Evidence from model schools in India," Economics of Education Review, Elsevier, vol. 97(C).
    5. Mo, Di & Bai, Yu & Shi, Yaojiang & Abbey, Cody & Zhang, Linxiu & Rozelle, Scott & Loyalka, Prashant, 2020. "Institutions, implementation, and program effectiveness: Evidence from a randomized evaluation of computer-assisted learning in rural China," Journal of Development Economics, Elsevier, vol. 146(C).
    6. Isaac Mbiti & Karthik Muralidharan & Mauricio Romero & Youdi Schipper & Constantine Manda & Rakesh Rajani, 2019. "Inputs, Incentives, and Complementarities in Education: Experimental Evidence from Tanzania," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1627-1673.
    7. Piza, Caio & Zwager, Astrid & Ruzzante, Matteo & Dantas, Rafael & Loureiro, Andre, 2024. "Teacher-led innovations to improve education outcomes: Experimental evidence from Brazil," Journal of Public Economics, Elsevier, vol. 234(C).
    8. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    9. Harounan Kazianga & Leigh Linden & Ali Protik & Matt Sloan, 2015. "Impact Evaluation of Burkina Faso's BRIGHT Program: Design Report," Mathematica Policy Research Reports c0250cd3f27d448ea70d909c3, Mathematica Policy Research.
    10. Islam, Asad, 2019. "Parent–teacher meetings and student outcomes: Evidence from a developing country," European Economic Review, Elsevier, vol. 111(C), pages 273-304.
    11. Allen, James & Mahumane, Arlete & Riddell, James & Rosenblat, Tanya & Yang, Dean & Yu, Hang, 2022. "Teaching and incentives: Substitutes or complements?," Economics of Education Review, Elsevier, vol. 91(C).
    12. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    13. Wagner, Valentin & Riener, Gerhard, 2015. "Peers or parents? On non-monetary incentives in schools," DICE Discussion Papers 203, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    14. Naik, Gopal & Chitre, Chetan & Bhalla, Manaswini & Rajan, Jothsna, 2020. "Impact of use of technology on student learning outcomes: Evidence from a large-scale experiment in India," World Development, Elsevier, vol. 127(C).
    15. Derksen, Laura & Michaud-Leclerc, Catherine & Souza, Pedro C.L., 2022. "Restricted access: How the internet can be used to promote reading and learning," Journal of Development Economics, Elsevier, vol. 155(C).
    16. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    17. Minahil Asim & Ronak Jain & Vatsal Khandelwal, 2024. "Great expectations? Experimental evidence from schools in Pakistan," ECON - Working Papers 454, Department of Economics - University of Zurich.
    18. Asadul Islam, 2017. "Parental Involvement in Education: Evidence from Field Experiments in Developing Countries," Monash Economics Working Papers 02-17, Monash University, Department of Economics.
    19. Sabrin Beg & Waqas Halim & Adrienne M. Lucas & Umar Saif, 2022. "Engaging Teachers with Technology Increased Achievement, Bypassing Teachers Did Not," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 61-90, May.
    20. Singh, Prakarsh & Masters, William A., 2017. "Impact of caregiver incentives on child health: Evidence from an experiment with Anganwadi workers in India," Journal of Health Economics, Elsevier, vol. 55(C), pages 219-231.

    More about this item

    Keywords

    Goal-setting; Recognition rewards; Student efforts; Zanzibar;
    All these keywords.

    JEL classification:

    • D9 - Microeconomics - - Micro-Based Behavioral Economics
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration
    • O55 - Economic Development, Innovation, Technological Change, and Growth - - Economywide Country Studies - - - Africa

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:103:y:2024:i:c:s0272775724000888. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.