IDEAS home Printed from https://ideas.repec.org/p/zbw/vfsc13/79795.html

"Making it count": Evidence from a Field Experiment on Assessment Rules, Study Incentives and Student Performance

Author

Listed:
  • Luehrmann, Melanie
  • Chevalier, Arnaud
  • Dolton, Peter

Abstract

This paper examines field experiment in which we encourage the use of computer-based tests (quizzes) through a set of non-financial incentives and test their effect on effort and performance of students. Our identification strategy exploits cross-cohort experimental variation in assessment rules and within course variation in incentives to determine their impact on the performance in exams. We find these incentives to result in an increase in grades of 2.4 marks or about 4%. The performance effects are concentrated in the lower quartile of the grade distribution and can be attributed to increase quiz participation. Our results suggest that use of computerised assessment methods is not only a relatively low cost method of fostering continuous learning but also an effective tool in increasing student effort and performance.

Suggested Citation

  • Luehrmann, Melanie & Chevalier, Arnaud & Dolton, Peter, 2013. ""Making it count": Evidence from a Field Experiment on Assessment Rules, Study Incentives and Student Performance," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79795, Verein für Socialpolitik / German Economic Association.
    • Handle: RePEc:zbw:vfsc13:79795
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/79795/1/VfS_2013_pid_963.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    2. Philipp Beltz & Susanne Link & Andreas Ostermaier, 2012. "Incentives for Students: Evidence from Two Natural Experiments," ifo Working Paper Series 133, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    3. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    4. Edward P. Lazear, 2000. "Performance Pay and Productivity," American Economic Review, American Economic Association, vol. 90(5), pages 1346-1361, December.
    5. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 1, number 1, June.
    6. Wayne A. Grove & Tim Wasserman, 2006. "Incentives and Student Learning: A Natural Experiment with Economics Problem Sets," American Economic Review, American Economic Association, vol. 96(2), pages 447-452, May.
    7. Edwin Leuven & Hessel Oosterbeek & Bas van der Klaauw, 2010. "The Effect of Financial Rewards on Students' Achievement: Evidence from a Randomized Experiment," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1243-1265, December.
    8. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 2, number 2, June.
    9. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    10. Azmat, Ghazala & Iriberri, Nagore, 2010. "The importance of relative performance feedback information: Evidence from a natural experiment using high school students," Journal of Public Economics, Elsevier, vol. 94(7-8), pages 435-452, August.
    11. Sheryl B. Ball & Catherine Eckel & Christian Rojas, 2006. "Technology Improves Learning in Large Principles of Economics Classes: Using Our WITS," American Economic Review, American Economic Association, vol. 96(2), pages 442-446, May.
    12. Andrews,Donald W. K. & Stock,James H. (ed.), 2005. "Identification and Inference for Econometric Models," Cambridge Books, Cambridge University Press, number 9780521844413, January.
    13. Bishop, John, 2006. "Drinking from the Fountain of Knowledge: Student Incentive to Study and Learn - Externalities, Information Problems and Peer Pressure," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 2, chapter 15, pages 909-944, Elsevier.
    14. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mangold, Benedikt & Pleier, Thomas & Brug, Christoph & Nolzen, Jan & Stübinger, Johannes, 2014. "Verbesserung des Lernverhaltens durch Online-Tests: Ein Jahr später," Discussion Papers 91/2013, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Statistics and Econometrics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chevalier, Arnaud & Dolton, Peter & Lührmann, Melanie, 2014. ""Making It Count": Evidence from a Field Study on Assessment Rules, Study Incentives and Student Performance," IZA Discussion Papers 8582, Institute of Labor Economics (IZA).
    2. Hege Marie Gjefsen & Trude Gunnes, 2015. "School accountability Incentives or sorting?," Discussion Papers 815, Statistics Norway, Research Department.
    3. Gjefsen, Hege Marie & Gunnes, Trude, 2016. "The effects of School Accountability on Teacher Mobility and Teacher Sorting," MPRA Paper 69664, University Library of Munich, Germany.
    4. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    5. Herranz-Zarzoso, Noemí & Sabater-Grande, Gerardo, 2018. "Monetary incentives and self-chosen goals in academic performance: An experimental study," International Review of Economics Education, Elsevier, vol. 27(C), pages 34-44.
    6. Noemí Herranz-Zarzoso & Gerardo Sabater-Grande, 2016. "Financial incentives and academic performance: An experimental study," Working Papers 2016/18, Economics Department, Universitat Jaume I, Castellón (Spain).
    7. Czibor, Eszter & Onderstal, Sander & Sloof, Randolph & van Praag, C. Mirjam, 2020. "Does relative grading help male students? Evidence from a field experiment in the classroom," Economics of Education Review, Elsevier, vol. 75(C).
    8. Uwe Dulleck & Juliana Silva-Goncalves & Benno Torgler, 2014. "Impact Evaluation of an Incentive Program on Educational Achievement of Indigenous Students," CREMA Working Paper Series 2014-13, Center for Research in Economics, Management and the Arts (CREMA).
    9. Adriana BARONE & Annamaria NESE, 2017. "Investment in Education, Obesity and Health Behaviours," CELPE Discussion Papers 146, CELPE - CEnter for Labor and Political Economics, University of Salerno, Italy.
    10. Johnston, Andrew C., 2021. "Preferences, Selection, and the Structure of Teacher Pay," IZA Discussion Papers 14831, Institute of Labor Economics (IZA).
    11. Uwe Dulleck & Juliana Silva-Goncalves & Benno Torgler, 2016. "Evaluation of an Incentive Program on Educational Achievement of Indigenous Students," The Economic Record, The Economic Society of Australia, vol. 92(298), pages 329-347, September.
    12. Daniel Horn & Hubert Janos Kiss, 2018. "Which preferences associate with school performance?—Lessons from an exploratory study with university students," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-32, February.
    13. Bigoni Maria & Fort Margherita & Nardotto Mattia & Reggiani Tommaso G., 2015. "Cooperation or Competition? A Field Experiment on Non-monetary Learning Incentives," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 15(4), pages 1753-1792, October.
    14. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    15. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    16. Islam, Asad & Kwon, Sungoh & Masood, Eema & Prakash, Nishith & Sabarwal, Shwetlena & Saraswat, Deepak, 2020. "When Goal-Setting Forges Ahead but Stops Short," GLO Discussion Paper Series 526, Global Labor Organization (GLO).
    17. Aysit Tansel & Ceyhan Ozturk & Erkan Erdil, 2021. "The Impact of Body Mass Index on Growth, Schooling, Productivity, and Savings: A Cross-Country Study," Koç University-TUSIAD Economic Research Forum Working Papers 2118, Koc University-TUSIAD Economic Research Forum.
    18. repec:cep:stieop:46 is not listed on IDEAS
    19. Czibor, Eszter & Claussen, Jörg & van Praag, Mirjam, 2019. "Women in a men’s world: Risk taking in an online card game community," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 62-89.
    20. Diaz-Serrano, Luis & Meix-Llop, Enric, 2012. "Do Fiscal and Political Decentralization Raise Students' Performance? A Cross-Country Analysis," IZA Discussion Papers 6722, Institute of Labor Economics (IZA).
    21. Rodríguez-Planas, Núria, 2010. "Longer-Term Impacts of Mentoring, Educational Services, and Incentives to Learn: Evidence from a Randomized Trial," IZA Discussion Papers 4754, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • D20 - Microeconomics - - Production and Organizations - - - General
    • A23 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Graduate

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:vfsc13:79795. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.