IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp12437.html
   My bibliography  Save this paper

Rank Incentives and Social Learning: Evidence from a Randomized Controlled Trial

Author

Listed:
  • Dobrescu, Isabella

    (University of New South Wales)

  • Faravelli, Marco

    (University of Queensland)

  • Megalokonomou, Rigissa

    (Monash University)

  • Motta, Alberto

    (University of New South Wales)

Abstract

In a 1-year randomized controlled trial involving thousands of university students, we provide real-time private feedback on relative performance in a semester-long online assignment. Within this setup, our experimental design cleanly identifies the behavioral response to rank incentives (i.e., the incentives stemming from an inherent preference for high rank). We find that rank incentives not only boost performance in the related assignment, but also increase the average grade across all course exams taken over the semester by 0.21 standard deviations. These beneficial effects remain sizeable across all quantiles and extend beyond the time of the intervention. The mechanism behind these findings involves social learning: rank incentives make students engage more in peer interactions, which lead them to perform significantly better across the board. Finally, we explore the virtues of real-time feedback by analyzing a number of alternative variations in the way it is provided.

Suggested Citation

  • Dobrescu, Isabella & Faravelli, Marco & Megalokonomou, Rigissa & Motta, Alberto, 2019. "Rank Incentives and Social Learning: Evidence from a Randomized Controlled Trial," IZA Discussion Papers 12437, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp12437
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp12437.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Azmat, Ghazala & Iriberri, Nagore, 2010. "The importance of relative performance feedback information: Evidence from a natural experiment using high school students," Journal of Public Economics, Elsevier, vol. 94(7-8), pages 435-452, August.
    2. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    3. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    4. Alexander Wolitzky, 2018. "Learning from Others' Outcomes," American Economic Review, American Economic Association, vol. 108(10), pages 2763-2801, October.
    5. Alexandre Mas & Enrico Moretti, 2009. "Peers at Work," American Economic Review, American Economic Association, vol. 99(1), pages 112-145, March.
    6. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    7. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    8. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukherji & Marc Shotland & Michael Walton, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level” in India," NBER Working Papers 22746, National Bureau of Economic Research, Inc.
    9. Roland G. Fryer, Jr., 2014. "Injecting Charter School Best Practices into Traditional Public Schools: Evidence from Field Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1355-1407.
    10. Duflo, Esther & Dupas, Pascaline & Kremer, Michael, 2015. "School governance, teacher incentives, and pupil–teacher ratios: Experimental evidence from Kenyan primary schools," Journal of Public Economics, Elsevier, vol. 123(C), pages 92-110.
    11. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2013. "Team Incentives: Evidence From A Firm Level Experiment," Journal of the European Economic Association, European Economic Association, vol. 11(5), pages 1079-1114, October.
    12. Eriksson, Tor & Poulsen, Anders & Villeval, Marie Claire, 2009. "Feedback and incentives: Experimental evidence," Labour Economics, Elsevier, vol. 16(6), pages 679-688, December.
    13. Paul Glewwe & Nauman Ilias & Michael Kremer, 2010. "Teacher Incentives," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 205-227, July.
    14. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    15. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    16. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    17. Tran, Anh & Zeckhauser, Richard, 2012. "Rank as an inherent incentive: Evidence from a field experiment," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 645-650.
    18. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    19. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    20. Jörn-Steffen Pischke, 2007. "The Impact of Length of the School Year on Student Performance and Earnings: Evidence From the German Short School Years," Economic Journal, Royal Economic Society, vol. 117(523), pages 1216-1242, October.
    21. Loretti I. Dobrescu, 2015. "To Love or to Pay: Savings and Health Care in Older Age," Journal of Human Resources, University of Wisconsin Press, vol. 50(1), pages 254-299.
    22. Jordi Blanes i Vidal & Mareike Nossol, 2011. "Tournaments Without Prizes: Evidence from Personnel Records," Management Science, INFORMS, vol. 57(10), pages 1721-1736, October.
    23. Camelia M. Kuhnen & Agnieszka Tymula, 2012. "Feedback, Self-Esteem, and Performance in Organizations," Management Science, INFORMS, vol. 58(1), pages 94-113, January.
    24. Abhijit Banerjee & Rukmini Banerji & Esther Duflo, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level†in India," Working Papers id:11419, eSocialSciences.
    25. Katrina Jessoe & David Rapson, 2014. "Knowledge Is (Less) Power: Experimental Evidence from Residential Energy Use," American Economic Review, American Economic Association, vol. 104(4), pages 1417-1438, April.
    26. Megalokonomou, Rigissa & Goulas, Sofoklis, 2015. "Knowing who you are - The Effect of Feedback Information on Short and Long Term Outcomes," The Warwick Economics Research Paper Series (TWERPS) 1075, University of Warwick, Department of Economics.
    27. Steven Blader & Claudine Gartenberg & Andrea Prat, 2020. "The Contingent Effect of Management Practices," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 721-749.
    28. Leonie Gerhards & Neele Siemer, 2016. "The Impact Of Private And Public Feedback On Worker Performance—Evidence From The Lab," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1188-1201, April.
    29. David J. Zimmerman, 2003. "Peer Effects in Academic Outcomes: Evidence from a Natural Experiment," The Review of Economics and Statistics, MIT Press, vol. 85(1), pages 9-23, February.
    30. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    31. Leonardo Bursztyn & Robert Jensen, 2015. "How Does Peer Pressure Affect Educational Investments?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1329-1367.
    32. Azmat, Ghazala & Bagues, Manuel & Cabrales, Antonio & Iriberri, Nagore, 2016. "What You Don't Know... Can't Hurt You? A Field Experiment on Relative Performance Feedback in Higher Education," IZA Discussion Papers 9853, Institute of Labor Economics (IZA).
    33. Atila Abdulkadiroğlu & Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak, 2011. "Accountability and Flexibility in Public Schools: Evidence from Boston's Charters And Pilots," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 699-748.
    34. Kugler, Adriana & Tinsley, Catherine H. & Ukhaneva, Olga, 2017. "Choice of Majors: Are Women Really Different from Men?," IZA Discussion Papers 10947, Institute of Labor Economics (IZA).
    35. Leonie Gerhards & Neele Siemer, 2014. "Private versus Public Feedback - The Incentive Effects of Symbolic Awards," Economics Working Papers 2014-01, Department of Economics and Business Economics, Aarhus University.
    36. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2018. "Normatively Framed Relative Performance Feedback – Field Experiment and Replication," MPRA Paper 88830, University Library of Munich, Germany.
    37. Victor Lavy, 2002. "Evaluating the Effect of Teachers' Group Performance Incentives on Pupil Achievement," Journal of Political Economy, University of Chicago Press, vol. 110(6), pages 1286-1317, December.
    38. Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2013. "Team incentives: evidence from a firm level," LSE Research Online Documents on Economics 53141, London School of Economics and Political Science, LSE Library.
    39. Bedard, Kelly & Kuhn, Peter, 2008. "Where class size really matters: Class size and student ratings of instructor effectiveness," Economics of Education Review, Elsevier, vol. 27(3), pages 253-265, June.
    40. Steven C. McMullen & Kathryn E. Rouse, 2012. "The Impact of Year-Round Schooling on Academic Achievement: Evidence from Mandatory School Calendar Conversions," American Economic Journal: Economic Policy, American Economic Association, vol. 4(4), pages 230-252, November.
    41. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    42. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2019. "What You Don’t Know…Can’t Hurt You? A Natural Field Experiment on Relative Performance Feedback in Higher Education," Management Science, INFORMS, vol. 65(8), pages 3714-3736, August.
    43. Ghazala Azmat & Nagore Iriberri, 2016. "The Provision of Relative Performance Feedback: An Analysis of Performance and Satisfaction," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 25(1), pages 77-110, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gwen-Jiro Clochard & Guillaume Hollard & Julia Wirtz, 2022. "More effort or better technologies? On the effect of relative performance feedback," Bristol Economics Discussion Papers 22/767, School of Economics, University of Bristol, UK.
    2. Hermes, Henning & Huschens, Martin & Rothlauf, Franz & Schunk, Daniel, 2021. "Motivating low-achievers—Relative performance feedback in primary schools," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 45-59.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fischer, Mira & Wagner, Valentin, 2018. "Effects of Timing and Reference Frame of Feedback: Evidence from a Field Experiment," IZA Discussion Papers 11970, Institute of Labor Economics (IZA).
    2. Goulas, Sofoklis & Megalokonomou, Rigissa, 2021. "Knowing who you actually are: The effect of feedback on short- and longer-term outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 589-615.
    3. Delavallade, Clara, 2021. "Motivating teams: Private feedback and public recognition at work," Journal of Public Economics, Elsevier, vol. 197(C).
    4. Gwen-Jiro Clochard & Guillaume Hollard & Julia Wirtz, 2022. "More effort or better technologies? On the effect of relative performance feedback," Bristol Economics Discussion Papers 22/767, School of Economics, University of Bristol, UK.
    5. Murphy, Richard & Weinhardt, Felix, 2020. "Top of the Class: The Importance of Ordinal Rank," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 87(6), pages 2777-2826.
    6. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    7. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2018. "Normatively Framed Relative Performance Feedback – Field Experiment and Replication," MPRA Paper 88830, University Library of Munich, Germany.
    8. Ertac, Seda & Gümren, Mert & Koçkesen, Levent, 2019. "Strategic feedback in teams: Theory and experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 162(C), pages 1-23.
    9. Delavallade,Clara Anne, 2021. "Motivating Teams : Private Feedback and Public Recognition at Work," Policy Research Working Paper Series 9621, The World Bank.
    10. Bandiera, Oriana & Larcinese, Valentino & Rasul, Imran, 2015. "Blissful ignorance? A natural experiment on the effect of feedback on students' performance," Labour Economics, Elsevier, vol. 34(C), pages 13-25.
    11. Fischer, Mira & Wagner, Valentin, 2019. "Effects of Timing and Reference Frame of Feedback," Rationality and Competition Discussion Paper Series 150, CRC TRR 190 Rationality and Competition.
    12. Vanessa, Mertins & Jeworrek, Sabrina & Vlassopoulos, Michael, 2018. ""The Good News about Bad News": Feedback about Past Organisational Failure Bad ist Impact in Worker Productivity," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181644, Verein für Socialpolitik / German Economic Association.
    13. Megalokonomou, Rigissa & Goulas, Sofoklis, 2015. "Knowing who you are - The Effect of Feedback Information on Short and Long Term Outcomes," The Warwick Economics Research Paper Series (TWERPS) 1075, University of Warwick, Department of Economics.
    14. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    15. Jeworrek, Sabrina & Mertins, Vanessa & Vlassopoulos, Michael, 2018. ""The good news about bad news": Feedback about past organisational failure and its impact on worker productivity," IWH Discussion Papers 1/2018, Halle Institute for Economic Research (IWH).
    16. Azmat, Ghazala & Iriberri, Nagore & Bagues, Manuel, 2016. "What you don't know... Can't hurt you? A field experiment on relative performance feedback in higher education," CEPR Discussion Papers 11201, C.E.P.R. Discussion Papers.
    17. Hoffmann, Christin & Thommes, Kirsten, 2020. "Can digital feedback increase employee performance and energy efficiency in firms? Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 49-65.
    18. Azmat, Ghazala & Bagues, Manuel & Cabrales, Antonio & Iriberri, Nagore, 2016. "What You Don't Know... Can't Hurt You? A Field Experiment on Relative Performance Feedback in Higher Education," IZA Discussion Papers 9853, Institute of Labor Economics (IZA).
    19. Selay Sahan & Euan Phimister, 2022. "Worker Incentives in the Banking Industry," Journal of Financial Services Research, Springer;Western Finance Association, vol. 61(2), pages 259-284, April.
    20. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2018. "What you don’t know... Can’t hurt you? A natural field experiment on relative performance feedback in higher education," Sciences Po publications info:hdl:2441/5r0qo9lp3v9, Sciences Po.

    More about this item

    Keywords

    relative performance feedback; rank incentives; social learning; academic performance; randomized controlled trial;
    All these keywords.

    JEL classification:

    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J18 - Labor and Demographic Economics - - Demographic Economics - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp12437. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.