IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v65y2019i8p3714-3736.html
   My bibliography  Save this article

What You Don’t Know…Can’t Hurt You? A Natural Field Experiment on Relative Performance Feedback in Higher Education

Author

Listed:
  • Ghazala Azmat

    (Sciences Po and Centre for Economic Performance, LSE, Paris, Île-de-France 75337, France)

  • Manuel Bagues

    (Aalto University and IZA, Helsinki 00076, Finland)

  • Antonio Cabrales

    (University College London, London WC1E 6BT, United Kingdom)

  • Nagore Iriberri

    (University of the Basque Country UPV/EHU, IKERBASQUE, Basque Foundation for Science, Bilbao, País Vasco 48080, Spain)

Abstract

This paper studies the effect of providing feedback to college students on their position in the grade distribution by using a natural field experiment. This information was updated every six months during a three-year period. We find that greater grades transparency decreases educational performance, as measured by the number of examinations passed and grade point average (GPA). However, self-reported satisfaction, as measured by surveys conducted after feedback is provided but before students take their examinations, increases. We provide a theoretical framework to understand these results, focusing on the role of prior beliefs and using out-of-trial surveys to test the model. In the absence of treatment, a majority of students underestimate their position in the grade distribution, suggesting that the updated information is “good news” for many students. Moreover, the negative effect on performance is driven by those students who underestimate their position in the absence of feedback. Students who overestimate initially their position, if anything, respond positively. The performance effects are short lived—by the time students graduate, they have similar accumulated GPA and graduation rates.

Suggested Citation

  • Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2019. "What You Don’t Know…Can’t Hurt You? A Natural Field Experiment on Relative Performance Feedback in Higher Education," Management Science, INFORMS, vol. 65(8), pages 3714-3736, August.
  • Handle: RePEc:inm:ormnsc:v:65:y:2019:i:8:p:3714-3736
    DOI: 10.1287/mnsc.2018.3131
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2018.3131
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2018.3131?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Azmat, Ghazala & Iriberri, Nagore, 2010. "The importance of relative performance feedback information: Evidence from a natural experiment using high school students," Journal of Public Economics, Elsevier, vol. 94(7-8), pages 435-452, August.
    2. Moore, Don A. & Cain, Daylian M., 2007. "Overconfidence and underconfidence: When and why people underestimate (and overestimate) the competition," Organizational Behavior and Human Decision Processes, Elsevier, vol. 103(2), pages 197-213, July.
    3. Bandiera, Oriana & Larcinese, Valentino & Rasul, Imran, 2015. "Blissful ignorance? A natural experiment on the effect of feedback on students' performance," Labour Economics, Elsevier, vol. 34(C), pages 13-25.
    4. Alexandre Mas & Enrico Moretti, 2009. "Peers at Work," American Economic Review, American Economic Association, vol. 99(1), pages 112-145, March.
    5. Markus M. Möbius & Muriel Niederle & Paul Niehaus & Tanya S. Rosenblat, 2022. "Managing Self-Confidence: Theory and Experimental Evidence," Management Science, INFORMS, vol. 68(11), pages 7793-7817, November.
    6. Omar Al-Ubaydli & John A. List, 2015. "Do Natural Field Experiments Afford Researchers More or Less Control than Laboratory Experiments? A Simple Model," NBER Working Papers 20877, National Bureau of Economic Research, Inc.
    7. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    8. Andrew Schotter & Isabel Trevino, 2014. "Belief Elicitation in the Laboratory," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 103-128, August.
    9. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    10. Antoni Calvó-Armengol & Eleonora Patacchini & Yves Zenou, 2009. "Peer Effects and Social Networks in Education," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1239-1267.
    11. Andrew Caplin & John Leahy, 2001. "Psychological Expected Utility Theory and Anticipatory Feelings," The Quarterly Journal of Economics, Oxford University Press, vol. 116(1), pages 55-79.
    12. Eriksson, Tor & Poulsen, Anders & Villeval, Marie Claire, 2009. "Feedback and incentives: Experimental evidence," Labour Economics, Elsevier, vol. 16(6), pages 679-688, December.
    13. Tran, Anh & Zeckhauser, Richard, 2012. "Rank as an inherent incentive: Evidence from a field experiment," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 645-650.
    14. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    15. Facundo Albornoz & Antonio Cabrales & Esther Hauk, 2019. "Occupational Choice with Endogenous Spillovers," The Economic Journal, Royal Economic Society, vol. 129(621), pages 1953-1970.
    16. Diamond, Douglas W, 1985. "Optimal Release of Information by Firms," Journal of Finance, American Finance Association, vol. 40(4), pages 1071-1094, September.
    17. Jordi Blanes i Vidal & Mareike Nossol, 2011. "Tournaments Without Prizes: Evidence from Personnel Records," Management Science, INFORMS, vol. 57(10), pages 1721-1736, October.
    18. Zahra Murad & Martin Sefton & Chris Starmer, 2016. "How do risk attitudes affect measured confidence?," Journal of Risk and Uncertainty, Springer, vol. 52(1), pages 21-46, February.
    19. David Eil & Justin M. Rao, 2011. "The Good News-Bad News Effect: Asymmetric Processing of Objective Information about Yourself," American Economic Journal: Microeconomics, American Economic Association, vol. 3(2), pages 114-138, May.
    20. Ertac, Seda, 2011. "Does self-relevance affect information processing? Experimental evidence on the response to performance and non-performance feedback," Journal of Economic Behavior & Organization, Elsevier, vol. 80(3), pages 532-545.
    21. Leonie Gerhards & Neele Siemer, 2014. "Private versus Public Feedback - The Incentive Effects of Symbolic Awards," Economics Working Papers 2014-01, Department of Economics and Business Economics, Aarhus University.
    22. Omar Al-Ubaydli & John A. List, 2015. "Do Natural Field Experiments Afford Researchers More or Less Control Than Laboratory Experiments?," American Economic Review, American Economic Association, vol. 105(5), pages 462-466, May.
    23. Roland Benabou, 1993. "Workings of a City: Location, Education, and Production," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 619-652.
    24. Zacharias Maniadis & Fabio Tufano & John A. List, 2014. "One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects," American Economic Review, American Economic Association, vol. 104(1), pages 277-290, January.
    25. Ghazala Azmat & Nagore Iriberri, 2016. "The Provision of Relative Performance Feedback: An Analysis of Performance and Satisfaction," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 25(1), pages 77-110, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Albarran, Pedro & Battaglia, Marianna & Sartarelli, Marcello, 2022. "The psychological effect of a math signal," Economics of Education Review, Elsevier, vol. 86(C).
    2. Jeffrey T. Denning & Richard Murphy & Felix Weinhardt, 2023. "Class Rank and Long-Run Outcomes," The Review of Economics and Statistics, MIT Press, vol. 105(6), pages 1426-1441, November.
    3. Bobba, Matteo & Frisancho, Veronica, 2022. "Self-perceptions about academic achievement: Evidence from Mexico City," Journal of Econometrics, Elsevier, vol. 231(1), pages 58-73.
    4. Banerjee, Ritwik & Gupta, Nabanita Datta & Villeval, Marie Claire, 2020. "Feedback spillovers across tasks, self-confidence and competitiveness," Games and Economic Behavior, Elsevier, vol. 123(C), pages 127-170.
    5. Delaney, Judith M. & Devereux, Paul J., 2021. "High School Rank in Math and English and the Gender Gap in STEM," Labour Economics, Elsevier, vol. 69(C).
    6. Dohmen, Thomas & Shvartsman, Elena, 2023. "Overexertion of Effort under Working Time Autonomy and Feedback Provision," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 1255-1266.
    7. Karol Mazur, 2021. "A note on pessimism in education and its economic consequences," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(4), pages 773-783, December.
    8. Dobrescu, Isabella & Faravelli, Marco & Megalokonomou, Rigissa & Motta, Alberto, 2019. "Rank Incentives and Social Learning: Evidence from a Randomized Controlled Trial," IZA Discussion Papers 12437, Institute of Labor Economics (IZA).
    9. Albert, Philipp & Kübler, Dorothea & Silva-Goncalves, Juliana, 2022. "Peer effects of ambition," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 161-195.
    10. Vanessa Mertins & Christian Walter, 2021. "In absence of money: a field experiment on volunteer work motivation," Experimental Economics, Springer;Economic Science Association, vol. 24(3), pages 952-984, September.
    11. Emanuela Macrí & Giuseppe Migali, 2022. "The effect of test anxiety on high stakes exams," Working Papers 365237216, Lancaster University Management School, Economics Department.
    12. López-Pintado, Dunia & Meléndez-Jiménez, Miguel A., 2021. "Far above others," Journal of Economic Theory, Elsevier, vol. 198(C).
      • Dunia López-Pintado & Miguel A. Meléndez-Jiménez, 2018. "Far above others," Working Papers 18.12, Universidad Pablo de Olavide, Department of Economics.
    13. Gwen-Jiro Clochard & Guillaume Hollard & Julia Wirtz, 2022. "More effort or better technologies? On the effect of relative performance feedback," Bristol Economics Discussion Papers 22/767, School of Economics, University of Bristol, UK.
    14. Megalokonomou, Rigissa & Zhang, Yi, 2022. "How Good Am I? Effects and Mechanisms behind Salient Ranks," IZA Discussion Papers 15604, Institute of Labor Economics (IZA).
    15. Marisa Hidalgo-Hidalgo & Dunia López-Pintado, 2023. "The uneven effects of peers on collaborative and individual tasks," Working Papers 23.07, Universidad Pablo de Olavide, Department of Economics.
    16. Lackner, Mario & Weichselbaumer, Michael, 2023. "Can barely winning lead to losing? Gender and past performance," Journal of Economic Behavior & Organization, Elsevier, vol. 208(C), pages 258-274.
    17. Delavallade, Clara, 2021. "Motivating teams: Private feedback and public recognition at work," Journal of Public Economics, Elsevier, vol. 197(C).
    18. Hoffmann, Christin & Thommes, Kirsten, 2020. "Can digital feedback increase employee performance and energy efficiency in firms? Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 49-65.
    19. Koriyama, Yukio & Ozkes, Ali I., 2021. "Inclusive cognitive hierarchy," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 458-480.
    20. Alexandra de Gendre & Nicolás Salamanca, 2020. "On the Mechanisms of Ability Peer Effects," Melbourne Institute Working Paper Series wp2020n19, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    21. Goulas, Sofoklis & Megalokonomou, Rigissa, 2021. "Knowing who you actually are: The effect of feedback on short- and longer-term outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 589-615.
    22. Yu, Han, 2020. "Am I the big fish? The effect of ordinal rank on student academic performance in middle school," Journal of Economic Behavior & Organization, Elsevier, vol. 176(C), pages 18-41.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2018. "What you don't know...Can't hurt you?: A natural field experiment on relative performance feedback in higher education," Sciences Po publications info:hdl:2441/5fhe3c1k6b8, Sciences Po.
    2. repec:hal:spmain:info:hdl:2441/5r0qo9lp3v97hptv0tki570p06 is not listed on IDEAS
    3. repec:hal:spmain:info:hdl:2441/5fhe3c1k6b8mu8jtd19s688u7s is not listed on IDEAS
    4. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2018. "What you don’t know... Can’t hurt you? A natural field experiment on relative performance feedback in higher education," Sciences Po publications info:hdl:2441/5r0qo9lp3v9, Sciences Po.
    5. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2018. "What you don’t know... Can’t hurt you? A natural field experiment on relative performance feedback in higher education," Sciences Po publications info:hdl:2441/5r0qo9lp3v9, Sciences Po.
    6. Azmat, Ghazala & Iriberri, Nagore & Bagues, Manuel, 2016. "What you don't know... Can't hurt you? A field experiment on relative performance feedback in higher education," CEPR Discussion Papers 11201, C.E.P.R. Discussion Papers.
    7. Delavallade, Clara, 2021. "Motivating teams: Private feedback and public recognition at work," Journal of Public Economics, Elsevier, vol. 197(C).
    8. Azmat, Ghazala & Bagues, Manuel & Cabrales, Antonio & Iriberri, Nagore, 2016. "What You Don't Know... Can't Hurt You? A Field Experiment on Relative Performance Feedback in Higher Education," IZA Discussion Papers 9853, Institute of Labor Economics (IZA).
    9. Delavallade,Clara Anne, 2021. "Motivating Teams : Private Feedback and Public Recognition at Work," Policy Research Working Paper Series 9621, The World Bank.
    10. Gwen-Jiro Clochard & Guillaume Hollard & Julia Wirtz, 2022. "More effort or better technologies? On the effect of relative performance feedback," Bristol Economics Discussion Papers 22/767, School of Economics, University of Bristol, UK.
    11. Fischer, Mira & Wagner, Valentin, 2019. "Effects of Timing and Reference Frame of Feedback," Rationality and Competition Discussion Paper Series 150, CRC TRR 190 Rationality and Competition.
    12. Fischer, Mira & Wagner, Valentin, 2018. "Effects of timing and reference frame of feedback: Evidence from a field experiment," Discussion Papers, Research Unit: Market Behavior SP II 2018-206, WZB Berlin Social Science Center.
    13. Ertac, Seda & Koçkesen, Levent & Ozdemir, Duygu, 2016. "The role of verifiability and privacy in the strategic provision of performance feedback: Theory and experimental evidence," Games and Economic Behavior, Elsevier, vol. 100(C), pages 24-45.
    14. Ertac, Seda & Gümren, Mert & Koçkesen, Levent, 2019. "Strategic feedback in teams: Theory and experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 162(C), pages 1-23.
    15. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2016. "What You Don’t Know... Can’t Hurt You? A Field Experiment on Relative Performance," Working Papers 788, Queen Mary University of London, School of Economics and Finance.
    16. Dobrescu, Isabella & Faravelli, Marco & Megalokonomou, Rigissa & Motta, Alberto, 2019. "Rank Incentives and Social Learning: Evidence from a Randomized Controlled Trial," IZA Discussion Papers 12437, Institute of Labor Economics (IZA).
    17. Vanessa, Mertins & Jeworrek, Sabrina & Vlassopoulos, Michael, 2018. ""The Good News about Bad News": Feedback about Past Organisational Failure Bad ist Impact in Worker Productivity," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181644, Verein für Socialpolitik / German Economic Association.
    18. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    19. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2018. "Normatively Framed Relative Performance Feedback – Field Experiment and Replication," MPRA Paper 88830, University Library of Munich, Germany.
    20. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    21. Jeworrek, Sabrina & Mertins, Vanessa & Vlassopoulos, Michael, 2018. ""The good news about bad news": Feedback about past organisational failure and its impact on worker productivity," IWH Discussion Papers 1/2018, Halle Institute for Economic Research (IWH).
    22. Beugnot, Julie & Fortin, Bernard & Lacroix, Guy & Villeval, Marie Claire, 2019. "Gender and peer effects on performance in social networks," European Economic Review, Elsevier, vol. 113(C), pages 207-224.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:65:y:2019:i:8:p:3714-3736. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.