IDEAS home Printed from https://ideas.repec.org/p/bge/wpaper/1210.html
   My bibliography  Save this paper

Academic Integrity in On-line Exams: Evidence from a Randomized Field Experiment

Author

Listed:
  • Flip Klijn
  • Mehdi Mdaghri Alaoui
  • Marc Vorsatz

Abstract

We study academic integrity in a final exam of a compulsory course with almost 500 undergraduate students (mostly in Economics and Business Management and Administration) at a major Spanish university. Confinement and university closure due to Covid-19 took place by the end of the last lecture week. As a consequence, the usual classroom exam was turned into an unproctored on-line multiple-choice exam without backtracking. We exploit the different orders of exam problems and detailed data with timestamps to study students’ academic integrity. Taking the average over questions that were part of both earlier and later “rounds,” we find that the number of correct answers to questions in the later round was 7.7% higher than those to the same questions in the earlier round. Moreover, the average completion time of questions in the later round was 18.1% shorter than that of the same questions in the earlier round. We estimate that between 13.4% and 22.5% of the students cheated due to information flows from earlier to later rounds. Nonetheless, since exam grades are positively correlated with previous continuous assessment, they can be considered informative. Finally, a mere reminder of the university’s code of ethics, which was sent to a subgroup halfway through the exam, did not affect cheating levels.

Suggested Citation

  • Flip Klijn & Mehdi Mdaghri Alaoui & Marc Vorsatz, 2020. "Academic Integrity in On-line Exams: Evidence from a Randomized Field Experiment," Working Papers 1210, Barcelona School of Economics.
  • Handle: RePEc:bge:wpaper:1210
    as

    Download full text from publisher

    File URL: https://bse.eu/sites/default/files/working_paper_pdfs/1210_0.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bilen, Eren & Matros, Alexander, 2021. "Online cheating amid COVID-19," Journal of Economic Behavior & Organization, Elsevier, vol. 182(C), pages 196-211.
    2. Urs Fischbacher & Franziska Föllmi-Heusi, 2013. "Lies In Disguise—An Experimental Study On Cheating," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 525-547, June.
    3. Clot, Sophie & Grolleau, Gilles & Ibanez, Lisette, 2022. "A reference point bias in judging cheaters," Journal of Economic Psychology, Elsevier, vol. 89(C).
    4. Sanchez-Pages, Santiago & Vorsatz, Marc, 2007. "An experimental study of truth-telling in a sender-receiver game," Games and Economic Behavior, Elsevier, vol. 61(1), pages 86-112, October.
    5. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    6. Uri Gneezy, 2005. "Deception: The Role of Consequences," American Economic Review, American Economic Association, vol. 95(1), pages 384-394, March.
    7. Alan, Sule & Ertac, Seda & Gumren, Mert, 2020. "Cheating and incentives in a performance context: Evidence from a field experiment on children," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 681-701.
    8. Navin Kartik, 2009. "Strategic Communication with Lying Costs," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1359-1395.
    9. Pfattheicher, Stefan & Schindler, Simon & Nockur, Laila, 2019. "On the impact of Honesty-Humility and a cue of being watched on cheating behavior," Journal of Economic Psychology, Elsevier, vol. 71(C), pages 159-174.
    10. César Martinelli & Susan W. Parker & Ana Cristina Pérez-Gea & Rodimiro Rodrigo, 2018. "Cheating and Incentives: Learning from a Policy Experiment," American Economic Journal: Economic Policy, American Economic Association, vol. 10(1), pages 298-325, February.
    11. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    12. R. Darrell Bock, 1972. "Estimating item parameters and latent ability when responses are scored in two or more nominal categories," Psychometrika, Springer;The Psychometric Society, vol. 37(1), pages 29-51, March.
    13. Crawford, Vincent P & Sobel, Joel, 1982. "Strategic Information Transmission," Econometrica, Econometric Society, vol. 50(6), pages 1431-1451, November.
    14. Vazquez, Jose J. & Chiang, Eric P. & Sarmiento-Barbieri, Ignacio, 2021. "Can we stay one step ahead of cheaters? A field experiment in proctoring online open book exams," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    15. Siniver, Erez & Yaniv, Gideon, 2019. "Optimism, pessimism, mood swings and dishonest behavior," Journal of Economic Psychology, Elsevier, vol. 72(C), pages 54-63.
    16. Steinel, Wolfgang & Valtcheva, Kalina & Gross, Jörg & Celse, Jérémy & Max, Sylvain & Shalvi, Shaul, 2022. "(Dis)honesty in the face of uncertain gains or losses," Journal of Economic Psychology, Elsevier, vol. 90(C).
    17. Fochmann, Martin & Müller, Nadja & Overesch, Michael, 2021. "Less cheating? The effects of prefilled forms on compliance behavior," Journal of Economic Psychology, Elsevier, vol. 83(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marie Claire Villeval, 2019. "Comportements (non) éthiques et stratégies morales," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 1021-1046.
    2. Peeters, Ronald & Vorsatz, Marc & Walzl, Markus, 2015. "Beliefs and truth-telling: A laboratory experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 113(C), pages 1-12.
    3. Corgnet, Brice & Martin, Ludivine & Ndodjang, Peguy & Sutan, Angela, 2019. "On the merit of equal pay: Performance manipulation and incentive setting," European Economic Review, Elsevier, vol. 113(C), pages 23-45.
    4. Despoina Alempaki & Valeria Burdea & Daniel Read, 2023. "Deceptive Communication: Direct Lies vs. Ignorance, Partial-Truth and Silence," Rationality and Competition Discussion Paper Series 444, CRC TRR 190 Rationality and Competition.
    5. Kurschilgen, Michael & Marcin, Isabel, 2019. "Communication is more than information sharing: The role of status-relevant knowledge," Games and Economic Behavior, Elsevier, vol. 113(C), pages 651-672.
    6. Lafky, Jonathan & Lai, Ernest K. & Lim, Wooyoung, 2022. "Preferences vs. strategic thinking: An investigation of the causes of overcommunication," Games and Economic Behavior, Elsevier, vol. 136(C), pages 92-116.
    7. Mark T. Le Quement & Amrish Patel, 2018. "Communication as Gift-Exchange," University of East Anglia School of Economics Working Paper Series 2018-06, School of Economics, University of East Anglia, Norwich, UK..
    8. Johannes Abeler & Armin Falk & Fabian Kosse, 2021. "Malleability of Preferences for Honesty," CESifo Working Paper Series 9033, CESifo.
    9. Dwenger, Nadja & Lohse, Tim, 2019. "Do individuals successfully cover up their lies? Evidence from a compliance experiment," Journal of Economic Psychology, Elsevier, vol. 71(C), pages 74-87.
    10. Serra Garcia, M. & van Damme, E.E.C. & Potters, J.J.M., 2010. "Which Words Bond? An Experiment on Signaling in a Public Good Game (replaced by TILEC DP 2011-055)," Other publications TiSEM 5ed24dc3-e6cf-4fa4-bace-2, Tilburg University, School of Economics and Management.
    11. Özalp Özer & Upender Subramanian & Yu Wang, 2018. "Information Sharing, Advice Provision, or Delegation: What Leads to Higher Trust and Trustworthiness?," Management Science, INFORMS, vol. 64(1), pages 474-493, January.
    12. Khalmetski, Kiryl, 2019. "Evasion of guilt in expert advice," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 296-310.
    13. Gottardi, Piero & Meléndez-Jiménez, Miguel A. & Feri, Francesco, 2016. "Can there be a market for cheap-talk information? Some experimental evidence," CEPR Discussion Papers 11206, C.E.P.R. Discussion Papers.
    14. Cabrales, Antonio & Feri, Francesco & Gottardi, Piero & Meléndez-Jiménez, Miguel A., 2020. "Can there be a market for cheap-talk information? An experimental investigation," Games and Economic Behavior, Elsevier, vol. 121(C), pages 368-381.
    15. Serra Garcia, M. & van Damme, E.E.C. & Potters, J.J.M., 2011. "Lying About What you Know or About What you Do? (replaces CentER DP 2010-033)," Discussion Paper 2011-139, Tilburg University, Center for Economic Research.
    16. Rosaz, Julie & Villeval, Marie Claire, 2012. "Lies and biased evaluation: A real-effort experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 537-549.
    17. Khalmetski, Kiryl & Rockenbach, Bettina & Werner, Peter, 2017. "Evasive lying in strategic communication," Journal of Public Economics, Elsevier, vol. 156(C), pages 59-72.
    18. López-Pérez, Raúl, 2009. "The Power of Words: Why Communication fosters Cooperation and Efficiency," Working Papers in Economic Theory 2009/01, Universidad Autónoma de Madrid (Spain), Department of Economic Analysis (Economic Theory and Economic History).
    19. Nicolas Jacquemet & Stéphane Luchini & Julie Rosaz & Jason F. Shogren, 2019. "Truth Telling Under Oath," Management Science, INFORMS, vol. 65(1), pages 426-438, January.
    20. Blume, Andreas & Lai, Ernest K. & Lim, Wooyoung, 2019. "Eliciting private information with noise: The case of randomized response," Games and Economic Behavior, Elsevier, vol. 113(C), pages 356-380.

    More about this item

    Keywords

    Field Experiment; academic integrity; code of ethics; on-line exam; COVID-19;
    All these keywords.

    JEL classification:

    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D9 - Microeconomics - - Micro-Based Behavioral Economics
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bge:wpaper:1210. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bruno Guallar (email available below). General contact details of provider: https://edirc.repec.org/data/bargses.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.