IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0314806.html
   My bibliography  Save this article

Experimental economics for machine learning—a methodological contribution on lie detection

Author

Listed:
  • Dmitri Bershadskyy
  • Laslo Dinges
  • Marc-André Fiedler
  • Ayoub Al-Hamadi
  • Nina Ostermaier
  • Joachim Weimann

Abstract

In this paper, we investigate how technology has contributed to experimental economics in the past and illustrate how experimental economics can contribute to technological progress in the future. We argue that with machine learning (ML), a new technology is at hand, where for the first time experimental economics can contribute to enabling substantial improvement of technology. At the same time, ML opens up new questions for experimental research because it can generate previously impossible observations. To demonstrate this, we focus on algorithms trained to detect lies. Such algorithms are of high relevance for research in economics as they deal with the ability to retrieve otherwise private information. We deduce that most of the commonly applied data sets for the training of lie detection algorithms could be improved by applying the toolbox of experimental economics. To illustrate this, we replicate the “lies in disguise-experiment” by Fischbacher and Föllmi-Heusi with a modification regarding monitoring. The modified setup guarantees a certain level of privacy from the experimenter yet allows to record the subjects as they lie to the camera. Despite monitoring, our results indicate the same lying behavior as in the original experiment. Yet, our experiment allows an individual-level analysis of experimental data and the generation of a lie detection algorithm with an accuracy rate of 67%, which we present in this article.

Suggested Citation

  • Dmitri Bershadskyy & Laslo Dinges & Marc-André Fiedler & Ayoub Al-Hamadi & Nina Ostermaier & Joachim Weimann, 2024. "Experimental economics for machine learning—a methodological contribution on lie detection," PLOS ONE, Public Library of Science, vol. 19(12), pages 1-19, December.
  • Handle: RePEc:plo:pone00:0314806
    DOI: 10.1371/journal.pone.0314806
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0314806
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0314806&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0314806?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Drew Fudenberg & Annie Liang, 2019. "Predicting and Understanding Initial Play," American Economic Review, American Economic Association, vol. 109(12), pages 4112-4141, December.
    2. Alex Sebastião Constâncio & Denise Fukumi Tsunoda & Helena de Fátima Nunes Silva & Jocelaine Martins da Silveira & Deborah Ribeiro Carvalho, 2023. "Deception detection with machine learning: A systematic review and statistical analysis," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-31, February.
    3. Gary Charness & Brian Jabarian & John A. List, 2023. "Generation Next: Experimentation with AI," NBER Working Papers 31679, National Bureau of Economic Research, Inc.
    4. Joseph Tao-yi Wang & Michael Spezio & Colin F. Camerer, 2010. "Pinocchio's Pupil: Using Eyetracking and Pupil Dilation to Understand Truth Telling and Deception in Sender-Receiver Games," American Economic Review, American Economic Association, vol. 100(3), pages 984-1007, June.
    5. Urs Fischbacher & Franziska Föllmi-Heusi, 2013. "Lies In Disguise—An Experimental Study On Cheating," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 525-547, June.
    6. Conrads, Julian & Lotz, Sebastian, 2015. "The effect of communication channels on dishonest behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 58(C), pages 88-93.
    7. Brooks, Harvey, 1994. "The relationship between science and technology," Research Policy, Elsevier, vol. 23(5), pages 477-486, September.
    8. Stefan P. Penczynski, 2019. "Using machine learning for communication classification," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 1002-1029, December.
    9. Gary Charness & Anya Samek & Jeroen Ven, 2022. "What is considered deception in experimental economics?," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 385-412, April.
    10. Lilleholt, Lau & Schild, Christoph & Zettler, Ingo, 2020. "Not all computerized cheating tasks are equal: A comparison of computerized and non-computerized versions of a cheating task," Journal of Economic Psychology, Elsevier, vol. 78(C).
    11. Peysakhovich, Alexander & Naecker, Jeffrey, 2017. "Using methods from machine learning to evaluate behavioral models of choice under risk and ambiguity," Journal of Economic Behavior & Organization, Elsevier, vol. 133(C), pages 373-384.
    12. Nikola Frollová & Marek Vranka & Petr Houdek, 2021. "A qualitative study of perception of a dishonesty experiment," Journal of Economic Methodology, Taylor & Francis Journals, vol. 28(3), pages 274-290, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heinicke, Franziska & Rosenkranz, Stephanie & Weitzel, Utz, 2019. "The effect of pledges on the distribution of lying behavior: An online experiment," Journal of Economic Psychology, Elsevier, vol. 73(C), pages 136-151.
    2. Ximena Garcia-Rada & Heather E. Mann & Lars Hornuf & Matthias Sohn & Juan Tafurt & Edwin S. Iversen Jr & Dan Ariely, 2018. "The Adaptive Liar: An Interactionist Approach of Multiple Dishonesty Domains," CESifo Working Paper Series 7215, CESifo.
    3. Hamid Aghadadashli & Georg Kirchsteiger & Patrick Legros, 2021. "Cheap Talk is not Cheap: Free versus Costly Communication," Working Papers ECARES 2021-07, ULB -- Universite Libre de Bruxelles.
    4. repec:cgr:cgsser:06-02 is not listed on IDEAS
    5. repec:cgr:cgsser:03-11 is not listed on IDEAS
    6. Garbarino, Ellen & Slonim, Robert & Villeval, Marie Claire, 2019. "Loss aversion and lying behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 379-393.
    7. Jeroen Ven & Marie Claire Villeval, 2015. "Dishonesty under scrutiny," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 86-99, July.
    8. Nir Chemaya & Daniel Martin, 2023. "Perceptions and Detection of AI Use in Manuscript Preparation for Academic Journals," Papers 2311.14720, arXiv.org, revised Jan 2024.
    9. Gill, David & Prowse, Victoria & Vlassopoulos, Michael, 2013. "Cheating in the workplace: An experimental study of the impact of bonuses and productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 96(C), pages 120-134.
    10. Houser, Daniel & Vetter, Stefan & Winter, Joachim, 2012. "Fairness and cheating," European Economic Review, Elsevier, vol. 56(8), pages 1645-1655.
    11. Andrea Albertazzi, 2022. "Individual cheating in the lab: a new measure and external validity," Theory and Decision, Springer, vol. 93(1), pages 37-67, July.
    12. Huber, Christoph & Litsios, Christos & Nieper, Annika & Promann, Timo, 2023. "On social norms and observability in (dis)honest behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 1086-1099.
    13. Catrine Jacobsen & Toke Reinholt Fosgaard & David Pascual†Ezama, 2018. "Why Do We Lie? A Practical Guide To The Dishonesty Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 357-387, April.
    14. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    15. Marie Claire Villeval, 2019. "Comportements (non) éthiques et stratégies morales," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 1021-1046.
    16. Klimm, Felix, 2019. "Suspicious success – Cheating, inequality acceptance, and political preferences," European Economic Review, Elsevier, vol. 117(C), pages 36-55.
    17. Peeters, Ronald & Vorsatz, Marc & Walzl, Markus, 2015. "Beliefs and truth-telling: A laboratory experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 113(C), pages 1-12.
    18. David J. Cooper & Ian Krajbich & Charles N. Noussair, 2019. "Choice-Process Data in Experimental Economics," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 1-13, August.
    19. Bahník, Štěpán & Houdek, Petr & Hudík, Marek & Say, Nicolas, 2025. "The limited role of prosocial behavior in preventing others from being dishonest," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 117(C).
    20. repec:osf:osfxxx:2nxv8_v1 is not listed on IDEAS
    21. repec:cup:judgdm:v:9:y:2014:i:3:p:199-206 is not listed on IDEAS
    22. Björn Frank, 2014. "Laboratory Evidence on Face-to-Face," International Regional Science Review, , vol. 37(4), pages 411-435, October.
    23. Kurschilgen, Michael & Marcin, Isabel, 2019. "Communication is more than information sharing: The role of status-relevant knowledge," Games and Economic Behavior, Elsevier, vol. 113(C), pages 651-672.
    24. Dufwenberg, Martin & Dufwenberg, Martin A., 2018. "Lies in disguise – A theoretical analysis of cheating," Journal of Economic Theory, Elsevier, vol. 175(C), pages 248-264.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0314806. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.