IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0314806.html
   My bibliography  Save this article

Experimental economics for machine learning—a methodological contribution on lie detection

Author

Listed:
  • Dmitri Bershadskyy
  • Laslo Dinges
  • Marc-André Fiedler
  • Ayoub Al-Hamadi
  • Nina Ostermaier
  • Joachim Weimann

Abstract

In this paper, we investigate how technology has contributed to experimental economics in the past and illustrate how experimental economics can contribute to technological progress in the future. We argue that with machine learning (ML), a new technology is at hand, where for the first time experimental economics can contribute to enabling substantial improvement of technology. At the same time, ML opens up new questions for experimental research because it can generate previously impossible observations. To demonstrate this, we focus on algorithms trained to detect lies. Such algorithms are of high relevance for research in economics as they deal with the ability to retrieve otherwise private information. We deduce that most of the commonly applied data sets for the training of lie detection algorithms could be improved by applying the toolbox of experimental economics. To illustrate this, we replicate the “lies in disguise-experiment” by Fischbacher and Föllmi-Heusi with a modification regarding monitoring. The modified setup guarantees a certain level of privacy from the experimenter yet allows to record the subjects as they lie to the camera. Despite monitoring, our results indicate the same lying behavior as in the original experiment. Yet, our experiment allows an individual-level analysis of experimental data and the generation of a lie detection algorithm with an accuracy rate of 67%, which we present in this article.

Suggested Citation

  • Dmitri Bershadskyy & Laslo Dinges & Marc-André Fiedler & Ayoub Al-Hamadi & Nina Ostermaier & Joachim Weimann, 2024. "Experimental economics for machine learning—a methodological contribution on lie detection," PLOS ONE, Public Library of Science, vol. 19(12), pages 1-19, December.
  • Handle: RePEc:plo:pone00:0314806
    DOI: 10.1371/journal.pone.0314806
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0314806
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0314806&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0314806?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Urs Fischbacher & Franziska Föllmi-Heusi, 2013. "Lies In Disguise—An Experimental Study On Cheating," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 525-547, June.
    2. Conrads, Julian & Lotz, Sebastian, 2015. "The effect of communication channels on dishonest behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 58(C), pages 88-93.
    3. Drew Fudenberg & Annie Liang, 2019. "Predicting and Understanding Initial Play," American Economic Review, American Economic Association, vol. 109(12), pages 4112-4141, December.
    4. Peysakhovich, Alexander & Naecker, Jeffrey, 2017. "Using methods from machine learning to evaluate behavioral models of choice under risk and ambiguity," Journal of Economic Behavior & Organization, Elsevier, vol. 133(C), pages 373-384.
    5. Brooks, Harvey, 1994. "The relationship between science and technology," Research Policy, Elsevier, vol. 23(5), pages 477-486, September.
    6. Alex Sebastião Constâncio & Denise Fukumi Tsunoda & Helena de Fátima Nunes Silva & Jocelaine Martins da Silveira & Deborah Ribeiro Carvalho, 2023. "Deception detection with machine learning: A systematic review and statistical analysis," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-31, February.
    7. Stefan P. Penczynski, 2019. "Using machine learning for communication classification," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 1002-1029, December.
    8. Nikola Frollová & Marek Vranka & Petr Houdek, 2021. "A qualitative study of perception of a dishonesty experiment," Journal of Economic Methodology, Taylor & Francis Journals, vol. 28(3), pages 274-290, July.
    9. Gary Charness & Brian Jabarian & John List, 2023. "Generation Next: Experimentation with AI," Artefactual Field Experiments 00777, The Field Experiments Website.
    10. Gary Charness & Anya Samek & Jeroen Ven, 2022. "What is considered deception in experimental economics?," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 385-412, April.
    11. Lilleholt, Lau & Schild, Christoph & Zettler, Ingo, 2020. "Not all computerized cheating tasks are equal: A comparison of computerized and non-computerized versions of a cheating task," Journal of Economic Psychology, Elsevier, vol. 78(C).
    12. Joseph Tao-yi Wang & Michael Spezio & Colin F. Camerer, 2010. "Pinocchio's Pupil: Using Eyetracking and Pupil Dilation to Understand Truth Telling and Deception in Sender-Receiver Games," American Economic Review, American Economic Association, vol. 100(3), pages 984-1007, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gill, David & Prowse, Victoria & Vlassopoulos, Michael, 2013. "Cheating in the workplace: An experimental study of the impact of bonuses and productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 96(C), pages 120-134.
    2. Heinicke, Franziska & Rosenkranz, Stephanie & Weitzel, Utz, 2019. "The effect of pledges on the distribution of lying behavior: An online experiment," Journal of Economic Psychology, Elsevier, vol. 73(C), pages 136-151.
    3. Shoshan, Vered & Hazan, Tamir & Plonsky, Ori, 2023. "BEAST-Net: Learning novel behavioral insights using a neural network adaptation of a behavioral model," OSF Preprints kaeny, Center for Open Science.
    4. Sorravich Kingsuwankul & Chloe Tergiman & Marie Claire Villeval, 2023. "Why do oaths work? Image concerns and credibility in promise keeping," Working Papers hal-04209489, HAL.
    5. Marie Claire Villeval, 2019. "Comportements (non) éthiques et stratégies morales," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 1021-1046.
    6. Dufwenberg, Martin & Dufwenberg, Martin A., 2018. "Lies in disguise – A theoretical analysis of cheating," Journal of Economic Theory, Elsevier, vol. 175(C), pages 248-264.
    7. repec:grz:wpsses:2017-01 is not listed on IDEAS
    8. Sandro Casal & Antonio Filippin, 2024. "The effect of observing multiple private information outcomes on the inclination to cheat," Economic Inquiry, Western Economic Association International, vol. 62(2), pages 543-562, April.
    9. Houser, Daniel & Vetter, Stefan & Winter, Joachim, 2012. "Fairness and cheating," European Economic Review, Elsevier, vol. 56(8), pages 1645-1655.
    10. Jeroen Ven & Marie Claire Villeval, 2015. "Dishonesty under scrutiny," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 86-99, July.
    11. Ximena Garcia-Rada & Heather E. Mann & Lars Hornuf & Matthias Sohn & Juan Tafurt & Edwin S. Iversen Jr & Dan Ariely, 2018. "The Adaptive Liar: An Interactionist Approach of Multiple Dishonesty Domains," CESifo Working Paper Series 7215, CESifo.
    12. Hamid Aghadadashli & Georg Kirchsteiger & Patrick Legros, 2021. "Cheap Talk is not Cheap: Free versus Costly Communication," Working Papers ECARES 2021-07, ULB -- Universite Libre de Bruxelles.
    13. repec:cgr:cgsser:06-02 is not listed on IDEAS
    14. repec:cgr:cgsser:03-11 is not listed on IDEAS
    15. Garbarino, Ellen & Slonim, Robert & Villeval, Marie Claire, 2019. "Loss aversion and lying behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 379-393.
    16. Blazquiz-Pulido, Juan Francisco & Polonio, Luca & Bilancini, Ennio, 2024. "Who's the deceiver? Identifying deceptive intentions in communication," Games and Economic Behavior, Elsevier, vol. 145(C), pages 451-466.
    17. Nir Chemaya & Daniel Martin, 2023. "Perceptions and Detection of AI Use in Manuscript Preparation for Academic Journals," Papers 2311.14720, arXiv.org, revised Jan 2024.
    18. Peeters, Ronald & Vorsatz, Marc & Walzl, Markus, 2015. "Beliefs and truth-telling: A laboratory experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 113(C), pages 1-12.
    19. Johannes Abeler & Daniele Nosenzo & Collin Raymond, 2019. "Preferences for Truth‐Telling," Econometrica, Econometric Society, vol. 87(4), pages 1115-1153, July.
    20. Andrea Albertazzi, 2022. "Individual cheating in the lab: a new measure and external validity," Theory and Decision, Springer, vol. 93(1), pages 37-67, July.
    21. Huber, Christoph & Litsios, Christos & Nieper, Annika & Promann, Timo, 2023. "On social norms and observability in (dis)honest behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 1086-1099.
    22. Catrine Jacobsen & Toke Reinholt Fosgaard & David Pascual†Ezama, 2018. "Why Do We Lie? A Practical Guide To The Dishonesty Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 357-387, April.
    23. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0314806. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.