IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0262249.html
   My bibliography  Save this article

Breaking the bonds of reinforcement: Effects of trial outcome, rule consistency and rule complexity against exploitable and unexploitable opponents

Author

Listed:
  • Jukka Sundvall
  • Benjamin James Dyson

Abstract

In two experiments, we used the simple zero-sum game Rock, Paper and Scissors to study the common reinforcement-based rules of repeating choices after winning (win-stay) and shifting from previous choice options after losing (lose-shift). Participants played the game against both computer opponents who could not be exploited and computer opponents who could be exploited by making choices that would at times conflict with reinforcement. Against unexploitable opponents, participants achieved an approximation of random behavior, contrary to previous research commonly finding reinforcement biases. Against exploitable opponents, the participants learned to exploit the opponent regardless of whether optimal choices conflicted with reinforcement or not. The data suggest that learning a rule that allows one to exploit was largely determined by the outcome of the previous trial.

Suggested Citation

  • Jukka Sundvall & Benjamin James Dyson, 2022. "Breaking the bonds of reinforcement: Effects of trial outcome, rule consistency and rule complexity against exploitable and unexploitable opponents," PLOS ONE, Public Library of Science, vol. 17(2), pages 1-19, February.
  • Handle: RePEc:plo:pone00:0262249
    DOI: 10.1371/journal.pone.0262249
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0262249
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0262249&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0262249?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    2. Benjamin J. Dyson, 2019. "Behavioural Isomorphism, Cognitive Economy and Recursive Thought in Non-Transitive Game Strategy," Games, MDPI, vol. 10(3), pages 1-14, August.
    3. Xu, Bin & Zhou, Hai-Jun & Wang, Zhijian, 2013. "Cycle frequency in standard Rock–Paper–Scissors games: Evidence from experimental economics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(20), pages 4997-5005.
    4. Vincent Srihaput & Kaylee Craplewe & Benjamin James Dyson, 2020. "Switching Competitors Reduces Win-Stay but Not Lose-Shift Behaviour: The Role of Outcome-Action Association Strength on Reinforcement Learning," Games, MDPI, vol. 11(3), pages 1-10, July.
    5. Koller, Manuel, 2016. "robustlmm: An R Package for Robust Estimation of Linear Mixed-Effects Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 75(i06).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vincent Srihaput & Kaylee Craplewe & Benjamin James Dyson, 2020. "Switching Competitors Reduces Win-Stay but Not Lose-Shift Behaviour: The Role of Outcome-Action Association Strength on Reinforcement Learning," Games, MDPI, vol. 11(3), pages 1-10, July.
    2. Erik Brockbank & Edward Vul, 2021. "Formalizing Opponent Modeling with the Rock, Paper, Scissors Game," Games, MDPI, vol. 12(3), pages 1-20, September.
    3. Seow Eng Ong & Davin Wang & Calvin Chua, 2023. "Disruptive Innovation and Real Estate Agency: The Disruptee Strikes Back," The Journal of Real Estate Finance and Economics, Springer, vol. 67(2), pages 287-317, August.
    4. Christiane Goodfellow & Dirk Schiereck & Steffen Wippler, 2013. "Are behavioural finance equity funds a superior investment? A note on fund performance and market efficiency," Journal of Asset Management, Palgrave Macmillan, vol. 14(2), pages 111-119, April.
    5. Philippe Fevrier & Sebastien Gay, 2005. "Informed Consent Versus Presumed Consent The Role of the Family in Organ Donations," HEW 0509007, University Library of Munich, Germany.
    6. Shuang Yao & Donghua Yu & Yan Song & Hao Yao & Yuzhen Hu & Benhai Guo, 2018. "Dry Bulk Carrier Investment Selection through a Dual Group Decision Fusing Mechanism in the Green Supply Chain," Sustainability, MDPI, vol. 10(12), pages 1-19, November.
    7. Senik, Claudia, 2009. "Direct evidence on income comparisons and their welfare effects," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 408-424, October.
    8. Jose Apesteguia & Miguel Ballester, 2009. "A theory of reference-dependent behavior," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 40(3), pages 427-455, September.
    9. Shoji, Isao & Kanehiro, Sumei, 2016. "Disposition effect as a behavioral trading activity elicited by investors' different risk preferences," International Review of Financial Analysis, Elsevier, vol. 46(C), pages 104-112.
    10. Christoph Engel & Michael Kurschilgen, 2011. "Fairness Ex Ante and Ex Post: Experimentally Testing Ex Post Judicial Intervention into Blockbuster Deals," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 8(4), pages 682-708, December.
    11. Christina Leuker & Thorsten Pachur & Ralph Hertwig & Timothy J. Pleskac, 2019. "Do people exploit risk–reward structures to simplify information processing in risky choice?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 76-94, August.
    12. Boone, Jan & Sadrieh, Abdolkarim & van Ours, Jan C., 2009. "Experiments on unemployment benefit sanctions and job search behavior," European Economic Review, Elsevier, vol. 53(8), pages 937-951, November.
    13. Singal, Vijay & Xu, Zhaojin, 2011. "Selling winners, holding losers: Effect on fund flows and survival of disposition-prone mutual funds," Journal of Banking & Finance, Elsevier, vol. 35(10), pages 2704-2718, October.
    14. Jos'e Cl'audio do Nascimento, 2019. "Behavioral Biases and Nonadditive Dynamics in Risk Taking: An Experimental Investigation," Papers 1908.01709, arXiv.org, revised Apr 2023.
    15. Alex Cukierman & Anton Muscatelli, 2001. "Do Central Banks have Precautionary Demands for Expansions and for Price Stability?," Working Papers 2002_4, Business School - Economics, University of Glasgow, revised Mar 2002.
    16. Dash, Saumya Ranjan & Maitra, Debasish, 2018. "Does sentiment matter for stock returns? Evidence from Indian stock market using wavelet approach," Finance Research Letters, Elsevier, vol. 26(C), pages 32-39.
    17. José F. Tudón M., 2019. "Perception, utility, and evolution," Economic Theory Bulletin, Springer;Society for the Advancement of Economic Theory (SAET), vol. 7(2), pages 191-208, December.
    18. Francesco GUALA, 2017. "Preferences: Neither Behavioural nor Mental," Departmental Working Papers 2017-05, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    19. Lepone, Grace & Tian, Gary, 2020. "Usage of conditional orders and the disposition effect in the stock market," Pacific-Basin Finance Journal, Elsevier, vol. 61(C).
    20. Shunda, Nicholas, 2009. "Auctions with a buy price: The case of reference-dependent preferences," Games and Economic Behavior, Elsevier, vol. 67(2), pages 645-664, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0262249. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.