IDEAS home Printed from https://ideas.repec.org/a/eee/gamebe/v140y2023icp50-72.html
   My bibliography  Save this article

Learning in rent-seeking contests with payoff risk and foregone payoff information

Author

Listed:
  • Masiliūnas, Aidas

Abstract

We test whether deviations from Nash equilibrium in rent-seeking contests can be explained by the slow convergence of payoff-based learning. We identify and eliminate two noise sources that slow down learning: first, opponents are changing their actions across rounds; second, payoffs are probabilistic, which reduces the correlation between expected and realized payoffs. We find that average choices are not significantly different from the risk-neutral Nash equilibrium predictions only when both noise sources are eliminated by supplying foregone payoff information and removing payoff risk. Payoff-based learning can explain these results better than alternative theories. We propose a hybrid learning model that combines reinforcement and belief learning with risk, social and other preferences, and show that it fits data well, mostly because of reinforcement learning.

Suggested Citation

  • Masiliūnas, Aidas, 2023. "Learning in rent-seeking contests with payoff risk and foregone payoff information," Games and Economic Behavior, Elsevier, vol. 140(C), pages 50-72.
  • Handle: RePEc:eee:gamebe:v:140:y:2023:i:c:p:50-72
    DOI: 10.1016/j.geb.2023.02.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0899825623000295
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.geb.2023.02.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Theo Offerman & Jan Potters & Joep Sonnemans, 2002. "Imitation and Belief Learning in an Oligopoly Experiment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 69(4), pages 973-997.
    2. Ockenfels, Axel & Selten, Reinhard, 2005. "Impulse balance equilibrium and feedback in first price auctions," Games and Economic Behavior, Elsevier, vol. 51(1), pages 155-170, April.
    3. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    4. Fallucchi, Francesco & Renner, Elke & Sefton, Martin, 2013. "Information feedback and contest structure in rent-seeking games," European Economic Review, Elsevier, vol. 64(C), pages 223-240.
    5. Timothy N. Cason & Daniel Friedman & ED Hopkins, 2014. "Cycles and Instability in a Rock--Paper--Scissors Population Game: A Continuous Time Experiment," Review of Economic Studies, Oxford University Press, vol. 81(1), pages 112-136.
    6. Shupp, Robert & Sheremeta, Roman M. & Schmidt, David & Walker, James, 2013. "Resource allocation contests: Experimental evidence," Journal of Economic Psychology, Elsevier, vol. 39(C), pages 257-267.
    7. Eyal Baharad & Shmuel Nitzan, 2008. "Contest Efforts in Light of Behavioural Considerations," Economic Journal, Royal Economic Society, vol. 118(533), pages 2047-2059, November.
    8. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    9. Kevin Chung & Keehyung Kim & Noah Lim, 2020. "Social Structures and Reputation in Expert Review Systems," Management Science, INFORMS, vol. 66(7), pages 3249-3276, July.
    10. Richard Engelbrecht-Wiggans & Elena Katok, 2009. "A Direct Test of Risk Aversion and Regret in First Price Sealed-Bid Auctions," Decision Analysis, INFORMS, vol. 6(2), pages 75-86, June.
    11. Paan Jindapon & Christopher Whaley, 2015. "Risk lovers and the rent over-investment puzzle," Public Choice, Springer, vol. 164(1), pages 87-101, July.
    12. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    13. Richard Engelbrecht-Wiggans & Elena Katok, 2008. "Regret and Feedback Information in First-Price Sealed-Bid Auctions," Management Science, INFORMS, vol. 54(4), pages 808-819, April.
    14. Stephenson, Daniel, 2019. "Coordination and evolutionary dynamics: When are evolutionary models reliable?," Games and Economic Behavior, Elsevier, vol. 113(C), pages 381-395.
    15. Daniel G. Stephenson & Alexander L. Brown, 2021. "Playing the field in all-pay auctions," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 489-514, June.
    16. Sheremeta, Roman M., 2010. "Experimental comparison of multi-stage and one-stage contests," Games and Economic Behavior, Elsevier, vol. 68(2), pages 731-747, March.
    17. Jorgen W. Weibull, 1997. "Evolutionary Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262731215, December.
    18. Kalai, Ehud & Lehrer, Ehud, 1993. "Rational Learning Leads to Nash Equilibrium," Econometrica, Econometric Society, vol. 61(5), pages 1019-1045, September.
    19. Oprea, Ryan & Henwood, Keith & Friedman, Daniel, 2011. "Separating the Hawks from the Doves: Evidence from continuous time laboratory games," Journal of Economic Theory, Elsevier, vol. 146(6), pages 2206-2225.
    20. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
    21. repec:cup:judgdm:v:5:y:2010:i:1:p:1-10 is not listed on IDEAS
    22. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    23. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    24. Shengwu Li, 2017. "Obviously Strategy-Proof Mechanisms," American Economic Review, American Economic Association, vol. 107(11), pages 3257-3287, November.
    25. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    26. Duffy, John & Hopkins, Ed, 2005. "Learning, information, and sorting in market entry games: theory and evidence," Games and Economic Behavior, Elsevier, vol. 51(1), pages 31-62, April.
    27. , P. & , Peyton, 2006. "Regret testing: learning to play Nash equilibrium without knowing you have an opponent," Theoretical Economics, Econometric Society, vol. 1(3), pages 341-367, September.
    28. McKinney, C. Nicholas & Van Huyck, John B., 2013. "Eureka Learning: Heuristics and response time in perfect information games," Games and Economic Behavior, Elsevier, vol. 79(C), pages 223-232.
    29. Bravo, Mario & Mertikopoulos, Panayotis, 2017. "On the robustness of learning in games with stochastically perturbed payoff observations," Games and Economic Behavior, Elsevier, vol. 103(C), pages 41-66.
    30. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    31. Subhasish M. Chowdhury & Anwesha Mukherjee & Theodore L. Turocy, 2020. "That’s the ticket: explicit lottery randomisation and learning in Tullock contests," Theory and Decision, Springer, vol. 88(3), pages 405-429, April.
    32. Eyal Baharad & Shmuel Nitzan, 2008. "Contest Efforts in Light of Behavioural Considerations," Economic Journal, Royal Economic Society, vol. 118(533), pages 2047-2059, November.
    33. Nax, Heinrich H. & Burton-Chellew, Maxwell N. & West, Stuart A. & Young, H. Peyton, 2016. "Learning in a black box," LSE Research Online Documents on Economics 68714, London School of Economics and Political Science, LSE Library.
    34. Benedikt Herrmann & Henrik Orzen, 2008. "The appearance of homo rivalis: Social preferences and the nature of rent seeking," Discussion Papers 2008-10, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    35. Nax, Heinrich H. & Burton-Chellew, Maxwell N. & West, Stuart A. & Young, H. Peyton, 2016. "Learning in a black box," Journal of Economic Behavior & Organization, Elsevier, vol. 127(C), pages 1-15.
    36. Masiliunas, Aidas & Mengel, Friederike & Reiss, J. Philipp, 2014. "Behavioral variation in Tullock contests," Working Paper Series in Economics 55, Karlsruhe Institute of Technology (KIT), Department of Economics and Management.
    37. Roman M. Sheremeta, 2013. "Overbidding And Heterogeneous Behavior In Contest Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 27(3), pages 491-514, July.
    38. Chowdhury, Subhasish M. & Sheremeta, Roman M. & Turocy, Theodore L., 2014. "Overbidding and overspreading in rent-seeking experiments: Cost structure and prize allocation rules," Games and Economic Behavior, Elsevier, vol. 87(C), pages 224-238.
    39. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    40. Cason, Timothy N. & Masters, William A. & Sheremeta, Roman M., 2020. "Winner-take-all and proportional-prize contests: Theory and experimental results," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 314-327.
    41. Roman Sheremeta & Jingjing Zhang, 2010. "Can groups solve the problem of over-bidding in contests?," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 35(2), pages 175-197, July.
    42. Gary Charness & Guillaume R. Frechette & John H. Kagel, 2004. "How Robust is Laboratory Gift Exchange?," Experimental Economics, Springer;Economic Science Association, vol. 7(2), pages 189-205, June.
    43. Cho, In-Koo & Matsui, Akihiko, 2005. "Learning aspiration in repeated games," Journal of Economic Theory, Elsevier, vol. 124(2), pages 171-201, October.
    44. Jacob K. Goeree & Charles A. Holt, 2001. "Ten Little Treasures of Game Theory and Ten Intuitive Contradictions," American Economic Review, American Economic Association, vol. 91(5), pages 1402-1422, December.
    45. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    46. Gneezy, Uri & Rustichini, Aldo & Vostroknutov, Alexander, 2010. "Experience and insight in the Race game," Journal of Economic Behavior & Organization, Elsevier, vol. 75(2), pages 144-155, August.
    47. Timothy C. Salmon, 2001. "An Evaluation of Econometric Models of Adaptive Learning," Econometrica, Econometric Society, vol. 69(6), pages 1597-1628, November.
    48. Duch, Matthias L. & Grossmann, Max R.P. & Lauer, Thomas, 2020. "z-Tree unleashed: A novel client-integrating architecture for conducting z-Tree experiments over the Internet," Journal of Behavioral and Experimental Finance, Elsevier, vol. 28(C).
    49. Shafran, Aric P., 2012. "Learning in games with risky payoffs," Games and Economic Behavior, Elsevier, vol. 75(1), pages 354-371.
    50. Dickinson, David L & McEvoy, David M, 2021. "Further from the truth: The impact of moving from in-person to online settings on dishonest behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    51. Armantier, Olivier, 2004. "Does observation influence learning?," Games and Economic Behavior, Elsevier, vol. 46(2), pages 221-239, February.
    52. Fonseca, Miguel A., 2009. "An experimental investigation of asymmetric contests," International Journal of Industrial Organization, Elsevier, vol. 27(5), pages 582-591, September.
    53. Yoella Bereby-Meyer & Alvin E. Roth, 2006. "The Speed of Learning in Noisy Games: Partial Reinforcement and the Sustainability of Cooperation," American Economic Review, American Economic Association, vol. 96(4), pages 1029-1042, September.
    54. Antoni Bosch-DomËnech & Nicolaas J. Vriend, 2003. "Imitation of successful behaviour in cournot markets," Economic Journal, Royal Economic Society, vol. 113(487), pages 495-524, April.
    55. Brit Grosskopf & Yoella Bereby-Meyer & Max Bazerman, 2007. "On the Robustness of the Winner’s Curse Phenomenon," Theory and Decision, Springer, vol. 63(4), pages 389-418, December.
    56. Cox, Caleb A., 2017. "Rent-seeking and competitive preferences," Journal of Economic Psychology, Elsevier, vol. 63(C), pages 102-116.
    57. Dufwenberg, Martin & Sundaram, Ramya & Butler, David J., 2010. "Epiphany in the Game of 21," Journal of Economic Behavior & Organization, Elsevier, vol. 75(2), pages 132-143, August.
    58. Jiawei Li & Stephen Leider & Damian Beil & Izak Duenyas, 2021. "Running online experiments using web-conferencing software," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 167-183, December.
    59. Nathaniel T Wilcox, 2006. "Theories of Learning in Games and Heterogeneity Bias," Econometrica, Econometric Society, vol. 74(5), pages 1271-1292, September.
    60. Emel Filiz-Ozbay & Erkut Y. Ozbay, 2007. "Auctions with Anticipated Regret: Theory and Experiment," American Economic Review, American Economic Association, vol. 97(4), pages 1407-1418, September.
    61. Curtis Kephart & Daniel Friedman, 2015. "Hotelling revisits the lab: equilibration in continuous and discrete time," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(2), pages 132-145, December.
    62. Brit Grosskopf & Ido Erev & Eldad Yechiam, 2006. "Foregone with the Wind: Indirect Payoff Information and its Implications for Choice," International Journal of Game Theory, Springer;Game Theory Society, vol. 34(2), pages 285-302, August.
    63. Nick Feltovich, 2000. "Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information," Econometrica, Econometric Society, vol. 68(3), pages 605-642, May.
    64. Andreas Blume & Douglas V. DeJong & George R. Neumann & N. E. Savin, 2002. "Learning and communication in sender-receiver games: an econometric investigation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(3), pages 225-247.
    65. Young, H. Peyton, 2009. "Learning by trial and error," Games and Economic Behavior, Elsevier, vol. 65(2), pages 626-643, March.
    66. TeckH. Ho & Xin Wang & ColinF. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesco Fallucchi & Jan Niederreiter & Massimo Riccaboni, 2021. "Learning and dropout in contests: an experimental approach," Theory and Decision, Springer, vol. 90(2), pages 245-278, March.
    2. Sheremeta, Roman, 2014. "Behavior in Contests," MPRA Paper 57451, University Library of Munich, Germany.
    3. Roman M. Sheremeta, 2014. "Behavioral Dimensions of Contests," Working Papers 14-14, Chapman University, Economic Science Institute.
    4. Chowdhury, Subhasish M. & Sheremeta, Roman M. & Turocy, Theodore L., 2014. "Overbidding and overspreading in rent-seeking experiments: Cost structure and prize allocation rules," Games and Economic Behavior, Elsevier, vol. 87(C), pages 224-238.
    5. Roman M. Sheremeta, 2013. "Overbidding And Heterogeneous Behavior In Contest Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 27(3), pages 491-514, July.
    6. Hoffmann, Magnus & Kolmar, Martin, 2017. "Distributional preferences in probabilistic and share contests," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 120-139.
    7. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    8. David Bruner & Caleb Cox & David M. McEvoy & Brock Stoddard, 2022. "Strategic thinking in contests," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 942-973, June.
    9. Cason, Timothy N. & Masters, William A. & Sheremeta, Roman M., 2020. "Winner-take-all and proportional-prize contests: Theory and experimental results," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 314-327.
    10. Subhasish M. Chowdhury & Anwesha Mukherjee & Theodore L. Turocy, 2020. "That’s the ticket: explicit lottery randomisation and learning in Tullock contests," Theory and Decision, Springer, vol. 88(3), pages 405-429, April.
    11. Roman M. Sheremeta, 2016. "Impulsive Behavior in Competition: Testing Theories of Overbidding in Rent-Seeking Contests," Working Papers 16-21, Chapman University, Economic Science Institute.
    12. Masiliūnas, Aidas & Nax, Heinrich H., 2020. "Framing and repeated competition," Games and Economic Behavior, Elsevier, vol. 124(C), pages 604-619.
    13. Shakun D. Mago & Anya C. Savikhin & Roman M. Sheremeta, 2012. "Facing Your Opponents: Social identification and information feedback in contests," Working Papers 12-15, Chapman University, Economic Science Institute.
    14. Boosey, Luke & Brookins, Philip & Ryvkin, Dmitry, 2017. "Contests with group size uncertainty: Experimental evidence," Games and Economic Behavior, Elsevier, vol. 105(C), pages 212-229.
    15. Llorente-Saguer, Aniol & Sheremeta, Roman M. & Szech, Nora, 2023. "Designing contests between heterogeneous contestants: An experimental study of tie-breaks and bid-caps in all-pay auctions," European Economic Review, Elsevier, vol. 154(C).
    16. Fallucchi, Francesco & Renner, Elke & Sefton, Martin, 2013. "Information feedback and contest structure in rent-seeking games," European Economic Review, Elsevier, vol. 64(C), pages 223-240.
    17. Kimbrough, Erik O. & Sheremeta, Roman M. & Shields, Timothy W., 2014. "When parity promotes peace: Resolving conflict between asymmetric agents," Journal of Economic Behavior & Organization, Elsevier, vol. 99(C), pages 96-108.
    18. Shafran, Aric P., 2012. "Learning in games with risky payoffs," Games and Economic Behavior, Elsevier, vol. 75(1), pages 354-371.
    19. Wen, Yuanji, 2018. "Voluntary information acquisition in an asymmetric-Information game:comparing learning theories in the laboratory," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 202-219.
    20. Bettina Rockenbach & Sebastian Schneiders & Marcin Waligora, 2018. "Pushing the bad away: reverse Tullock contests," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 4(1), pages 73-85, July.

    More about this item

    Keywords

    Experiment; Contests; Reinforcement learning; Foregone payoffs; Payoff risk; Nash equilibrium;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D71 - Microeconomics - - Analysis of Collective Decision-Making - - - Social Choice; Clubs; Committees; Associations
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:gamebe:v:140:y:2023:i:c:p:50-72. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622836 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.