IDEAS home Printed from https://ideas.repec.org/a/bpj/bejtec/v12y2012i1n25.html
   My bibliography  Save this article

An Axiomatization of Learning Rules when Counterfactuals are not Observed

Author

Listed:
  • Mengel Friederike

    (Maastricht University)

  • Rivas Javier

    (University of Leicester)

Abstract

In this paper we study learning procedures when counterfactuals (payoffs of not chosen actions) are not observed. The decision maker reasons in two steps: First, she updates her propensities for choosing each action after every payoff experience, where propensities can be interpreted as preferences. Then, she transforms these propensities into choice probabilities. We introduce a set of axioms on how propensities are updated and on how these propensities are translated into choices and study the decision marker's behavior when such axioms are in place. Our characterization includes the linear reinforcement learning rule from Roth and Erev (1995).

Suggested Citation

  • Mengel Friederike & Rivas Javier, 2012. "An Axiomatization of Learning Rules when Counterfactuals are not Observed," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 12(1), pages 1-19, July.
    • Handle: RePEc:bpj:bejtec:v:12:y:2012:i:1:n:25
    DOI: 10.1515/1935-1704.1828
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/1935-1704.1828
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.1515/1935-1704.1828?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    2. Tilman Börgers & Antonio J. Morales & Rajiv Sarin, 2004. "Expedient and Monotone Learning Rules," Econometrica, Econometric Society, vol. 72(2), pages 383-405, March.
    3. Schlag, Karl H., 1998. "Why Imitate, and If So, How?, : A Boundedly Rational Approach to Multi-armed Bandits," Journal of Economic Theory, Elsevier, vol. 78(1), pages 130-156, January.
    4. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    5. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Agastya, Murali & Slinko, Arkadii, 2015. "Dynamic choice in a complex world," Journal of Economic Theory, Elsevier, vol. 158(PA), pages 232-258.
    2. Oyarzun, Carlos & Sanjurjo, Adam & Nguyen, Hien, 2017. "Response functions," European Economic Review, Elsevier, vol. 98(C), pages 1-31.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Oyarzun, Carlos & Sarin, Rajiv, 2013. "Learning and risk aversion," Journal of Economic Theory, Elsevier, vol. 148(1), pages 196-225.
    2. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    3. John Huyck & Raymond Battalio & Frederick Rankin, 2007. "Selection dynamics and adaptive behavior without much information," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 53-65, October.
    4. Todd Guilfoos & Andreas Duus Pape, 2020. "Estimating Case-Based Learning," Games, MDPI, vol. 11(3), pages 1-25, September.
    5. Atanasios Mitropoulos, 2001. "Learning Under Little Information: An Experiment on Mutual Fate Control," Game Theory and Information 0110003, University Library of Munich, Germany.
    6. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    7. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    8. Ido Erev & Eyal Ert & Alvin E. Roth, 2010. "A Choice Prediction Competition for Market Entry Games: An Introduction," Games, MDPI, vol. 1(2), pages 1-20, May.
    9. Jieyao Ding & Andreas Nicklisch, 2013. "On the Impulse in Impulse Learning," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2013_02, Max Planck Institute for Research on Collective Goods.
    10. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    11. Sebastian J. Goerg & Tibor Neugebauer & Abdolkarim Sadrieh, 2016. "Impulse Response Dynamics in Weakest Link Games," German Economic Review, Verein für Socialpolitik, vol. 17(3), pages 284-297, August.
    12. Ron Borkovsky & Paul Ellickson & Brett Gordon & Victor Aguirregabiria & Pedro Gardete & Paul Grieco & Todd Gureckis & Teck-Hua Ho & Laurent Mathevet & Andrew Sweeting, 2015. "Multiplicity of equilibria and information structures in empirical games: challenges and prospects," Marketing Letters, Springer, vol. 26(2), pages 115-125, June.
    13. Oyarzun, Carlos & Sarin, Rajiv, 2012. "Mean and variance responsive learning," Games and Economic Behavior, Elsevier, vol. 75(2), pages 855-866.
    14. Hopkins, Ed, 2007. "Adaptive learning models of consumer behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 64(3-4), pages 348-368.
    15. Sergiu Hart & Andreu Mas-Colell, 2013. "A Simple Adaptive Procedure Leading To Correlated Equilibrium," World Scientific Book Chapters, in: Simple Adaptive Strategies From Regret-Matching to Uncoupled Dynamics, chapter 2, pages 17-46, World Scientific Publishing Co. Pte. Ltd..
    16. Marco LiCalzi & Roland Mühlenbernd, 2022. "Feature-weighted categorized play across symmetric games," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 1052-1078, June.
    17. Ponti, Giovanni, 2000. "Continuous-time evolutionary dynamics: theory and practice," Research in Economics, Elsevier, vol. 54(2), pages 187-214, June.
    18. Osili, Una Okonkwo & Paulson, Anna, 2014. "Crises and confidence: Systemic banking crises and depositor behavior," Journal of Financial Economics, Elsevier, vol. 111(3), pages 646-660.
    19. Haruvy, Ernan & Stahl, Dale O., 2012. "Between-game rule learning in dissimilar symmetric normal-form games," Games and Economic Behavior, Elsevier, vol. 74(1), pages 208-221.
    20. Rivas, Javier, 2013. "Probability matching and reinforcement learning," Journal of Mathematical Economics, Elsevier, vol. 49(1), pages 17-21.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:bejtec:v:12:y:2012:i:1:n:25. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyterbrill.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.