IDEAS home Printed from https://ideas.repec.org/a/bpj/bejtec/v12y2012i1n25.html
   My bibliography  Save this article

An Axiomatization of Learning Rules when Counterfactuals are not Observed

Author

Listed:
  • Mengel Friederike

    () (Maastricht University)

  • Rivas Javier

    () (University of Leicester)

Abstract

In this paper we study learning procedures when counterfactuals (payoffs of not chosen actions) are not observed. The decision maker reasons in two steps: First, she updates her propensities for choosing each action after every payoff experience, where propensities can be interpreted as preferences. Then, she transforms these propensities into choice probabilities. We introduce a set of axioms on how propensities are updated and on how these propensities are translated into choices and study the decision marker's behavior when such axioms are in place. Our characterization includes the linear reinforcement learning rule from Roth and Erev (1995).

Suggested Citation

  • Mengel Friederike & Rivas Javier, 2012. "An Axiomatization of Learning Rules when Counterfactuals are not Observed," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 12(1), pages 1-19, July.
    • Handle: RePEc:bpj:bejtec:v:12:y:2012:i:1:n:25
    as

    Download full text from publisher

    File URL: https://www.degruyter.com/view/j/bejte.2012.12.issue-1/1935-1704.1828/1935-1704.1828.xml?format=INT
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tilman Börgers & Antonio J. Morales & Rajiv Sarin, 2004. "Expedient and Monotone Learning Rules," Econometrica, Econometric Society, vol. 72(2), pages 383-405, March.
    2. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Agastya, Murali & Slinko, Arkadii, 2015. "Dynamic choice in a complex world," Journal of Economic Theory, Elsevier, vol. 158(PA), pages 232-258.
    2. Oyarzun, Carlos & Sanjurjo, Adam & Nguyen, Hien, 2017. "Response functions," European Economic Review, Elsevier, vol. 98(C), pages 1-31.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Oyarzun, Carlos & Sarin, Rajiv, 2012. "Mean and variance responsive learning," Games and Economic Behavior, Elsevier, vol. 75(2), pages 855-866.
    2. Hopkins, Ed, 2007. "Adaptive learning models of consumer behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 64(3-4), pages 348-368.
    3. Oyarzun, Carlos & Sarin, Rajiv, 2013. "Learning and risk aversion," Journal of Economic Theory, Elsevier, vol. 148(1), pages 196-225.
    4. John Huyck & Raymond Battalio & Frederick Rankin, 2007. "Selection dynamics and adaptive behavior without much information," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 53-65, October.
    5. Todd Guilfoos & Andreas Duus Pape, 2020. "Estimating Case-Based Learning," Games, MDPI, Open Access Journal, vol. 11(3), pages 1-25, September.
    6. Noah Gans & George Knox & Rachel Croson, 2007. "Simple Models of Discrete Choice and Their Performance in Bandit Experiments," Manufacturing & Service Operations Management, INFORMS, vol. 9(4), pages 383-408, December.
    7. Terracol, Antoine & Vaksmann, Jonathan, 2009. "Dumbing down rational players: Learning and teaching in an experimental game," Journal of Economic Behavior & Organization, Elsevier, vol. 70(1-2), pages 54-71, May.
    8. Antonio Cabrales & Rosemarie Nagel & Roc Armenter, 2007. "Equilibrium selection through incomplete information in coordination games: an experimental study," Experimental Economics, Springer;Economic Science Association, vol. 10(3), pages 221-234, September.
    9. Jonas Hedlund & Carlos Oyarzun, 2018. "Imitation in heterogeneous populations," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 65(4), pages 937-973, June.
    10. Atanasios Mitropoulos, 2001. "Learning Under Little Information: An Experiment on Mutual Fate Control," Game Theory and Information 0110003, University Library of Munich, Germany.
    11. Iftekhar, M. S. & Tisdell, J. G., 2018. "Learning in repeated multiple unit combinatorial auctions: An experimental study," Working Papers 267301, University of Western Australia, School of Agricultural and Resource Economics.
    12. Wang, Xianjia & Lv, Shaojie, 2019. "The roles of particle swarm intelligence in the prisoner’s dilemma based on continuous and mixed strategy systems on scale-free networks," Applied Mathematics and Computation, Elsevier, vol. 355(C), pages 213-220.
    13. Wilfred Amaldoss & Chuan He, 2016. "Does Informative Advertising Increase Market Price? An Experimental Investigation," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 3(2), pages 63-80, June.
    14. Astrid Dannenberg & Carlo Gallier, 2020. "The choice of institutions to solve cooperation problems: a survey of experimental research," Experimental Economics, Springer;Economic Science Association, vol. 23(3), pages 716-749, September.
    15. Bayer, Ralph-C & Ke, Changxia, 2018. "What causes rockets and feathers? An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 223-237.
    16. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    17. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    18. Colin F. Camerer & Ernst Fehr, "undated". "Measuring Social Norms and Preferences using Experimental Games: A Guide for Social Scientists," IEW - Working Papers 097, Institute for Empirical Research in Economics - University of Zurich.
    19. Benaïm, Michel & Hofbauer, Josef & Hopkins, Ed, 2009. "Learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1694-1709, July.
    20. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:bejtec:v:12:y:2012:i:1:n:25. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Peter Golla). General contact details of provider: https://www.degruyter.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.