IDEAS home Printed from https://ideas.repec.org/a/spr/comaot/v13y2007i1d10.1007_s10588-006-9010-7.html
   My bibliography  Save this article

Learning and transfer in dynamic decision environments

Author

Listed:
  • Faison P. Gibson

    (Eastern Michigan University)

Abstract

An important aspect of learning is the ability to transfer knowledge to new contexts. However, in dynamic decision tasks, such as bargaining, firefighting, and process control, where decision makers must make repeated decisions under time pressure and outcome feedback may relate to any of a number of decisions, such transfer has proven elusive. This paper proposes a two-stage connectionist model which hypothesizes that decision makers learn to identify categories of evidence requiring similar decisions as they perform in dynamic environments. The model suggests conditions under which decision makers will be able to use this ability to help them in novel situations. These predictions are compared against those of a one-stage decision model that does not learn evidence categories, as is common in many current theories of repeated decision making. Both models' predictions are then tested against the performance of decision makers in an Internet bargaining task. Both models correctly predict aspects of decision makers' learning under different interventions. The two-stage model provides closer fits to decision maker performance in a new, related bargaining task and accounts for important features of higher-performing decision makers' learning. Although frequently omitted in recent accounts of repeated decision making, the processes of evidence category formation described by the two-stage model appear critical in understanding the extent to which decision makers learn from feedback in dynamic tasks.

Suggested Citation

  • Faison P. Gibson, 2007. "Learning and transfer in dynamic decision environments," Computational and Mathematical Organization Theory, Springer, vol. 13(1), pages 39-61, March.
  • Handle: RePEc:spr:comaot:v:13:y:2007:i:1:d:10.1007_s10588-006-9010-7
    DOI: 10.1007/s10588-006-9010-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10588-006-9010-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10588-006-9010-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    2. Gibson, Faison P., 2000. "Feedback Delays: How Can Decision Makers Learn Not to Buy a New Car Every Time the Garage Is Empty?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 83(1), pages 141-166, September.
    3. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    4. Kishore Sengupta & Tarek K. Abdel-Hamid, 1993. "Alternative Conceptions of Feedback in Dynamic Decision Environments: An Experimental Investigation," Management Science, INFORMS, vol. 39(4), pages 411-428, April.
    5. Sterman, John., 1994. "Learning in and about complex systems," Working papers 3660-94., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    6. Gibson, Faison P. & Fichman, Mark & Plaut, David C., 1997. "Learning in Dynamic Decision Tasks: Computational Model and Empirical Evidence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 71(1), pages 1-35, July.
    7. Diehl, Ernst & Sterman, John D., 1995. "Effects of Feedback Complexity on Dynamic Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(2), pages 198-215, May.
    8. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    9. John D. C. Little, 1970. "Models and Managers: The Concept of a Decision Calculus," Management Science, INFORMS, vol. 16(8), pages 466-485, April.
    10. John D. Sterman, 1989. "Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment," Management Science, INFORMS, vol. 35(3), pages 321-339, March.
    11. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    12. Mark Paich & John D. Sterman, 1993. "Boom, Bust, and Failures to Learn in Experimental Markets," Management Science, INFORMS, vol. 39(12), pages 1439-1458, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Faison P. Gibson, 2003. "Supporting Learning in Evolving Dynamic Environments," Computational and Mathematical Organization Theory, Springer, vol. 9(4), pages 305-326, December.
    2. Faison P. Gibson, 2002. "Is It Better to Forget? Stimulus-Response, Prediction, and the Weight of Past Experience in a Fast-Paced Bargaining Task," Computational and Mathematical Organization Theory, Springer, vol. 8(1), pages 31-47, May.
    3. Gibson, Faison P., 2000. "Feedback Delays: How Can Decision Makers Learn Not to Buy a New Car Every Time the Garage Is Empty?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 83(1), pages 141-166, September.
    4. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    5. Anthony Ziegelmeyer & Frédéric Koessler & Kene Boun My & Laurent Denant-Boèmont, 2008. "Road Traffic Congestion and Public Information: An Experimental Investigation," Journal of Transport Economics and Policy, University of Bath, vol. 42(1), pages 43-82, January.
    6. DeJong, D.V. & Blume, A. & Neumann, G., 1998. "Learning in Sender-Receiver Games," Other publications TiSEM 4a8b4f46-f30b-4ad2-bb0c-1, Tilburg University, School of Economics and Management.
    7. Michael Foley & Rory Smead & Patrick Forber & Christoph Riedl, 2021. "Avoiding the bullies: The resilience of cooperation among unequals," PLOS Computational Biology, Public Library of Science, vol. 17(4), pages 1-18, April.
    8. Jean-François Laslier & Bernard Walliser, 2015. "Stubborn learning," Theory and Decision, Springer, vol. 79(1), pages 51-93, July.
    9. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
    10. Franke, Reiner, 2003. "Reinforcement learning in the El Farol model," Journal of Economic Behavior & Organization, Elsevier, vol. 51(3), pages 367-388, July.
    11. Arifovic, Jasmina & Karaivanov, Alexander, 2010. "Learning by doing vs. learning from others in a principal-agent model," Journal of Economic Dynamics and Control, Elsevier, vol. 34(10), pages 1967-1992, October.
    12. Dürsch, Peter & Kolb, Albert & Oechssler, Jörg & Schipper, Burkhard C., 2005. "Rage Against the Machines: How Subjects Learn to Play Against Computers," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 63, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    13. Gary Charness & Dan Levin, 2003. "Bayesian Updating vs. Reinforcement and Affect: A Laboratory Study," Levine's Bibliography 666156000000000180, UCLA Department of Economics.
    14. Atun, Rifat A. & Lebcir, Reda M. & McKee, Martin & Habicht, Jarno & Coker, Richard J., 2007. "Impact of joined-up HIV harm reduction and multidrug resistant tuberculosis control programmes in Estonia: System dynamics simulation model," Health Policy, Elsevier, vol. 81(2-3), pages 207-217, May.
    15. Blume, Andreas & Gneezy, Uri, 2000. "An Experimental Investigation of Optimal Learning in Coordination Games," Journal of Economic Theory, Elsevier, vol. 90(1), pages 161-172, January.
    16. Cleotilde Gonzalez & Jose Quesada, 2003. "Learning in Dynamic Decision Making: The Recognition Process," Computational and Mathematical Organization Theory, Springer, vol. 9(4), pages 287-304, December.
    17. Oyarzun, Carlos & Sarin, Rajiv, 2013. "Learning and risk aversion," Journal of Economic Theory, Elsevier, vol. 148(1), pages 196-225.
    18. James Andreoni & Marco Castillo & Ragan Petrie, 2009. "Revealing Preferences for Fairness in Ultimatum Bargaining," Korean Economic Review, Korean Economic Association, vol. 25, pages 35-63.
    19. Nick Feltovich, 2000. "Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information," Econometrica, Econometric Society, vol. 68(3), pages 605-642, May.
    20. Gary Charness & Dan Levin, 2005. "When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect," American Economic Review, American Economic Association, vol. 95(4), pages 1300-1309, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:comaot:v:13:y:2007:i:1:d:10.1007_s10588-006-9010-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.