IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v57y2021i3d10.1007_s10614-018-9803-z.html
   My bibliography  Save this article

Human and Machine Learning

Author

Listed:
  • Ying-Fang Kao
  • Ragupathy Venkatachalam

    (University of London)

Abstract

In this paper, we consider learning by human beings and machines in the light of Herbert Simon’s pioneering contributions to the theory of Human Problem Solving. Using board games of perfect information as a paradigm, we explore differences in human and machine learning in complex strategic environments. In doing so, we contrast theories of learning in classical game theory with computational game theory proposed by Simon. Among theories that invoke computation, we make a further distinction between computable and computational or machine learning theories. We argue that the modern machine learning algorithms, although impressive in terms of their performance, do not necessarily shed enough light on human learning. Instead, they seem to take us further away from Simon’s lifelong quest to understand the mechanics of actual human behaviour.

Suggested Citation

  • Ying-Fang Kao & Ragupathy Venkatachalam, 2021. "Human and Machine Learning," Computational Economics, Springer;Society for Computational Economics, vol. 57(3), pages 889-909, March.
    • Handle: RePEc:kap:compec:v:57:y:2021:i:3:d:10.1007_s10614-018-9803-z
    DOI: 10.1007/s10614-018-9803-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-018-9803-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-018-9803-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    2. R.J. Aumann & S. Hart (ed.), 2002. "Handbook of Game Theory with Economic Applications," Handbook of Game Theory with Economic Applications, Elsevier, edition 1, volume 3, number 3.
    3. Smale, Stephen, 1976. "Dynamics in General Equilibrium Theory," American Economic Review, American Economic Association, vol. 66(2), pages 288-294, May.
    4. Sergiu Hart & Andreu Mas-Colell, 2013. "A Simple Adaptive Procedure Leading To Correlated Equilibrium," World Scientific Book Chapters, in: Simple Adaptive Strategies From Regret-Matching to Uncoupled Dynamics, chapter 2, pages 17-46, World Scientific Publishing Co. Pte. Ltd..
    5. Selten, Reinhard & Stoecker, Rolf, 1986. "End behavior in sequences of finite Prisoner's Dilemma supergames A learning theory approach," Journal of Economic Behavior & Organization, Elsevier, vol. 7(1), pages 47-70, March.
    6. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    7. Prasad, Kislaya, 1997. "On the computability of Nash equilibria," Journal of Economic Dynamics and Control, Elsevier, vol. 21(6), pages 943-953, June.
    8. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    9. Kalai, Ehud & Lehrer, Ehud, 1993. "Rational Learning Leads to Nash Equilibrium," Econometrica, Econometric Society, vol. 61(5), pages 1019-1045, September.
    10. Simon, Herbert A., 2000. "Barriers and bounds to Rationality," Structural Change and Economic Dynamics, Elsevier, vol. 11(1-2), pages 243-253, July.
    11. Ying-Fang Kao & K. Vela Velupillai, 2015. "Behavioural economics: Classical and modern," The European Journal of the History of Economic Thought, Taylor & Francis Journals, vol. 22(2), pages 236-271, April.
    12. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    13. Spear, Stephen E, 1989. "Learning Rational Expectations under Computability Constraints," Econometrica, Econometric Society, vol. 57(4), pages 889-910, July.
    14. Nachbar, John H & Zame, William R, 1996. "Non-computable Strategies and Discounted Repeated Games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 8(1), pages 103-122, June.
    15. Velupillai, K., 2000. "Computable Economics: The Arne Ryde Memorial Lectures," OUP Catalogue, Oxford University Press, number 9780198295273.
    16. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    17. Rubinstein, Ariel, 1986. "Finite automata play the repeated prisoner's dilemma," Journal of Economic Theory, Elsevier, vol. 39(1), pages 83-96, June.
    18. Arrow, Kenneth J, 1986. "Rationality of Self and Others in an Economic System," The Journal of Business, University of Chicago Press, vol. 59(4), pages 385-399, October.
    19. M. Euwe, 2016. "Mathematics — Set-Theoretic Considerations on the Game of Chess," New Mathematics and Natural Computation (NMNC), World Scientific Publishing Co. Pte. Ltd., vol. 12(01), pages 11-20, March.
    20. Halpern, Joseph Y. & Pass, Rafael, 2015. "Algorithmic rationality: Game theory with costly computation," Journal of Economic Theory, Elsevier, vol. 156(C), pages 246-268.
    21. Simon, Herbert A. & Schaeffer, Jonathan, 1992. "The game of chess," Handbook of Game Theory with Economic Applications, in: R.J. Aumann & S. Hart (ed.), Handbook of Game Theory with Economic Applications, edition 1, volume 1, chapter 1, pages 1-17, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jeoung Yul Lee & Daekwan Kim & Byungchul Choi & Alfredo Jiménez, 2023. "Early evidence on how Industry 4.0 reshapes MNEs’ global value chains: The role of value creation versus value capturing by headquarters and foreign subsidiaries," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 54(4), pages 599-630, June.
    2. Rossy Chumbe & Stefany Silva & Yvan Garcia, 2023. "Comparison of the machine learning and AquaCrop models for quinoa crops," Research in Agricultural Engineering, Czech Academy of Agricultural Sciences, vol. 69(2), pages 65-75.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    2. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    3. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    4. Teck H Ho & Colin Camerer & Juin-Kuan Chong, 2003. "Functional EWA: A one-parameter theory of learning in games," Levine's Working Paper Archive 506439000000000514, David K. Levine.
    5. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    6. Benaïm, Michel & Hofbauer, Josef & Hopkins, Ed, 2009. "Learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1694-1709, July.
    7. Jean-François Laslier & Bernard Walliser, 2015. "Stubborn learning," Theory and Decision, Springer, vol. 79(1), pages 51-93, July.
    8. Arifovic, Jasmina & Karaivanov, Alexander, 2010. "Learning by doing vs. learning from others in a principal-agent model," Journal of Economic Dynamics and Control, Elsevier, vol. 34(10), pages 1967-1992, October.
    9. Beggs, A.W., 2005. "On the convergence of reinforcement learning," Journal of Economic Theory, Elsevier, vol. 122(1), pages 1-36, May.
    10. Wolf Ze'ev Ehrblatt & Kyle Hyndman & Erkut Y. ÄOzbay & Andrew Schotter, 2006. "Convergence: An Experimental Study," Levine's Working Paper Archive 122247000000001148, David K. Levine.
    11. Nick Feltovich, 2000. "Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information," Econometrica, Econometric Society, vol. 68(3), pages 605-642, May.
    12. Pedro Dal Bo & Guillaume R. Frechette, 2007. "The Evolution of Cooperation in Infinitely Repeated Games: Experimental Evidence," Working Papers 2007-7, Brown University, Department of Economics.
    13. Martin G. Kocher & Matthias Sutter, 2005. "The Decision Maker Matters: Individual Versus Group Behaviour in Experimental Beauty-Contest Games," Economic Journal, Royal Economic Society, vol. 115(500), pages 200-223, January.
    14. Albert Banal-Estañol & Augusto Rupérez-Micola, 2010. "Are agent-based simulations robust? The wholesale electricity trading case," Economics Working Papers 1214, Department of Economics and Business, Universitat Pompeu Fabra.
    15. Peiran Jiao, 2015. "The Double-Channeled Effects of Experience on Individual Investment Decisions: Experimental Evidence," Economics Series Working Papers 766, University of Oxford, Department of Economics.
    16. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
    17. James Andreoni & Marco Castillo & Ragan Petrie, 2009. "Revealing Preferences for Fairness in Ultimatum Bargaining," Korean Economic Review, Korean Economic Association, vol. 25, pages 35-63.
    18. Waltman, Ludo & Kaymak, Uzay, 2008. "Q-learning agents in a Cournot oligopoly model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(10), pages 3275-3293, October.
    19. Yoella Bereby-Meyer & Alvin E. Roth, 2006. "The Speed of Learning in Noisy Games: Partial Reinforcement and the Sustainability of Cooperation," American Economic Review, American Economic Association, vol. 96(4), pages 1029-1042, September.
    20. Phanish Puranam & Murali Swamy, 2016. "How Initial Representations Shape Coupled Learning Processes," Organization Science, INFORMS, vol. 27(2), pages 323-335, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:57:y:2021:i:3:d:10.1007_s10614-018-9803-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.