IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/47201.html
   My bibliography  Save this paper

Applications in Agent-Based Computational Economics

Author

Listed:
  • Schuster, Stephan

Abstract

A constituent feature of adaptive complex system are non-linear feedback mechanisms between actors. This makes it often difficult to model and analyse them. Agent-based Computational Economics (ACE) uses computer simulation methods to represent such systems and analyse non-linear processes. The aim of this thesis is to explore ways of modelling adaptive agents in ACE models. Its major contribution is of a methodological nature. Artificial intelligence and machine learning methods are used to represent agents and learning processes in ACE models. In this work, a general reinforcement learning framework is developed and realised in a simulation system. This system is used to implement three models of increasing complexity in two different economic domains. One of these domains are iterative games in which agents meet repeatedly and interact. In an experimental labour market, it is shown how statistical discrimination can be generated simply by means of the learning algorithm used. The aim of this model is mainly to illustrate the features of the learning framework. The results resemble actual patterns of observed human behaviour in laboratory settings. The second model treats strategic network formation. The main contribution here is to show how agent-based modelling helps to analyse non-linearity that is introduced when assumptions of perfect information and full rationality are relaxed. The other domain has a Health Economics background. The aim here is to provide insights of how the approach might be useful in real-world applications. For this, a general model of primary care is developed, and the implications of different consumer behaviour (based on the learning features introduced before) analysed.

Suggested Citation

  • Schuster, Stephan, 2012. "Applications in Agent-Based Computational Economics," MPRA Paper 47201, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:47201
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/47201/1/MPRA_paper_47201.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chalkley, Martin & Malcomson, James M., 1998. "Contracting for health services when patient demand does not reflect quality," Journal of Health Economics, Elsevier, vol. 17(1), pages 1-19, January.
    2. Karandikar, Rajeeva & Mookherjee, Dilip & Ray, Debraj & Vega-Redondo, Fernando, 1998. "Evolving Aspirations and Cooperation," Journal of Economic Theory, Elsevier, vol. 80(2), pages 292-331, June.
    3. Sarin, Rajiv & Vahid, Farshid, 2001. "Predicting How People Play Games: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 34(1), pages 104-122, January.
    4. Chen, Yan & Khoroshilov, Yuri, 2003. "Learning under limited information," Games and Economic Behavior, Elsevier, vol. 44(1), pages 1-25, July.
    5. Falk Armin & Kosfeld Michael, 2012. "It's all about Connections: Evidence on Network Formation," Review of Network Economics, De Gruyter, vol. 11(3), pages 1-36, September.
    6. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    7. Scott, Anthony & Hall, Jane, 1995. "Evaluating the effects of GP remuneration: problems and prospects," Health Policy, Elsevier, vol. 31(3), pages 183-195, March.
    8. Beal, Sylvain & Querou, Nicolas, 2007. "Bounded rationality and repeated network formation," Mathematical Social Sciences, Elsevier, vol. 54(1), pages 71-89, July.
    9. Arthur, W Brian, 1993. "On Designing Economic Agents That Behave Like Human Agents," Journal of Evolutionary Economics, Springer, vol. 3(1), pages 1-22, February.
    10. Hopkins, Ed & Posch, Martin, 2005. "Attainability of boundary points under reinforcement learning," Games and Economic Behavior, Elsevier, vol. 53(1), pages 110-125, October.
    11. Sylvain Béal, 2005. "Bounded Rationality and Repeated Network Formation," Post-Print hal-00375460, HAL.
    12. Corbae, Dean & Duffy, John, 2008. "Experiments with network formation," Games and Economic Behavior, Elsevier, vol. 64(1), pages 81-120, September.
    13. Goyal, Sanjeev, 2003. "Learning in Networks: a survey," Economics Discussion Papers 9983, University of Essex, Department of Economics.
    14. Borgers, Tilman & Sarin, Rajiv, 2000. "Naive Reinforcement Learning with Endogenous Aspirations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 921-950, November.
    15. Jackson, Matthew O. & van den Nouweland, Anne, 2005. "Strongly stable networks," Games and Economic Behavior, Elsevier, vol. 51(2), pages 420-444, May.
    16. Leombruni, Roberto & Richiardi, Matteo, 2005. "Why are economists sceptical about agent-based simulations?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 103-109.
    17. Herbert Simon, 2000. "Bounded rationality in social science: Today and tomorrow," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 1(1), pages 25-39, March.
    18. Rosella LEVAGGI & Lise ROCHAIX, 2007. "Exit, Choice Or Loyalty: Patient Driven Competition In Primary Care," Annals of Public and Cooperative Economics, Wiley Blackwell, vol. 78(4), pages 501-535, December.
    19. Sylvain Béal, 2005. "Bounded Rationality and Repeated Network Formation," Post-Print hal-00375458, HAL.
    20. Deroian, Frederic, 2003. "Farsighted strategies in the formation of a communication network," Economics Letters, Elsevier, vol. 80(3), pages 343-349, September.
    21. Jackson, Matthew O. & Wolinsky, Asher, 1996. "A Strategic Model of Social and Economic Networks," Journal of Economic Theory, Elsevier, vol. 71(1), pages 44-74, October.
    22. Napel, Stefan, 2003. "Aspiration adaptation in the ultimatum minigame," Games and Economic Behavior, Elsevier, vol. 43(1), pages 86-106, April.
    23. Young, H Peyton, 1993. "The Evolution of Conventions," Econometrica, Econometric Society, vol. 61(1), pages 57-84, January.
    24. Mookherjee, Dilip & Sopher, Barry, 1997. "Learning and Decision Costs in Experimental Constant Sum Games," Games and Economic Behavior, Elsevier, vol. 19(1), pages 97-132, April.
    25. Gilboa, Itzhak & Schmeidler, David, 1996. "Case-Based Optimization," Games and Economic Behavior, Elsevier, vol. 15(1), pages 1-26, July.
    26. Martin Gaynor, "undated". "What Do We Know About Competition and Quality in Health Care Markets?," GSIA Working Papers 2006-E62, Carnegie Mellon University, Tepper School of Business.
    27. Chalkley, Martin & Malcomson, James M, 1998. "Contracting for Health Services with Unmonitored Quality," Economic Journal, Royal Economic Society, vol. 108(449), pages 1093-1110, July.
    28. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    29. Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
    30. Ma, Ching-to Albert, 1994. "Health Care Payment Systems: Cost and Quality Incentives," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 3(1), pages 93-112, Spring.
    31. Vick, Sandra & Scott, Anthony, 1998. "Agency in health care. Examining patients' preferences for attributes of the doctor-patient relationship," Journal of Health Economics, Elsevier, vol. 17(5), pages 587-605, October.
    32. Stephan Schuster, 2012. "BRA: An Algorithm for Simulating Bounded Rational Agents," Computational Economics, Springer;Society for Computational Economics, vol. 39(1), pages 51-69, January.
    33. Hole, Arne Risa, 2008. "Modelling heterogeneity in patients' preferences for the attributes of a general practitioner appointment," Journal of Health Economics, Elsevier, vol. 27(4), pages 1078-1094, July.
    34. Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers Archive 10368, Iowa State University, Department of Economics.
    35. Gravelle, Hugh & Masiero, Giuliano, 2000. "Quality incentives in a regulated market with imperfect information and switching costs: capitation in general practice," Journal of Health Economics, Elsevier, vol. 19(6), pages 1067-1088, November.
    36. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    37. Sylvain Béal, 2005. "Bounded Rationality and Repeated Network Formation," Post-Print hal-00375457, HAL.
    38. Neil Rickman & Alistair McGuire, 1999. "Regulating Providers’ Reimbursement in a Mixed Market for Health Care," Scottish Journal of Political Economy, Scottish Economic Society, vol. 46(1), pages 53-71, February.
    39. Tesfatsion, Leigh, 2006. "Agent-Based Computational Economics: A Constructive Approach to Economic Theory," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 16, pages 831-880, Elsevier.
    40. Yan Chen & Fang-Fang Tang, 1998. "Learning and Incentive-Compatible Mechanisms for Public Goods Provision: An Experimental Study," Journal of Political Economy, University of Chicago Press, vol. 106(3), pages 633-662, June.
    41. Matteo Richiardi, 2003. "The Promises and Perils of Agent-Based Computational Economics," LABORatorio R. Revelli Working Papers Series 29, LABORatorio R. Revelli, Centre for Employment Studies.
    42. Venkatesh Bala & Sanjeev Goyal, 2000. "A Noncooperative Model of Network Formation," Econometrica, Econometric Society, vol. 68(5), pages 1181-1230, September.
    43. LeBaron, Blake & Arthur, W. Brian & Palmer, Richard, 1999. "Time series properties of an artificial stock market," Journal of Economic Dynamics and Control, Elsevier, vol. 23(9-10), pages 1487-1516, September.
    44. Grytten, Jostein & Sorensen, Rune, 2007. "Primary physician services--List size and primary physicians' service production," Journal of Health Economics, Elsevier, vol. 26(4), pages 721-741, July.
    45. Ron Sun & Isaac Naveh, 2007. "Social institution, cognition, and survival: a cognitive–social simulation," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 6(2), pages 115-142, November.
    46. Watts, Alison, 2002. "Non-myopic formation of circle networks," Economics Letters, Elsevier, vol. 74(2), pages 277-282, January.
    47. Galeotti, Andrea & Goyal, Sanjeev & Kamphorst, Jurjen, 2006. "Network formation with heterogeneous players," Games and Economic Behavior, Elsevier, vol. 54(2), pages 353-372, February.
    48. Stahl, Dale O., 2000. "Rule Learning in Symmetric Normal-Form Games: Theory and Evidence," Games and Economic Behavior, Elsevier, vol. 32(1), pages 105-138, July.
    49. Laslier, Jean-Francois & Topol, Richard & Walliser, Bernard, 2001. "A Behavioral Learning Process in Games," Games and Economic Behavior, Elsevier, vol. 37(2), pages 340-366, November.
    50. Jean-François Laslier & Bernard Walliser, 2005. "A reinforcement learning process in extensive form games," International Journal of Game Theory, Springer;Game Theory Society, vol. 33(2), pages 219-227, June.
    51. McBride, Michael, 2006. "Imperfect monitoring in communication networks," Journal of Economic Theory, Elsevier, vol. 126(1), pages 97-119, January.
    52. Karlsson, Martin, 2007. "Quality incentives for GPs in a regulated market," Journal of Health Economics, Elsevier, vol. 26(4), pages 699-720, July.
    53. Marinoso, Begona Garcia & Jelovac, Izabela, 2003. "GPs' payment contracts and their referral practice," Journal of Health Economics, Elsevier, vol. 22(4), pages 617-635, July.
    54. Scott, Anthony, 2000. "Economics of general practice," Handbook of Health Economics, in: A. J. Culyer & J. P. Newhouse (ed.), Handbook of Health Economics, edition 1, volume 1, chapter 22, pages 1175-1200, Elsevier.
    55. Sylvain Béal, 2005. "Bounded rationality and repeated network formation," Post-Print hal-00375455, HAL.
    56. Brenner, Thomas, 2006. "Agent Learning Representation: Advice on Modelling Economic Learning," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 18, pages 895-947, Elsevier.
    57. Woodward, Robert S. & Warren-Boulton, Frederick, 1984. "Considering the effects of financial incentives and professional ethics on `appropriate' medical care," Journal of Health Economics, Elsevier, vol. 3(3), pages 223-237, December.
    58. Leigh Tesfatsion & Kenneth L. Judd (ed.), 2006. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 2, number 2.
    59. Sylvain Béal, 2005. "Bounded Rationality and Repeated Network Formation," Post-Print hal-00375554, HAL.
    60. Mandy Ryan, 1994. "Agency in Health Care: Lessons for Economists from Sociologists," American Journal of Economics and Sociology, Wiley Blackwell, vol. 53(2), pages 207-217, April.
    61. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    62. Pemantle, Robin & Skyrms, Brian, 2004. "Network formation by reinforcement learning: the long and medium run," Mathematical Social Sciences, Elsevier, vol. 48(3), pages 315-327, November.
    63. Jackson, Matthew O. & Watts, Alison, 2002. "The Evolution of Social and Economic Networks," Journal of Economic Theory, Elsevier, vol. 106(2), pages 265-295, October.
    64. Watts, Alison, 2001. "A Dynamic Model of Network Formation," Games and Economic Behavior, Elsevier, vol. 34(2), pages 331-341, February.
    65. Devlin, Rose Anne & Sarma, Sisira, 2008. "Do physician remuneration schemes matter? The case of Canadian family physicians," Journal of Health Economics, Elsevier, vol. 27(5), pages 1168-1181, September.
    66. Sylvain Béal, 2005. "Bounded Rationality and Repeated Network Formation," Post-Print hal-00375555, HAL.
    67. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Gotts, Nicholas M. & Polhill, J. Gary, 2007. "Transient and asymptotic dynamics of reinforcement learning in games," Games and Economic Behavior, Elsevier, vol. 61(2), pages 259-276, November.
    68. B Hutchison & S Birch & J Hurley & J Lomas & F Stratford-Devai, 1994. "Do Physician Payment Mechanisms Affect Hospital Utilization? A Study of Health Service Organizations in Ontario," Centre for Health Economics and Policy Analysis Working Paper Series 1994-02, Centre for Health Economics and Policy Analysis (CHEPA), McMaster University, Hamilton, Canada.
    69. Gifford Sharon, 2005. "Limited Attention as the Bound on Rationality," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 5(1), pages 1-42, December.
    70. Giorgio Fagiolo & Alessio Moneta & Paul Windrum, 2007. "A Critical Guide to Empirical Validation of Agent-Based Models in Economics: Methodologies, Procedures, and Open Problems," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 195-226, October.
    71. Grytten, Jostein & Sorensen, Rune, 2001. "Type of contract and supplier-induced demand for primary physicians in Norway," Journal of Health Economics, Elsevier, vol. 20(3), pages 379-393, May.
    72. Mooney, Gavin & Ryan, Mandy, 1993. "Agency in health care: Getting beyond first principles," Journal of Health Economics, Elsevier, vol. 12(2), pages 125-135, July.
    73. A. J. Culyer & J. P. Newhouse (ed.), 2000. "Handbook of Health Economics," Handbook of Health Economics, Elsevier, edition 1, volume 1, number 1.
    74. Kristiansen, Ivar Sønbø & Mooney, Gavin, 1993. "The general practitioner's use of time: Is it influenced by the remuneration system?," Social Science & Medicine, Elsevier, vol. 37(3), pages 393-399, August.
    75. Izabela Jelovac, 2001. "Physicians' payment contracts, treatment decisions and diagnosis accuracy," Health Economics, John Wiley & Sons, Ltd., vol. 10(1), pages 9-25, January.
    76. Sarin, Rajiv & Vahid, Farshid, 1999. "Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 28(2), pages 294-309, August.
    77. Roland G. Fryer & Jacob K. Goeree & Charles A. Holt, 2005. "Experience-Based Discrimination: Classroom Games," The Journal of Economic Education, Taylor & Francis Journals, vol. 36(2), pages 160-170, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schuster, Stephan, 2010. "Network Formation with Adaptive Agents," MPRA Paper 27388, University Library of Munich, Germany.
    2. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Gotts, Nicholas M. & Polhill, J. Gary, 2007. "Transient and asymptotic dynamics of reinforcement learning in games," Games and Economic Behavior, Elsevier, vol. 61(2), pages 259-276, November.
    3. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    4. Oyarzun, Carlos & Sarin, Rajiv, 2013. "Learning and risk aversion," Journal of Economic Theory, Elsevier, vol. 148(1), pages 196-225.
    5. Segismundo S. Izquierdo & Luis R. Izquierdo & Nicholas M. Gotts, 2008. "Reinforcement Learning Dynamics in Social Dilemmas," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-1.
    6. Naoki Funai, 2019. "Convergence results on stochastic adaptive learning," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 68(4), pages 907-934, November.
    7. Waltman, Ludo & Kaymak, Uzay, 2008. "Q-learning agents in a Cournot oligopoly model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(10), pages 3275-3293, October.
    8. Joost Vandenbossche & Thomas Demuynck, 2013. "Network Formation with Heterogeneous Agents and Absolute Friction," Computational Economics, Springer;Society for Computational Economics, vol. 42(1), pages 23-45, June.
    9. Jackson, Matthew O. & Zenou, Yves, 2015. "Games on Networks," Handbook of Game Theory with Economic Applications,, Elsevier.
    10. Ianni, Antonella, 2014. "Learning strict Nash equilibria through reinforcement," Journal of Mathematical Economics, Elsevier, vol. 50(C), pages 148-155.
    11. Chen, Shu-Heng, 2012. "Varieties of agents in agent-based computational economics: A historical and an interdisciplinary perspective," Journal of Economic Dynamics and Control, Elsevier, vol. 36(1), pages 1-25.
    12. Yangbo Song & Mihaela Schaar, 2015. "Dynamic network formation with incomplete information," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 59(2), pages 301-331, June.
    13. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    14. Péter Bayer & Ani Guerdjikova, 2020. "Optimism leads to optimality: Ambiguity in network formation," Working Papers hal-03005107, HAL.
    15. Page, Frank Jr. & Wooders, Myrna H. & Kamat, Samir, 2005. "Networks and farsighted stability," Journal of Economic Theory, Elsevier, vol. 120(2), pages 257-269, February.
    16. Jeannette Brosig‐Koch & Burkhard Hehenkamp & Johanna Kokot, 2017. "The effects of competition on medical service provision," Health Economics, John Wiley & Sons, Ltd., vol. 26(S3), pages 6-20, December.
    17. Funai, Naoki, 2022. "Reinforcement learning with foregone payoff information in normal form games," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 638-660.
    18. Mengel, Friederike, 2012. "Learning across games," Games and Economic Behavior, Elsevier, vol. 74(2), pages 601-619.
    19. Shu-Heng Chen & Bin-Tzong Chie & Ying-Fang Kao & Ragupathy Venkatachalam, 2019. "Agent-Based Modeling of a Non-tâtonnement Process for the Scarf Economy: The Role of Learning," Computational Economics, Springer;Society for Computational Economics, vol. 54(1), pages 305-341, June.
    20. Hopkins, Ed & Posch, Martin, 2005. "Attainability of boundary points under reinforcement learning," Games and Economic Behavior, Elsevier, vol. 53(1), pages 110-125, October.

    More about this item

    Keywords

    agent-based economics; reinforcement learning; statistical discrimination; health care market; network formation games;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • D85 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Network Formation
    • I11 - Health, Education, and Welfare - - Health - - - Analysis of Health Care Markets
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing
    • Y40 - Miscellaneous Categories - - Dissertations - - - Dissertations

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:47201. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.