IDEAS home Printed from https://ideas.repec.org/p/arx/papers/0710.0114.html
   My bibliography  Save this paper

Reinforcement learning in market games

Author

Listed:
  • Edward W. Piotrowski
  • Jan Sladkowski
  • Anna Szczypinska

Abstract

Financial markets investors are involved in many games -- they must interact with other agents to achieve their goals. Among them are those directly connected with their activity on markets but one cannot neglect other aspects that influence human decisions and their performance as investors. Distinguishing all subgames is usually beyond hope and resource consuming. In this paper we study how investors facing many different games, gather information and form their decision despite being unaware of the complete structure of the game. To this end we apply reinforcement learning methods to the Information Theory Model of Markets (ITMM). Following Mengel, we can try to distinguish a class $\Gamma$ of games and possible actions (strategies) $a^{i}_{m_{i}}$ for $i-$th agent. Any agent divides the whole class of games into analogy subclasses she/he thinks are analogous and therefore adopts the same strategy for a given subclass. The criteria for partitioning are based on profit and costs analysis. The analogy classes and strategies are updated at various stages through the process of learning. This line of research can be continued in various directions.

Suggested Citation

  • Edward W. Piotrowski & Jan Sladkowski & Anna Szczypinska, 2007. "Reinforcement learning in market games," Papers 0710.0114, arXiv.org.
  • Handle: RePEc:arx:papers:0710.0114
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/0710.0114
    File Function: Latest version
    Download Restriction: no

    References listed on IDEAS

    as
    1. Piotrowski, Edward W., 2003. "Fixed point theorem for simple quantum strategies in quantum market games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 324(1), pages 196-200.
    2. Piotrowski, Edward W & Sładkowski, Jan, 2004. "Arbitrage risk induced by transaction costs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 331(1), pages 233-239.
    3. Mengel, Friederike, 2012. "Learning across games," Games and Economic Behavior, Elsevier, vol. 74(2), pages 601-619.
    4. Edward W. Piotrowski & Jan Sladkowski, "undated". "Quantum Computer: An Appliance for Playing Market Games," Departmental Working Papers 16, University of Bialtystok, Department of Theoretical Physics.
    5. Edward W. Piotrowski & Malgorzata Schroeder, "undated". "Kelly Criterion Revisited: Optimal Bets," Departmental Working Papers 24, University of Bialtystok, Department of Theoretical Physics.
    6. Edward W. Piotrowski & Jerzy Luczka, "undated". "The relativistic velocity addition law optimizes a forecast gambler's profit," Departmental Working Papers 31, University of Bialtystok, Department of Theoretical Physics.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:0710.0114. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators). General contact details of provider: http://arxiv.org/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.