IDEAS home Printed from https://ideas.repec.org/a/spr/joptap/v166y2015i2d10.1007_s10957-014-0649-9.html
   My bibliography  Save this article

Stationary Anonymous Sequential Games with Undiscounted Rewards

Author

Listed:
  • Piotr Więcek

    (Wrocław University of Technology)

  • Eitan Altman

    (INRIA)

Abstract

Stationary anonymous sequential games with undiscounted rewards are a special class of games that combine features from both population games (infinitely many players) with stochastic games. We extend the theory for these games to the cases of total expected reward as well as to the expected average reward. We show that in the anonymous sequential game equilibria correspond to the limits of those of related finite population games as the number of players grows to infinity. We provide examples to illustrate our results.

Suggested Citation

  • Piotr Więcek & Eitan Altman, 2015. "Stationary Anonymous Sequential Games with Undiscounted Rewards," Journal of Optimization Theory and Applications, Springer, vol. 166(2), pages 686-710, August.
    • Handle: RePEc:spr:joptap:v:166:y:2015:i:2:d:10.1007_s10957-014-0649-9
    DOI: 10.1007/s10957-014-0649-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10957-014-0649-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10957-014-0649-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bergin, J & Bernhardt, D, 1995. "Anonymous Sequential Games: Existence and Characterization of Equilibria," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 5(3), pages 461-489, May.
    2. Jovanovic, Boyan & Rosenthal, Robert W., 1988. "Anonymous sequential games," Journal of Mathematical Economics, Elsevier, vol. 17(1), pages 77-87, February.
    3. Green, Edward J., 1980. "Noncooperative price taking in large dynamic markets," Journal of Economic Theory, Elsevier, vol. 22(2), pages 155-182, April.
    4. Keith W. Ross & Ravi Varadarajan, 1991. "Multichain Markov Decision Processes with a Sample Path Constraint: A Decomposition Approach," Mathematics of Operations Research, INFORMS, vol. 16(1), pages 195-207, February.
    5. Green, Edward J, 1984. "Continuum and Finite-Player Noncooperative Models of Competition," Econometrica, Econometric Society, vol. 52(4), pages 975-993, July.
    6. David Housman, 1988. "Infinite Player Noncooperative Games and the Continuity of the Nash Equilibrium Correspondence," Mathematics of Operations Research, INFORMS, vol. 13(3), pages 488-496, August.
    7. Weintraub, Gabriel Y. & Benkard, C. Lanier & Van Roy, Benjamin, 2011. "Industry dynamics: Foundations for models with an infinite number of firms," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1965-1994, September.
    8. Sachin Adlakha & Ramesh Johari, 2013. "Mean Field Equilibrium in Dynamic Games with Strategic Complementarities," Operations Research, INFORMS, vol. 61(4), pages 971-989, August.
    9. Gabriel Y. Weintraub & C. Lanier Benkard & Benjamin Van Roy, 2008. "Markov Perfect Industry Dynamics With Many Firms," Econometrica, Econometric Society, vol. 76(6), pages 1375-1411, November.
    10. Bergin, James & Bernhardt, Dan, 1992. "Anonymous sequential games with aggregate uncertainty," Journal of Mathematical Economics, Elsevier, vol. 21(6), pages 543-562.
    11. Ross Cressman, 2003. "Evolutionary Dynamics and Extensive Form Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262033054, December.
    12. Ioannis Karatzas & Martin Shubik & William D. Sudderth, 1992. "Construction of Stationary Markov Equilibria in a Strategic Market Game," Cowles Foundation Discussion Papers 1033, Cowles Foundation for Research in Economics, Yale University.
    13. Chakrabarti, Subir K., 2003. "Pure strategy Markov equilibrium in stochastic games with a continuum of players," Journal of Mathematical Economics, Elsevier, vol. 39(7), pages 693-724, September.
    14. Hopenhayn, Hugo A & Prescott, Edward C, 1992. "Stochastic Monotonicity and Stationary Distributions for Dynamic Economies," Econometrica, Econometric Society, vol. 60(6), pages 1387-1406, November.
    15. Per Krusell & Anthony A. Smith & Jr., 1998. "Income and Wealth Heterogeneity in the Macroeconomy," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 867-896, October.
    16. Shie Mannor & John N. Tsitsiklis, 2005. "On the Empirical State-Action Frequencies in Markov Decision Processes Under General Policies," Mathematics of Operations Research, INFORMS, vol. 30(3), pages 545-561, August.
    17. János Flesch & Gijs Schoenmakers & Koos Vrieze, 2009. "Stochastic games on a product state space: the periodic case," International Journal of Game Theory, Springer;Game Theory Society, vol. 38(2), pages 263-289, June.
    18. Sabourian, Hamid, 1990. "Anonymous repeated games with a large number of players and random outcomes," Journal of Economic Theory, Elsevier, vol. 51(1), pages 92-110, June.
    19. Hopenhayn, Hugo A, 1992. "Entry, Exit, and Firm Dynamics in Long Run Equilibrium," Econometrica, Econometric Society, vol. 60(5), pages 1127-1150, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Piotr Więcek, 2020. "Discrete-Time Ergodic Mean-Field Games with Average Reward on Compact Spaces," Dynamic Games and Applications, Springer, vol. 10(1), pages 222-256, March.
    2. Piotr Więcek, 2017. "Total Reward Semi-Markov Mean-Field Games with Complementarity Properties," Dynamic Games and Applications, Springer, vol. 7(3), pages 507-529, September.
    3. Berkay Anahtarci & Can Deha Kariksiz & Naci Saldi, 2023. "Q-Learning in Regularized Mean-field Games," Dynamic Games and Applications, Springer, vol. 13(1), pages 89-117, March.
    4. Ilaria Brunetti & Yezekael Hayel & Eitan Altman, 2018. "State-Policy Dynamics in Evolutionary Games," Dynamic Games and Applications, Springer, vol. 8(1), pages 93-116, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jian Yang, 2017. "A link between sequential semi-anonymous nonatomic games and their large finite counterparts," International Journal of Game Theory, Springer;Game Theory Society, vol. 46(2), pages 383-433, May.
    2. Jian Yang, 2021. "Analysis of Markovian Competitive Situations Using Nonatomic Games," Dynamic Games and Applications, Springer, vol. 11(1), pages 184-216, March.
    3. Jian Yang, 2015. "Analysis of Markovian Competitive Situations using Nonatomic Games," Papers 1510.06813, arXiv.org, revised Apr 2017.
    4. Jian Yang, 2015. "A Link between Sequential Semi-anonymous Nonatomic Games and their Large Finite Counterparts," Papers 1510.06809, arXiv.org, revised Jun 2016.
    5. Sachin Adlakha & Ramesh Johari, 2013. "Mean Field Equilibrium in Dynamic Games with Strategic Complementarities," Operations Research, INFORMS, vol. 61(4), pages 971-989, August.
    6. Miao, Jianjun, 2006. "Competitive equilibria of economies with a continuum of consumers and aggregate shocks," Journal of Economic Theory, Elsevier, vol. 128(1), pages 274-298, May.
    7. Aaron Bodoh-Creed & Brent Hickman, 2016. "College Assignment as a Large Contest," Working Papers 2016-27, Becker Friedman Institute for Research In Economics.
    8. Adlakha, Sachin & Johari, Ramesh & Weintraub, Gabriel Y., 2015. "Equilibria of dynamic games with many players: Existence, approximation, and market structure," Journal of Economic Theory, Elsevier, vol. 156(C), pages 269-316.
    9. Bodoh-Creed, Aaron, 2013. "Efficiency and information aggregation in large uniform-price auctions," Journal of Economic Theory, Elsevier, vol. 148(6), pages 2436-2466.
    10. Krishnamurthy Iyer & Ramesh Johari & Mukund Sundararajan, 2014. "Mean Field Equilibria of Dynamic Auctions with Learning," Management Science, INFORMS, vol. 60(12), pages 2949-2970, December.
    11. Piotr Więcek, 2020. "Discrete-Time Ergodic Mean-Field Games with Average Reward on Compact Spaces," Dynamic Games and Applications, Springer, vol. 10(1), pages 222-256, March.
    12. Kalai, Ehud & Shmaya, Eran, 2018. "Large strategic dynamic interactions," Journal of Economic Theory, Elsevier, vol. 178(C), pages 59-81.
    13. Bodoh-Creed, Aaron L. & Hickman, Brent R., 2018. "College assignment as a large contest," Journal of Economic Theory, Elsevier, vol. 175(C), pages 88-126.
    14. Piotr Więcek, 2017. "Total Reward Semi-Markov Mean-Field Games with Complementarity Properties," Dynamic Games and Applications, Springer, vol. 7(3), pages 507-529, September.
    15. Light, Bar & Weintraub, Gabriel, 2018. "Mean Field Equilibrium: Uniqueness, Existence, and Comparative Statics," Research Papers 3731, Stanford University, Graduate School of Business.
    16. Balbus, Lukasz & Dziewulski, Pawel & Reffett, Kevin & Wozny, Lukasz, 2022. "Markov distributional equilibrium dynamics in games with complementarities and no aggregate risk," Theoretical Economics, Econometric Society, vol. 17(2), May.
    17. AMIR, Rabah, 2001. "Stochastic games in economics and related fields: an overview," LIDAM Discussion Papers CORE 2001060, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    18. Jian Yang & Yusen Xia & Xiangtong Qi & Yifeng Liu, 2014. "A nonatomic‐game model for timing clearance sales under competition," Naval Research Logistics (NRL), John Wiley & Sons, vol. 61(5), pages 365-385, August.
    19. Daniel Lacker & Kavita Ramanan, 2019. "Rare Nash Equilibria and the Price of Anarchy in Large Static Games," Mathematics of Operations Research, INFORMS, vol. 44(2), pages 400-422, May.
    20. Ren'e Aid & Matteo Basei & Giorgio Ferrari, 2023. "A Stationary Mean-Field Equilibrium Model of Irreversible Investment in a Two-Regime Economy," Papers 2305.00541, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joptap:v:166:y:2015:i:2:d:10.1007_s10957-014-0649-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.