IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v61y2013i4p971-989.html
   My bibliography  Save this article

Mean Field Equilibrium in Dynamic Games with Strategic Complementarities

Author

Listed:
  • Sachin Adlakha

    (Center for Mathematics of Information, California Institute of Technology, Pasadena, California 91125)

  • Ramesh Johari

    (Department of Management Science and Engineering, Stanford University, Stanford, California 94305)

Abstract

We study a class of stochastic dynamic games that exhibit strategic complementarities between players; formally, in the games we consider, the payoff of a player has increasing differences between her own state and the empirical distribution of the states of other players. Such games can be used to model a diverse set of applications, including network security models, recommender systems, and dynamic search in markets. Stochastic games are generally difficult to analyze, and these difficulties are only exacerbated when the number of players is large (as might be the case in the preceding examples).We consider an approximation methodology called mean field equilibrium to study these games. In such an equilibrium, each player reacts to only the long-run average state of other players. We find necessary conditions for the existence of a mean field equilibrium in such games. Furthermore, as a simple consequence of this existence theorem, we obtain several natural monotonicity properties. We show that there exist a “largest” and a “smallest” equilibrium among all those where the equilibrium strategy used by a player is nondecreasing, and we also show that players converge to each of these equilibria via natural myopic learning dynamics ; as we argue, these dynamics are more reasonable than the standard best-response dynamics. We also provide sensitivity results, where we quantify how the equilibria of such games move in response to changes in parameters of the game (for example, the introduction of incentives to players).

Suggested Citation

  • Sachin Adlakha & Ramesh Johari, 2013. "Mean Field Equilibrium in Dynamic Games with Strategic Complementarities," Operations Research, INFORMS, vol. 61(4), pages 971-989, August.
  • Handle: RePEc:inm:oropre:v:61:y:2013:i:4:p:971-989
    DOI: 10.1287/opre.2013.1192
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.2013.1192
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.2013.1192?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Darrell Duffie & Semyon Malamud & Gustavo Manso, 2009. "Information Percolation With Equilibrium Search Dynamics," Econometrica, Econometric Society, vol. 77(5), pages 1513-1574, September.
    2. Doraszelski, Ulrich & Pakes, Ariel, 2007. "A Framework for Applied Dynamic Analysis in IO," Handbook of Industrial Organization, in: Mark Armstrong & Robert Porter (ed.), Handbook of Industrial Organization, edition 1, volume 3, chapter 30, pages 1887-1966, Elsevier.
    3. Hopenhayn, Hugo A & Prescott, Edward C, 1992. "Stochastic Monotonicity and Stationary Distributions for Dynamic Economies," Econometrica, Econometric Society, vol. 60(6), pages 1387-1406, November.
    4. Rabah Amir, 2002. "Complementarity and Diagonal Dominance in Discounted Stochastic Games," Annals of Operations Research, Springer, vol. 114(1), pages 39-56, August.
    5. Bergin, J & Bernhardt, D, 1995. "Anonymous Sequential Games: Existence and Characterization of Equilibria," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 5(3), pages 461-489, May.
    6. Gabriel Y. Weintraub & C. Lanier Benkard & Benjamin Van Roy, 2008. "Markov Perfect Industry Dynamics With Many Firms," Econometrica, Econometric Society, vol. 76(6), pages 1375-1411, November.
    7. Jovanovic, Boyan & Rosenthal, Robert W., 1988. "Anonymous sequential games," Journal of Mathematical Economics, Elsevier, vol. 17(1), pages 77-87, February.
    8. Federico Echenique & Aaron Edlin, 2001. "Mixed Equilibria in Games of Strategic Complements are Unstable," Levine's Working Paper Archive 563824000000000161, David K. Levine.
    9. Zhou Lin, 1994. "The Set of Nash Equilibria of a Supermodular Game Is a Complete Lattice," Games and Economic Behavior, Elsevier, vol. 7(2), pages 295-300, September.
    10. Pakes, Ariel & McGuire, Paul, 2001. "Stochastic Algorithms, Symmetric Markov Perfect Equilibrium, and the 'Curse' of Dimensionality," Econometrica, Econometric Society, vol. 69(5), pages 1261-1281, September.
    11. James E. Smith & Kevin F. McCardle, 2002. "Structural Properties of Stochastic Dynamic Programs," Operations Research, INFORMS, vol. 50(5), pages 796-809, October.
    12. Vives, Xavier, 1990. "Nash equilibrium with strategic complementarities," Journal of Mathematical Economics, Elsevier, vol. 19(3), pages 305-321.
    13. Kunreuther, Howard & Heal, Geoffrey, 2003. "Interdependent Security," Journal of Risk and Uncertainty, Springer, vol. 26(2-3), pages 231-249, March-May.
    14. Diamond, Peter A, 1982. "Aggregate Demand Management in Search Equilibrium," Journal of Political Economy, University of Chicago Press, vol. 90(5), pages 881-894, October.
    15. Xavier Vives, 2009. "Strategic complementarity in multi-stage games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 40(1), pages 151-171, July.
    16. Minyi Huang & Roland P. Malhamé & Peter E. Caines, 2005. "Nash Equilibria for Large-Population Linear Stochastic Systems of Weakly Coupled Agents," Springer Books, in: El Kébir Boukas & Roland P. Malhamé (ed.), Analysis, Control and Optimization of Complex Dynamic Systems, chapter 0, pages 215-252, Springer.
    17. Horst, Ulrich, 2005. "Stationary equilibria in discounted stochastic games with weakly interacting players," Games and Economic Behavior, Elsevier, vol. 51(1), pages 83-108, April.
    18. Federico Echenique, 2003. "Mixed equilibria in games of strategic complementarities," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 22(1), pages 33-44, August.
    19. Dutta, Prajit K. & Majumdar, Mukul K. & Sundaram, Rangarajan K., 1994. "Parametric continuity in dynamic programming problems," Journal of Economic Dynamics and Control, Elsevier, vol. 18(6), pages 1069-1092, November.
    20. Milgrom, Paul & Roberts, John, 1990. "Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities," Econometrica, Econometric Society, vol. 58(6), pages 1255-1277, November.
    21. Terry L. Friesz & David Bernstein & Tony E. Smith & Roger L. Tobin & B. W. Wie, 1993. "A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem," Operations Research, INFORMS, vol. 41(1), pages 179-191, February.
    22. Curtat, Laurent O., 1996. "Markov Equilibria of Stochastic Games with Complementarities," Games and Economic Behavior, Elsevier, vol. 17(2), pages 177-199, December.
    23. Hopenhayn, Hugo A, 1992. "Entry, Exit, and Firm Dynamics in Long Run Equilibrium," Econometrica, Econometric Society, vol. 60(5), pages 1127-1150, September.
    24. Acemoglu, Daron & Jensen, Martin Kaae, 2013. "Aggregate comparative statics," Games and Economic Behavior, Elsevier, vol. 81(C), pages 27-49.
    25. Andrzej Nowak, 2007. "On stochastic games in economics," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 66(3), pages 513-530, December.
    26. Chakrabarti, Subir K., 2003. "Pure strategy Markov equilibrium in stochastic games with a continuum of players," Journal of Mathematical Economics, Elsevier, vol. 39(7), pages 693-724, September.
    27. Weintraub, Gabriel Y. & Benkard, C. Lanier & Van Roy, Benjamin, 2011. "Industry dynamics: Foundations for models with an infinite number of firms," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1965-1994, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Piotr Więcek, 2020. "Discrete-Time Ergodic Mean-Field Games with Average Reward on Compact Spaces," Dynamic Games and Applications, Springer, vol. 10(1), pages 222-256, March.
    2. Bar Light, 2019. "General equilibrium in a heterogeneous-agent incomplete-market economy with many consumption goods and a risk-free bond," Papers 1906.06810, arXiv.org, revised Mar 2021.
    3. Light, Bar & Weintraub, Gabriel, 2018. "Mean Field Equilibrium: Uniqueness, Existence, and Comparative Statics," Research Papers 3731, Stanford University, Graduate School of Business.
    4. Bar Light, 2021. "Stochastic Comparative Statics in Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 46(2), pages 797-810, May.
    5. Botao Yang & Sha Yang & Shantanu Dutta, 2022. "Platform Service Offering to Business Customers: Strategic Considerations in Engendering Seller Use of Marketing Tools," Marketing Science, INFORMS, vol. 41(2), pages 361-379, March.
    6. Dianetti, Jodi & Ferrari, Giorgio & Fischer, Markus & Nendel, Max, 2019. "Submodular Mean Field Games. Existence and Approximation of Solutions," Center for Mathematical Economics Working Papers 621, Center for Mathematical Economics, Bielefeld University.
    7. Daniel Lacker & Kavita Ramanan, 2019. "Rare Nash Equilibria and the Price of Anarchy in Large Static Games," Mathematics of Operations Research, INFORMS, vol. 44(2), pages 400-422, May.
    8. Régis Chenavaz & Corina Paraschiv & Gabriel Turinici, 2021. "Dynamic Pricing of New Products in Competitive Markets: A Mean-Field Game Approach," Dynamic Games and Applications, Springer, vol. 11(3), pages 463-490, September.
    9. Harsha Honnappa & Rahul Jain, 2015. "Strategic Arrivals into Queueing Networks: The Network Concert Queueing Game," Operations Research, INFORMS, vol. 63(1), pages 247-259, February.
    10. Jian Yang & Yusen Xia & Xiangtong Qi & Yifeng Liu, 2014. "A nonatomic‐game model for timing clearance sales under competition," Naval Research Logistics (NRL), John Wiley & Sons, vol. 61(5), pages 365-385, August.
    11. Rene Carmona & Francois Delarue & Daniel Lacker, 2016. "Mean field games of timing and models for bank runs," Papers 1606.03709, arXiv.org, revised Jan 2017.
    12. Krishnamurthy Iyer & Ramesh Johari & Mukund Sundararajan, 2014. "Mean Field Equilibria of Dynamic Auctions with Learning," Management Science, INFORMS, vol. 60(12), pages 2949-2970, December.
    13. Manxi Wu & Saurabh Amin & Asuman Ozdaglar, 2021. "Multi-agent Bayesian Learning with Best Response Dynamics: Convergence and Stability," Papers 2109.00719, arXiv.org.
    14. Piotr Więcek, 2017. "Total Reward Semi-Markov Mean-Field Games with Complementarity Properties," Dynamic Games and Applications, Springer, vol. 7(3), pages 507-529, September.
    15. Piotr Więcek & Eitan Altman, 2015. "Stationary Anonymous Sequential Games with Undiscounted Rewards," Journal of Optimization Theory and Applications, Springer, vol. 166(2), pages 686-710, August.
    16. Yunke Mai & Bin Hu & Saša Pekeč, 2023. "Courteous or Crude? Managing User Conduct to Improve On-Demand Service Platform Performance," Management Science, INFORMS, vol. 69(2), pages 996-1016, February.
    17. Jian Yang, 2017. "A link between sequential semi-anonymous nonatomic games and their large finite counterparts," International Journal of Game Theory, Springer;Game Theory Society, vol. 46(2), pages 383-433, May.
    18. Stefanny Ramirez & Dario Bauso, 2023. "Dynamic Games with Strategic Complements and Large Number of Players," Journal of Optimization Theory and Applications, Springer, vol. 197(1), pages 1-21, April.
    19. Mintz, Yonatan & Aswani, Anil & Kaminsky, Philip & Flowers, Elena & Fukuoka, Yoshimi, 2023. "Behavioral analytics for myopic agents," European Journal of Operational Research, Elsevier, vol. 310(2), pages 793-811.
    20. Dario Bauso & Raffaele Pesenti & Marco Tolotti, 2016. "Opinion Dynamics and Stubbornness Via Multi-Population Mean-Field Games," Journal of Optimization Theory and Applications, Springer, vol. 170(1), pages 266-293, July.
    21. Jian Yang, 2021. "Analysis of Markovian Competitive Situations Using Nonatomic Games," Dynamic Games and Applications, Springer, vol. 11(1), pages 184-216, March.
    22. Bar Light, 2019. "Stochastic Comparative Statics in Markov Decision Processes," Papers 1904.05481, arXiv.org, revised Jan 2020.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adlakha, Sachin & Johari, Ramesh & Weintraub, Gabriel Y., 2015. "Equilibria of dynamic games with many players: Existence, approximation, and market structure," Journal of Economic Theory, Elsevier, vol. 156(C), pages 269-316.
    2. Piotr Więcek, 2017. "Total Reward Semi-Markov Mean-Field Games with Complementarity Properties," Dynamic Games and Applications, Springer, vol. 7(3), pages 507-529, September.
    3. Light, Bar & Weintraub, Gabriel, 2018. "Mean Field Equilibrium: Uniqueness, Existence, and Comparative Statics," Research Papers 3731, Stanford University, Graduate School of Business.
    4. Piotr Więcek & Eitan Altman, 2015. "Stationary Anonymous Sequential Games with Undiscounted Rewards," Journal of Optimization Theory and Applications, Springer, vol. 166(2), pages 686-710, August.
    5. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    6. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    7. John Duggan, 2011. "Noisy Stochastic Games," RCER Working Papers 562, University of Rochester - Center for Economic Research (RCER).
    8. Mirman, Leonard J. & Morand, Olivier F. & Reffett, Kevin L., 2008. "A qualitative approach to Markovian equilibrium in infinite horizon economies with capital," Journal of Economic Theory, Elsevier, vol. 139(1), pages 75-98, March.
    9. Rabah Amir, 2005. "Supermodularity and Complementarity in Economics: An Elementary Survey," Southern Economic Journal, John Wiley & Sons, vol. 71(3), pages 636-660, January.
    10. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov‐perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243, June.
    11. Cao, Zhigang & Chen, Xujin & Qin, Cheng-Zhong & Wang, Changjun & Yang, Xiaoguang, 2018. "Embedding games with strategic complements into games with strategic substitutes," Journal of Mathematical Economics, Elsevier, vol. 78(C), pages 45-51.
    12. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2013. "Markov Stationary Equilibria in Stochastic Supermodular Games with Imperfect Private and Public Information," Dynamic Games and Applications, Springer, vol. 3(2), pages 187-206, June.
    13. Rabah Amir, 2018. "Special issue: supermodularity and monotone methods in economics," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(3), pages 547-556, October.
    14. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    15. Krishnamurthy Iyer & Ramesh Johari & Mukund Sundararajan, 2014. "Mean Field Equilibria of Dynamic Auctions with Learning," Management Science, INFORMS, vol. 60(12), pages 2949-2970, December.
    16. Anna Jaśkiewicz & Andrzej S. Nowak, 2016. "Stationary Almost Markov Perfect Equilibria in Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 41(2), pages 430-441, May.
    17. Jian Yang, 2017. "A link between sequential semi-anonymous nonatomic games and their large finite counterparts," International Journal of Game Theory, Springer;Game Theory Society, vol. 46(2), pages 383-433, May.
    18. Ulrich Doraszelski & Mark Satterthwaite, 2003. "Foundations of Markov-Perfect Industry Dynamics. Existence, Purification, and Multiplicity," Discussion Papers 1383, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    19. Duggan, John & Kalandrakis, Tasos, 2012. "Dynamic legislative policy making," Journal of Economic Theory, Elsevier, vol. 147(5), pages 1653-1688.
    20. Jian Yang, 2021. "Analysis of Markovian Competitive Situations Using Nonatomic Games," Dynamic Games and Applications, Springer, vol. 11(1), pages 184-216, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:61:y:2013:i:4:p:971-989. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.