IDEAS home Printed from https://ideas.repec.org/a/spr/dyngam/v13y2023i1d10.1007_s13235-022-00469-5.html
   My bibliography  Save this article

Robust Networked Multiagent Optimization: Designing Agents to Repair Their Own Utility Functions

Author

Listed:
  • Philip N. Brown

    (University of Colorado Colorado Springs)

  • Joshua H. Seaton

    (University of Colorado Colorado Springs)

  • Jason R. Marden

    (University of California Santa Barbara)

Abstract

We study settings in which autonomous agents are designed to optimize a given system-level objective. In typical approaches to this problem, each agent is endowed with a decision-making rule that specifies the agent’s choice as a function of relevant information pertaining to the system’s state. The choices of other agents in the system comprise a key component of this information. This paper considers a scenario in which the designed decision-making rules are not implementable in the realized system due to discrepancies between the anticipated and realized information available to the agents. The focus of this paper is to develop methods by which the agents can preserve system-level performance guarantees in these unanticipated scenarios through local and independent redesigns of their own decision-making rules. First, we show a general impossibility result which states that in general settings, there are no local redesign methodologies that can offer any preservation of system-level performance guarantees, even when the affected agents satisfy an inconsequentiality criterion. However, we then show that when system-level objectives are submodular, local redesigns of utility functions do exist which allow nominal performance guarantees to degrade gracefully as information is denied to agents. That is, in these submodular settings, agents can adapt to informational inconsistencies independently without incurring much loss in terms of system-level performance.

Suggested Citation

  • Philip N. Brown & Joshua H. Seaton & Jason R. Marden, 2023. "Robust Networked Multiagent Optimization: Designing Agents to Repair Their Own Utility Functions," Dynamic Games and Applications, Springer, vol. 13(1), pages 187-207, March.
  • Handle: RePEc:spr:dyngam:v:13:y:2023:i:1:d:10.1007_s13235-022-00469-5
    DOI: 10.1007/s13235-022-00469-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13235-022-00469-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s13235-022-00469-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Blume Lawrence E., 1995. "The Statistical Mechanics of Best-Response Strategy Revision," Games and Economic Behavior, Elsevier, vol. 11(2), pages 111-145, November.
    2. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    3. Young, H Peyton, 1993. "The Evolution of Conventions," Econometrica, Econometric Society, vol. 61(1), pages 57-84, January.
    4. Blume Lawrence E., 1993. "The Statistical Mechanics of Strategic Interaction," Games and Economic Behavior, Elsevier, vol. 5(3), pages 387-424, July.
    5. Pradelski, Bary S.R. & Young, H. Peyton, 2012. "Learning efficient Nash equilibria in distributed systems," Games and Economic Behavior, Elsevier, vol. 75(2), pages 882-897.
    6. Alós-Ferrer, Carlos & Netzer, Nick, 2010. "The logit-response dynamics," Games and Economic Behavior, Elsevier, vol. 68(2), pages 413-427, March.
    7. Jasper Jong & Marc Uetz, 2020. "The quality of equilibria for set packing and throughput scheduling games," International Journal of Game Theory, Springer;Game Theory Society, vol. 49(1), pages 321-344, March.
    8. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    9. Candogan, Ozan & Ozdaglar, Asuman & Parrilo, Pablo A., 2013. "Dynamics in near-potential games," Games and Economic Behavior, Elsevier, vol. 82(C), pages 66-90.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simon Weidenholzer, 2010. "Coordination Games and Local Interactions: A Survey of the Game Theoretic Literature," Games, MDPI, vol. 1(4), pages 1-35, November.
    2. Marden, Jason R. & Shamma, Jeff S., 2015. "Game Theory and Distributed Control****Supported AFOSR/MURI projects #FA9550-09-1-0538 and #FA9530-12-1-0359 and ONR projects #N00014-09-1-0751 and #N0014-12-1-0643," Handbook of Game Theory with Economic Applications,, Elsevier.
    3. Edward Cartwright, 2002. "Learning to play approximate Nash equilibria in games with many players," Levine's Working Paper Archive 506439000000000070, David K. Levine.
    4. Candogan, Ozan & Ozdaglar, Asuman & Parrilo, Pablo A., 2013. "Dynamics in near-potential games," Games and Economic Behavior, Elsevier, vol. 82(C), pages 66-90.
    5. Alós-Ferrer, Carlos & Weidenholzer, Simon, 2008. "Contagion and efficiency," Journal of Economic Theory, Elsevier, vol. 143(1), pages 251-274, November.
    6. Ge Jiang & Simon Weidenholzer, 2017. "Local interactions under switching costs," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 64(3), pages 571-588, October.
    7. Staudigl, Mathias, 2012. "Stochastic stability in asymmetric binary choice coordination games," Games and Economic Behavior, Elsevier, vol. 75(1), pages 372-401.
    8. Edward Cartwright, 2004. "Contagion and the Emergence of Convention in Small Worlds," Studies in Economics 0414, School of Economics, University of Kent.
    9. Carlos Alós-Ferrer & Georg Kirchsteiger & Markus Walzl, 2010. "On the Evolution of Market Institutions: The Platform Design Paradox," Economic Journal, Royal Economic Society, vol. 120(543), pages 215-243, March.
    10. Oyama, Daisuke & Takahashi, Satoru, 2015. "Contagion and uninvadability in local interaction games: The bilingual game and general supermodular games," Journal of Economic Theory, Elsevier, vol. 157(C), pages 100-127.
    11. Lim, Wooyoung & Neary, Philip R., 2016. "An experimental investigation of stochastic adjustment dynamics," Games and Economic Behavior, Elsevier, vol. 100(C), pages 208-219.
    12. Carlos Alós-Ferrer & Nick Netzer, 2015. "Robust stochastic stability," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 58(1), pages 31-57, January.
    13. Cartwright, Edward, 2003. "Imitation and the Emergence of Nash Equilibrium Play in Games with Many Players," The Warwick Economics Research Paper Series (TWERPS) 684, University of Warwick, Department of Economics.
    14. Hofbauer,J. & Sandholm,W.H., 2001. "Evolution and learning in games with randomly disturbed payoffs," Working papers 5, Wisconsin Madison - Social Systems.
    15. Alós-Ferrer, Carlos & Buckenmaier, Johannes, 2017. "Trader matching and the selection of market institutions," Journal of Mathematical Economics, Elsevier, vol. 69(C), pages 118-127.
    16. Hofbauer,J. & Sandholm,W.H., 2001. "Evolution and learning in games with randomly disturbed payoffs," Working papers 5, Wisconsin Madison - Social Systems.
    17. Carlos Alós-Ferrer & Georg Kirchsteiger, 2015. "Learning and market clearing: theory and experiments," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 60(2), pages 203-241, October.
    18. Matros, Alexander & Moser, Scott, 2015. "Coordination in a changing environment," Journal of Economic Behavior & Organization, Elsevier, vol. 112(C), pages 64-84.
    19. Jakub Bielawski & Thiparat Chotibut & Fryderyk Falniowski & Michal Misiurewicz & Georgios Piliouras, 2022. "Unpredictable dynamics in congestion games: memory loss can prevent chaos," Papers 2201.10992, arXiv.org, revised Jan 2022.
    20. Neary, Philip R., 2012. "Competing conventions," Games and Economic Behavior, Elsevier, vol. 76(1), pages 301-328.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:dyngam:v:13:y:2023:i:1:d:10.1007_s13235-022-00469-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.