IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i4p321-d494549.html
   My bibliography  Save this article

Analytical Method for Mechanism Design in Partially Observable Markov Games

Author

Listed:
  • Julio B. Clempner

    (Escuela Superior de Física y Matemáticas, Instituto Politécnico Nacional, School of Physics and Mathematics, National Polytechnic Institute, Edificio 9 U.P. Adolfo Lopez Mateos, Col. San Pedro Zacatenco, 07730 Mexico City, Mexico)

  • Alexander S. Poznyak

    (Center for Research and Advanced Studies Av. IPN 2508, Department of Control Automatics, Col. San Pedro Zacatenco, 07360 Mexico City, Mexico)

Abstract

A theme that become common knowledge of the literature is the difficulty of developing a mechanism that is compatible with individual incentives that simultaneously result in efficient decisions that maximize the total reward. In this paper, we suggest an analytical method for computing a mechanism design. This problem is explored in the context of a framework, in which the players follow an average utility in a non-cooperative Markov game with incomplete state information. All of the Nash equilibria are approximated in a sequential process. We describe a method for the derivative of the player’s equilibrium that instruments the design of the mechanism. In addition, it showed the convergence and rate of convergence of the proposed method. For computing the mechanism, we consider an extension of the Markov model for which it is introduced a new variable that represents the product of the mechanism design and the joint strategy. We derive formulas to recover the variables of interest: mechanisms, strategy, and distribution vector. The mechanism design and equilibrium strategies computation differ from those in previous literature. A numerical example presents the usefulness and effectiveness of the proposed method.

Suggested Citation

  • Julio B. Clempner & Alexander S. Poznyak, 2021. "Analytical Method for Mechanism Design in Partially Observable Markov Games," Mathematics, MDPI, vol. 9(4), pages 1-15, February.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:4:p:321-:d:494549
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/4/321/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/4/321/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Escobar, Juan F. & Llanes, Gastón, 2018. "Cooperation dynamics in repeated games of adverse selection," Journal of Economic Theory, Elsevier, vol. 176(C), pages 408-443.
    2. B. Douglas Bernheim & Erik Madsen, 2017. "Price Cutting and Business Stealing in Imperfect Cartels," American Economic Review, American Economic Association, vol. 107(2), pages 387-424, February.
    3. Johannes Hörner & Satoru Takahashi & Nicolas Vieille, 2015. "Truthful Equilibria in Dynamic Bayesian Games," Econometrica, Econometric Society, vol. 83(5), pages 1795-1848, September.
    4. Susan Athey & Kyle Bagwell, 2008. "Collusion With Persistent Cost Shocks," Econometrica, Econometric Society, vol. 76(3), pages 493-540, May.
    5. Dirk Bergemann & Juuso Välimäki, 2019. "Dynamic Mechanism Design: An Introduction," Journal of Economic Literature, American Economic Association, vol. 57(2), pages 235-274, June.
    6. William Vickrey, 1961. "Counterspeculation, Auctions, And Competitive Sealed Tenders," Journal of Finance, American Finance Association, vol. 16(1), pages 8-37, March.
    7. John C. Harsanyi, 1967. "Games with Incomplete Information Played by "Bayesian" Players, I-III Part I. The Basic Model," Management Science, INFORMS, vol. 14(3), pages 159-182, November.
    8. d'Aspremont, Claude & Gerard-Varet, Louis-Andre, 1979. "Incentives and incomplete information," Journal of Public Economics, Elsevier, vol. 11(1), pages 25-45, February.
    9. William P. Rogerson, 1992. "Contractual Solutions to the Hold-Up Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 59(4), pages 777-793.
    10. George J. Mailath & Andrew Postlewaite, 1990. "Asymmetric Information Bargaining Problems with Many Agents," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 57(3), pages 351-367.
    11. David Rahman, 2014. "The Power of Communication," American Economic Review, American Economic Association, vol. 104(11), pages 3737-3751, November.
    12. Anthony Downs, 1957. "An Economic Theory of Political Action in a Democracy," Journal of Political Economy, University of Chicago Press, vol. 65(2), pages 135-135.
    13. Julio B. Clempner, 2018. "On Lyapunov Game Theory Equilibrium: Static and Dynamic Approaches," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 20(02), pages 1-14, June.
    14. Julio B. Clempner & Alexander S. Poznyak, 2020. "Finding the Strong Nash Equilibrium: Computation, Existence and Characterization for Markov Games," Journal of Optimization Theory and Applications, Springer, vol. 186(3), pages 1029-1052, September.
    15. Groves, Theodore, 1973. "Incentives in Teams," Econometrica, Econometric Society, vol. 41(4), pages 617-631, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Julio B. Clempner, 2023. "A Dynamic Mechanism Design for Controllable and Ergodic Markov Games," Computational Economics, Springer;Society for Computational Economics, vol. 61(3), pages 1151-1171, March.
    2. Zheng Zhang & Yingtong Wang & Qingchun Meng & Qiang Han, 2022. "Impact of Third-Degree Price Discrimination on Welfare under the Asymmetric Price Game," Mathematics, MDPI, vol. 10(8), pages 1-16, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Jehiel & Laurent Lamy, 2018. "A Mechanism Design Approach to the Tiebout Hypothesis," Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 735-760.
    2. Chan, Jimmy & Zhang, Wenzhang, 2015. "Collusion enforcement with private information and private monitoring," Journal of Economic Theory, Elsevier, vol. 157(C), pages 188-211.
    3. Lau, Stephanie, 2011. "Investment incentives in bilateral trading," Games and Economic Behavior, Elsevier, vol. 73(2), pages 538-552.
    4. Matsushima, Hitoshi & Noda, Shunya, 2023. "Mechanism design with general ex-ante investments," Journal of Mathematical Economics, Elsevier, vol. 106(C).
    5. Ledyard, John O., "undated". "Public Goods: A Survey of Experimental Research," Working Papers 861, California Institute of Technology, Division of the Humanities and Social Sciences.
    6. Escobar, Juan F. & Llanes, Gastón, 2018. "Cooperation dynamics in repeated games of adverse selection," Journal of Economic Theory, Elsevier, vol. 176(C), pages 408-443.
    7. Hitoshi Matsushima & Shunya Noda, 2019. "Mechanism Design with General Ex-Ante Investments (Revised version of F415 )," CARF F-Series CARF-F-464, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    8. Vijay Krishna & Motty Perry, 1997. "Efficient Mechanism Design," Game Theory and Information 9703010, University Library of Munich, Germany, revised 28 Apr 1998.
    9. Goeree, Jacob K. & Zhang, Jingjing, 2017. "One man, one bid," Games and Economic Behavior, Elsevier, vol. 101(C), pages 151-171.
    10. He, Wei & Li, Jiangtao, 2016. "Efficient dynamic mechanisms with interdependent valuations," Games and Economic Behavior, Elsevier, vol. 97(C), pages 166-173.
    11. Laffont, Jean-Jacques & Martimort, David, 2005. "The design of transnational public good mechanisms for developing countries," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 159-196, February.
    12. d'Aspremont, Claude & Cremer, Jacques & Gerard-Varet, Louis-Andre, 2004. "Balanced Bayesian mechanisms," Journal of Economic Theory, Elsevier, vol. 115(2), pages 385-396, April.
    13. Takashi Kunimoto & Cuiling Zhang, 2021. "On incentive compatible, individually rational public good provision mechanisms," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 57(2), pages 431-468, August.
    14. Corchón, Luis C., 2008. "The theory of implementation : what did we learn?," UC3M Working papers. Economics we081207, Universidad Carlos III de Madrid. Departamento de Economía.
    15. M. Yenmez, 2015. "Incentive compatible market design with applications," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(3), pages 543-569, August.
    16. Bierbrauer, Felix & Netzer, Nick, 2016. "Mechanism design and intentions," Journal of Economic Theory, Elsevier, vol. 163(C), pages 557-603.
    17. Claude d'Aspremont & Jacques Crémer & Louis-André Gérard-Varet, 2003. "Correlation, independence, and Bayesian incentives," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 21(2), pages 281-310, October.
    18. Jackson, Matthew & Moulin, Hervé, 1992. "Implementing a public project and distributing its cost," Journal of Economic Theory, Elsevier, vol. 57(1), pages 125-140.
    19. Miller, Nolan H. & Pratt, John W. & Zeckhauser, Richard J. & Johnson, Scott, 2007. "Mechanism design with multidimensional, continuous types and interdependent valuations," Journal of Economic Theory, Elsevier, vol. 136(1), pages 476-496, September.
    20. Pérez-Nievas, Mikel, 2000. "Interim efficient allocation mechanisms," UC3M Working papers. Economics 7220, Universidad Carlos III de Madrid. Departamento de Economía.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:4:p:321-:d:494549. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.