IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/1195.html
   My bibliography  Save this paper

NISOCSol an algorithm for approximating Markovian equilibria in dynamic games with coupled-constraints

Author

Listed:
  • Krawczyk, Jacek
  • Azzato, Jeffrey

Abstract

In this report, we outline a method for approximating a Markovian (or feedback-Nash) equilibrium of a dynamic game, possibly subject to coupled-constraints. We treat such a game as a "multiple" optimal control problem. A method for approximating a solution to a given optimal control problem via backward induction on Markov chains was developed in Krawczyk (2006). A Markovian equilibrium may be obtained numerically by adapting this backward induction approach to a stage Nikaido-Isoda function (described in Krawczyk & Zuccollo (2006)).

Suggested Citation

  • Krawczyk, Jacek & Azzato, Jeffrey, 2006. "NISOCSol an algorithm for approximating Markovian equilibria in dynamic games with coupled-constraints," MPRA Paper 1195, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:1195
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/1195/1/MPRA_paper_1195.pdf
    File Function: original version
    Download Restriction: no
    File URL: https://mpra.ub.uni-muenchen.de/10235/1/MPRA_paper_10235.pdf
    File Function: revised version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alistair Windsor & Jacek B. Krawczyk, 1997. "A Matlab Package for Approximating the Solution to a Continuous- Time Stochastic Optimal Control Problem," Computational Economics 9710002, University Library of Munich, Germany.
    2. J. B. Krawczyk & M. Tidball, 2006. "A Discrete-Time Dynamic Game of Seasonal Water Allocation," Journal of Optimization Theory and Applications, Springer, vol. 128(2), pages 411-429, February.
    3. Azzato, Jeffrey & Krawczyk, Jacek, 2006. "SOCSol4L An improved MATLAB package for approximating the solution to a continuous-time stochastic optimal control problem," MPRA Paper 1179, University Library of Munich, Germany.
    4. Steffan Berridge & Jacek Krawczyk, "undated". "Relaxation Algorithms in Finding Nash Equilibrium," Computing in Economics and Finance 1997 159, Society for Computational Economics.
    5. Krawczyk, Jacek & Zuccollo, James, 2006. "NIRA-3: An improved MATLAB package for finding Nash equilibria in infinite games," MPRA Paper 1119, University Library of Munich, Germany.
    6. Krawczyk, Jacek B., 2005. "Coupled constraint Nash equilibria in environmental games," Resource and Energy Economics, Elsevier, vol. 27(2), pages 157-181, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Contreras, Javier & Krawczyk, Jacek & Zuccollo, James, 2008. "The invisible polluter: Can regulators save consumer surplus?," MPRA Paper 9890, University Library of Munich, Germany.
    2. Contreras, Javier & Krawczyk, Jacek & Zuccollo, James, 2008. "Can planners control competitive generators?," MPRA Paper 10395, University Library of Munich, Germany.
    3. Boucekkine, Raouf & Krawczyk, Jacek B. & Vallée, Thomas, 2010. "Towards an understanding of tradeoffs between regional wealth, tightness of a common environmental constraint and the sharing rules," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1813-1835, September.
    4. Flam, Sjur & Ruszczynski, A., 2006. "Computing Normalized Equilibria in Convex-Concave Games," Working Papers 2006:9, Lund University, Department of Economics.
    5. Krawczyk, Jacek & Zuccollo, James, 2006. "NIRA-3: An improved MATLAB package for finding Nash equilibria in infinite games," MPRA Paper 1119, University Library of Munich, Germany.
    6. Bolei Di & Andrew Lamperski, 2022. "Newton’s Method, Bellman Recursion and Differential Dynamic Programming for Unconstrained Nonlinear Dynamic Games," Dynamic Games and Applications, Springer, vol. 12(2), pages 394-442, June.
    7. J. Contreras & J. B. Krawczyk & J. Zuccollo, 2016. "Economics of collective monitoring: a study of environmentally constrained electricity generators," Computational Management Science, Springer, vol. 13(3), pages 349-369, July.
    8. Francisco Facchinei & Christian Kanzow, 2010. "Generalized Nash Equilibrium Problems," Annals of Operations Research, Springer, vol. 175(1), pages 177-211, March.
    9. Jacek B. Krawczyk & Mabel Tidball, 2016. "Economic Problems with Constraints: How Efficiency Relates to Equilibrium," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 18(04), pages 1-19, December.
    10. Foster, Jarred & Krawczyk, Jacek B, 2013. "Sensitivity of cautious-relaxed investment policies to target variation," Working Paper Series 2972, Victoria University of Wellington, School of Economics and Finance.
    11. A. Heusinger & C. Kanzow, 2009. "Relaxation Methods for Generalized Nash Equilibrium Problems with Inexact Line Search," Journal of Optimization Theory and Applications, Springer, vol. 143(1), pages 159-183, October.
    12. K. Kubota & M. Fukushima, 2010. "Gap Function Approach to the Generalized Nash Equilibrium Problem," Journal of Optimization Theory and Applications, Springer, vol. 144(3), pages 511-531, March.
    13. Gürkan, G. & Pang, J.S., 2009. "Approximizations of Nash equilibria," Other publications TiSEM de211d31-d77d-4211-9ca8-2, Tilburg University, School of Economics and Management.
    14. Elnaz Kanani Kuchesfehani & Georges Zaccour, 2015. "S-adapted Equilibria in Games Played Over Event Trees with Coupled Constraints," Journal of Optimization Theory and Applications, Springer, vol. 166(2), pages 644-658, August.
    15. Krawczyk, Jacek B & Townsend, Wilbur, 2014. "NIRA-GUI: A matlab application which solves for couple-constraint nash equibria from a symbolic specification," Working Paper Series 3414, Victoria University of Wellington, School of Economics and Finance.
    16. Foster, Jarred, 2011. "Target variation in a loss avoiding pension fund problem," MPRA Paper 36177, University Library of Munich, Germany.
    17. Francisco Facchinei & Jong-Shi Pang & Gesualdo Scutari, 2014. "Non-cooperative games with minmax objectives," Computational Optimization and Applications, Springer, vol. 59(1), pages 85-112, October.
    18. Axel Dreves & Christian Kanzow, 2011. "Nonsmooth optimization reformulations characterizing all solutions of jointly convex generalized Nash equilibrium problems," Computational Optimization and Applications, Springer, vol. 50(1), pages 23-48, September.
    19. Tang, Rui & Li, Hangxin & Wang, Shengwei, 2019. "A game theory-based decentralized control strategy for power demand management of building cluster using thermal mass and energy storage," Applied Energy, Elsevier, vol. 242(C), pages 809-820.
    20. Nadja Harms & Tim Hoheisel & Christian Kanzow, 2015. "On a Smooth Dual Gap Function for a Class of Player Convex Generalized Nash Equilibrium Problems," Journal of Optimization Theory and Applications, Springer, vol. 166(2), pages 659-685, August.

    More about this item

    Keywords

    Computational techniques; Noncooperative games; Econometric software; Taxation; Water; Climate; Dynamic programming; Dynamic games; Applications of game theory; Environmental economics; Computational economics; Nikaido-Isoda function; Approximating Markov decision chains;
    All these keywords.

    JEL classification:

    • C87 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Econometric Software
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • Q25 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Renewable Resources and Conservation - - - Water
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • E62 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - Fiscal Policy; Modern Monetary Theory

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:1195. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.