IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1909.03574.html
   My bibliography  Save this paper

A fixed-point policy-iteration-type algorithm for symmetric nonzero-sum stochastic impulse control games

Author

Listed:
  • Diego Zabaljauregui

Abstract

Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has hindered their proliferation. Semi-analytical approaches make strong assumptions pertaining to very particular cases. To the author's best knowledge, the only numerical method in the literature is the heuristic one we put forward to solve an underlying system of quasi-variational inequalities. Focusing on symmetric games, this paper presents a simpler, more precise and efficient fixed-point policy-iteration-type algorithm which removes the strong dependence on the initial guess and the relaxation scheme of the previous method. A rigorous convergence analysis is undertaken with natural assumptions on the players strategies, which admit graph-theoretic interpretations in the context of weakly chained diagonally dominant matrices. A novel provably convergent single-player impulse control solver is also provided. The main algorithm is used to compute with high precision equilibrium payoffs and Nash equilibria of otherwise very challenging problems, and even some which go beyond the scope of the currently available theory.

Suggested Citation

  • Diego Zabaljauregui, 2019. "A fixed-point policy-iteration-type algorithm for symmetric nonzero-sum stochastic impulse control games," Papers 1909.03574, arXiv.org, revised Jun 2020.
    • Handle: RePEc:arx:papers:1909.03574
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1909.03574
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Abel Cadenillas & Tahir Choulli & Michael Taksar & Lei Zhang, 2006. "Classical And Impulse Stochastic Control For The Optimization Of The Dividend And Risk Policies Of An Insurance Firm," Mathematical Finance, Wiley Blackwell, vol. 16(1), pages 181-202, January.
    2. John C. Harsanyi & Reinhard Selten, 1988. "A General Theory of Equilibrium Selection in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262582384, December.
    3. Jean-Philippe Chancelier & Marouen Messaoud & Agnès Sulem, 2007. "A policy iteration algorithm for fixed point problems with nonexpansive operators," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 65(2), pages 239-259, April.
    4. René Aïd & Matteo Basei & Giorgia Callegaro & Luciano Campi & Tiziano Vargiolu, 2020. "Nonzero-Sum Stochastic Differential Games with Impulse Controls: A Verification Theorem with Applications," Mathematics of Operations Research, INFORMS, vol. 45(1), pages 205-232, February.
    5. Ralf Korn, 1999. "Some applications of impulse control in mathematical finance," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 50(3), pages 493-518, December.
    6. Matteo Basei, 2018. "Optimal price management in retail energy markets: an impulse control problem with asymptotic estimates," Papers 1803.08166, arXiv.org, revised Mar 2019.
    7. Seydel, Roland C., 2009. "Existence and uniqueness of viscosity solutions for QVI associated with impulse control of jump-diffusions," Stochastic Processes and their Applications, Elsevier, vol. 119(10), pages 3719-3748, October.
    8. Monique Jeanblanc‐Picqué, 1993. "Impulse Control Method and Exchange Rate," Mathematical Finance, Wiley Blackwell, vol. 3(2), pages 161-177, April.
    9. Matteo Basei, 2019. "Optimal price management in retail energy markets: an impulse control problem with asymptotic estimates," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 89(3), pages 355-383, June.
    10. Cadenillas, Abel & Zapatero, Fernando, 1999. "Optimal Central Bank Intervention in the Foreign Exchange Market," Journal of Economic Theory, Elsevier, vol. 87(1), pages 218-242, July.
    11. Mundaca, Gabriela & Oksendal, Bernt, 1998. "Optimal stochastic intervention control with application to the exchange rate," Journal of Mathematical Economics, Elsevier, vol. 29(2), pages 225-243, March.
    12. Jerome F. Eastham & Kevin J. Hastings, 1988. "Optimal Impulse Control of Portfolios," Mathematics of Operations Research, INFORMS, vol. 13(4), pages 588-605, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diego Zabaljauregui, 2020. "Optimal market making under partial information and numerical methods for impulse control games with applications," Papers 2009.06521, arXiv.org.
    2. Baccarin, Stefano, 2009. "Optimal impulse control for a multidimensional cash management system with generalized cost functions," European Journal of Operational Research, Elsevier, vol. 196(1), pages 198-206, July.
    3. Matteo Basei, 2019. "Optimal price management in retail energy markets: an impulse control problem with asymptotic estimates," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 89(3), pages 355-383, June.
    4. Matteo Basei, 2018. "Optimal price management in retail energy markets: an impulse control problem with asymptotic estimates," Papers 1803.08166, arXiv.org, revised Mar 2019.
    5. Ferrari, Giorgio & Koch, Torben, 2018. "On a Strategic Model of Pollution Control," Center for Mathematical Economics Working Papers 586, Center for Mathematical Economics, Bielefeld University.
    6. Giorgio Ferrari & Tiziano Vargiolu, 2020. "On the singular control of exchange rates," Annals of Operations Research, Springer, vol. 292(2), pages 795-832, September.
    7. Parsiad Azimzadeh & Peter A. Forsyth, 2015. "Weakly chained matrices, policy iteration, and impulse control," Papers 1510.03928, arXiv.org, revised Sep 2017.
    8. Giorgio Ferrari & Torben Koch, 2019. "On a strategic model of pollution control," Annals of Operations Research, Springer, vol. 275(2), pages 297-319, April.
    9. Chi Seng Pun, 2022. "Robust classical-impulse stochastic control problems in an infinite horizon," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 96(2), pages 291-312, October.
    10. Sadana, Utsav & Reddy, Puduru Viswanadha & Zaccour, Georges, 2021. "Nash equilibria in nonzero-sum differential games with impulse control," European Journal of Operational Research, Elsevier, vol. 295(2), pages 792-805.
    11. Ohnishi, Masamitsu & Tsujimura, Motoh, 2006. "An impulse control of a geometric Brownian motion with quadratic costs," European Journal of Operational Research, Elsevier, vol. 168(2), pages 311-321, January.
    12. Cadenillas, Abel & Zapatero, Fernando, 1999. "Optimal Central Bank Intervention in the Foreign Exchange Market," Journal of Economic Theory, Elsevier, vol. 87(1), pages 218-242, July.
    13. Eyal Neuman & Alexander Schied & Chengguo Weng & Xiaole Xue, 2020. "A central bank strategy for defending a currency peg," Papers 2008.00470, arXiv.org.
    14. Sandun Perera & Winston Buckley, 2017. "On the existence and uniqueness of the optimal central bank intervention policy in a forex market with jumps," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(8), pages 877-885, August.
    15. Yiannis Kamarianakis & Anastasios Xepapadeas, 2006. "Stochastic impulse control with discounted and ergodic optimization criteria: A comparative study for the control of risky holdings," Working Papers 0709, University of Crete, Department of Economics.
    16. Ren'e Aid & Lamia Ben Ajmia & M'hamed Gaigi & Mohamed Mnif, 2021. "Nonzero-sum stochastic impulse games with an application in competitive retail energy markets," Papers 2112.10213, arXiv.org.
    17. Jukka Isohätälä & Alistair Milne & Donald Robertson, 2020. "The Net Worth Trap: Investment and Output Dynamics in the Presence of Financing Constraints," Mathematics, MDPI, vol. 8(8), pages 1-32, August.
    18. Abel Cadenillas & Peter Lakner & Michael Pinedo, 2010. "Optimal Control of a Mean-Reverting Inventory," Operations Research, INFORMS, vol. 58(6), pages 1697-1710, December.
    19. Seydel, Roland C., 2009. "Existence and uniqueness of viscosity solutions for QVI associated with impulse control of jump-diffusions," Stochastic Processes and their Applications, Elsevier, vol. 119(10), pages 3719-3748, October.
    20. Valeri Zakamouline, 2005. "A unified approach to portfolio optimization with linear transaction costs," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 62(2), pages 319-343, November.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1909.03574. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.