IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2204.07134.html
   My bibliography  Save this paper

Reinforcement Learning Policy Recommendation for Interbank Network Stability

Author

Listed:
  • Alessio Brini
  • Gabriele Tedeschi
  • Daniele Tantari

Abstract

In this paper, we analyze the effect of a policy recommendation on the performance of an artificial interbank market. Financial institutions stipulate lending agreements following a public recommendation and their individual information. The former is modeled by a reinforcement learning optimal policy that maximizes the system's fitness and gathers information on the economic environment. The policy recommendation directs economic actors to create credit relationships through the optimal choice between a low interest rate or a high liquidity supply. The latter, based on the agents' balance sheet, allows determining the liquidity supply and interest rate that the banks optimally offer their clients within the market. Thanks to the combination between the public and the private signal, financial institutions create or cut their credit connections over time via a preferential attachment evolving procedure able to generate a dynamic network. Our results show that the emergence of a core-periphery interbank network, combined with a certain level of homogeneity in the size of lenders and borrowers, is essential to ensure the system's resilience. Moreover, the optimal policy recommendation obtained through reinforcement learning is crucial in mitigating systemic risk.

Suggested Citation

  • Alessio Brini & Gabriele Tedeschi & Daniele Tantari, 2022. "Reinforcement Learning Policy Recommendation for Interbank Network Stability," Papers 2204.07134, arXiv.org, revised May 2023.
  • Handle: RePEc:arx:papers:2204.07134
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2204.07134
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Michel Dietsch, 2004. "Should SME exposures be treated as retail or corporate exposures: a comparative analysis of probabilities of default and assets correlations in French and German SMEs," ULB Institutional Repository 2013/14164, ULB -- Universite Libre de Bruxelles.
    2. Mr. Romain M Veyrune & Guido della Valle & Shaoyu Guo, 2018. "Relationship Between Short-Term Interest Rates and Excess Reserves: A Logistic Approach," IMF Working Papers 2018/080, International Monetary Fund.
    3. Collard, Fabrice & Boissay, Frédéric & Galì, Jordi & Manea, Cristina, 2021. "Monetary Policy and Endogenous Financial Crises," TSE Working Papers 21-1277, Toulouse School of Economics (TSE), revised Apr 2023.
    4. Gabriel Jiménez & Steven Ongena & José‐Luis Peydró & Jesús Saurina, 2014. "Hazardous Times for Monetary Policy: What Do Twenty‐Three Million Bank Loans Say About the Effects of Monetary Policy on Credit Risk‐Taking?," Econometrica, Econometric Society, vol. 82(2), pages 463-505, March.
    5. Bernanke, Ben S. & Gertler, Mark & Gilchrist, Simon, 1999. "The financial accelerator in a quantitative business cycle framework," Handbook of Macroeconomics, in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 21, pages 1341-1393, Elsevier.
    6. Thakor, Anjan V., 2020. "Fintech and banking: What do we know?," Journal of Financial Intermediation, Elsevier, vol. 41(C).
    7. Bruce C. Greenwald & Joseph E. Stiglitz, 1993. "Financial Market Imperfections and Business Cycles," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 77-114.
    8. Bonner, C. & Eijffinger, S.C.W., 2012. "The Impact of the LCR on the Interbank Money Market," Other publications TiSEM 62237388-9a7c-458c-8608-9, Tilburg University, School of Economics and Management.
    9. Xavier Freixas & Antoine Martin & David Skeie, 2011. "Bank Liquidity, Interbank Markets, and Monetary Policy," The Review of Financial Studies, Society for Financial Studies, vol. 24(8), pages 2656-2692.
    10. Gai, Prasanna & Kapadia, Sujit, 2010. "Contagion in financial networks," Bank of England working papers 383, Bank of England.
    11. Viral V. Acharya & Tanju Yorulmazer, 2008. "Information Contagion and Bank Herding," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(1), pages 215-231, February.
    12. Silvano Cincotti & Marco Raberto & Andrea Teglio, 2012. "Macroprudential Policies in an Agent-Based Artificial Economy," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(5), pages 205-234.
    13. Viral V. Acharya & Tanju Yorulmazer, 2008. "Cash-in-the-Market Pricing and Optimal Resolution of Bank Failures," The Review of Financial Studies, Society for Financial Studies, vol. 21(6), pages 2705-2742, November.
    14. Mark Gertler & Nobuhiro Kiyotaki & Andrea Prestipino, 2020. "A Macroeconomic Model with Financial Panics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(1), pages 240-288.
    15. de Masi, G. & Iori, G. & Caldarelli, G., 2006. "A fitness model for the Italian interbank money market," Working Papers 06/08, Department of Economics, City University London.
    16. Freixas, Xavier & Parigi, Bruno M & Rochet, Jean-Charles, 2000. "Systemic Risk, Interbank Relations, and Liquidity Provision by the Central Bank," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 32(3), pages 611-638, August.
    17. Thakor, Anjan, 2020. "Corrigendum to: Fintech and Banking: What Do We Know?," Journal of Financial Intermediation, Elsevier, vol. 43(C).
    18. Jonathan Goldberg & Elizabeth C. Klee & Edward Simpson Prescott & Paul R. Wood, 2020. "Monetary Policy Strategies and Tools: Financial Stability Considerations," Finance and Economics Discussion Series 2020-074, Board of Governors of the Federal Reserve System (U.S.).
    19. Battiston, Stefano & Delli Gatti, Domenico & Gallegati, Mauro & Greenwald, Bruce & Stiglitz, Joseph E., 2012. "Liaisons dangereuses: Increasing connectivity, risk sharing, and systemic risk," Journal of Economic Dynamics and Control, Elsevier, vol. 36(8), pages 1121-1141.
    20. Markus K. Brunnermeier & Thomas M. Eisenbach & Yuliy Sannikov, 2012. "Macroeconomics with Financial Frictions: A Survey," Levine's Working Paper Archive 786969000000000384, David K. Levine.
    21. Paul De Grauwe, 2011. "The Banking Crisis: Causes, Consequences and Remedies," World Scientific Book Chapters, in: Simon J Evenett & Robert M Stern (ed.), Systemic Implications Of Transatlantic Regulatory Cooperation And Competition, chapter 2, pages 23-46, World Scientific Publishing Co. Pte. Ltd..
    22. Altavilla, Carlo & Lemke, Wolfgang & Linzert, Tobias & Tapking, Jens & von Landesberger, Julian, 2021. "Assessing the efficacy, efficiency and potential side effects of the ECB’s monetary policy instruments since 2014," Occasional Paper Series 278, European Central Bank.
    23. Franklin Allen & Douglas Gale, 2000. "Financial Contagion," Journal of Political Economy, University of Chicago Press, vol. 108(1), pages 1-33, February.
    24. Svensson, Lars E.O., 2017. "Cost-benefit analysis of leaning against the wind," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 193-213.
    25. Aleem, Irfan, 1990. "Imperfect Information, Screening, and the Costs of Informal Lending: A Study of a Rural Credit Market in Pakistan," The World Bank Economic Review, World Bank, vol. 4(3), pages 329-349, September.
    26. Matthew Elliott & Benjamin Golub & Matthew O. Jackson, 2014. "Financial Networks and Contagion," American Economic Review, American Economic Association, vol. 104(10), pages 3115-3153, October.
    27. Hoff, Karla & Stiglitz, Joseph E, 1990. "Imperfect Information and Rural Credit Markets--Puzzles and Policy Perspectives," The World Bank Economic Review, World Bank, vol. 4(3), pages 235-250, September.
    28. Fernando Lozano & Jaime Lozano & Mario García, 2007. "An artificial economy based on reinforcement learning and agent based modeling," Documentos de Trabajo 3907, Universidad del Rosario.
    29. Frédéric Boissay & Fabrice Collard & Frank Smets, 2016. "Booms and Banking Crises," Journal of Political Economy, University of Chicago Press, vol. 124(2), pages 489-538.
    30. Giovanni Calice & Carlo Sala & Daniele Tantari, 2020. "Contingent Convertible Bonds in Financial Networks," Papers 2009.00062, arXiv.org, revised Dec 2023.
    31. Angelini, P. & Maresca, G. & Russo, D., 1996. "Systemic risk in the netting system," Journal of Banking & Finance, Elsevier, vol. 20(5), pages 853-868, June.
    32. Jean-Charles Rochet & Jean Tirole, 1996. "Interbank lending and systemic risk," Proceedings, Board of Governors of the Federal Reserve System (U.S.), pages 733-765.
    33. Maudos, Joaquin & Fernandez de Guevara, Juan, 2004. "Factors explaining the interest margin in the banking sectors of the European Union," Journal of Banking & Finance, Elsevier, vol. 28(9), pages 2259-2281, September.
    34. Giri, Federico & Riccetti, Luca & Russo, Alberto & Gallegati, Mauro, 2019. "Monetary policy and large crises in a financial accelerator agent-based model," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 42-58.
    35. Bester, Helmut, 1985. "Screening vs. Rationing in Credit Markets with Imperfect Information," American Economic Review, American Economic Association, vol. 75(4), pages 850-855, September.
    36. Alessandro Caiani & Antoine Godin & Stefano Lucarelli, 2015. "Innovation and Finance: A Stock Flow Consistent Analysis of Great Surges of Development," Economic Complexity and Evolution, in: Andreas Pyka & John Foster (ed.), The Evolution of Economic and Innovation Systems, edition 127, pages 401-430, Springer.
    37. Eric Bartelsman & Stefano Scarpetta & Fabiano Schivardi, 2005. "Comparative analysis of firm demographics and survival: evidence from micro-level sources in OECD countries," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 14(3), pages 365-391, June.
    38. Reichlin, Lucrezia & Pill, Huw & Giannone, Domenico & Lenza, Michele, 2010. "Non-standard Monetary Policy Measures and Monetary Developments," CEPR Discussion Papers 8125, C.E.P.R. Discussion Papers.
    39. Iori, Giulia & Jafarey, Saqib & Padilla, Francisco G., 2006. "Systemic risk on the interbank market," Journal of Economic Behavior & Organization, Elsevier, vol. 61(4), pages 525-542, December.
    40. Tedeschi, Gabriele & Vidal-Tomás, David & Delli-Gatti, Domenico & Gallegati, Mauro, 2021. "The macroeconomic effects of default and debt restructuring: An agent based exploration," International Review of Economics & Finance, Elsevier, vol. 76(C), pages 1146-1163.
    41. John B. Taylor, 2011. "Macroeconomic Lessons from the Great Deviation," NBER Chapters, in: NBER Macroeconomics Annual 2010, volume 25, pages 387-395, National Bureau of Economic Research, Inc.
    42. Upper, Christian, 2011. "Simulation methods to assess the danger of contagion in interbank markets," Journal of Financial Stability, Elsevier, vol. 7(3), pages 111-125, August.
    43. Paolo Tasca & Stefano Battiston, "undated". "Diversification and Financial Stability," Working Papers CCSS-11-001, ETH Zurich, Chair of Systems Design.
    44. Lenzu, Simone & Tedeschi, Gabriele, 2012. "Systemic risk on different interbank network topologies," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(18), pages 4331-4341.
    45. Edward I. Altman & Gabriele Sabato, 2013. "MODELING CREDIT RISK FOR SMEs: EVIDENCE FROM THE US MARKET," World Scientific Book Chapters, in: Oliviero Roggi & Edward I Altman (ed.), Managing and Measuring Risk Emerging Global Standards and Regulations After the Financial Crisis, chapter 9, pages 251-279, World Scientific Publishing Co. Pte. Ltd..
    46. Frederic Boissay & Fabrice Collard & Jordi Galí & Cristina Manea, 2021. "Monetary Policy and Endogenous Financial Crises," Working Papers 1308, Barcelona School of Economics.
    47. Amir Mosavi & Pedram Ghamisi & Yaser Faghan & Puhong Duan, 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," Papers 2004.01509, arXiv.org.
    48. Mosavi, Amir & Faghan, Yaser & Ghamisi, Pedram & Duan, Puhong & Ardabili, Sina Faizollahzadeh & Hassan, Salwana & Band, Shahab S., 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," OSF Preprints jrc58, Center for Open Science.
    49. Caiani, Alessandro & Godin, Antoine & Caverzasi, Eugenio & Gallegati, Mauro & Kinsella, Stephen & Stiglitz, Joseph E., 2016. "Agent based-stock flow consistent macroeconomics: Towards a benchmark model," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 375-408.
    50. Jairaj Gupta & Nicholas Wilson & Andros Gregoriou & Jerome Healy, 2014. "The value of operating cash flow in modelling credit risk for SMEs," Applied Financial Economics, Taylor & Francis Journals, vol. 24(9), pages 649-660, May.
    51. Battiston, Stefano & Gatti, Domenico Delli & Gallegati, Mauro & Greenwald, Bruce & Stiglitz, Joseph E., 2012. "Default cascades: When does risk diversification increase stability?," Journal of Financial Stability, Elsevier, vol. 8(3), pages 138-149.
    52. Bruce Ian Carlin & Miguel Sousa Lobo & S. Viswanathan, 2007. "Episodic Liquidity Crises: Cooperative and Predatory Trading," Journal of Finance, American Finance Association, vol. 62(5), pages 2235-2274, October.
    53. Ilia D. Dichev, 1998. "Is the Risk of Bankruptcy a Systematic Risk?," Journal of Finance, American Finance Association, vol. 53(3), pages 1131-1147, June.
    54. Collard, Fabrice & Boissay, Frédéric & Galì, Jordi & Manea, Cristina, 2021. "Monetary Policy and Endogenous Financial Crises," TSE Working Papers 21-1277, Toulouse School of Economics (TSE), revised Apr 2023.
    55. Zhengyao Jiang & Dixing Xu & Jinjun Liang, 2017. "A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem," Papers 1706.10059, arXiv.org, revised Jul 2017.
    56. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    57. Amirhosein Mosavi & Yaser Faghan & Pedram Ghamisi & Puhong Duan & Sina Faizollahzadeh Ardabili & Ely Salwana & Shahab S. Band, 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," Mathematics, MDPI, vol. 8(10), pages 1-42, September.
    58. Dell'Ariccia, Giovanni & Marquez, Robert, 2004. "Information and bank credit allocation," Journal of Financial Economics, Elsevier, vol. 72(1), pages 185-214, April.
    59. Gabriele Tedeschi & Amin Mazloumian & Mauro Gallegati & Dirk Helbing, 2012. "Bankruptcy Cascades in Interbank Markets," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-10, December.
    60. Riccetti, Luca & Russo, Alberto & Gallegati, Mauro, 2018. "Financial Regulation And Endogenous Macroeconomic Crises," Macroeconomic Dynamics, Cambridge University Press, vol. 22(4), pages 896-930, June.
    61. Andrew G. Haldane & Robert M. May, 2011. "Systemic risk in banking ecosystems," Nature, Nature, vol. 469(7330), pages 351-355, January.
    62. Agostino Capponi & Xu Sun & David D. Yao, 2020. "A Dynamic Network Model of Interbank Lending—Systemic Risk and Liquidity Provisioning," Mathematics of Operations Research, INFORMS, vol. 45(3), pages 1127-1152, August.
    63. Fabio Caccioli & Thomas A. Catanach & J. Doyne Farmer, 2012. "Heterogeneity, Correlations And Financial Contagion," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 15(supp0), pages 1-15.
    64. Amil Dasgupta, 2004. "Financial Contagion Through Capital Connections: A Model of the Origin and Spread of Bank Panics," Journal of the European Economic Association, MIT Press, vol. 2(6), pages 1049-1084, December.
    65. Reichlin, Lucrezia & Pill, Huw & Giannone, Domenico & Lenza, Michele, 2010. "Non-standard Monetary Policy Measures and Monetary Developments," CEPR Discussion Papers 8125, C.E.P.R. Discussion Papers.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Berardi, Simone & Tedeschi, Gabriele, 2017. "From banks' strategies to financial (in)stability," International Review of Economics & Finance, Elsevier, vol. 47(C), pages 255-272.
    2. Andre R. Neveu, 2018. "A survey of network-based analysis and systemic risk measurement," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 13(2), pages 241-281, July.
    3. Hüser, Anne-Caroline, 2016. "Too interconnected to fail: A survey of the Interbank Networks literature," SAFE Working Paper Series 91, Leibniz Institute for Financial Research SAFE, revised 2016.
    4. Teteryatnikova, Mariya, 2014. "Systemic risk in banking networks: Advantages of “tiered” banking systems," Journal of Economic Dynamics and Control, Elsevier, vol. 47(C), pages 186-210.
    5. Adão, Luiz F.S. & Silveira, Douglas & Ely, Regis A. & Cajueiro, Daniel O., 2022. "The impacts of interest rates on banks’ loan portfolio risk-taking," Journal of Economic Dynamics and Control, Elsevier, vol. 144(C).
    6. Grilli, Ruggero & Tedeschi, Gabriele & Gallegati, Mauro, 2020. "Business fluctuations in a behavioral switching model: Gridlock effects and credit crunch phenomena in financial networks," Journal of Economic Dynamics and Control, Elsevier, vol. 114(C).
    7. Grilli, Ruggero & Tedeschi, Gabriele & Gallegati, Mauro, 2014. "Bank interlinkages and macroeconomic stability," International Review of Economics & Finance, Elsevier, vol. 34(C), pages 72-88.
    8. León, C., 2015. "Financial stability from a network perspective," Other publications TiSEM bb2e4e44-e842-45c6-a946-4, Tilburg University, School of Economics and Management.
    9. Gabriele Tedeschi & Amin Mazloumian & Mauro Gallegati & Dirk Helbing, 2012. "Bankruptcy Cascades in Interbank Markets," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-10, December.
    10. León, Carlos & Machado, Clara & Sarmiento, Miguel, 2018. "Identifying central bank liquidity super-spreaders in interbank funds networks," Journal of Financial Stability, Elsevier, vol. 35(C), pages 75-92.
    11. Jose Fique, 2016. "A Microfounded Design of Interconnectedness-Based Macroprudential Policy," Staff Working Papers 16-6, Bank of Canada.
    12. Marco Bardoscia & Paolo Barucca & Stefano Battiston & Fabio Caccioli & Giulio Cimini & Diego Garlaschelli & Fabio Saracco & Tiziano Squartini & Guido Caldarelli, 2021. "The Physics of Financial Networks," Papers 2103.05623, arXiv.org.
    13. Vinko Zlatić & Giampaolo Gabbi & Hrvoje Abraham, 2015. "Reduction of Systemic Risk by Means of Pigouvian Taxation," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-18, July.
    14. Paolo Bartesaghi & Michele Benzi & Gian Paolo Clemente & Rosanna Grassi & Ernesto Estrada, 2019. "Risk-dependent centrality in economic and financial networks," Papers 1907.07908, arXiv.org, revised Apr 2020.
    15. Christoph Siebenbrunner, 2021. "Quantifying the importance of different contagion channels as sources of systemic risk," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 16(1), pages 103-131, January.
    16. Jiajia, Liu & Kun, Guo & Fangcheng, Tang & Yahan, Wang & Shouyang, Wang, 2023. "The effect of the disposal of non-performing loans on interbank liquidity risk in China: A cash flow network-based analysis," The Quarterly Review of Economics and Finance, Elsevier, vol. 89(C), pages 105-119.
    17. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    18. Oet, Mikhail V. & Ong, Stephen J., 2019. "From organization to activity in the US collateralized interbank market," Research in International Business and Finance, Elsevier, vol. 50(C), pages 472-485.
    19. Lasse Loepfe & Antonio Cabrales & Angel Sánchez, 2013. "Towards a Proper Assignment of Systemic Risk: The Combined Roles of Network Topology and Shock Characteristics," PLOS ONE, Public Library of Science, vol. 8(10), pages 1-1, October.
    20. Pawe{l} Smaga & Mateusz Wili'nski & Piotr Ochnicki & Piotr Arendarski & Tomasz Gubiec, 2016. "Can banks default overnight? Modeling endogenous contagion on O/N interbank market," Papers 1603.05142, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2204.07134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.