IDEAS home Printed from https://ideas.repec.org/a/eee/finsta/v67y2023ics1572308923000396.html
   My bibliography  Save this article

Reinforcement learning policy recommendation for interbank network stability

Author

Listed:
  • Brini, Alessio
  • Tedeschi, Gabriele
  • Tantari, Daniele

Abstract

In this paper, we analyze the effect of a policy recommendation on the performance of an artificial interbank market. Financial institutions stipulate lending agreements following a public recommendation and their individual information. The former is modeled by a reinforcement learning optimal policy that maximizes the system’s fitness and gathers information on the economic environment. The policy recommendation directs economic actors to create credit relationships through the optimal choice between a low interest rate or a high liquidity supply. The latter, based on the agents’ balance sheet, allows determining the liquidity supply and interest rate that the banks optimally offer their clients within the market. Thanks to the combination between the public and the private signal, financial institutions create or cut their credit connections over time via a preferential attachment evolving procedure able to generate a dynamic network. Our results show that the emergence of a core–periphery interbank network, combined with a certain level of homogeneity in the size of lenders and borrowers, is essential to ensure the system’s resilience. Moreover, the optimal policy recommendation obtained through reinforcement learning is crucial in mitigating systemic risk.

Suggested Citation

  • Brini, Alessio & Tedeschi, Gabriele & Tantari, Daniele, 2023. "Reinforcement learning policy recommendation for interbank network stability," Journal of Financial Stability, Elsevier, vol. 67(C).
  • Handle: RePEc:eee:finsta:v:67:y:2023:i:c:s1572308923000396
    DOI: 10.1016/j.jfs.2023.101139
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1572308923000396
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jfs.2023.101139?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Collard, Fabrice & Boissay, Frédéric & Galì, Jordi & Manea, Cristina, 2021. "Monetary Policy and Endogenous Financial Crises," TSE Working Papers 21-1277, Toulouse School of Economics (TSE), revised Apr 2023.
    2. Bonner, C. & Eijffinger, S.C.W., 2012. "The Impact of the LCR on the Interbank Money Market," Other publications TiSEM 62237388-9a7c-458c-8608-9, Tilburg University, School of Economics and Management.
    3. Xavier Freixas & Antoine Martin & David Skeie, 2011. "Bank Liquidity, Interbank Markets, and Monetary Policy," The Review of Financial Studies, Society for Financial Studies, vol. 24(8), pages 2656-2692.
    4. Gai, Prasanna & Kapadia, Sujit, 2010. "Contagion in financial networks," Bank of England working papers 383, Bank of England.
    5. Viral V. Acharya & Tanju Yorulmazer, 2008. "Cash-in-the-Market Pricing and Optimal Resolution of Bank Failures," The Review of Financial Studies, Society for Financial Studies, vol. 21(6), pages 2705-2742, November.
    6. Mark Gertler & Nobuhiro Kiyotaki & Andrea Prestipino, 2020. "A Macroeconomic Model with Financial Panics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(1), pages 240-288.
    7. de Masi, G. & Iori, G. & Caldarelli, G., 2006. "A fitness model for the Italian interbank money market," Working Papers 06/08, Department of Economics, City University London.
    8. Thakor, Anjan, 2020. "Corrigendum to: Fintech and Banking: What Do We Know?," Journal of Financial Intermediation, Elsevier, vol. 43(C).
    9. Jonathan Goldberg & Elizabeth C. Klee & Edward Simpson Prescott & Paul R. Wood, 2020. "Monetary Policy Strategies and Tools: Financial Stability Considerations," Finance and Economics Discussion Series 2020-074, Board of Governors of the Federal Reserve System (U.S.).
    10. Markus K. Brunnermeier & Thomas M. Eisenbach & Yuliy Sannikov, 2012. "Macroeconomics with Financial Frictions: A Survey," Levine's Working Paper Archive 786969000000000384, David K. Levine.
    11. Franklin Allen & Douglas Gale, 2000. "Financial Contagion," Journal of Political Economy, University of Chicago Press, vol. 108(1), pages 1-33, February.
    12. Matthew Elliott & Benjamin Golub & Matthew O. Jackson, 2014. "Financial Networks and Contagion," American Economic Review, American Economic Association, vol. 104(10), pages 3115-3153, October.
    13. Battiston, Stefano & Delli Gatti, Domenico & Gallegati, Mauro & Greenwald, Bruce & Stiglitz, Joseph E., 2012. "Liaisons dangereuses: Increasing connectivity, risk sharing, and systemic risk," Journal of Economic Dynamics and Control, Elsevier, vol. 36(8), pages 1121-1141.
    14. Bernanke, Ben S. & Gertler, Mark & Gilchrist, Simon, 1999. "The financial accelerator in a quantitative business cycle framework," Handbook of Macroeconomics, in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 21, pages 1341-1393, Elsevier.
    15. Eric Bartelsman & Stefano Scarpetta & Fabiano Schivardi, 2005. "Comparative analysis of firm demographics and survival: evidence from micro-level sources in OECD countries," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 14(3), pages 365-391, June.
    16. John B. Taylor, 2011. "Macroeconomic Lessons from the Great Deviation," NBER Chapters, in: NBER Macroeconomics Annual 2010, volume 25, pages 387-395, National Bureau of Economic Research, Inc.
    17. Upper, Christian, 2011. "Simulation methods to assess the danger of contagion in interbank markets," Journal of Financial Stability, Elsevier, vol. 7(3), pages 111-125, August.
    18. Giri, Federico & Riccetti, Luca & Russo, Alberto & Gallegati, Mauro, 2019. "Monetary policy and large crises in a financial accelerator agent-based model," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 42-58.
    19. Caiani, Alessandro & Godin, Antoine & Caverzasi, Eugenio & Gallegati, Mauro & Kinsella, Stephen & Stiglitz, Joseph E., 2016. "Agent based-stock flow consistent macroeconomics: Towards a benchmark model," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 375-408.
    20. Viral V. Acharya & Tanju Yorulmazer, 2008. "Information Contagion and Bank Herding," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(1), pages 215-231, February.
    21. Zhengyao Jiang & Dixing Xu & Jinjun Liang, 2017. "A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem," Papers 1706.10059, arXiv.org, revised Jul 2017.
    22. Gabriele Tedeschi & Amin Mazloumian & Mauro Gallegati & Dirk Helbing, 2012. "Bankruptcy Cascades in Interbank Markets," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-10, December.
    23. Svensson, Lars E.O., 2017. "Cost-benefit analysis of leaning against the wind," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 193-213.
    24. Reichlin, Lucrezia & Pill, Huw & Giannone, Domenico & Lenza, Michele, 2010. "Non-standard Monetary Policy Measures and Monetary Developments," CEPR Discussion Papers 8125, C.E.P.R. Discussion Papers.
    25. Gabriel Jiménez & Steven Ongena & José‐Luis Peydró & Jesús Saurina, 2014. "Hazardous Times for Monetary Policy: What Do Twenty‐Three Million Bank Loans Say About the Effects of Monetary Policy on Credit Risk‐Taking?," Econometrica, Econometric Society, vol. 82(2), pages 463-505, March.
    26. Thakor, Anjan V., 2020. "Fintech and banking: What do we know?," Journal of Financial Intermediation, Elsevier, vol. 41(C).
    27. Silvano Cincotti & Marco Raberto & Andrea Teglio, 2012. "Macroprudential Policies in an Agent-Based Artificial Economy," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(5), pages 205-234.
    28. Aleem, Irfan, 1990. "Imperfect Information, Screening, and the Costs of Informal Lending: A Study of a Rural Credit Market in Pakistan," The World Bank Economic Review, World Bank, vol. 4(3), pages 329-349, September.
    29. Frédéric Boissay & Fabrice Collard & Frank Smets, 2016. "Booms and Banking Crises," Journal of Political Economy, University of Chicago Press, vol. 124(2), pages 489-538.
    30. Jean-Charles Rochet & Jean Tirole, 1996. "Interbank lending and systemic risk," Proceedings, Board of Governors of the Federal Reserve System (U.S.), pages 733-765.
    31. Reichlin, Lucrezia & Pill, Huw & Giannone, Domenico & Lenza, Michele, 2010. "Non-standard Monetary Policy Measures and Monetary Developments," CEPR Discussion Papers 8125, C.E.P.R. Discussion Papers.
    32. Iori, Giulia & Jafarey, Saqib & Padilla, Francisco G., 2006. "Systemic risk on the interbank market," Journal of Economic Behavior & Organization, Elsevier, vol. 61(4), pages 525-542, December.
    33. Tedeschi, Gabriele & Vidal-Tomás, David & Delli-Gatti, Domenico & Gallegati, Mauro, 2021. "The macroeconomic effects of default and debt restructuring: An agent based exploration," International Review of Economics & Finance, Elsevier, vol. 76(C), pages 1146-1163.
    34. Lenzu, Simone & Tedeschi, Gabriele, 2012. "Systemic risk on different interbank network topologies," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(18), pages 4331-4341.
    35. Amir Mosavi & Pedram Ghamisi & Yaser Faghan & Puhong Duan, 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," Papers 2004.01509, arXiv.org.
    36. Jairaj Gupta & Nicholas Wilson & Andros Gregoriou & Jerome Healy, 2014. "The value of operating cash flow in modelling credit risk for SMEs," Applied Financial Economics, Taylor & Francis Journals, vol. 24(9), pages 649-660, May.
    37. Bruce Ian Carlin & Miguel Sousa Lobo & S. Viswanathan, 2007. "Episodic Liquidity Crises: Cooperative and Predatory Trading," Journal of Finance, American Finance Association, vol. 62(5), pages 2235-2274, October.
    38. F. Boissay & F. Collard & Jordi Galí & C. Manea, 2021. "Monetary policy and endogenous financial crises," Economics Working Papers 1810, Department of Economics and Business, Universitat Pompeu Fabra.
    39. Amil Dasgupta, 2004. "Financial Contagion Through Capital Connections: A Model of the Origin and Spread of Bank Panics," Journal of the European Economic Association, MIT Press, vol. 2(6), pages 1049-1084, December.
    40. Michel Dietsch, 2004. "Should SME exposures be treated as retail or corporate exposures: a comparative analysis of probabilities of default and assets correlations in French and German SMEs," ULB Institutional Repository 2013/14164, ULB -- Universite Libre de Bruxelles.
    41. Freixas, Xavier & Parigi, Bruno M & Rochet, Jean-Charles, 2000. "Systemic Risk, Interbank Relations, and Liquidity Provision by the Central Bank," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 32(3), pages 611-638, August.
    42. Giovanni Calice & Carlo Sala & Daniele Tantari, 2020. "Contingent Convertible Bonds in Financial Networks," Papers 2009.00062, arXiv.org, revised Dec 2023.
    43. Maudos, Joaquin & Fernandez de Guevara, Juan, 2004. "Factors explaining the interest margin in the banking sectors of the European Union," Journal of Banking & Finance, Elsevier, vol. 28(9), pages 2259-2281, September.
    44. Alessandro Caiani & Antoine Godin & Stefano Lucarelli, 2015. "Innovation and Finance: A Stock Flow Consistent Analysis of Great Surges of Development," Economic Complexity and Evolution, in: Andreas Pyka & John Foster (ed.), The Evolution of Economic and Innovation Systems, edition 127, pages 401-430, Springer.
    45. Paolo Tasca & Stefano Battiston, "undated". "Diversification and Financial Stability," Working Papers CCSS-11-001, ETH Zurich, Chair of Systems Design.
    46. Edward I. Altman & Gabriele Sabato, 2013. "MODELING CREDIT RISK FOR SMEs: EVIDENCE FROM THE US MARKET," World Scientific Book Chapters, in: Oliviero Roggi & Edward I Altman (ed.), Managing and Measuring Risk Emerging Global Standards and Regulations After the Financial Crisis, chapter 9, pages 251-279, World Scientific Publishing Co. Pte. Ltd..
    47. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    48. Andrew G. Haldane & Robert M. May, 2011. "Systemic risk in banking ecosystems," Nature, Nature, vol. 469(7330), pages 351-355, January.
    49. Agostino Capponi & Xu Sun & David D. Yao, 2020. "A Dynamic Network Model of Interbank Lending—Systemic Risk and Liquidity Provisioning," Mathematics of Operations Research, INFORMS, vol. 45(3), pages 1127-1152, August.
    50. Fabio Caccioli & Thomas A. Catanach & J. Doyne Farmer, 2012. "Heterogeneity, Correlations And Financial Contagion," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 15(supp0), pages 1-15.
    51. Mr. Romain M Veyrune & Guido della Valle & Shaoyu Guo, 2018. "Relationship Between Short-Term Interest Rates and Excess Reserves: A Logistic Approach," IMF Working Papers 2018/080, International Monetary Fund.
    52. Bruce C. Greenwald & Joseph E. Stiglitz, 1993. "Financial Market Imperfections and Business Cycles," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 77-114.
    53. Paul De Grauwe, 2011. "The Banking Crisis: Causes, Consequences and Remedies," World Scientific Book Chapters, in: Simon J Evenett & Robert M Stern (ed.), Systemic Implications Of Transatlantic Regulatory Cooperation And Competition, chapter 2, pages 23-46, World Scientific Publishing Co. Pte. Ltd..
    54. Altavilla, Carlo & Lemke, Wolfgang & Linzert, Tobias & Tapking, Jens & von Landesberger, Julian, 2021. "Assessing the efficacy, efficiency and potential side effects of the ECB’s monetary policy instruments since 2014," Occasional Paper Series 278, European Central Bank.
    55. Hoff, Karla & Stiglitz, Joseph E, 1990. "Imperfect Information and Rural Credit Markets--Puzzles and Policy Perspectives," The World Bank Economic Review, World Bank, vol. 4(3), pages 235-250, September.
    56. Fernando Lozano & Jaime Lozano & Mario García, 2007. "An artificial economy based on reinforcement learning and agent based modeling," Documentos de Trabajo 3907, Universidad del Rosario.
    57. Angelini, P. & Maresca, G. & Russo, D., 1996. "Systemic risk in the netting system," Journal of Banking & Finance, Elsevier, vol. 20(5), pages 853-868, June.
    58. Bester, Helmut, 1985. "Screening vs. Rationing in Credit Markets with Imperfect Information," American Economic Review, American Economic Association, vol. 75(4), pages 850-855, September.
    59. Frederic Boissay & Fabrice Collard & Jordi Galí & Cristina Manea, 2021. "Monetary Policy and Endogenous Financial Crises," Working Papers 1308, Barcelona School of Economics.
    60. Mosavi, Amir & Faghan, Yaser & Ghamisi, Pedram & Duan, Puhong & Ardabili, Sina Faizollahzadeh & Hassan, Salwana & Band, Shahab S., 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," OSF Preprints jrc58, Center for Open Science.
    61. Battiston, Stefano & Gatti, Domenico Delli & Gallegati, Mauro & Greenwald, Bruce & Stiglitz, Joseph E., 2012. "Default cascades: When does risk diversification increase stability?," Journal of Financial Stability, Elsevier, vol. 8(3), pages 138-149.
    62. Ilia D. Dichev, 1998. "Is the Risk of Bankruptcy a Systematic Risk?," Journal of Finance, American Finance Association, vol. 53(3), pages 1131-1147, June.
    63. Amirhosein Mosavi & Yaser Faghan & Pedram Ghamisi & Puhong Duan & Sina Faizollahzadeh Ardabili & Ely Salwana & Shahab S. Band, 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," Mathematics, MDPI, vol. 8(10), pages 1-42, September.
    64. Dell'Ariccia, Giovanni & Marquez, Robert, 2004. "Information and bank credit allocation," Journal of Financial Economics, Elsevier, vol. 72(1), pages 185-214, April.
    65. Riccetti, Luca & Russo, Alberto & Gallegati, Mauro, 2018. "Financial Regulation And Endogenous Macroeconomic Crises," Macroeconomic Dynamics, Cambridge University Press, vol. 22(4), pages 896-930, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Berardi, Simone & Tedeschi, Gabriele, 2017. "From banks' strategies to financial (in)stability," International Review of Economics & Finance, Elsevier, vol. 47(C), pages 255-272.
    2. Andre R. Neveu, 2018. "A survey of network-based analysis and systemic risk measurement," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 13(2), pages 241-281, July.
    3. Hüser, Anne-Caroline, 2016. "Too interconnected to fail: A survey of the Interbank Networks literature," SAFE Working Paper Series 91, Leibniz Institute for Financial Research SAFE, revised 2016.
    4. Teteryatnikova, Mariya, 2014. "Systemic risk in banking networks: Advantages of “tiered” banking systems," Journal of Economic Dynamics and Control, Elsevier, vol. 47(C), pages 186-210.
    5. Adão, Luiz F.S. & Silveira, Douglas & Ely, Regis A. & Cajueiro, Daniel O., 2022. "The impacts of interest rates on banks’ loan portfolio risk-taking," Journal of Economic Dynamics and Control, Elsevier, vol. 144(C).
    6. Grilli, Ruggero & Tedeschi, Gabriele & Gallegati, Mauro, 2020. "Business fluctuations in a behavioral switching model: Gridlock effects and credit crunch phenomena in financial networks," Journal of Economic Dynamics and Control, Elsevier, vol. 114(C).
    7. Grilli, Ruggero & Tedeschi, Gabriele & Gallegati, Mauro, 2014. "Bank interlinkages and macroeconomic stability," International Review of Economics & Finance, Elsevier, vol. 34(C), pages 72-88.
    8. León, C., 2015. "Financial stability from a network perspective," Other publications TiSEM bb2e4e44-e842-45c6-a946-4, Tilburg University, School of Economics and Management.
    9. Gabriele Tedeschi & Amin Mazloumian & Mauro Gallegati & Dirk Helbing, 2012. "Bankruptcy Cascades in Interbank Markets," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-10, December.
    10. León, Carlos & Machado, Clara & Sarmiento, Miguel, 2018. "Identifying central bank liquidity super-spreaders in interbank funds networks," Journal of Financial Stability, Elsevier, vol. 35(C), pages 75-92.
    11. Jose Fique, 2016. "A Microfounded Design of Interconnectedness-Based Macroprudential Policy," Staff Working Papers 16-6, Bank of Canada.
    12. Marco Bardoscia & Paolo Barucca & Stefano Battiston & Fabio Caccioli & Giulio Cimini & Diego Garlaschelli & Fabio Saracco & Tiziano Squartini & Guido Caldarelli, 2021. "The Physics of Financial Networks," Papers 2103.05623, arXiv.org.
    13. Vinko Zlatić & Giampaolo Gabbi & Hrvoje Abraham, 2015. "Reduction of Systemic Risk by Means of Pigouvian Taxation," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-18, July.
    14. Paolo Bartesaghi & Michele Benzi & Gian Paolo Clemente & Rosanna Grassi & Ernesto Estrada, 2019. "Risk-dependent centrality in economic and financial networks," Papers 1907.07908, arXiv.org, revised Apr 2020.
    15. Christoph Siebenbrunner, 2021. "Quantifying the importance of different contagion channels as sources of systemic risk," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 16(1), pages 103-131, January.
    16. Jiajia, Liu & Kun, Guo & Fangcheng, Tang & Yahan, Wang & Shouyang, Wang, 2023. "The effect of the disposal of non-performing loans on interbank liquidity risk in China: A cash flow network-based analysis," The Quarterly Review of Economics and Finance, Elsevier, vol. 89(C), pages 105-119.
    17. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    18. Oet, Mikhail V. & Ong, Stephen J., 2019. "From organization to activity in the US collateralized interbank market," Research in International Business and Finance, Elsevier, vol. 50(C), pages 472-485.
    19. Lasse Loepfe & Antonio Cabrales & Angel Sánchez, 2013. "Towards a Proper Assignment of Systemic Risk: The Combined Roles of Network Topology and Shock Characteristics," PLOS ONE, Public Library of Science, vol. 8(10), pages 1-1, October.
    20. Pawe{l} Smaga & Mateusz Wili'nski & Piotr Ochnicki & Piotr Arendarski & Tomasz Gubiec, 2016. "Can banks default overnight? Modeling endogenous contagion on O/N interbank market," Papers 1603.05142, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finsta:v:67:y:2023:i:c:s1572308923000396. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jfstabil .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.