IDEAS home Printed from https://ideas.repec.org/p/bdi/wptemi/td_1206_19.html
   My bibliography  Save this paper

Machine learning in the service of policy targeting: the case of public credit guarantees

Author

Listed:
  • Monica Andini

    (Bank of Italy)

  • Michela Boldrini

    (University of Bologna)

  • Emanuele Ciani

    (Bank of Italy)

  • Guido de Blasio

    (Bank of Italy)

  • Alessio D'Ignazio

    (Bank of Italy)

  • Andrea Paladini

    (University of Rome "La Sapienza")

Abstract

We use Machine Learning (ML) predictive tools to propose a policy-assignment rule designed to increase the effectiveness of public guarantee programs. This rule can be used as a benchmark to improve targeting in order to reach the stated policy goals. Public guarantee schemes should target firms that are both financially constrained and creditworthy, but they often employ naïve assignment rules (mostly based only on the probability of default) that may lead to an inefficient allocation of resources. Examining the case of Italy’s Guarantee Fund, we suggest a benchmark ML-based assignment rule, trained and tested on credit register data. Compared with the current eligibility criteria, the ML-based benchmark leads to a significant improvement in the effectiveness of the Fund in gaining credit access to firms. We discuss the problems in estimating and using these algorithms for the actual implementation of public policies, such as transparency and omitted payoffs.

Suggested Citation

  • Monica Andini & Michela Boldrini & Emanuele Ciani & Guido de Blasio & Alessio D'Ignazio & Andrea Paladini, 2019. "Machine learning in the service of policy targeting: the case of public credit guarantees," Temi di discussione (Economic working papers) 1206, Bank of Italy, Economic Research and International Relations Area.
  • Handle: RePEc:bdi:wptemi:td_1206_19
    as

    Download full text from publisher

    File URL: http://www.bancaditalia.it/pubblicazioni/temi-discussione/2019/2019-1206/en_tema_1206.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Giorgio Gobbi & Francesco Palazzo & Anatoli Segura1, 2020. "Unintended effects of loan guarantees during the Covid-19 crisis," Vox eBook Chapters, in: AgneÌ€s BeÌ nassy-QueÌ reÌ & Beatrice Weder di Mauro (ed.), Europe in the Time of Covid-19, edition 1, volume 1, chapter 1, pages 104-108, Centre for Economic Policy Research.
    2. Gabriel Jiménez & Steven Ongena & José‐Luis Peydró & Jesús Saurina, 2014. "Hazardous Times for Monetary Policy: What Do Twenty‐Three Million Bank Loans Say About the Effects of Monetary Policy on Credit Risk‐Taking?," Econometrica, Econometric Society, vol. 82(2), pages 463-505, March.
    3. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    4. Reint Gropp & Christian Gruendl & Andre Guettler, 2014. "The Impact of Public Guarantees on Bank Risk-Taking: Evidence from a Natural Experiment," Review of Finance, European Finance Association, vol. 18(2), pages 457-488.
    5. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    6. Rajan, Uday & Seru, Amit & Vig, Vikrant, 2015. "The failure of models that predict failure: Distance, incentives, and defaults," Journal of Financial Economics, Elsevier, vol. 115(2), pages 237-260.
    7. Beck, Thorsten & Klapper, Leora F. & Mendoza, Juan Carlos, 2010. "The typology of partial credit guarantee funds around the world," Journal of Financial Stability, Elsevier, vol. 6(1), pages 10-25, April.
    8. Alessio D’Ignazio & Carlo Menon, 2020. "Causal Effect of Credit Guarantees for Small‐ and Medium‐Sized Enterprises: Evidence from Italy," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(1), pages 191-218, January.
    9. Fabiano Schivardi & Enrico Sette & Guido Tabellini, 2022. "Credit Misallocation During the European Financial Crisis," The Economic Journal, Royal Economic Society, vol. 132(641), pages 391-423.
    10. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    11. Aaron Chalfin & Oren Danieli & Andrew Hillis & Zubin Jelveh & Michael Luca & Jens Ludwig & Sendhil Mullainathan, 2016. "Productivity and Selection of Human Capital with Machine Learning," American Economic Review, American Economic Association, vol. 106(5), pages 124-127, May.
    12. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020. "Simple Local Polynomial Density Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
    13. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    14. Cowan, Kevin & Drexler, Alejandro & Yañez, Álvaro, 2015. "The effect of credit guarantees on credit availability and delinquency rates," Journal of Banking & Finance, Elsevier, vol. 59(C), pages 98-110.
    15. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    16. Andini, Monica & Ciani, Emanuele & de Blasio, Guido & D'Ignazio, Alessio & Salvestrini, Viola, 2018. "Targeting with machine learning: An application to a tax rebate program in Italy," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 86-102.
    17. Lagazio, Corrado & Persico, Luca & Querci, Francesca, 2021. "Public guarantees to SME lending: Do broader eligibility criteria pay off?," Journal of Banking & Finance, Elsevier, vol. 133(C).
    18. Saadani, Youssef & Arvai, Zsofia & Rocha, Roberto, 2011. "A review of credit guarantee schemes in the Middle East and North Africa Region," Policy Research Working Paper Series 5612, The World Bank.
    19. Alberto Abadie & David Drukker & Jane Leber Herr & Guido W. Imbens, 2004. "Implementing matching estimators for average treatment effects in Stata," Stata Journal, StataCorp LP, vol. 4(3), pages 290-311, September.
    20. Rodrigo Martín-García & Jorge Morán Santor, 2021. "Public guarantees: a countercyclical instrument for SME growth. Evidence from the Spanish Region of Madrid," Small Business Economics, Springer, vol. 56(1), pages 427-449, January.
    21. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    22. Uesugi, Iichiro & Sakai, Koji & Yamashiro, Guy M., 2010. "The Effectiveness of Public Credit Guarantees in the Japanese Loan Market," Journal of the Japanese and International Economies, Elsevier, vol. 24(4), pages 457-480, December.
    23. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    24. Zia, Bilal H., 2008. "Export incentives, financial constraints, and the (mis)allocation of credit: Micro-level evidence from subsidized export loans," Journal of Financial Economics, Elsevier, vol. 87(2), pages 498-527, February.
    25. Honohan, Patrick, 2010. "Partial credit guarantees: Principles and practice," Journal of Financial Stability, Elsevier, vol. 6(1), pages 1-9, April.
    26. Jiménez, Gabriel & Ongena, Steven & Peydró, José-Luis & Saurina, Jesús, 2012. "Credit Supply and Monetary Policy: Identifying the Bank Balance-Sheet Channel with Loan Applications," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 102(5), pages 2301-2326.
    27. Jianqing Fan & Jinchi Lv, 2008. "Sure independence screening for ultrahigh dimensional feature space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(5), pages 849-911, November.
    28. de Blasio, Guido & De Mitri, Stefania & D'Ignazio, Alessio & Finaldi Russo, Paolo & Stoppani, Lavinia, 2018. "Public guarantees to SME borrowing. A RDD evaluation," Journal of Banking & Finance, Elsevier, vol. 96(C), pages 73-86.
    29. Kuniyoshi Saito & Daisuke Tsuruta, 2018. "Information asymmetry in small and medium enterprise credit guarantee schemes: evidence from Japan," Applied Economics, Taylor & Francis Journals, vol. 50(22), pages 2469-2485, May.
    30. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    31. Edward L. Glaeser & Hyunjin Kim & Michael Luca, 2019. "Nowcasting the Local Economy: Using Yelp Data to Measure Economic Activity," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 249-273, National Bureau of Economic Research, Inc.
    32. Allan Riding & Judith Madill & George Haines, 2007. "Incrementality of SME Loan Guarantees," Small Business Economics, Springer, vol. 29(1), pages 47-61, June.
    33. Maddalena Galardo & Maurizio Lozzi & Paolo Emilio Mistrulli, 2019. "Credit supply, uncertainty and trust: the role of social capital," Temi di discussione (Economic working papers) 1245, Bank of Italy, Economic Research and International Relations Area.
    34. Guglielmo Barone & Litterio Mirenda & Sauro Mocetti, 2016. "Losing my connection: The role of interlocking directorates," Working Paper series 16-09, Rimini Centre for Economic Analysis.
    35. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2018. "Manipulation testing based on density discontinuity," Stata Journal, StataCorp LP, vol. 18(1), pages 234-261, March.
    36. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ashesh Rambachan, 2018. "Algorithmic Fairness," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 22-27, May.
    37. Susan Athey, 2018. "The Impact of Machine Learning on Economics," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 507-547, National Bureau of Economic Research, Inc.
    38. Albertazzi, Ugo & Bottero, Margherita & Sene, Gabriele, 2017. "Information externalities in the credit market and the spell of credit rationing," Journal of Financial Intermediation, Elsevier, vol. 30(C), pages 61-70.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Emanuele Ciani & Marco Gallo & Zeno Rotondi, 2020. "Public credit guarantee and financial additionalities across SME risk classes," Temi di discussione (Economic working papers) 1265, Bank of Italy, Economic Research and International Relations Area.
    2. de Blasio, Guido & D'Ignazio, Alessio & Letta, Marco, 2022. "Gotham city. Predicting ‘corrupted’ municipalities with machine learning," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    3. Guido de Blasio & Alessio D'Ignazio & Marco Letta, 2020. "Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities," Working Papers 16/20, Sapienza University of Rome, DISS.
    4. Borrotti, Matteo & Rabasco, Michele & Santoro, Alessandro, 2023. "Using accounting information to predict aggressive tax location decisions by European groups," Economic Systems, Elsevier, vol. 47(3).
    5. Michele Rabasco & Pietro Battiston, 2023. "Predicting the deterrence effect of tax audits. A machine learning approach," Metroeconomica, Wiley Blackwell, vol. 74(3), pages 531-556, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McKenzie, David & Sansone, Dario, 2017. "Man vs. Machine in Predicting Successful Entrepreneurs: Evidence from a Business Plan Competition in Nigeria," CEPR Discussion Papers 12523, C.E.P.R. Discussion Papers.
    2. de Blasio, Guido & De Mitri, Stefania & D'Ignazio, Alessio & Finaldi Russo, Paolo & Stoppani, Lavinia, 2018. "Public guarantees to SME borrowing. A RDD evaluation," Journal of Banking & Finance, Elsevier, vol. 96(C), pages 73-86.
    3. de Blasio, Guido & D'Ignazio, Alessio & Letta, Marco, 2022. "Gotham city. Predicting ‘corrupted’ municipalities with machine learning," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    4. Lorenzo Gai & Maria Cristina Arcuri & Federica Ielasi, 2023. "How does government-backed finance affect SMEs’ crisis predictors?," Small Business Economics, Springer, vol. 61(3), pages 1205-1229, October.
    5. William Mullins & Patricio Toro, 2018. "Credit Guarantees and New Bank Relationships," Working Papers Central Bank of Chile 820, Central Bank of Chile.
    6. Elliott Ash & Sergio Galletta & Tommaso Giommoni, 2021. "A Machine Learning Approach to Analyze and Support Anti-Corruption Policy," CESifo Working Paper Series 9015, CESifo.
    7. Andini, Monica & Ciani, Emanuele & de Blasio, Guido & D'Ignazio, Alessio & Salvestrini, Viola, 2018. "Targeting with machine learning: An application to a tax rebate program in Italy," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 86-102.
    8. Guido de Blasio & Alessio D'Ignazio & Marco Letta, 2020. "Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities," Working Papers 16/20, Sapienza University of Rome, DISS.
    9. Ricci, Lorenzo & Soggia, Giovanni & Trimarchi, Lorenzo, 2023. "The impact of bank lending standards on credit to firms," Journal of Banking & Finance, Elsevier, vol. 152(C).
    10. Michael Allan Ribers & Hannes Ullrich, 2019. "Battling Antibiotic Resistance: Can Machine Learning Improve Prescribing?," Papers 1906.03044, arXiv.org.
    11. Michael Allan Ribers & Hannes Ullrich, 2020. "Machine Predictions and Human Decisions with Variation in Payoffs and Skill," CESifo Working Paper Series 8702, CESifo.
    12. Peter Hennecke & Doris Neuberger & Dirk Ulbricht, 2019. "The economic and fiscal benefits of guarantee banks in Germany," Small Business Economics, Springer, vol. 53(3), pages 771-794, October.
    13. Lagazio, Corrado & Persico, Luca & Querci, Francesca, 2021. "Public guarantees to SME lending: Do broader eligibility criteria pay off?," Journal of Banking & Finance, Elsevier, vol. 133(C).
    14. Fabio Pammolli & Paolo Bonaretti & Massimo Riccaboni & Valentina Tortolini, 2019. "Quali Regole per la Spesa Farmaceutica? - Criticità, Impatti, Proposte," Working Papers CERM 01-2019, Competitività, Regole, Mercati (CERM).
    15. Yang, Jingwen & Gong, Qingbin & Sendra García, Javier & Xu, Bing, 2022. "Non-parametric identification of public guarantee schemes and commercial banks," Journal of Business Research, Elsevier, vol. 144(C), pages 1196-1206.
    16. McKenzie, David & Sansone, Dario, 2019. "Predicting entrepreneurial success is hard: Evidence from a business plan competition in Nigeria," Journal of Development Economics, Elsevier, vol. 141(C).
    17. Hennecke, Peter & Neuberger, Doris & Ulbricht, Dirk, 2017. "The economic and fiscal value of German guarantee banks," Thuenen-Series of Applied Economic Theory 152, University of Rostock, Institute of Economics.
    18. Théo Nicolas & Stefano Ungaro & Éric Vansteenberghe, 2023. "Public-Guaranteed Loans, Bank Risk-Taking and Regulatory Capital Windfall [Prêts garantis par l'État, prise de risque bancaire et effet d'aubaine sur le capital réglementaire]," Débats économiques et financiers 41, Banque de France.
    19. Bauer, Kevin & Pfeuffer, Nicolas & Abdel-Karim, Benjamin M. & Hinz, Oliver & Kosfeld, Michael, 2020. "The terminator of social welfare? The economic consequences of algorithmic discrimination," SAFE Working Paper Series 287, Leibniz Institute for Financial Research SAFE.
    20. Thomas Url, 2018. "Die Folgen staatlicher Wechselbürgschaften und Beteiligungsgarantien für Inlandsbeschäftigung und Leistungsbilanz," WIFO Studies, WIFO, number 61057, February.

    More about this item

    Keywords

    machine learning; program evaluation; loan guarantees;
    All these keywords.

    JEL classification:

    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • H81 - Public Economics - - Miscellaneous Issues - - - Governmental Loans; Loan Guarantees; Credits; Grants; Bailouts

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdi:wptemi:td_1206_19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bdigvit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.