IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v37y2021i1p360-377.html
   My bibliography  Save this article

Preventing rather than punishing: An early warning model of malfeasance in public procurement

Author

Listed:
  • Gallego, Jorge
  • Rivero, Gonzalo
  • Martínez, Juan

Abstract

Is it possible to predict malfeasance in public procurement? With the proliferation of e-procurement systems in the public sector, anti-corruption agencies and watchdog organizations have access to valuable sources of information with which to identify transactions that are likely to become troublesome and why. In this article, we discuss the promises and challenges of using machine learning models to predict inefficiency and corruption in public procurement. We illustrate this approach with a dataset with more than two million public procurement contracts in Colombia. We trained machine learning models to predict which of them will result in corruption investigations, a breach of contract, or implementation inefficiencies. We then discuss how our models can help practitioners better understand the drivers of corruption and inefficiency in public procurement. Our approach will be useful to governments interested in exploiting large administrative datasets to improve the provision of public goods, and it highlights some of the tradeoffs and challenges that they might face throughout this process.

Suggested Citation

  • Gallego, Jorge & Rivero, Gonzalo & Martínez, Juan, 2021. "Preventing rather than punishing: An early warning model of malfeasance in public procurement," International Journal of Forecasting, Elsevier, vol. 37(1), pages 360-377.
  • Handle: RePEc:eee:intfor:v:37:y:2021:i:1:p:360-377
    DOI: 10.1016/j.ijforecast.2020.06.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207020300935
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2020.06.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Takaya Saito & Marc Rehmsmeier, 2015. "The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-21, March.
    2. Erica Bosio & Simeon Djankov & Edward Glaeser & Andrei Shleifer, 2022. "Public Procurement in Law and Practice," American Economic Review, American Economic Association, vol. 112(4), pages 1091-1117, April.
    3. Sean Lewis-Faupel & Yusuf Neggers & Benjamin A. Olken & Rohini Pande, 2016. "Can Electronic Procurement Improve Infrastructure Provision? Evidence from Public Works in India and Indonesia," American Economic Journal: Economic Policy, American Economic Association, vol. 8(3), pages 258-283, August.
    4. ,, 1998. "Problems And Solutions," Econometric Theory, Cambridge University Press, vol. 14(5), pages 687-698, October.
    5. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    6. Shang-Jin Wei, 2000. "Natural openness and good government," Policy Research Working Paper Series 2411, The World Bank.
    7. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    8. Enrico Colombatto, 2001. "Discretionary power, rent-seeking and corruption," ICER Working Papers 24-2001, ICER - International Centre for Economic Research.
    9. AlÌcia Adserý, 2003. "Are You Being Served? Political Accountability and Quality of Government," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 19(2), pages 445-490, October.
    10. Maxim Mironov & Ekaterina Zhuravskaya, 2016. "Corruption in Procurement and the Political Cycle in Tunneling: Evidence from Financial Transactions Data," American Economic Journal: Economic Policy, American Economic Association, vol. 8(2), pages 287-321, May.
    11. Emanuele Colonnelli & Mounu Prem, 2022. "Corruption and Firms [Mafia and Public Spending: Evidence on the Fiscal Multiplier from a Quasi-experiment]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(2), pages 695-732.
    12. Gallego, Jorge & Prem, Mounu & Vargas, Juan F., 2020. "Corruption in the Times of Pandemia," SocArXiv js8by, Center for Open Science.
    13. Fonseca-Mairena, María Haydée & Triossi, Matteo, 2019. "Incentives and implementation in marriage markets with externalities," Economics Letters, Elsevier, vol. 185(C).
    14. Paul Collier & Martina Kirchberger & Måns Söderbom, 2016. "The Cost of Road Infrastructure in Low- and Middle-Income Countries," The World Bank Economic Review, World Bank, vol. 30(3), pages 522-548.
    15. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    16. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    17. Robin Burgess & Remi Jedwab & Edward Miguel & Ameet Morjaria & Gerard Padró i Miquel, 2015. "The Value of Democracy: Evidence from Road Building in Kenya," American Economic Review, American Economic Association, vol. 105(6), pages 1817-1851, June.
    18. Bardhan, Pranab, 2006. "The economist's approach to the problem of corruption," World Development, Elsevier, vol. 34(2), pages 341-348, February.
    19. Emanuele Colonnelli & Jorge Gallego & Mounu Prem, 2022. "What predicts corruption?," Chapters, in: Paolo Buonanno & Paolo Vanin & Juan Vargas (ed.), A Modern Guide to the Economics of Crime, chapter 16, pages 345-373, Edward Elgar Publishing.
    20. Decarolis, Francesco & Palumbo, Giuliana, 2015. "Renegotiation of public contracts: An empirical analysis," Economics Letters, Elsevier, vol. 132(C), pages 77-81.
    21. Gary S. Becker & George J. Stigler, 1974. "Law Enforcement, Malfeasance, and Compensation of Enforcers," The Journal of Legal Studies, University of Chicago Press, vol. 3(1), pages 1-18, January.
    22. Dal Bo, Ernesto & Rossi, Martin A., 2007. "Corruption and inefficiency: Theory and evidence from electric utilities," Journal of Public Economics, Elsevier, vol. 91(5-6), pages 939-962, June.
    23. Bent Flyvbjerg & Mette K. Skamris holm & Søren L. Buhl, 2003. "How common and how large are cost overruns in transport infrastructure projects?," Transport Reviews, Taylor & Francis Journals, vol. 23(1), pages 71-88, January.
    24. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    25. Cranmer, Skyler J. & Desmarais, Bruce A., 2017. "What Can We Learn from Predictive Modeling?," Political Analysis, Cambridge University Press, vol. 25(2), pages 145-166, April.
    26. Martina Björkman & Jakob Svensson, 2009. "Power to the People: Evidence from a Randomized Field Experiment on Community-Based Monitoring in Uganda," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 735-769.
    27. Myerson Roger B., 1993. "Effectiveness of Electoral Systems for Reducing Government Corruption: A Game-Theoretic Analysis," Games and Economic Behavior, Elsevier, vol. 5(1), pages 118-132, January.
    28. Emanuele Colonnelli & Mounu Prem & Edoardo Teso, 2020. "Patronage and Selection in Public Sector Organizations," American Economic Review, American Economic Association, vol. 110(10), pages 3071-3099, October.
    29. Francesco Decarolis, 2014. "Awarding Price, Contract Performance, and Bids Screening: Evidence from Procurement Auctions," American Economic Journal: Applied Economics, American Economic Association, vol. 6(1), pages 108-132, January.
    30. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    31. Mungiu-Pippidi,Alina, 2015. "The Quest for Good Governance," Cambridge Books, Cambridge University Press, number 9781107534575.
    32. Decio Coviello & Stefano Gagliarducci, 2017. "Tenure in Office and Public Procurement," American Economic Journal: Economic Policy, American Economic Association, vol. 9(3), pages 59-105, August.
    33. Juan Carlos Henao & Carmen Eloísa Ruiz López, 2018. "Corrupción en Colombia Tomo 3 Corrupción privada," Books, Universidad Externado de Colombia, Facultad de Derecho, number 1026, October.
    34. Muchlinski, David & Siroky, David & He, Jingrui & Kocher, Matthew, 2016. "Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data," Political Analysis, Cambridge University Press, vol. 24(1), pages 87-103, January.
    35. ,, 1998. "Problems And Solutions," Econometric Theory, Cambridge University Press, vol. 14(3), pages 381-386, June.
    36. ,, 1998. "Problems And Solutions," Econometric Theory, Cambridge University Press, vol. 14(4), pages 525-537, August.
    37. Treisman, Daniel, 2000. "The causes of corruption: a cross-national study," Journal of Public Economics, Elsevier, vol. 76(3), pages 399-457, June.
    38. Claudio Ferraz & Frederico Finan, 2008. "Exposing Corrupt Politicians: The Effects of Brazil's Publicly Released Audits on Electoral Outcomes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(2), pages 703-745.
    39. ,, 1998. "Problems And Solutions," Econometric Theory, Cambridge University Press, vol. 14(2), pages 285-292, April.
    40. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    41. ,, 1998. "Problems And Solutions," Econometric Theory, Cambridge University Press, vol. 14(1), pages 151-159, February.
    42. Rafael Di Tella & Alberto Ades, 1999. "Rents, Competition, and Corruption," American Economic Review, American Economic Association, vol. 89(4), pages 982-993, September.
    43. Oriana Bandiera & Andrea Prat & Tommaso Valletti, 2009. "Active and Passive Waste in Government Spending: Evidence from a Policy Experiment," American Economic Review, American Economic Association, vol. 99(4), pages 1278-1308, September.
    44. Gallego, Jorge & Li, Christopher & Wantchekon, Leonard, 2020. "Electoral Intermediaries," Working papers 45, Red Investigadores de Economía.
    45. Mungiu-Pippidi,Alina, 2015. "The Quest for Good Governance," Cambridge Books, Cambridge University Press, number 9781107113923.
    46. A. Belloni & V. Chernozhukov & I. Fernández‐Val & C. Hansen, 2017. "Program Evaluation and Causal Inference With High‐Dimensional Data," Econometrica, Econometric Society, vol. 85, pages 233-298, January.
    47. Karina Margarita Acevedo & Iván David Bornacelly, 2014. "Panel Municipal del CEDE," Documentos CEDE 12223, Universidad de los Andes, Facultad de Economía, CEDE.
    48. Nicolas Campos & Eduardo Engel & Ronald D. Fischer & Alexander Galetovic, 2019. "Renegotiations and corruption in infrastructure: The Odebrecht case," "Marco Fanno" Working Papers 0230, Dipartimento di Scienze Economiche "Marco Fanno".
    49. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115, pages 200-249.
    50. Di Tella, Rafael & Schargrodsky, Ernesto, 2003. "The Role of Wages and Auditing during a Crackdown on Corruption in the City of Buenos Aires," Journal of Law and Economics, University of Chicago Press, vol. 46(1), pages 269-292, April.
    51. Félix J. López-Iturriaga & Iván Pastor Sanz, 2018. "Predicting Public Corruption with Neural Networks: An Analysis of Spanish Provinces," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 140(3), pages 975-998, December.
    52. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    53. Van Rijckeghem, Caroline & Weder, Beatrice, 2001. "Bureaucratic corruption and the rate of temptation: do wages in the civil service affect corruption, and by how much?," Journal of Development Economics, Elsevier, vol. 65(2), pages 307-331, August.
    54. Luke N. Condra & Michael Callen & Radha K. Iyengar & James D. Long & Jacob N. Shapiro, 2019. "Damaging democracy? Security provision and turnout in Afghan elections†," Economics and Politics, Wiley Blackwell, vol. 31(2), pages 163-193, July.
    55. Cassandra E DiRienzo & Jayoti Das & Kathryn T Cort & John Burbridge, 2007. "Corruption and the role of information," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 38(2), pages 320-332, March.
    56. Paolo Mauro, 1995. "Corruption and Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 681-712.
    57. Timothy G. Conley & Francesco Decarolis, 2016. "Detecting Bidders Groups in Collusive Auctions," American Economic Journal: Microeconomics, American Economic Association, vol. 8(2), pages 1-38, May.
    58. Bansak, Kirk, 2019. "Can nonexperts really emulate statistical learning methods? A comment on “The accuracy, fairness, and limits of predicting recidivismâ€," Political Analysis, Cambridge University Press, vol. 27(3), pages 370-380, July.
    59. Coviello, Decio & Mariniello, Mario, 2014. "Publicity requirements in public procurement: Evidence from a regression discontinuity design," Journal of Public Economics, Elsevier, vol. 109(C), pages 76-100.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gallego, Jorge & Prem, Mounu & Vargas, Juan F., 2022. "Predicting Politicians' Misconduct: Evidence from Colombia," SocArXiv 5dp8t, Center for Open Science.
    2. Frédéric Marty, 2022. "From Economic Evidence to Algorithmic Evidence: Artificial Intelligence and Blockchain: An Application to Anti-competitive Agreements," GREDEG Working Papers 2022-32, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    3. Belev, S. & Veterinarov, V. & Matveev, E., 2023. "Vertical collusion in public procurement: Estimation based on data for R&D composite auctions," Journal of the New Economic Association, New Economic Association, vol. 59(2), pages 36-63.
    4. Guido de Blasio & Alessio D'Ignazio & Marco Letta, 2020. "Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities," Working Papers 16/20, Sapienza University of Rome, DISS.
    5. Vitezslav Titl & Deni Mazrekaj & Fritz Schiltz, 2024. "Identifying Politically Connected Firms: A Machine Learning Approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 86(1), pages 137-155, February.
    6. Vitezslav Titl & Fritz Schiltz, 2021. "Identifying Politically Connected Firms: A Machine Learning Approach," Working Papers 2110, Utrecht School of Economics.
    7. Gallego, Jorge & Prem, Mounu & Vargas, Juan F., 2020. "Corruption in the Times of Pandemia," Working papers 43, Red Investigadores de Economía.
    8. de Blasio, Guido & D'Ignazio, Alessio & Letta, Marco, 2022. "Gotham city. Predicting ‘corrupted’ municipalities with machine learning," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    9. Elliott Ash & Sergio Galletta & Tommaso Giommoni, 2021. "A Machine Learning Approach to Analyze and Support Anti-Corruption Policy," CESifo Working Paper Series 9015, CESifo.
    10. Frédéric Marty & Thierry Warin, 2023. "Deciphering Algorithmic Collusion: Insights from Bandit Algorithms and Implications for Antitrust Enforcement," CIRANO Working Papers 2023s-26, CIRANO.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Erica Bosio & Simeon Djankov & Edward Glaeser & Andrei Shleifer, 2022. "Public Procurement in Law and Practice," American Economic Review, American Economic Association, vol. 112(4), pages 1091-1117, April.
    2. Abhijit Banerjee & Rema Hanna, 2012. "Corruption [The Handbook of Organizational Economics]," Introductory Chapters,, Princeton University Press.
      • Banerjee, Abhijit & Hanna, Rema & Mullainathan, Sendhil, 2012. "Corruption," Working Paper Series rwp12-023, Harvard University, John F. Kennedy School of Government.
      • Hanna, Rema N. & Mullainathan, Sendhil & Banerjee, Abhijit, 2012. "Corruption," Scholarly Articles 8830779, Harvard Kennedy School of Government.
      • Abhijit Banerjee & Rema Hanna & Sendhil Mullainathan, 2012. "Corruption," Working Papers id:4952, eSocialSciences.
      • Abhijit Banerjee & Sendhil Mullainathan & Rema Hanna, 2012. "Corruption," NBER Working Papers 17968, National Bureau of Economic Research, Inc.
    3. Krisztina Kis-Katos & Günther G. Schulze, 2013. "Corruption in Southeast Asia: a survey of recent research," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 27(1), pages 79-109, May.
    4. Nelson Ramírez-Rondán & Saki Bigio, 2006. "Corruption and Development Indicators: An Empirical Review," Working Papers 2006-007, Banco Central de Reserva del Perú.
    5. Gans-Morse, Jordan & Borges, Mariana & Makarin, Alexey & Mannah-Blankson, Theresa & Nickow, Andre & Zhang, Dong, 2018. "Reducing bureaucratic corruption: Interdisciplinary perspectives on what works," World Development, Elsevier, vol. 105(C), pages 171-188.
    6. Elliott Ash & Sergio Galletta & Tommaso Giommoni, 2021. "A Machine Learning Approach to Analyze and Support Anti-Corruption Policy," CESifo Working Paper Series 9015, CESifo.
    7. Claudio Ferraz & Frederico Finan, 2011. "Electoral Accountability and Corruption: Evidence from the Audits of Local Governments," American Economic Review, American Economic Association, vol. 101(4), pages 1274-1311, June.
    8. Claudio Ferraz & Frederico Finan & Diana Belo Moreira, 2009. "Corrupting Learning: Evidence from Missing Federal Education Funds in Brazil," Textos para discussão 562, Department of Economics PUC-Rio (Brazil).
    9. Jensen, Nathan M. & Li, Quan & Rahman, Aminur, 2007. "Heard melodies are sweet, but those unheard are sweeter : understanding corruption using cross-national firm-level surveys," Policy Research Working Paper Series 4413, The World Bank.
    10. Rodrigo Carril, 2021. "Rules Versus Discretion in Public Procurement," Working Papers 1232, Barcelona School of Economics.
    11. Benjamin A. Olken & Rohini Pande, 2012. "Corruption in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 479-509, July.
    12. Yan Leung Cheung & P. Raghavendra Rau & Aris Stouraitis, 2012. "How much do firms pay as bribes and what benefits do they get? Evidence from corruption cases worldwide," NBER Working Papers 17981, National Bureau of Economic Research, Inc.
    13. Roberto Burguet & Juan-José Ganuza & José García-Montalvo, 2016. "The Microeconomics of Corruption. A Review of Thirty Years of Research," Working Papers 908, Barcelona School of Economics.
    14. Gallego, Jorge & Prem, Mounu & Vargas, Juan F., 2020. "Corruption in the Times of Pandemia," SocArXiv js8by, Center for Open Science.
    15. Schumacher, Ingmar, 2013. "Political stability, corruption and trust in politicians," Economic Modelling, Elsevier, vol. 31(C), pages 359-369.
    16. Olivier Armantier & Amadou Boly, 2008. "Can Corruption Be Studied in the Lab? Comparing a Field and a Lab Experiment," CIRANO Working Papers 2008s-26, CIRANO.
    17. Calogero Guccio & Domenico Lisi & Ilde Rizzo, 2019. "When the purchasing officer looks the other way: on the waste effects of debauched local environment in public works execution," Economics of Governance, Springer, vol. 20(3), pages 205-236, September.
    18. Maximiliano Lauletta & Martín A. Rossi & Christian A. Ruzzier, 2022. "Audits and Government Hiring Practices," Economica, London School of Economics and Political Science, vol. 89(353), pages 214-227, January.
    19. Jensen, Nathan M & Rahman, Aminur, 2011. "The silence of corruption : identifying underreporting of business corruption through randomized response techniques," Policy Research Working Paper Series 5696, The World Bank.
    20. Sarah Brierley, 2020. "Unprincipled Principals: Co‐opted Bureaucrats and Corruption in Ghana," American Journal of Political Science, John Wiley & Sons, vol. 64(2), pages 209-222, April.

    More about this item

    Keywords

    Public procurement; Corruption; Inefficiency; Machine learning; Forecasting;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • M42 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Accounting - - - Auditing
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:37:y:2021:i:1:p:360-377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.