IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v351y2025i2d10.1007_s10479-024-06321-w.html
   My bibliography  Save this article

Evolution of performance in the water and sewage sector in Brazil: a robust directional Benefit-of-the-Doubt assessment of municipalities from Santa Catarina state

Author

Listed:
  • Andréia May

    (Universidade Federal de Santa Catarina)

  • Carlos Ernani Fries

    (Universidade Federal de Santa Catarina)

  • Hermilio Vilarinho

    (Faculdade de Engenharia da Universidade do Porto
    INESC TEC)

  • Ana S. Camanho

    (Faculdade de Engenharia da Universidade do Porto)

Abstract

The water supply and sewage sector (WSS) is essential for promoting health and providing the population with drinking water and the adequate disposal of effluents. Assessing the evolution of performance in WSS allows for highlighting the best and worst results achieved, identifying benchmarks, and pinpointing sources of improvement for water services. Brazil has a large population and immense freshwater reserves that are unevenly distributed throughout the territory. This situation emanates a challenge that requires the efficient management of water resources. This study develops a composite indicator framework based on the robust Benefit-of-the-Doubt (BoD) approach to estimate the performance of municipalities of the Brazilian State of Santa Catarina from 2009 to 2021, considering financial, operational, and quality dimensions associated with the provision of WSS services. Subsequently, the Global Malmquist Index (GMI) is applied to assess the performance evolution of the municipalities over time. The BoD results enable the quantification of the relative contribution of each sub-indicator to the performance score, allowing the assessment of the strengths and weaknesses of each municipality. The GMI results show an average performance loss of 3.3% in Santa Catarina state and considerable variability among municipalities, with scores ranging from losses of 54.2% to gains of 109.3% in the period analysed.

Suggested Citation

  • Andréia May & Carlos Ernani Fries & Hermilio Vilarinho & Ana S. Camanho, 2025. "Evolution of performance in the water and sewage sector in Brazil: a robust directional Benefit-of-the-Doubt assessment of municipalities from Santa Catarina state," Annals of Operations Research, Springer, vol. 351(2), pages 1489-1535, August.
    • Handle: RePEc:spr:annopr:v:351:y:2025:i:2:d:10.1007_s10479-024-06321-w
    DOI: 10.1007/s10479-024-06321-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-024-06321-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-024-06321-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. M C A S Portela & E Thanassoulis & A Horncastle & T Maugg, 2011. "Productivity change in the water industry in England and Wales: application of the meta-Malmquist index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(12), pages 2173-2188, December.
    2. Dong-hyun Oh, 2010. "A global Malmquist-Luenberger productivity index," Journal of Productivity Analysis, Springer, vol. 34(3), pages 183-197, December.
    3. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    4. Mocholi-Arce, Manuel & Sala-Garrido, Ramon & Molinos-Senante, Maria & Maziotis, Alexandros, 2021. "Performance assessment of water companies: A metafrontier approach accounting for quality of service and group heterogeneities," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    5. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    6. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    7. Jayanath Ananda & Nicholas Pawsey, 2019. "Benchmarking service quality in the urban water industry," Journal of Productivity Analysis, Springer, vol. 51(1), pages 55-72, February.
    8. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    9. See, Kok Fong & Ma, Zhanxin, 2018. "Does non-revenue water affect Malaysia's water services industry productivity?," Utilities Policy, Elsevier, vol. 54(C), pages 125-131.
    10. Alexandros Maziotis & María Molinos-Senante & Ramon Sala-Garrido, 2017. "Assesing the Impact of Quality of Service on the Productivity of Water Industry: a Malmquist-Luenberger Approach for England and Wales," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 31(8), pages 2407-2427, June.
    11. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    12. Molinos-Senante, María & Maziotis, Alexandros & Sala-Garrido, Ramón, 2014. "The Luenberger productivity indicator in the water industry: An empirical analysis for England and Wales," Utilities Policy, Elsevier, vol. 30(C), pages 18-28.
    13. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    14. Henriques, Alda A. & Camanho, Ana S. & Amorim, Pedro & Silva, Jaime G., 2020. "Performance benchmarking using composite indicators to support regulation of the Portuguese wastewater sector," Utilities Policy, Elsevier, vol. 66(C).
    15. Mohsen Afsharian & Heinz Ahn, 2015. "The overall Malmquist index: a new approach for measuring productivity changes over time," Annals of Operations Research, Springer, vol. 226(1), pages 1-27, March.
    16. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    17. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    18. Timo Kuosmanen, 2002. "Modeling Blank Data Entries in Data Envelopment Analysis," Econometrics 0210001, University Library of Munich, Germany.
    19. María Molinos-Senante & Alexandros Maziotis & Ramon Sala-Garrido, 2017. "Assessment of the Total Factor Productivity Change in the English and Welsh Water Industry: a Färe-Primont Productivity Index Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 31(8), pages 2389-2405, June.
    20. Sarrico, C. S. & Dyson, R. G., 2004. "Restricting virtual weights in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 159(1), pages 17-34, November.
    21. Yogita Mumssen & Gustavo Saltiel & Bill Kingdom, 2018. "Aligning Institutions and Incentives for Sustainable Water Supply and Sanitation Services," World Bank Publications - Reports 29795, The World Bank Group.
    22. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    23. Tourinho, Marco & Barbosa, Flávia & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2023. "Productivity change in Brazilian water services: A benchmarking study of national and regional trends," Socio-Economic Planning Sciences, Elsevier, vol. 86(C).
    24. Mergoni, Anna & D'Inverno, Giovanna & Carosi, Laura, 2022. "A composite indicator for measuring the environmental performance of water, wastewater, and solid waste utilities," Utilities Policy, Elsevier, vol. 74(C).
    25. Guerrini, Andrea & Molinos-Senante, María & Romano, Giulia, 2018. "Italian regulatory reform and water utility performance: An impact analysis," Utilities Policy, Elsevier, vol. 52(C), pages 95-102.
    26. George Battese & D. Rao & Christopher O'Donnell, 2004. "A Metafrontier Production Function for Estimation of Technical Efficiencies and Technology Gaps for Firms Operating Under Different Technologies," Journal of Productivity Analysis, Springer, vol. 21(1), pages 91-103, January.
    27. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    28. George E. Battese & D. S. Prasada Rao, 2002. "Technology Gap, Efficiency, and a Stochastic Metafrontier Function," International Journal of Business and Economics, School of Management Development, Feng Chia University, Taichung, Taiwan, vol. 1(2), pages 87-93, August.
    29. Chambers, Robert G. & Chung, Yangho & Fare, Rolf, 1996. "Benefit and Distance Functions," Journal of Economic Theory, Elsevier, vol. 70(2), pages 407-419, August.
    30. Pereira, Miguel Alves & Vilarinho, Hermilio & D’Inverno, Giovanna & Camanho, Ana S., 2023. "A regulatory robust conditional approach to measuring the efficiency of wholesale water supply and wastewater treatment services," Utilities Policy, Elsevier, vol. 83(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miguel Alves Pereira & Giovanna D’Inverno & Ana Santos Camanho, 2025. "Learning mobility in European higher education: How has the Union’s flagship initiative progressed?," Annals of Operations Research, Springer, vol. 351(2), pages 1589-1619, August.
    2. Tourinho, Marco & Barbosa, Flávia & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2023. "Productivity change in Brazilian water services: A benchmarking study of national and regional trends," Socio-Economic Planning Sciences, Elsevier, vol. 86(C).
    3. Vilarinho, Hermilio & Pereira, Miguel Alves & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2024. "Water Utility Service Quality Index: A customer-centred approach for assessing the quality of service in the water sector," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    4. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    5. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    6. Tourinho, Marco & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2022. "Performance assessment of water services in Brazilian municipalities: An integrated view of efficiency and access," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    7. D’Inverno, Giovanna & Polo, Cristina & Sicilia, Gabriela & Simancas, Rosa, 2025. "International differences in educational equity: An assessment using the Benefit of the Doubt model," Socio-Economic Planning Sciences, Elsevier, vol. 99(C).
    8. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    9. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    10. D’Inverno, Giovanna & De Witte, Kristof, 2020. "Service level provision in municipalities: A flexible directional distance composite indicator," European Journal of Operational Research, Elsevier, vol. 286(3), pages 1129-1141.
    11. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    12. Pereira, Miguel Alves & Camanho, Ana Santos & Figueira, José Rui & Marques, Rui Cunha, 2021. "Incorporating preference information in a range directional composite indicator: The case of Portuguese public hospitals," European Journal of Operational Research, Elsevier, vol. 294(2), pages 633-650.
    13. Eni Dardha & Nicky Rogge, 2020. "How's Life in Your Region? Measuring Regional Material Living Conditions, Quality of Life and Subjective Well-Being in OECD Countries Using a Robust, Conditional Benefit-of-the-Doubt Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(3), pages 1015-1073, October.
    14. Mergoni, Anna & D'Inverno, Giovanna & Carosi, Laura, 2022. "A composite indicator for measuring the environmental performance of water, wastewater, and solid waste utilities," Utilities Policy, Elsevier, vol. 74(C).
    15. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    16. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    17. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    18. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    19. Yin, Changjun & Hsiao, Bo & See, Kok Fong, 2024. "Efficiency analysis of China's urban water supply utilities using a dynamic multiactivity network DEA model," Structural Change and Economic Dynamics, Elsevier, vol. 71(C), pages 387-404.
    20. Ramon Sala-Garrido & Manuel Mocholí-Arce & María Molinos-Senante, 2021. "Assessing the Quality of Service of Water Companies: a ‘Benefit of the Doubt’ Composite Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 371-387, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:351:y:2025:i:2:d:10.1007_s10479-024-06321-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.