IDEAS home Printed from https://ideas.repec.org/a/wly/sustdv/v33y2025i5p7038-7052.html

Evaluating the Sustainability of Water and Sanitation Services: A Comparative Analysis of Methodological Approaches

Author

Listed:
  • Alexandros Maziotis
  • Maria Molinos‐Senante

Abstract

Benchmarking the sustainability of water utilities (WUs) in the provision of water and sanitation services is essential for addressing global sustainability goals. This study proposes a water utility sustainability index (WUSI), which was estimated for a sample of 29 WUs in Chile. To evaluate the impact of weighting methodologies on sustainability assessments, two approaches were applied: the benefit of doubt (BoD) method and the analytic hierarchy process (AHP). The results indicate that the average WUSI score under the BoD method was 0.987, with 55.17% of WUs achieving the maximum score of 1.0, whereas the AHP approach yielded a lower mean score of 0.551, with the highest‐performing WU reaching 0.737. This difference arises from the fact that the weights assigned to the indicators comprising the WUSI under the BoD approach are endogenously optimized to maximize the composite index for each WU, leading to the suppression of poor‐performing indicators. In addition, the BoD method exhibited lower variance (SD = 0.035) compared to AHP (SD = 0.095), suggesting a tendency to overestimate sustainability. The ranking of WUs also varied significantly depending on the weighting methodology used. The study revealed that utility size and geographical location influence sustainability outcomes. The significant discrepancies in WUSI scores based on the weighting methodology highlight the need for regulators to adopt a hybrid approach, combining objective, data‐driven methods with expert and stakeholder input to ensure more balanced and contextually relevant sustainability assessments.

Suggested Citation

  • Alexandros Maziotis & Maria Molinos‐Senante, 2025. "Evaluating the Sustainability of Water and Sanitation Services: A Comparative Analysis of Methodological Approaches," Sustainable Development, John Wiley & Sons, Ltd., vol. 33(5), pages 7038-7052, October.
  • Handle: RePEc:wly:sustdv:v:33:y:2025:i:5:p:7038-7052
    DOI: 10.1002/sd.3511
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sd.3511
    Download Restriction: no

    File URL: https://libkey.io/10.1002/sd.3511?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Romano, Giulia & Guerrini, Andrea & Campedelli, Bettina, 2015. "The new Italian water tariff method: A launching point for novel infrastructures or a backwards step?," Utilities Policy, Elsevier, vol. 34(C), pages 45-53.
    2. M C A Silva Portela & E Thanassoulis & G Simpson, 2004. "Negative data in DEA: a directional distance approach applied to bank branches," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(10), pages 1111-1121, October.
    3. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    4. Alessandro Pagano & Raffaele Giordano & Michele Vurro, 2021. "A Decision Support System Based on AHP for Ranking Strategies to Manage Emergencies on Drinking Water Supply Systems," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(2), pages 613-628, January.
    5. Vidoli, F. & Fusco, E. & Pignataro, G. & Guccio, C., 2024. "Multi-directional Robust Benefit of the Doubt model: An application to the measurement of the quality of acute care services in OECD countries," Socio-Economic Planning Sciences, Elsevier, vol. 93(C).
    6. D’Inverno, Giovanna & De Witte, Kristof, 2020. "Service level provision in municipalities: A flexible directional distance composite indicator," European Journal of Operational Research, Elsevier, vol. 286(3), pages 1129-1141.
    7. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    8. Silva, Maria C.A. & Camanho, Ana S. & Barbosa, Flávia, 2020. "Benchmarking of secondary schools based on Students’ results in higher education," Omega, Elsevier, vol. 95(C).
    9. Denantes, Julia & Donoso, Guillermo, 2021. "Factors influencing customer satisfaction with water service quality in Chile," Utilities Policy, Elsevier, vol. 73(C).
    10. K Kerstens & I Van de Woestyne, 2011. "Negative data in DEA: a simple proportional distance function approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(7), pages 1413-1419, July.
    11. D’Inverno, Giovanna & Carosi, Laura & Romano, Giulia, 2021. "Environmental sustainability and service quality beyond economic and financial indicators: A performance evaluation of Italian water utilities," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    12. Romano, Giulia & Molinos-Senante, María & Guerrini, Andrea, 2017. "Water utility efficiency assessment in Italy by accounting for service quality: An empirical investigation," Utilities Policy, Elsevier, vol. 45(C), pages 97-108.
    13. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    14. Peeter Peda & Giuseppe Grossi & Margo Liik, 2013. "Do ownership and size affect the performance of water utilities? Evidence from Estonian municipalities," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 17(2), pages 237-259, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. D’Inverno, Giovanna & Carosi, Laura & Romano, Giulia, 2021. "Environmental sustainability and service quality beyond economic and financial indicators: A performance evaluation of Italian water utilities," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    2. Miguel Alves Pereira & Giovanna D’Inverno & Ana Santos Camanho, 2025. "Learning mobility in European higher education: How has the Union’s flagship initiative progressed?," Annals of Operations Research, Springer, vol. 351(2), pages 1589-1619, August.
    3. Mergoni, Anna & Emrouznejad, Ali & De Witte, Kristof, 2025. "Fifty years of Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 326(3), pages 389-412.
    4. Maziotis, Alexandros & Molinos-Senante, Maria, 2025. "Assessing the resilience of water and wastewater utilities: A multi-criteria approach for Chile," Socio-Economic Planning Sciences, Elsevier, vol. 102(C).
    5. Kao, Chiang, 2020. "Measuring efficiency in a general production possibility set allowing for negative data," European Journal of Operational Research, Elsevier, vol. 282(3), pages 980-988.
    6. D’Inverno, Giovanna & Polo, Cristina & Sicilia, Gabriela & Simancas, Rosa, 2025. "International differences in educational equity: An assessment using the Benefit of the Doubt model," Socio-Economic Planning Sciences, Elsevier, vol. 99(C).
    7. Laura Carosi & Ana Camanho & Giovanna D’Inverno & Kristof Witte & Rossana Riccardi, 2020. "Preface to the special issue on performance measurement and efficiency analysis—theory and practice," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 409-412, December.
    8. Mosnier, Claire & Boukhriss, Sanae & Minviel, Jean-Joseph, 2023. "Does pig production improves cattle farm sustainability in the French massif central? A hierarchical constrained directional benefit-of-the-doubt approach," Agricultural Systems, Elsevier, vol. 210(C).
    9. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    10. Kao, Chiang, 2022. "Measuring efficiency in a general production possibility set allowing for negative data: An extension and a focus on returns to scale," European Journal of Operational Research, Elsevier, vol. 296(1), pages 267-276.
    11. Silva, Maria C.A. & Camanho, Ana S. & Barbosa, Flávia, 2020. "Benchmarking of secondary schools based on Students’ results in higher education," Omega, Elsevier, vol. 95(C).
    12. Vilarinho, Hermilio & Pereira, Miguel Alves & D’Inverno, Giovanna & Camanho, Ana S., 2026. "A composite indicator framework integrating regulator perspectives for assessing water service quality," Omega, Elsevier, vol. 138(C).
    13. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    14. Vilarinho, Hermilio & Pereira, Miguel Alves & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2024. "Water Utility Service Quality Index: A customer-centred approach for assessing the quality of service in the water sector," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    15. Tarnaud, Albane Christine & Leleu, Hervé, 2018. "Portfolio analysis with DEA: Prior to choosing a model," Omega, Elsevier, vol. 75(C), pages 57-76.
    16. Henriques, Alda A. & Camanho, Ana S. & Amorim, Pedro & Silva, Jaime G., 2020. "Performance benchmarking using composite indicators to support regulation of the Portuguese wastewater sector," Utilities Policy, Elsevier, vol. 66(C).
    17. Amineh Ghazi & Farhad Hosseinzadeh Lotfi & Masoud Sanei, 2020. "Hybrid efficiency measurement and target setting based on identifying defining hyperplanes of the PPS with negative data," Operational Research, Springer, vol. 20(2), pages 1055-1092, June.
    18. Sahoo, Biresh K. & Mehdiloozad, Mahmood & Tone, Kaoru, 2014. "Cost, revenue and profit efficiency measurement in DEA: A directional distance function approach," European Journal of Operational Research, Elsevier, vol. 237(3), pages 921-931.
    19. Barra, Cristian & Zotti, Roberto, 2014. "Handling negative data using Data Envelopment Analysis: a directional distance approach applied to higher education," MPRA Paper 55570, University Library of Munich, Germany.
    20. Ruiz, Francisco & El Gibari, Samira & Cabello, José M. & Gómez, Trinidad, 2020. "MRP-WSCI: Multiple reference point based weak and strong composite indicators," Omega, Elsevier, vol. 95(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:sustdv:v:33:y:2025:i:5:p:7038-7052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1099-1719 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.