IDEAS home Printed from https://ideas.repec.org/a/eee/juipol/v96y2025ics0957178725000888.html

A multi-period, multi-criteria model for dynamic performance assessment of the Portuguese water sector

Author

Listed:
  • Tralhão, Sandra
  • Martins, Rita
  • Costa, João Paulo

Abstract

We develop and apply a multi-period overall performance evaluation model, supported by multi-criteria decision aid methods, to assess the dynamic performance of Portuguese water service providers. Data from 2018 to 2021 provided by the regulation authority were used, and a preference elicitation procedure was applied to a pool of experts to determine the scale coefficients associated with the importance of the criteria and with each period under analysis. The results reveal peculiarities that would not be visible using a single-period evaluation process or a criterion-by-criterion evaluation model. For example, we identify service providers with unsatisfactory performance in areas critical to achieving the sector's strategic goals. We highlight the trend of stagnating performance in most indicators, even those that have shown unsatisfactory performance over the years, as is the case with the non-revenue water and major rehabilitation indicators. After applying the model, we can conclude that none of the water utilities is rated as providing “good quality service".

Suggested Citation

  • Tralhão, Sandra & Martins, Rita & Costa, João Paulo, 2025. "A multi-period, multi-criteria model for dynamic performance assessment of the Portuguese water sector," Utilities Policy, Elsevier, vol. 96(C).
    • Handle: RePEc:eee:juipol:v:96:y:2025:i:c:s0957178725000888
    DOI: 10.1016/j.jup.2025.101973
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0957178725000888
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jup.2025.101973?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Zorica Srdjevic & Bojan Srdjevic, 2017. "An Extension of the Sustainability Index Definition in Water Resources Planning and Management," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 31(5), pages 1695-1712, March.
    2. Rocha, António & Costa, Ana Sara & Figueira, José Rui & Ferreira, Diogo Cunha & Marques, Rui Cunha, 2021. "Quality assessment of the Portuguese public hospitals: A multiple criteria approach," Omega, Elsevier, vol. 105(C).
    3. Scholten, Lisa & Schuwirth, Nele & Reichert, Peter & Lienert, Judit, 2015. "Tackling uncertainty in multi-criteria decision analysis – An application to water supply infrastructure planning," European Journal of Operational Research, Elsevier, vol. 242(1), pages 243-260.
    4. Bendoly, Elliot & Bachrach, Daniel G., 2003. "A process-based model for priority convergence in multi-period group decision-making," European Journal of Operational Research, Elsevier, vol. 148(3), pages 534-545, August.
    5. Tajbakhsh, Alireza & Hassini, Elkafi, 2018. "Evaluating sustainability performance in fossil-fuel power plants using a two-stage data envelopment analysis," Energy Economics, Elsevier, vol. 74(C), pages 154-178.
    6. Mergoni, Anna & D'Inverno, Giovanna & Carosi, Laura, 2022. "A composite indicator for measuring the environmental performance of water, wastewater, and solid waste utilities," Utilities Policy, Elsevier, vol. 74(C).
    7. Beata Gavurova & Kristina Kocisova & Jakub Sopko, 2021. "Health system efficiency in OECD countries: dynamic network DEA approach," Health Economics Review, Springer, vol. 11(1), pages 1-25, December.
    8. Islam, Md. Rabiul & Aziz, Md. Tareq & Alauddin, Mohammed & Kader, Zarjes & Islam, Md. Rakibul, 2024. "Site suitability assessment for solar power plants in Bangladesh: A GIS-based analytical hierarchy process (AHP) and multi-criteria decision analysis (MCDA) approach," Renewable Energy, Elsevier, vol. 220(C).
    9. Pinto, F.S. & Costa, A.S. & Figueira, J.R. & Marques, R.C., 2017. "The quality of service: An overall performance assessment for water utilities," Omega, Elsevier, vol. 69(C), pages 115-125.
    10. Mónica de Castro-Pardo & Pascual Fernández Martínez & Amelia Pérez Zabaleta & João C. Azevedo, 2021. "Dealing with Water Conflicts: A Comprehensive Review of MCDM Approaches to Manage Freshwater Ecosystem Services," Land, MDPI, vol. 10(5), pages 1-32, April.
    11. Siskos, Eleftherios & Tsotsolas, Nikos, 2015. "Elicitation of criteria importance weights through the Simos method: A robustness concern," European Journal of Operational Research, Elsevier, vol. 246(2), pages 543-553.
    12. Bruno Urli & Anissa Frini & Sarah Ben Amor, 2019. "PROMETHEE-MP: a generalisation of PROMETHEE for multi-period evaluations under uncertainty," International Journal of Multicriteria Decision Making, Inderscience Enterprises Ltd, vol. 8(1), pages 13-37.
    13. Tobias Witt & Matthias Klumpp, 2021. "Multi-Period Multi-Criteria Decision Making under Uncertainty: A Renewable Energy Transition Case from Germany," Sustainability, MDPI, vol. 13(11), pages 1-20, June.
    14. Srivastava, Akanksha & Parmar, Dipteek & Pamucar, Dragan, 2023. "Comparing multi-criteria models for ranking the Performance of India's water supply utilities," Utilities Policy, Elsevier, vol. 84(C).
    15. Sandra S. Tralhão & Rita Martins & João Paulo Costa, 2018. "Overall Assessment of Environmental Sustainability: The Portuguese Water Industry Case," Notas Económicas, Faculty of Economics, University of Coimbra, issue 47, pages 1-12, December.
    16. Anissa Frini & Sarah Benamor, 2018. "Making Decisions in a Sustainable Development Context: A State-of-the-Art Survey and Proposal of a Multi-period Single Synthesizing Criterion Approach," Computational Economics, Springer;Society for Computational Economics, vol. 52(2), pages 341-385, August.
    17. Andrés Calizaya & Oliver Meixner & Lars Bengtsson & Ronny Berndtsson, 2010. "Multi-criteria Decision Analysis (MCDA) for Integrated Water Resources Management (IWRM) in the Lake Poopo Basin, Bolivia," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 24(10), pages 2267-2289, August.
    18. repec:spr:thdchp:978-3-319-30690-2_6 is not listed on IDEAS
    19. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    20. Pelegrina, Guilherme Dean & Duarte, Leonardo Tomazeli & Grabisch, Michel & Romano, João Marcos Travassos, 2020. "The multilinear model in multicriteria decision making: The case of 2-additive capacities and contributions to parameter identification," European Journal of Operational Research, Elsevier, vol. 282(3), pages 945-956.
    21. Mocholi-Arce, Manuel & Sala-Garrido, Ramon & Molinos-Senante, Maria & Maziotis, Alexandros, 2021. "Performance assessment of water companies: A metafrontier approach accounting for quality of service and group heterogeneities," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    22. Bai, Bo & Xiong, Siqin & Ma, Xiaoming & Liao, Xiawei, 2024. "Assessment of floating solar photovoltaic potential in China," Renewable Energy, Elsevier, vol. 220(C).
    23. Berta Macheve & Alexander Danilenko & L. Joe Moffitt & Caroline van den Berg, 2014. "The IBNET Water Supply and Sanitation Blue Book 2014 : The International Benchmarking Network for Water and Sanitation Utilities Databook," World Bank Publications - Books, The World Bank Group, number 19811, April.
    24. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    25. Picazo-Tadeo, Andres J. & Saez-Fernandez, Francisco J. & Gonzalez-Gomez, Francisco, 2008. "Does service quality matter in measuring the performance of water utilities," Utilities Policy, Elsevier, vol. 16(1), pages 30-38, March.
    26. Sandra S. Tralhão & Rita Martins & João Paulo Costa, 2018. "Overall Assessment of Environmental Sustainability: The Portuguese Water Industry Case," Notas Económicas, Faculty of Economics, University of Coimbra, issue 47, pages 47-58, December.
    27. Theodor J Stewart, 2005. "Dealing with Uncertainties in MCDA," International Series in Operations Research & Management Science, in: Multiple Criteria Decision Analysis: State of the Art Surveys, chapter 0, pages 445-466, Springer.
    28. Cook, Wade D. & Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada & Zhu, Joe, 2019. "DEA-based benchmarking for performance evaluation in pay-for-performance incentive plans," Omega, Elsevier, vol. 84(C), pages 45-54.
    29. Andressa Schlickmann & Sandro César Bortoluzzi, 2023. "Environmental Education Performance Evaluation in a Higher Education Institution," Systemic Practice and Action Research, Springer, vol. 36(6), pages 935-965, December.
    30. Mohammad Ali Hatefi & Seyyed Abdollah Razavi & Vahid Abiri, 2023. "A Novel Multi-attribute Model to Select Appropriate Weighting Method in Decision Making, an Empirical Application in Petroleum Industry," Group Decision and Negotiation, Springer, vol. 32(6), pages 1351-1390, December.
    31. Akanksha Srivastava & Dipteek Parmar, 2023. "Development of water utility performance index using hybrid aggregation technique for water supply systems in India," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(12), pages 15183-15204, December.
    32. Aydin, Nezir, 2017. "A fuzzy-based multi-dimensional and multi-period service quality evaluation outline for rail transit systems," Transport Policy, Elsevier, vol. 55(C), pages 87-98.
    33. Mats Danielson & Love Ekenberg, 2016. "The CAR Method for Using Preference Strength in Multi-criteria Decision Making," Group Decision and Negotiation, Springer, vol. 25(4), pages 775-797, July.
    34. D’Inverno, Giovanna & Carosi, Laura & Romano, Giulia, 2021. "Environmental sustainability and service quality beyond economic and financial indicators: A performance evaluation of Italian water utilities," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    35. Stefan Hajkowicz & Kerry Collins, 2007. "A Review of Multiple Criteria Analysis for Water Resource Planning and Management," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 21(9), pages 1553-1566, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vilarinho, Hermilio & Pereira, Miguel Alves & D’Inverno, Giovanna & Camanho, Ana S., 2026. "A composite indicator framework integrating regulator perspectives for assessing water service quality," Omega, Elsevier, vol. 138(C).
    2. Vilarinho, Hermilio & Pereira, Miguel Alves & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2024. "Water Utility Service Quality Index: A customer-centred approach for assessing the quality of service in the water sector," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    3. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    4. Huang, River & Corrente, Salvatore & Siskos, Eleftherios & Burgherr, Peter, 2026. "The Multi-Level Cards method: Weights elicitation, consistency checking and restoration for hierarchical criteria," Omega, Elsevier, vol. 138(C).
    5. de Castro-Pardo, Mónica & Cabello, José Manuel & Martín, José María & Ruiz, Francisco, 2023. "A multi reference point based index to assess and monitor European water policies from a sustainability approach," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    6. Andréia May & Carlos Ernani Fries & Hermilio Vilarinho & Ana S. Camanho, 2025. "Evolution of performance in the water and sewage sector in Brazil: a robust directional Benefit-of-the-Doubt assessment of municipalities from Santa Catarina state," Annals of Operations Research, Springer, vol. 351(2), pages 1489-1535, August.
    7. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    8. Greco, Salvatore & Słowiński, Roman & Wallenius, Jyrki, 2025. "Fifty years of multiple criteria decision analysis: From classical methods to robust ordinal regression," European Journal of Operational Research, Elsevier, vol. 323(2), pages 351-377.
    9. Gomes da Silva Farias, Pamella & Mendonça Silva, Maisa & de Tarso Marques Bezerra, Saulo, 2025. "Evaluating the water quality of Brazilian distribution companies by the grey-TOPSIS method," Utilities Policy, Elsevier, vol. 97(C).
    10. Mónica de Castro-Pardo & Pascual Fernández Martínez & Amelia Pérez Zabaleta & João C. Azevedo, 2021. "Dealing with Water Conflicts: A Comprehensive Review of MCDM Approaches to Manage Freshwater Ecosystem Services," Land, MDPI, vol. 10(5), pages 1-32, April.
    11. Afsaneh Afzali & Soheil Sabri & M. Rashid & Jamal Mohammad Vali Samani & Ahmad Ludin, 2014. "Inter-Municipal Landfill Site Selection Using Analytic Network Process," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 28(8), pages 2179-2194, June.
    12. José Ribas, 2014. "An Assessment of Conflicting Intentions in the Use of Multipurpose Water Reservoirs," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 28(12), pages 3989-4000, September.
    13. A. Psomas & I. Vryzidis & A. Spyridakos & M. Mimikou, 2021. "MCDA approach for agricultural water management in the context of water–energy–land–food nexus," Operational Research, Springer, vol. 21(1), pages 689-723, March.
    14. Wulf, David & Bertsch, Valentin, 2016. "A natural language generation approach to support understanding and traceability of multi-dimensional preferential sensitivity analysis in multi-criteria decision making," MPRA Paper 75025, University Library of Munich, Germany.
    15. A. Alvarado & M. Esteller & E. Quentin & J. Expósito, 2016. "Multi-Criteria Decision Analysis and GIS Approach for Prioritization of Drinking Water Utilities Protection Based on their Vulnerability to Contamination," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 30(4), pages 1549-1566, March.
    16. Haddad, M. & Sanders, D. & Tewkesbury, G., 2020. "Selecting a discrete multiple criteria decision making method for Boeing to rank four global market regions," Transportation Research Part A: Policy and Practice, Elsevier, vol. 134(C), pages 1-15.
    17. Mahdi Zarghami, 2010. "Urban Water Management Using Fuzzy-Probabilistic Multi-Objective Programming with Dynamic Efficiency," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 24(15), pages 4491-4504, December.
    18. Lienert, Judit & Duygan, Mert & Zheng, Jun, 2016. "Preference stability over time with multiple elicitation methods to support wastewater infrastructure decision-making," European Journal of Operational Research, Elsevier, vol. 253(3), pages 746-760.
    19. Molinos-Senante, María & Delgado-Antequera, Laura & Gómez, Trinidad, 2022. "Measuring the quality of service of water companies: A two-stage goal programming synthetic index proposal," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    20. Siskos, Eleftherios & Burgherr, Peter, 2022. "Multicriteria decision support for the evaluation of electricity supply resilience: Exploration of interacting criteria," European Journal of Operational Research, Elsevier, vol. 298(2), pages 611-626.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:juipol:v:96:y:2025:i:c:s0957178725000888. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.sciencedirect.com/journal/utilities-policy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.