IDEAS home Printed from https://ideas.repec.org/a/eee/enepol/v210y2026ics0301421525005208.html

Optimism, pessimism, and chaos worldwide: A comparative study of energy management performance with robust benchmarking methods

Author

Listed:
  • de Almeida Farinhas, Filipe Ribeiro
  • Vara, Guilherme
  • Caldas, Paulo
  • Ferreira, Diogo Cunha

Abstract

Assessing national Energy Management Performance (EMP) is vital but faces methodological challenges, including weighting subjectivity and sensitivity to outliers and contextual factors in frontier analysis. This study addresses these issues by comparing EMP across 174 countries (c. 2022) using 13 core indicators. It employs Benefit-of-the-Doubt (BoD) modeling (optimistic and pessimistic), robust unconditional order-m analysis (m=40), and conditional order-m analysis incorporating nine environmental variables (e.g., Human Development Index, Environmental Performance Index) to evaluate contextual influence. Results from the initial BoD analysis (optimistic vs. pessimistic) revealed significant divergence and a moderate negative correlation (rank correlation ρ≈−0.4) between optimistic and pessimistic scores and ranks, indicating performance specialization. The unconditional order-m analysis (m=40) yielded an average efficiency potential of 0.873, though 39 top-performing countries could not be evaluated as they defined the frontier. The conditional order-m analysis, accounting for environmental context, resulted in high efficiency scores (mean >0.97). Critically, country rankings remained exceptionally stable (Spearman’s ρ≥0.96) when comparing conditional results to baseline BoD ranks and across different environmental contexts. This suggests that while context theoretically matters, its influence on relative EMP rankings, as assessed by this specific conditional methodology, was minimal, likely due to high baseline BoD performance levels.

Suggested Citation

  • de Almeida Farinhas, Filipe Ribeiro & Vara, Guilherme & Caldas, Paulo & Ferreira, Diogo Cunha, 2026. "Optimism, pessimism, and chaos worldwide: A comparative study of energy management performance with robust benchmarking methods," Energy Policy, Elsevier, vol. 210(C).
  • Handle: RePEc:eee:enepol:v:210:y:2026:i:c:s0301421525005208
    DOI: 10.1016/j.enpol.2025.115013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0301421525005208
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.enpol.2025.115013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Shahbaz, Muhammad & Khan, Saleheen & Tahir, Mohammad Iqbal, 2013. "The dynamic links between energy consumption, economic growth, financial development and trade in China: Fresh evidence from multivariate framework analysis," Energy Economics, Elsevier, vol. 40(C), pages 8-21.
    2. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    3. Gulati, Rachita & Kattumuri, Ruth & Kumar, Sunil, 2020. "A non-parametric index of corporate governance in the banking industry: An application to Indian data," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    4. Sovacool, Benjamin K. & Mukherjee, Ishani, 2011. "Conceptualizing and measuring energy security: A synthesized approach," Energy, Elsevier, vol. 36(8), pages 5343-5355.
    5. Oleg Badunenko & Pavlo Mozharovskyi, 2016. "Nonparametric frontier analysis using Stata," Stata Journal, StataCorp LLC, vol. 16(3), pages 550-589, September.
    6. Färe, Rolf & Karagiannis, Giannis & Hasannasab, Maryam & Margaritis, Dimitris, 2019. "A benefit-of-the-doubt model with reverse indicators," European Journal of Operational Research, Elsevier, vol. 278(2), pages 394-400.
    7. Serra, Teresa & Oude Lansink, Alfons, 2014. "Measuring the impacts of production risk on technical efficiency: A state-contingent conditional order-m approach," European Journal of Operational Research, Elsevier, vol. 239(1), pages 237-242.
    8. Kristof De Witte & Mika Kortelainen, 2013. "What explains the performance of students in a heterogeneous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Applied Economics, Taylor & Francis Journals, vol. 45(17), pages 2401-2412, June.
    9. Sachs,Jeffrey D. & Kroll,Christian & Lafortune,Guillame & Fuller,Grayson & Woelm,Finn, 2022. "Sustainable Development Report 2022," Cambridge Books, Cambridge University Press, number 9781009210034.
    10. Fisher-Vanden, Karen & Jefferson, Gary H. & Jingkui, Ma & Jianyi, Xu, 2006. "Technology development and energy productivity in China," Energy Economics, Elsevier, vol. 28(5-6), pages 690-705, November.
    11. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    12. Mulder, Peter & de Groot, Henri L.F. & Pfeiffer, Birte, 2014. "Dynamics and determinants of energy intensity in the service sector: A cross-country analysis, 1980–2005," Ecological Economics, Elsevier, vol. 100(C), pages 1-15.
    13. Donata Favaro & Eniel Ninka & Margherita Turvani, 2018. "Human capital, technology intensity, and growth in a regional context," Argomenti, University of Urbino Carlo Bo, Department of Economics, Society & Politics, vol. 9(9), pages 1-22, January-A.
    14. Léopold Simar, 2003. "Detecting Outliers in Frontier Models: A Simple Approach," Journal of Productivity Analysis, Springer, vol. 20(3), pages 391-424, November.
    15. Genave, Anna & Blancard, Stéphane & Garabedian, Sabine, 2020. "An assessment of energy vulnerability in Small Island Developing States," Ecological Economics, Elsevier, vol. 171(C).
    16. Ravanos, Panagiotis & Karagiannis, Giannis, 2022. "Tricks with the BoD model and an application to the e-Government Development Index," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    17. Victor V. Podinovski & Tatiana Bouzdine-Chameeva, 2013. "Weight Restrictions and Free Production in Data Envelopment Analysis," Operations Research, INFORMS, vol. 61(2), pages 426-437, April.
    18. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    19. H. Fried & C. Lovell & S. Schmidt & S. Yaisawarng, 2002. "Accounting for Environmental Effects and Statistical Noise in Data Envelopment Analysis," Journal of Productivity Analysis, Springer, vol. 17(1), pages 157-174, January.
    20. Lafuente, Esteban & Araya, Manuel & Leiva, Juan Carlos, 2022. "Assessment of local competitiveness: A composite indicator analysis of Costa Rican counties using the ‘Benefit of the Doubt’ model," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    21. Sadorsky, Perry, 2009. "Renewable energy consumption, CO2 emissions and oil prices in the G7 countries," Energy Economics, Elsevier, vol. 31(3), pages 456-462, May.
    22. Gearhart, Richard S. & Michieka, Nyakundi M., 2018. "A comparison of the robust conditional order-m estimation and two stage DEA in measuring healthcare efficiency among California counties," Economic Modelling, Elsevier, vol. 73(C), pages 395-406.
    23. Mergoni, Anna & Dipierro, Anna Rita & Colamartino, Chiara, 2024. "European agricultural sector: The tortuous path across efficiency, sustainability and environmental risk," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    24. Wenling Wang & Tong Chen, 2020. "Efficiency Evaluation and Influencing Factor Analysis of China’s Public Cultural Services Based on a Super-Efficiency Slacks-Based Measure Model," Sustainability, MDPI, vol. 12(8), pages 1-14, April.
    25. Patterson, Murray G, 1996. "What is energy efficiency? : Concepts, indicators and methodological issues," Energy Policy, Elsevier, vol. 24(5), pages 377-390, May.
    26. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2012. "How to measure the impact of environmental factors in a nonparametric production model," European Journal of Operational Research, Elsevier, vol. 223(3), pages 818-833.
    27. Van Puyenbroeck, Tom & Montalto, Valentina & Saisana, Michaela, 2021. "Benchmarking culture in Europe: A data envelopment analysis approach to identify city-specific strengths," European Journal of Operational Research, Elsevier, vol. 288(2), pages 584-597.
    28. Pereira, Miguel Alves & Camanho, Ana Santos & Marques, Rui Cunha & Figueira, José Rui, 2021. "The convergence of the World Health Organization Member States regarding the United Nations’ Sustainable Development Goal ‘Good health and well-being’," Omega, Elsevier, vol. 104(C).
    29. Sachs,Jeffrey D. & Kroll,Christian & Lafortune,Guillame & Fuller,Grayson & Woelm,Finn, 2022. "Sustainable Development Report 2022," Cambridge Books, Cambridge University Press, number 9781009210089.
    30. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    31. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    32. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    33. Roger Carrington & Tim Coelli & D. S. Prasada Rao, 2005. "The Performance Of Australian Universities: Conceptual Issues And Preliminary Results," Economic Papers, The Economic Society of Australia, vol. 24(2), pages 145-163, June.
    34. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    35. Enzo Barberio Mariano & Diogo Ferraz & Simone Cristina Oliveira Gobbo, 2021. "The Human Development Index with Multiple Data Envelopment Analysis Approaches: A Comparative Evaluation Using Social Network Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 443-500, September.
    36. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    37. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    38. Sahoo, Biresh K. & Singh, Ramadhar & Mishra, Bineet & Sankaran, Krithiga, 2017. "Research productivity in management schools of India during 1968-2015: A directional benefit-of-doubt model analysis," Omega, Elsevier, vol. 66(PA), pages 118-139.
    39. D’Inverno, Giovanna & Carosi, Laura & Romano, Giulia, 2021. "Environmental sustainability and service quality beyond economic and financial indicators: A performance evaluation of Italian water utilities," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    40. Poumanyvong, Phetkeo & Kaneko, Shinji, 2010. "Does urbanization lead to less energy use and lower CO2 emissions? A cross-country analysis," Ecological Economics, Elsevier, vol. 70(2), pages 434-444, December.
    41. Changhee Kim & Hyunjung Kim & Kanghwa Choi, 2020. "Efficiency Analysis of Public Library Services Based on Establishing Entity and Outsourcing," Sustainability, MDPI, vol. 12(21), pages 1-15, November.
    42. A Zanella & A S Camanho & T G Dias, 2013. "Benchmarking countries’ environmental performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(3), pages 426-438, March.
    43. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mergoni, Anna & Emrouznejad, Ali & De Witte, Kristof, 2025. "Fifty years of Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 326(3), pages 389-412.
    2. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    3. D’Inverno, Giovanna & Polo, Cristina & Sicilia, Gabriela & Simancas, Rosa, 2025. "International differences in educational equity: An assessment using the Benefit of the Doubt model," Socio-Economic Planning Sciences, Elsevier, vol. 99(C).
    4. Marc Aliana & Diego Prior & Emili Tortosa-Ausina, 2024. "Assessing the impact of environmental factors on emergency healthcare quality: Implications for budget allocation," Working Papers 2024/04, Economics Department, Universitat Jaume I, Castellón (Spain).
    5. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    6. Giménez, Víctor & Prior, Diego & Thieme, Claudio & Tortosa-Ausina, Emili, 2024. "International comparisons of COVID-19 pandemic management: What can be learned from activity analysis techniques?," Omega, Elsevier, vol. 122(C).
    7. Nolwenn Roudaut & Anne Vanhems, 2012. "Explaining firms efficiency in the Ivorian manufacturing sector: a robust nonparametric approach," Journal of Productivity Analysis, Springer, vol. 37(2), pages 155-169, April.
    8. Alda A. Henriques & Milton Fontes & Ana S. Camanho & Giovanna D’Inverno & Pedro Amorim & Jaime Gabriel Silva, 2022. "Performance evaluation of problematic samples: a robust nonparametric approach for wastewater treatment plants," Annals of Operations Research, Springer, vol. 315(1), pages 193-220, August.
    9. Amir Moradi-Motlagh & Ali Emrouznejad, 2022. "The origins and development of statistical approaches in non-parametric frontier models: a survey of the first two decades of scholarly literature (1998–2020)," Annals of Operations Research, Springer, vol. 318(1), pages 713-741, November.
    10. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    11. Endre Bjoerndal & Mette Bjoerndal & Astrid Cullmann & Maria Nieswand, 2016. "Finding the Right Yardstick: Regulation under Heterogeneous Environments," Discussion Papers of DIW Berlin 1555, DIW Berlin, German Institute for Economic Research.
    12. Bjørndal, Endre & Bjørndal, Mette & Cullmann, Astrid & Nieswand, Maria, 2018. "Finding the right yardstick: Regulation of electricity networks under heterogeneous environments," European Journal of Operational Research, Elsevier, vol. 265(2), pages 710-722.
    13. Gearhart, Richard & Michieka, Nyakundi, 2019. "Natural resource abundance and healthcare efficiency in Appalachia: A robust conditional approach," Energy Policy, Elsevier, vol. 129(C), pages 985-996.
    14. Valentin Zelenyuk, 2019. "Data Envelopment Analysis and Business Analytics: The Big Data Challenges and Some Solutions," CEPA Working Papers Series WP072019, School of Economics, University of Queensland, Australia.
    15. Polemis, Michael L. & Tzeremes, Nickolaos G., 2019. "Competitive conditions and sectors’ productive efficiency: A conditional non-parametric frontier analysis," European Journal of Operational Research, Elsevier, vol. 276(3), pages 1104-1118.
    16. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    17. López-Torres, Laura & Johnes, Jill & Elliott, Caroline & Polo, Cristina, 2021. "The effects of competition and collaboration on efficiency in the UK independent school sector," Economic Modelling, Elsevier, vol. 96(C), pages 40-53.
    18. Juan Aparicio & Jose M. Cordero & Cristina Polo, 2026. "The measurement and decomposition of productivity change with environmental variables: a conditional nonparametric frontier analysis approach," Annals of Operations Research, Springer, vol. 359(3), pages 2351-2388, April.
    19. Michael Zschille, 2015. "Consolidating the water industry: an analysis of the potential gains from horizontal integration in a conditional efficiency framework," Journal of Productivity Analysis, Springer, vol. 44(1), pages 97-114, August.
    20. Franz R. Hahn, 2007. "Determinants of Bank Efficiency in Europe. Assessing Bank Performance Across Markets," WIFO Studies, WIFO, number 31499.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:enepol:v:210:y:2026:i:c:s0301421525005208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/enpol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.