IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v294y2021i2p633-650.html
   My bibliography  Save this article

Incorporating preference information in a range directional composite indicator: The case of Portuguese public hospitals

Author

Listed:
  • Pereira, Miguel Alves
  • Camanho, Ana Santos
  • Figueira, José Rui
  • Marques, Rui Cunha

Abstract

Grasping the intricacy and diversity of complex systems dealing with ever-growing amounts of data is essential to public and private institutions’ continuous improvement. Composite indicators (CIs) emerge as aggregators of key performance indicators, providing a single measure that reflects those multidimensional performance aspects. One way to build such measures is based on the use of data envelopment analysis (DEA). Several DEA models can be used to generate CIs. Still, not many of them can deal concurrently with desirable and undesirable outputs, and incorporate the decision-making actors’ preference information. Based on the directional ‘Benefit-of-the-Doubt’ model, we propose a novel approach consisting of the simultaneous use of weight restrictions and an artificial target reached via a range directional vector. The resulting CI assesses the Portuguese public hospitals’ performance under two perspectives of hospital activity: users and providers. In the end, managerial and policy implications are withdrawn from the results of this study conducted in cooperation with the Portuguese Ministry of Health.

Suggested Citation

  • Pereira, Miguel Alves & Camanho, Ana Santos & Figueira, José Rui & Marques, Rui Cunha, 2021. "Incorporating preference information in a range directional composite indicator: The case of Portuguese public hospitals," European Journal of Operational Research, Elsevier, vol. 294(2), pages 633-650.
    • Handle: RePEc:eee:ejores:v:294:y:2021:i:2:p:633-650
    DOI: 10.1016/j.ejor.2021.01.045
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721000758
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2021.01.045?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. D'Inverno, Giovanna & Carosi, Laura & Ravagli, Letizia, 2018. "Global public spending efficiency in Tuscan municipalities," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 102-113.
    2. Ferretti, Valentina, 2016. "From stakeholders analysis to cognitive mapping and Multi Attribute Value Theory: an integrated approach for policy support," LSE Research Online Documents on Economics 65737, London School of Economics and Political Science, LSE Library.
    3. Golany, B & Roll, Y, 1989. "An application procedure for DEA," Omega, Elsevier, vol. 17(3), pages 237-250.
    4. Marichal, Jean-Luc & Roubens, Marc, 2000. "Determination of weights of interacting criteria from a reference set," European Journal of Operational Research, Elsevier, vol. 124(3), pages 641-650, August.
    5. Korhonen, Pekka J. & Silvennoinen, Kari & Wallenius, Jyrki & Öörni, Anssi, 2012. "Can a linear value function explain choices? An experimental study," European Journal of Operational Research, Elsevier, vol. 219(2), pages 360-367.
    6. Sarrico, C. S. & Dyson, R. G., 2004. "Restricting virtual weights in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 159(1), pages 17-34, November.
    7. Giannis Karagiannis & Georgia Paschalidou, 2017. "Assessing research effectiveness: a comparison of alternative nonparametric models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 456-468, April.
    8. Merja Halme & Tarja Joro & Pekka Korhonen & Seppo Salo & Jyrki Wallenius, 1999. "A Value Efficiency Approach to Incorporating Preference Information in Data Envelopment Analysis," Management Science, INFORMS, vol. 45(1), pages 103-115, January.
    9. Knox Lovell, C. A., 1995. "Measuring the macroeconomic performance of the Taiwanese economy," International Journal of Production Economics, Elsevier, vol. 39(1-2), pages 165-178, April.
    10. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    11. Halme, Merja & Korhonen, Pekka, 2000. "Restricting weights in value efficiency analysis," European Journal of Operational Research, Elsevier, vol. 126(1), pages 175-188, October.
    12. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    13. Helda Azevedo & Céu Mateus, 2014. "Cost effects of hospital mergers in Portugal," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 15(9), pages 999-1010, December.
    14. Thanassoulis, E. & Dyson, R. G., 1992. "Estimating preferred target input-output levels using data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 56(1), pages 80-97, January.
    15. Tarja Joro & Pekka J. Korhonen, 2015. "Value Efficiency Analysis," International Series in Operations Research & Management Science, in: Extension of Data Envelopment Analysis with Preference Information, edition 127, chapter 0, pages 95-109, Springer.
    16. Tarja Joro & Pekka J. Korhonen, 2015. "Data Envelopment Analysis," International Series in Operations Research & Management Science, in: Extension of Data Envelopment Analysis with Preference Information, edition 127, chapter 0, pages 15-26, Springer.
    17. V V Podinovski, 2007. "Improving data envelopment analysis by the use of production trade-offs," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(10), pages 1261-1270, October.
    18. Oggioni, G. & Riccardi, R. & Toninelli, R., 2011. "Eco-efficiency of the world cement industry: A data envelopment analysis," Energy Policy, Elsevier, vol. 39(5), pages 2842-2854, May.
    19. Pereira, Miguel Alves & Figueira, José Rui & Marques, Rui Cunha, 2020. "Using a Choquet integral-based approach for incorporating decision-maker’s preference judgments in a Data Envelopment Analysis model," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1016-1030.
    20. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    21. Pereira, Miguel Alves & Machete, Inês Freire & Ferreira, Diogo Cunha & Marques, Rui Cunha, 2020. "Using multi-criteria decision analysis to rank European health systems: The Beveridgian financing case," Socio-Economic Planning Sciences, Elsevier, vol. 72(C).
    22. Russell G. Thompson & F. D. Singleton & Robert M. Thrall & Barton A. Smith, 1986. "Comparative Site Evaluations for Locating a High-Energy Physics Lab in Texas," Interfaces, INFORMS, vol. 16(6), pages 35-49, December.
    23. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    24. Färe, Rolf & Karagiannis, Giannis, 2014. "Benefit-of-the-doubt aggregation and the diet problem," Omega, Elsevier, vol. 47(C), pages 33-35.
    25. Nicky J. Welton & Howard H. Z. Thom, 2015. "Value of Information," Medical Decision Making, , vol. 35(5), pages 564-566, July.
    26. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    27. Nicky Rogge & Ilse Nijverseel, 2019. "Quality of Life in the European Union: A Multidimensional Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(2), pages 765-789, January.
    28. Fare, Rolf, et al, 1993. "Derivation of Shadow Prices for Undesirable Outputs: A Distance Function Approach," The Review of Economics and Statistics, MIT Press, vol. 75(2), pages 374-380, May.
    29. Ferretti, Valentina, 2016. "From stakeholders analysis to cognitive mapping and Multi-Attribute Value Theory: An integrated approach for policy support," European Journal of Operational Research, Elsevier, vol. 253(2), pages 524-541.
    30. Yasar A. Ozcan, 2008. "Health Care Benchmarking and Performance Evaluation," International Series in Operations Research and Management Science, Springer, number 978-0-387-75448-2, December.
    31. Tom Puyenbroeck, 2018. "On the Output Orientation of the Benefit-of-the-Doubt-Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(2), pages 415-431, September.
    32. Jacobs,Rowena & Smith,Peter C. & Street,Andrew, 2006. "Measuring Efficiency in Health Care," Cambridge Books, Cambridge University Press, number 9780521851442.
    33. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    34. Färe, Rolf & Karagiannis, Giannis & Hasannasab, Maryam & Margaritis, Dimitris, 2019. "A benefit-of-the-doubt model with reverse indicators," European Journal of Operational Research, Elsevier, vol. 278(2), pages 394-400.
    35. Boaz Golany, 1988. "Note---A Note on Including Ordinal Relations Among Multipliers in Data Envelopment Analysis," Management Science, INFORMS, vol. 34(8), pages 1029-1033, August.
    36. Caves, Douglas W & Christensen, Laurits R & Diewert, W Erwin, 1982. "Multilateral Comparisons of Output, Input, and Productivity Using Superlative Index Numbers," Economic Journal, Royal Economic Society, vol. 92(365), pages 73-86, March.
    37. Bottero, M. & Ferretti, V. & Figueira, J.R. & Greco, S. & Roy, B., 2018. "On the Choquet multiple criteria preference aggregation model: Theoretical and practical insights from a real-world application," European Journal of Operational Research, Elsevier, vol. 271(1), pages 120-140.
    38. Henriques, Alda A. & Camanho, Ana S. & Amorim, Pedro & Silva, Jaime G., 2020. "Performance benchmarking using composite indicators to support regulation of the Portuguese wastewater sector," Utilities Policy, Elsevier, vol. 66(C).
    39. Podinovski, Victor V., 2001. "DEA models for the explicit maximisation of relative efficiency," European Journal of Operational Research, Elsevier, vol. 131(3), pages 572-586, June.
    40. Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
    41. Tarja Joro & Pekka J. Korhonen, 2015. "Extension of Data Envelopment Analysis with Preference Information," International Series in Operations Research and Management Science, Springer, edition 127, number 978-1-4899-7528-7, December.
    42. Dyson, R. G. & Allen, R. & Camanho, A. S. & Podinovski, V. V. & Sarrico, C. S. & Shale, E. A., 2001. "Pitfalls and protocols in DEA," European Journal of Operational Research, Elsevier, vol. 132(2), pages 245-259, July.
    43. Seiford, Lawrence M. & Zhu, Joe, 2002. "Modeling undesirable factors in efficiency evaluation," European Journal of Operational Research, Elsevier, vol. 142(1), pages 16-20, October.
    44. Pittman, Russell W, 1983. "Multilateral Productivity Comparisons with Undesirable Outputs," Economic Journal, Royal Economic Society, vol. 93(372), pages 883-891, December.
    45. E. Thanassoulis & R. Allen, 1998. "Simulating Weights Restrictions in Data Envelopment Analysis by Means of Unobserved DMUs," Management Science, INFORMS, vol. 44(4), pages 586-594, April.
    46. Agha Iqbal Ali & Wade D. Cook & Lawrence M. Seiford, 1991. "Strict vs. Weak Ordinal Relations for Multipliers in Data Envelopment Analysis," Management Science, INFORMS, vol. 37(6), pages 733-738, June.
    47. Scheel, Holger, 2001. "Undesirable outputs in efficiency valuations," European Journal of Operational Research, Elsevier, vol. 132(2), pages 400-410, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pereira, Miguel Alves & Camanho, Ana Santos & Marques, Rui Cunha & Figueira, José Rui, 2021. "The convergence of the World Health Organization Member States regarding the United Nations’ Sustainable Development Goal ‘Good health and well-being’," Omega, Elsevier, vol. 104(C).
    2. Agovino, Massimiliano & Musella, Gaetano & Scaletti, Alessandro, 2022. "Equilibrium and efficiency in the first aid services market: The case of the emergency department of Sorrento," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    3. Arabmaldar, Aliasghar & Sahoo, Biresh K. & Ghiyasi, Mojtaba, 2023. "A generalized robust data envelopment analysis model based on directional distance function," European Journal of Operational Research, Elsevier, vol. 311(2), pages 617-632.
    4. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    5. Vidoli, F.; & Fusco, E.; & Pignataro, G.; & Guccio, C.;, 2023. "Multi-directional Robust Benefit of the Doubt model: a comprehensive measure for the quality of health care in OECD countries," Health, Econometrics and Data Group (HEDG) Working Papers 23/14, HEDG, c/o Department of Economics, University of York.
    6. Tourinho, Marco & Barbosa, Flávia & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2023. "Productivity change in Brazilian water services: A benchmarking study of national and regional trends," Socio-Economic Planning Sciences, Elsevier, vol. 86(C).
    7. Elorza, María Eugenia & Moscoso, Nebel Silvana & Blanco, Anibal Manuel, 2022. "Assessing performance in health care: A mathematical programming approach for the re-design of primary health care networks," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    8. Carina Steckenleiter & Michael Lechner & Tim Pawlowski & Ute Schüttoff, 2023. "Do local expenditures on sports facilities affect sports participation?," Economic Inquiry, Western Economic Association International, vol. 61(4), pages 1103-1128, October.
    9. Zhang, Cai Wen & Yang, Yuanhui, 2023. "Appraisal of regional hospital efficiency and healthcare quality in China: Impacts of subsidies and marketization," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    10. Wanke, Peter & Araujo, Claudia & Tan, Yong & Antunes, Jorge & Pimenta, Roberto, 2023. "Efficiency in university hospitals: A genetic optimized semi-parametric production function," Operations Research Perspectives, Elsevier, vol. 10(C).
    11. Pereira, Miguel Alves & Marques, Rui Cunha, 2022. "The ‘Sustainable Public Health Index’: What if public health and sustainable development are compatible?," World Development, Elsevier, vol. 149(C).
    12. Pereira, Miguel Alves & Marques, Rui Cunha, 2022. "Is sunshine regulation the new prescription to brighten up public hospitals in Portugal?," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    13. Yu, Haiyan & Yang, Ching-Chi & Yu, Ping, 2023. "Constrained optimization for stratified treatment rules in reducing hospital readmission rates of diabetic patients," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1355-1364.
    14. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    15. Jiménez-Fernández, Eduardo & Sánchez, Angeles & Ortega-Pérez, Mario, 2022. "Dealing with weighting scheme in composite indicators: An unsupervised distance-machine learning proposal for quantitative data," Socio-Economic Planning Sciences, Elsevier, vol. 83(C).
    16. Wang, Qingyi & Liu, Zhuomeng & Jiang, Peng & Luo, Li, 2022. "A stochastic programming model for emergency supplies pre-positioning, transshipment and procurement in a regional healthcare coalition," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    17. Färe, Rolf & Karagiannis, Giannis, 2022. "Aggregating Farrell efficiencies without value data: The case of hospitals," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    18. Samieinasab, Mina & Hamid, Mahdi & Rabbani, Masoud, 2022. "An integrated resilience engineering-lean management approach to performance assessment and improvement of clinical departments," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pereira, Miguel Alves & Figueira, José Rui & Marques, Rui Cunha, 2020. "Using a Choquet integral-based approach for incorporating decision-maker’s preference judgments in a Data Envelopment Analysis model," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1016-1030.
    2. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    3. Pereira, Miguel Alves & Camanho, Ana Santos & Marques, Rui Cunha & Figueira, José Rui, 2021. "The convergence of the World Health Organization Member States regarding the United Nations’ Sustainable Development Goal ‘Good health and well-being’," Omega, Elsevier, vol. 104(C).
    4. António J. R. Santos & Sérgio P. Santos & Carla A. F. Amado & Efigénio L. Rebelo & Júlio C. Mendes, 2020. "Labor inspectorates’ efficiency and effectiveness assessment as a learning path to improve work-related accident prevention," Annals of Operations Research, Springer, vol. 288(2), pages 609-651, May.
    5. D’Inverno, Giovanna & De Witte, Kristof, 2020. "Service level provision in municipalities: A flexible directional distance composite indicator," European Journal of Operational Research, Elsevier, vol. 286(3), pages 1129-1141.
    6. Dovile Stumbriene & Ana S. Camanho & Audrone Jakaitiene, 2020. "The performance of education systems in the light of Europe 2020 strategy," Annals of Operations Research, Springer, vol. 288(2), pages 577-608, May.
    7. Pérez, Karen & González-Araya, Marcela C. & Iriarte, Alfredo, 2017. "Energy and GHG emission efficiency in the Chilean manufacturing industry: Sectoral and regional analysis by DEA and Malmquist indexes," Energy Economics, Elsevier, vol. 66(C), pages 290-302.
    8. Zhou, Peng & Poh, Kim Leng & Ang, Beng Wah, 2007. "A non-radial DEA approach to measuring environmental performance," European Journal of Operational Research, Elsevier, vol. 178(1), pages 1-9, April.
    9. T Joro & E-J Viitala, 2004. "Weight-restricted DEA in action: from expert opinions to mathematical models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(8), pages 814-821, August.
    10. Ahti Salo & Antti Punkka, 2011. "Ranking Intervals and Dominance Relations for Ratio-Based Efficiency Analysis," Management Science, INFORMS, vol. 57(1), pages 200-214, January.
    11. Tavana, Madjid & Ebrahimnejad, Ali & Santos-Arteaga, Francisco J. & Mansourzadeh, Seyed Mehdi & Matin, Reza Kazemi, 2018. "A hybrid DEA-MOLP model for public school assessment and closure decision in the City of Philadelphia," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 70-89.
    12. William W. Cooper & Kyung Sam Park & Gang Yu, 2001. "An Illustrative Application of Idea (Imprecise Data Envelopment Analysis) to a Korean Mobile Telecommunication Company," Operations Research, INFORMS, vol. 49(6), pages 807-820, December.
    13. Zhou, P. & Ang, B.W. & Poh, K.L., 2008. "A survey of data envelopment analysis in energy and environmental studies," European Journal of Operational Research, Elsevier, vol. 189(1), pages 1-18, August.
    14. Panagiotis Ravanos & Giannis Karagiannis, 2021. "Using VEA to assess effectiveness in the development of human capabilities," Economic Change and Restructuring, Springer, vol. 54(1), pages 75-99, February.
    15. Halme, Merja & Korhonen, Pekka, 2000. "Restricting weights in value efficiency analysis," European Journal of Operational Research, Elsevier, vol. 126(1), pages 175-188, October.
    16. Fusco, Elisa & Vidoli, Francesco & Rogge, Nicky, 2020. "Spatial directional robust Benefit of the Doubt approach in presence of undesirable output: An application to Italian waste sector," Omega, Elsevier, vol. 94(C).
    17. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    18. Mai, Nhat Chi, 2015. "Efficiency of the banking system in Vietnam under financial liberalization," OSF Preprints qsf6d, Center for Open Science.
    19. Kalinichenko, Olena & Amado, Carla A.F. & Santos, Sérgio P., 2022. "Exploring the potential of Data Envelopment Analysis for enhancing pay-for-performance programme design in primary health care," European Journal of Operational Research, Elsevier, vol. 298(3), pages 1084-1100.
    20. Panagiotis Ravanos & Giannis Karagiannis, 2022. "On VEA, Production Trade-offs and Weight Restrictions," Discussion Paper Series 2022_04, Department of Economics, University of Macedonia, revised Jun 2022.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:294:y:2021:i:2:p:633-650. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.