IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v87y2019icp150-157.html
   My bibliography  Save this article

Performance evaluation through DEA benchmarking adjusted to goals

Author

Listed:
  • Ruiz, José L.
  • Sirvent, Inmaculada

Abstract

Data Envelopment Analysis (DEA) is extended to the evaluation of performance of organizations within the framework of the implementation of plans for improvements that set management goals. Managers usually set goals without having any evidence that they will be achievable at the moment of conducting performance evaluation or, on the contrary, they may set little too unambitious goals. Using DEA for the benchmarking ensures an evaluation in terms of targets that both are attainable and represent best practices. In addition, the approach we propose adjusts the DEA benchmarking to the goals in order to consider the policy of improvements that was pursued with the setting of such goals. From the methodological point of view, the models that minimize the distance to the DEA strong efficient frontier are extended to incorporate goal information. Specifically, the models developed seek DEA targets that are as close as possible to both actual performances and management goals. To illustrate, we examine an example that is concerned with the evaluation of performance of public Spanish universities.

Suggested Citation

  • Ruiz, José L. & Sirvent, Inmaculada, 2019. "Performance evaluation through DEA benchmarking adjusted to goals," Omega, Elsevier, vol. 87(C), pages 150-157.
  • Handle: RePEc:eee:jomega:v:87:y:2019:i:c:p:150-157
    DOI: 10.1016/j.omega.2018.08.014
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048318300604
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2018.08.014?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    2. Charnes, A. & Cooper, W. W. & Huang, Z. M. & Sun, D. B., 1990. "Polyhedral Cone-Ratio DEA Models with an illustrative application to large commercial banks," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 73-91.
    3. Fang, Lei, 2015. "Centralized resource allocation based on efficiency analysis for step-by-step improvement paths," Omega, Elsevier, vol. 51(C), pages 24-28.
    4. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    5. Russell G. Thompson & F. D. Singleton & Robert M. Thrall & Barton A. Smith, 1986. "Comparative Site Evaluations for Locating a High-Energy Physics Lab in Texas," Interfaces, INFORMS, vol. 16(6), pages 35-49, December.
    6. Ruiz, José L. & Segura, José V. & Sirvent, Inmaculada, 2015. "Benchmarking and target setting with expert preferences: An application to the evaluation of educational performance of Spanish universities," European Journal of Operational Research, Elsevier, vol. 242(2), pages 594-605.
    7. Post, Thierry & Spronk, Jaap, 1999. "Performance benchmarking using interactive data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 472-487, June.
    8. Aparicio, Juan & Cordero, Jose M. & Pastor, Jesus T., 2017. "The determination of the least distance to the strongly efficient frontier in Data Envelopment Analysis oriented models: Modelling and computational aspects," Omega, Elsevier, vol. 71(C), pages 1-10.
    9. Joe Zhu, 2014. "Data Envelopment Analysis," International Series in Operations Research & Management Science, in: Quantitative Models for Performance Evaluation and Benchmarking, edition 3, chapter 1, pages 1-9, Springer.
    10. Maria Silva Portela & Pedro Borges & Emmanuel Thanassoulis, 2003. "Finding Closest Targets in Non-Oriented DEA Models: The Case of Convex and Non-Convex Technologies," Journal of Productivity Analysis, Springer, vol. 19(2), pages 251-269, April.
    11. tone, Kaoru, 2010. "Variations on the theme of slacks-based measure of efficiency in DEA," European Journal of Operational Research, Elsevier, vol. 200(3), pages 901-907, February.
    12. Juan Aparicio & C. A. Knox Lovell & Jesus T. Pastor (ed.), 2016. "Advances in Efficiency and Productivity," International Series in Operations Research and Management Science, Springer, number 978-3-319-48461-7, September.
    13. Cook, Wade D. & Tone, Kaoru & Zhu, Joe, 2014. "Data envelopment analysis: Prior to choosing a model," Omega, Elsevier, vol. 44(C), pages 1-4.
    14. Hirofumi Fukuyama & Hiroya Masaki & Kazuyuki Sekitani & Jianming Shi, 2014. "Distance optimization approach to ratio-form efficiency measures in data envelopment analysis," Journal of Productivity Analysis, Springer, vol. 42(2), pages 175-186, October.
    15. Hirofumi Fukuyama & Jens Leth Hougaard & Kazuyuki Sekitani & Jianming Shi, 2016. "Efficiency measurement with a non-convex free disposal hull technology," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(1), pages 9-19, January.
    16. Rajiv D. Banker & Richard C. Morey, 1986. "Efficiency Analysis for Exogenously Fixed Inputs and Outputs," Operations Research, INFORMS, vol. 34(4), pages 513-521, August.
    17. Stewart, Theodor J., 2010. "Goal directed benchmarking for organizational efficiency," Omega, Elsevier, vol. 38(6), pages 534-539, December.
    18. Hinojosa, M.A. & Mármol, A.M., 2011. "Axial solutions for multiple objective linear problems. An application to target setting in DEA models with preferences," Omega, Elsevier, vol. 39(2), pages 159-167, April.
    19. Yang, Jian-Bo & Wong, Brandon Y.H. & Xu, Dong-Ling & Stewart, Theodor J., 2009. "Integrating DEA-oriented performance assessment and target setting using interactive MOLP methods," European Journal of Operational Research, Elsevier, vol. 195(1), pages 205-222, May.
    20. Mohammad Khoveyni & Robabeh Eslami, 2016. "Managerial goals directed benchmarking for organised efficiency in data envelopment analysis," International Journal of Information and Decision Sciences, Inderscience Enterprises Ltd, vol. 8(1), pages 1-23.
    21. Merja Halme & Tarja Joro & Pekka Korhonen & Seppo Salo & Jyrki Wallenius, 1999. "A Value Efficiency Approach to Incorporating Preference Information in Data Envelopment Analysis," Management Science, INFORMS, vol. 45(1), pages 103-115, January.
    22. Joro, Tarja & Korhonen, Pekka & Zionts, Stanley, 2003. "An interactive approach to improve estimates of value efficiency in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 149(3), pages 688-699, September.
    23. Cook, Wade D. & Ruiz, José L. & Sirvent, Inmaculada & Zhu, Joe, 2017. "Within-group common benchmarking using DEA," European Journal of Operational Research, Elsevier, vol. 256(3), pages 901-910.
    24. Thanassoulis, E. & Dyson, R. G., 1992. "Estimating preferred target input-output levels using data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 56(1), pages 80-97, January.
    25. S Lozano & G Villa, 2005. "Determining a sequence of targets in DEA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(12), pages 1439-1447, December.
    26. Juan Aparicio & José Ruiz & Inmaculada Sirvent, 2007. "Closest targets and minimum distance to the Pareto-efficient frontier in DEA," Journal of Productivity Analysis, Springer, vol. 28(3), pages 209-218, December.
    27. Ando, Kazutoshi & Minamide, Masato & Sekitani, Kazuyuki & Shi, Jianming, 2017. "Monotonicity of minimum distance inefficiency measures for Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 260(1), pages 232-243.
    28. M P Estellita Lins & L Angulo-Meza & A C Moreira Da Silva, 2004. "A multi-objective approach to determine alternative targets in data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(10), pages 1090-1101, October.
    29. Athanassopoulos, Antreas D., 1995. "Goal programming & data envelopment analysis (GoDEA) for target-based multi-level planning: Allocating central grants to the Greek local authorities," European Journal of Operational Research, Elsevier, vol. 87(3), pages 535-550, December.
    30. Antreas D. Athanassopoulos, 1998. "Decision Support for Target-Based Resource Allocation of Public Services in Multiunit and Multilevel Systems," Management Science, INFORMS, vol. 44(2), pages 173-187, February.
    31. Aparicio, Juan & Pastor, Jesus T., 2014. "Closest targets and strong monotonicity on the strongly efficient frontier in DEA," Omega, Elsevier, vol. 44(C), pages 51-57.
    32. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    33. Majid Azadi & Seyed Mostafa Mirhedayatian & Reza Farzipoor Saen, 2013. "A new fuzzy goal directed benchmarking for supplier selection," International Journal of Services and Operations Management, Inderscience Enterprises Ltd, vol. 14(3), pages 321-335.
    34. Ruiz, José L. & Sirvent, Inmaculada, 2016. "Common benchmarking and ranking of units with DEA," Omega, Elsevier, vol. 65(C), pages 1-9.
    35. Nuria Ramón & José L. Ruiz & Inmaculada Sirvent, 2016. "On the Use of DEA Models with Weight Restrictions for Benchmarking and Target Setting," International Series in Operations Research & Management Science, in: Juan Aparicio & C. A. Knox Lovell & Jesus T. Pastor (ed.), Advances in Efficiency and Productivity, chapter 0, pages 149-180, Springer.
    36. Fukuyama, Hirofumi & Maeda, Yasunobu & Sekitani, Kazuyuki & Shi, Jianming, 2014. "Input–output substitutability and strongly monotonic p-norm least distance DEA measures," European Journal of Operational Research, Elsevier, vol. 237(3), pages 997-1007.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kadziński, Miłosz & Stamenković, Mladen & Uniejewski, Maciej, 2022. "Stepwise benchmarking for multiple criteria sorting," Omega, Elsevier, vol. 108(C).
    2. Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada, 2020. "Cross-benchmarking for performance evaluation: Looking across best practices of different peer groups using DEA," Omega, Elsevier, vol. 92(C).
    3. Monge, Juan F. & Ruiz, José L., 2023. "Setting closer targets based on non-dominated convex combinations of Pareto-efficient units: A bi-level linear programming approach in Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 311(3), pages 1084-1096.
    4. An, Qingxian & Tao, Xiangyang & Xiong, Beibei, 2021. "Benchmarking with data envelopment analysis: An agency perspective," Omega, Elsevier, vol. 101(C).
    5. Jarmila Horváthová & Martina Mokrišová & Mária Vrábliková, 2021. "Benchmarking—A Way of Finding Risk Factors in Business Performance," JRFM, MDPI, vol. 14(5), pages 1-17, May.
    6. Zhu, Qingyuan & Aparicio, Juan & Li, Feng & Wu, Jie & Kou, Gang, 2022. "Determining closest targets on the extended facet production possibility set in data envelopment analysis: Modeling and computational aspects," European Journal of Operational Research, Elsevier, vol. 296(3), pages 927-939.
    7. Kim, Nam Hyok & He, Feng & Zhang, Hongjie & Hong, Kwon Ryong & Ri, Kwang-Chol, 2023. "A data envelopment analysis-based clustering approach under dynamic situations," European Journal of Operational Research, Elsevier, vol. 311(1), pages 251-262.
    8. Alda A. Henriques & Milton Fontes & Ana S. Camanho & Giovanna D’Inverno & Pedro Amorim & Jaime Gabriel Silva, 2022. "Performance evaluation of problematic samples: a robust nonparametric approach for wastewater treatment plants," Annals of Operations Research, Springer, vol. 315(1), pages 193-220, August.
    9. Ji, Zhiyong & Wu, Xianhua & Chen, Xueli & Zhou, Wenzhuo & Song, Malin, 2023. "Finding green performance targets globally closest to management goals for ports experiencing similar circumstances," Resources Policy, Elsevier, vol. 85(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada, 2020. "Cross-benchmarking for performance evaluation: Looking across best practices of different peer groups using DEA," Omega, Elsevier, vol. 92(C).
    2. Monge, Juan F. & Ruiz, José L., 2023. "Setting closer targets based on non-dominated convex combinations of Pareto-efficient units: A bi-level linear programming approach in Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 311(3), pages 1084-1096.
    3. Cook, Wade D. & Ruiz, José L. & Sirvent, Inmaculada & Zhu, Joe, 2017. "Within-group common benchmarking using DEA," European Journal of Operational Research, Elsevier, vol. 256(3), pages 901-910.
    4. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    5. Kao, Chiang, 2022. "Closest targets in the slacks-based measure of efficiency for production units with multi-period data," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1042-1054.
    6. Somayeh Razipour-GhalehJough & Farhad Hosseinzadeh Lotfi & Gholamreza Jahanshahloo & Mohsen Rostamy-malkhalifeh & Hamid Sharafi, 2020. "Finding closest target for bank branches in the presence of weight restrictions using data envelopment analysis," Annals of Operations Research, Springer, vol. 288(2), pages 755-787, May.
    7. Ruiz, José L. & Segura, José V. & Sirvent, Inmaculada, 2015. "Benchmarking and target setting with expert preferences: An application to the evaluation of educational performance of Spanish universities," European Journal of Operational Research, Elsevier, vol. 242(2), pages 594-605.
    8. Aparicio, Juan & Cordero, Jose M. & Pastor, Jesus T., 2017. "The determination of the least distance to the strongly efficient frontier in Data Envelopment Analysis oriented models: Modelling and computational aspects," Omega, Elsevier, vol. 71(C), pages 1-10.
    9. Ruiz, José L. & Sirvent, Inmaculada, 2016. "Common benchmarking and ranking of units with DEA," Omega, Elsevier, vol. 65(C), pages 1-9.
    10. Juan Aparicio & Magdalena Kapelko & Bernhard Mahlberg & Jose L. Sainz-Pardo, 2017. "Measuring input-specific productivity change based on the principle of least action," Journal of Productivity Analysis, Springer, vol. 47(1), pages 17-31, February.
    11. Tavana, Madjid & Ebrahimnejad, Ali & Santos-Arteaga, Francisco J. & Mansourzadeh, Seyed Mehdi & Matin, Reza Kazemi, 2018. "A hybrid DEA-MOLP model for public school assessment and closure decision in the City of Philadelphia," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 70-89.
    12. Lozano, Sebastián & Khezri, Somayeh, 2021. "Network DEA smallest improvement approach," Omega, Elsevier, vol. 98(C).
    13. Cook, Wade D. & Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada & Zhu, Joe, 2019. "DEA-based benchmarking for performance evaluation in pay-for-performance incentive plans," Omega, Elsevier, vol. 84(C), pages 45-54.
    14. Le, Minh Hanh & Afsharian, Mohsen & Ahn, Heinz, 2021. "Inverse Frontier-based Benchmarking for Investigating the Efficiency and Achieving the Targets in the Vietnamese Education System," Omega, Elsevier, vol. 103(C).
    15. Zhu, Qingyuan & Aparicio, Juan & Li, Feng & Wu, Jie & Kou, Gang, 2022. "Determining closest targets on the extended facet production possibility set in data envelopment analysis: Modeling and computational aspects," European Journal of Operational Research, Elsevier, vol. 296(3), pages 927-939.
    16. Juan Aparicio & Jesus T. Pastor & Jose L. Sainz-Pardo & Fernando Vidal, 2020. "Estimating and decomposing overall inefficiency by determining the least distance to the strongly efficient frontier in data envelopment analysis," Operational Research, Springer, vol. 20(2), pages 747-770, June.
    17. Yang, J.B. & Wong, B.Y.H. & Xu, D.L. & Liu, X.B. & Steuer, R.E., 2010. "Integrated bank performance assessment and management planning using hybrid minimax reference point - DEA approach," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1506-1518, December.
    18. Sekitani, Kazuyuki & Zhao, Yu, 2023. "Least-distance approach for efficiency analysis: A framework for nonlinear DEA models," European Journal of Operational Research, Elsevier, vol. 306(3), pages 1296-1310.
    19. Zhu, Qingyuan & Wu, Jie & Ji, Xiang & Li, Feng, 2018. "A simple MILP to determine closest targets in non-oriented DEA model satisfying strong monotonicity," Omega, Elsevier, vol. 79(C), pages 1-8.
    20. Aparicio, Juan & Garcia-Nove, Eva M. & Kapelko, Magdalena & Pastor, Jesus T., 2017. "Graph productivity change measure using the least distance to the pareto-efficient frontier in data envelopment analysis," Omega, Elsevier, vol. 72(C), pages 1-14.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:87:y:2019:i:c:p:150-157. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.