IDEAS home Printed from https://ideas.repec.org/a/eee/apmaco/v406y2021ics0096300321003507.html
   My bibliography  Save this article

An evaluation of cross-efficiency methods: With an application to warehouse performance

Author

Listed:
  • Balk, Bert M.
  • (René) De Koster, M.B.M.
  • Kaps, Christian
  • Zofío, José L.

Abstract

Cross-efficiency measurement is an extension of Data Envelopment Analysis that allows for tie-breaking ranking of the Decision Making Units (DMUs) using all the peer evaluations. In this article we examine the theory of cross-efficiency measurement by comparing a selection of methods popular in the literature. These methods are applied to performance measurement of European warehouses. We develop a cross-efficiency method based on a rank-order DEA model to accommodate the ordinal nature of some key variables characterizing warehouse performance. This is one of the first comparisons of methods on a real-life dataset and the first time that a model allowing for qualitative variables is included in such a comparison. Our results show that the choice of model matters, as one obtains statistically different rankings from each one of them. This holds in particular for the multiplicative and game-theoretic methods whose results diverge from the classic method. From a managerial perspective, focused on the applicability of the methods, we evaluate them through a multidimensional metric which considers their capability to rank DMUs, their ease of implementation, and their robustness to sensitivity analyses. We conclude that standard weight-restriction methods, as initiated by Sexton et al. [48], perform as well as recently introduced, more sophisticated alternatives.

Suggested Citation

  • Balk, Bert M. & (René) De Koster, M.B.M. & Kaps, Christian & Zofío, José L., 2021. "An evaluation of cross-efficiency methods: With an application to warehouse performance," Applied Mathematics and Computation, Elsevier, vol. 406(C).
    • Handle: RePEc:eee:apmaco:v:406:y:2021:i:c:s0096300321003507
    DOI: 10.1016/j.amc.2021.126261
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0096300321003507
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.amc.2021.126261?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Ying-Ming & Chin, Kwai-Sang, 2010. "Some alternative models for DEA cross-efficiency evaluation," International Journal of Production Economics, Elsevier, vol. 128(1), pages 332-338, November.
    2. W-M Lu & S-F Lo, 2007. "A benchmark-learning roadmap for regional sustainable development in China," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(7), pages 841-849, July.
    3. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    4. John S. Liu & Louis Y. Y. Lu & Wen-Min Lu, 2016. "Research Fronts and Prevailing Applications in Data Envelopment Analysis," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, chapter 0, pages 543-574, Springer.
    5. Joe Zhu, 2014. "Quantitative Models for Performance Evaluation and Benchmarking," International Series in Operations Research and Management Science, Springer, edition 3, number 978-3-319-06647-9, December.
    6. Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada, 2010. "On the choice of weights profiles in cross-efficiency evaluations," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1564-1572, December.
    7. Balk,Bert M., 2012. "Price and Quantity Index Numbers," Cambridge Books, Cambridge University Press, number 9781107404960, January.
    8. Timothy Anderson & Keith Hollingsworth & Lane Inman, 2002. "The Fixed Weighting Nature of A Cross-Evaluation Model," Journal of Productivity Analysis, Springer, vol. 17(3), pages 249-255, May.
    9. Dariush Khezrimotlagh & Yao Chen, 2018. "Data Envelopment Analysis," International Series in Operations Research & Management Science, in: Decision Making and Performance Evaluation Using Data Envelopment Analysis, chapter 0, pages 217-234, Springer.
    10. Y M Wang & K S Chin & J B Yang, 2007. "Measuring the performances of decision-making units using geometric average efficiency," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(7), pages 929-937, July.
    11. Andrew Johnson & Leon McGinnis, 2011. "Performance measurement in the warehousing industry," IISE Transactions, Taylor & Francis Journals, vol. 43(3), pages 220-230.
    12. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min, 2016. "Research fronts in data envelopment analysis," Omega, Elsevier, vol. 58(C), pages 33-45.
    13. Cook, Wade D. & Zhu, Joe, 2006. "Rank order data in DEA: A general framework," European Journal of Operational Research, Elsevier, vol. 174(2), pages 1021-1038, October.
    14. Nynke Faber & René B.M. De Koster & Ale Smidts, 2018. "Survival of the fittest: the impact of fit between warehouse management structure and warehouse context on warehouse performance," International Journal of Production Research, Taylor & Francis Journals, vol. 56(1-2), pages 120-139, January.
    15. Wu, Jie & Chu, Junfei & Sun, Jiasen & Zhu, Qingyuan, 2016. "DEA cross-efficiency evaluation based on Pareto improvement," European Journal of Operational Research, Elsevier, vol. 248(2), pages 571-579.
    16. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    17. Sungmook Lim & Joe Zhu, 2015. "DEA Cross Efficiency Under Variable Returns to Scale," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 3, pages 45-66, Springer.
    18. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    19. Reza Maddahi & Gholam Reza Jahanshahloo & Farhad Hosseinzadeh Lotfi & Ali Ebrahimnejad, 2014. "Optimising proportional weights as a secondary goal in DEA cross-efficiency evaluation," International Journal of Operational Research, Inderscience Enterprises Ltd, vol. 19(2), pages 234-245.
    20. Olesen, Ole Bent, 2018. "Cross Efficiency Analysis and Extended Facets," Data Envelopment Analysis Journal, now publishers, vol. 4(1), pages 27-65, December.
    21. Joe Zhu, 2014. "DEA Cross Efficiency," International Series in Operations Research & Management Science, in: Quantitative Models for Performance Evaluation and Benchmarking, edition 3, chapter 4, pages 61-92, Springer.
    22. Sungmook Lim & Joe Zhu, 2015. "DEA cross-efficiency evaluation under variable returns to scale," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(3), pages 476-487, March.
    23. Friedman, Lea & Sinuany-Stern, Zilla, 1997. "Scaling units via the canonical correlation analysis in the DEA context," European Journal of Operational Research, Elsevier, vol. 100(3), pages 629-637, August.
    24. W D Cook & J Zhu, 2014. "DEA Cobb–Douglas frontier and cross-efficiency," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(2), pages 265-268, February.
    25. Chris Tofallis, 2014. "On constructing a composite indicator with multiplicative aggregation and the avoidance of zero weights in DEA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(5), pages 791-792, May.
    26. Wade D. Cook & Joe Zhu, 2015. "DEA Cross Efficiency," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 2, pages 23-43, Springer.
    27. Kao, Chiang & Liu, Shiang-Tai, 2019. "Cross efficiency measurement and decomposition in two basic network systems," Omega, Elsevier, vol. 83(C), pages 70-79.
    28. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    29. Aczel, Janos & Roberts, Fred S., 1989. "On the possible merging functions," Mathematical Social Sciences, Elsevier, vol. 17(3), pages 205-243, June.
    30. William W. Cooper & José L. Ruiz & Inmaculada Sirvent, 2011. "Choices and Uses of DEA Weights," International Series in Operations Research & Management Science, in: William W. Cooper & Lawrence M. Seiford & Joe Zhu (ed.), Handbook on Data Envelopment Analysis, chapter 0, pages 93-126, Springer.
    31. Balk, B.M. & de Koster, M.B.M. & Kaps, C. & Zofío, J.L., 2017. "An Evaluation of Cross-Efficiency Methods, Applied to Measuring Warehouse Performance," ERIM Report Series Research in Management ERS-2017-015-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    32. Charnes, A. & Cooper, W. W. & Seiford, L. & Stutz, J., 1982. "A multiplicative model for efficiency analysis," Socio-Economic Planning Sciences, Elsevier, vol. 16(5), pages 223-224.
    33. Wu, Jie & Liang, Liang & Chen, Yao, 2009. "DEA game cross-efficiency approach to Olympic rankings," Omega, Elsevier, vol. 37(4), pages 909-918, August.
    34. Liang Liang & Jie Wu & Wade D. Cook & Joe Zhu, 2008. "The DEA Game Cross-Efficiency Model and Its Nash Equilibrium," Operations Research, INFORMS, vol. 56(5), pages 1278-1288, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Esteve, Miriam & Aparicio, Juan & Rodriguez-Sala, Jesus J. & Zhu, Joe, 2023. "Random Forests and the measurement of super-efficiency in the context of Free Disposal Hull," European Journal of Operational Research, Elsevier, vol. 304(2), pages 729-744.
    2. Lanqing Du & Jinwook Lee, 2023. "Workforce pDEI: Productivity Coupled with DEI," Papers 2311.11231, arXiv.org, revised Dec 2023.
    3. Ebrahimi, Bohlool & Dhamotharan, Lalitha & Ghasemi, Mohammad Reza & Charles, Vincent, 2022. "A cross-inefficiency approach based on the deviation variables framework," Omega, Elsevier, vol. 111(C).
    4. Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel & Zofío, José L., 2021. "Is more always better? On the relevance of decreasing returns to scale on innovation," Technovation, Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng Li & Han Wu & Qingyuan Zhu & Liang Liang & Gang Kou, 2021. "Data envelopment analysis cross efficiency evaluation with reciprocal behaviors," Annals of Operations Research, Springer, vol. 302(1), pages 173-210, July.
    2. Balk, B.M. & de Koster, M.B.M. & Kaps, C. & Zofío, J.L., 2017. "An Evaluation of Cross-Efficiency Methods, Applied to Measuring Warehouse Performance," ERIM Report Series Research in Management ERS-2017-015-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    3. Jie Wu & Junfei Chu & Qingyuan Zhu & Pengzhen Yin & Liang Liang, 2016. "DEA cross-efficiency evaluation based on satisfaction degree: an application to technology selection," International Journal of Production Research, Taylor & Francis Journals, vol. 54(20), pages 5990-6007, October.
    4. Juan Aparicio & José L. Zofío, 2020. "New Definitions of Economic Cross-efficiency," International Series in Operations Research & Management Science, in: Juan Aparicio & C. A. Knox Lovell & Jesus T. Pastor & Joe Zhu (ed.), Advances in Efficiency and Productivity II, pages 11-32, Springer.
    5. Meng, Fanyong & Xiong, Beibei, 2021. "Logical efficiency decomposition for general two-stage systems in view of cross efficiency," European Journal of Operational Research, Elsevier, vol. 294(2), pages 622-632.
    6. Ebrahimi, Bohlool & Dhamotharan, Lalitha & Ghasemi, Mohammad Reza & Charles, Vincent, 2022. "A cross-inefficiency approach based on the deviation variables framework," Omega, Elsevier, vol. 111(C).
    7. Aparicio, Juan & Zofío, José L., 2021. "Economic cross-efficiency," Omega, Elsevier, vol. 100(C).
      • Aparicio, J. & Zofío, J.L., 2019. "Economic Cross-Efficiency," ERIM Report Series Research in Management ERS-2019-001-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    8. Ali Homayoni & Reza Fallahnejad & Farhad Hosseinzadeh Lotfi, 2022. "Cross Malmquist Productivity Index in Data Envelopment Analysis," 4OR, Springer, vol. 20(4), pages 567-602, December.
    9. Wenli Liu & Ying-Ming Wang & Shulong Lv, 2017. "An aggressive game cross-efficiency evaluation in data envelopment analysis," Annals of Operations Research, Springer, vol. 259(1), pages 241-258, December.
    10. Hamid Kiaei & Reza Farzipoor Saen & Reza Kazemi Matin, 2023. "Cross-efficiency evaluation and improvement in two-stage network data envelopment analysis," Annals of Operations Research, Springer, vol. 321(1), pages 281-309, February.
    11. Davtalab-Olyaie, Mostafa & Asgharian, Masoud, 2021. "On Pareto-optimality in the cross-efficiency evaluation," European Journal of Operational Research, Elsevier, vol. 288(1), pages 247-257.
    12. Oukil, Amar, 2020. "Exploiting value system multiplicity and preference voting for robust ranking," Omega, Elsevier, vol. 94(C).
    13. Wu, Jie & Chu, Junfei & Sun, Jiasen & Zhu, Qingyuan, 2016. "DEA cross-efficiency evaluation based on Pareto improvement," European Journal of Operational Research, Elsevier, vol. 248(2), pages 571-579.
    14. Qingxian An & Fanyong Meng & Beibei Xiong, 2018. "Interval cross efficiency for fully ranking decision making units using DEA/AHP approach," Annals of Operations Research, Springer, vol. 271(2), pages 297-317, December.
    15. H. Örkcü & Mehmet Ünsal & Hasan Bal, 2015. "A modification of a mixed integer linear programming (MILP) model to avoid the computational complexity," Annals of Operations Research, Springer, vol. 235(1), pages 599-623, December.
    16. Wang, Ying-Ming & Chin, Kwai-Sang, 2011. "The use of OWA operator weights for cross-efficiency aggregation," Omega, Elsevier, vol. 39(5), pages 493-503, October.
    17. Kao, Chiang & Liu, Shiang-Tai, 2020. "A slacks-based measure model for calculating cross efficiency in data envelopment analysis," Omega, Elsevier, vol. 95(C).
    18. Qiang Hou & Meiou Wang & Xue Zhou, 2018. "Improved DEA Cross Efficiency Evaluation Method Based on Ideal and Anti-Ideal Points," Discrete Dynamics in Nature and Society, Hindawi, vol. 2018, pages 1-9, April.
    19. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min, 2016. "Research fronts in data envelopment analysis," Omega, Elsevier, vol. 58(C), pages 33-45.
    20. Jianhui Xie & Qiwei Xie & Yongjun Li & Liang Liang, 2021. "Solving data envelopment analysis models with sum-of-fractional objectives: a global optimal approach based on the multiparametric disaggregation technique," Annals of Operations Research, Springer, vol. 304(1), pages 453-480, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:apmaco:v:406:y:2021:i:c:s0096300321003507. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/applied-mathematics-and-computation .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.