IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v67y2017icp1-18.html
   My bibliography  Save this article

Integrated framework for robustness analysis using ratio-based efficiency model with application to evaluation of Polish airports

Author

Listed:
  • Kadziński, Miłosz
  • Labijak, Anna
  • Napieraj, Małgorzata

Abstract

We consider a problem of evaluating efficiency of Decision Making Units (DMUs) based on their deterministic performance on multiple consumed inputs and multiple produced outputs. We apply a ratio-based efficiency measure, and account for the Decision Maker׳s preference information representable with linear constraints involving input/output weights. We analyze the set of all feasible weights to answer various robustness concerns by deriving: (1) extreme efficiency scores and (2) extreme efficiency ranks for each DMU, (3) possible and necessary efficiency preference relations for pairs of DMUs, (4) efficiency distribution, (5) efficiency rank acceptability indices, and (6) pairwise efficiency outranking indices. The proposed hybrid approach combines and extends previous results from Ratio-based Efficiency Analysis and the SMAA-D method. The practical managerial implications are derived from the complementary character of accounted perspectives on DMUs׳ efficiencies. We present an innovative open-source software implementing an integrated framework for robustness analysis using a ratio-based efficiency model on the diviz platform. The proposed approach is applied to a real-world problem of evaluating efficiency of Polish airports. We consider four inputs related to the capacities of a terminal, runways, and an apron, and to the airport׳s catchment area, and two outputs concerning passenger traffic and number of aircraft movements. We present how the results can be affected by integrating the weight constraints and eliminating outlier DMUs.

Suggested Citation

  • Kadziński, Miłosz & Labijak, Anna & Napieraj, Małgorzata, 2017. "Integrated framework for robustness analysis using ratio-based efficiency model with application to evaluation of Polish airports," Omega, Elsevier, vol. 67(C), pages 1-18.
  • Handle: RePEc:eee:jomega:v:67:y:2017:i:c:p:1-18
    DOI: 10.1016/j.omega.2016.03.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048316000499
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2016.03.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. William W. Cooper & Lawrence M. Seiford & Joe Zhu (ed.), 2011. "Handbook on Data Envelopment Analysis," International Series in Operations Research and Management Science, Springer, number 978-1-4419-6151-8, September.
    2. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    3. Santos, Sérgio P. & Amado, Carla A.F., 2014. "On the need for reform of the Portuguese judicial system – Does Data Envelopment Analysis assessment support it?," Omega, Elsevier, vol. 47(C), pages 1-16.
    4. Tsou, Chi-Ming & Huang, Deng-Yuan, 2010. "On some methods for performance ranking and correspondence analysis in the DEA context," European Journal of Operational Research, Elsevier, vol. 203(3), pages 771-783, June.
    5. Sarkis, Joseph & Talluri, Srinivas, 2004. "Performance based clustering for benchmarking of US airports," Transportation Research Part A: Policy and Practice, Elsevier, vol. 38(5), pages 329-346, June.
    6. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    7. Yu, Ming-Miin & Chern, Ching-Chin & Hsiao, Bo, 2013. "Human resource rightsizing using centralized data envelopment analysis: Evidence from Taiwan's Airports," Omega, Elsevier, vol. 41(1), pages 119-130.
    8. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    9. M C Gouveia & L C Dias & C H Antunes, 2008. "Additive DEA based on MCDA with imprecise information," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(1), pages 54-63, January.
    10. Yongjun Shen & Elke Hermans & Tom Brijs & Geert Wets, 2013. "Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(2), pages 739-756, November.
    11. Tervonen, Tommi & van Valkenhoef, Gert & Baştürk, Nalan & Postmus, Douwe, 2013. "Hit-And-Run enables efficient weight generation for simulation-based multiple criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 224(3), pages 552-559.
    12. Bellini, Tiziano, 2012. "Forward search outlier detection in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 216(1), pages 200-207.
    13. Joe Zhu, 2014. "Data Envelopment Analysis," International Series in Operations Research & Management Science, in: Quantitative Models for Performance Evaluation and Benchmarking, edition 3, chapter 1, pages 1-9, Springer.
    14. Banker, Rajiv D. & Chang, Hsihui, 2006. "The super-efficiency procedure for outlier identification, not for ranking efficient units," European Journal of Operational Research, Elsevier, vol. 175(2), pages 1311-1320, December.
    15. Wu, Yen-Chun Jim & Goh, Mark, 2010. "Container port efficiency in emerging and more advanced markets," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 46(6), pages 1030-1042, November.
    16. Atici, Kazim Baris & Podinovski, Victor V., 2015. "Using data envelopment analysis for the assessment of technical efficiency of units with different specialisations: An application to agriculture," Omega, Elsevier, vol. 54(C), pages 72-83.
    17. Lahdelma, Risto & Salminen, Pekka, 2006. "Stochastic multicriteria acceptability analysis using the data envelopment model," European Journal of Operational Research, Elsevier, vol. 170(1), pages 241-252, April.
    18. Zhu, Joe, 1996. "Robustness of the efficient DMUs in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 90(3), pages 451-460, May.
    19. Avkiran, Necmi Kemal, 2015. "An illustration of dynamic network DEA in commercial banking including robustness tests," Omega, Elsevier, vol. 55(C), pages 141-150.
    20. Fung, Michael Ka Yiu & Wan, Ken Kai Hong & Hui, Yer Van & Law, Japhet Sebastian, 2008. "Productivity changes in Chinese airports 1995-2004," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 44(3), pages 521-542, May.
    21. Cook, Wade D. & Tone, Kaoru & Zhu, Joe, 2014. "Data envelopment analysis: Prior to choosing a model," Omega, Elsevier, vol. 44(C), pages 1-4.
    22. Barros, Carlos Pestana, 2008. "Technical change and productivity growth in airports: A case study," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(5), pages 818-832, June.
    23. Ahti Salo & Antti Punkka, 2011. "Ranking Intervals and Dominance Relations for Ratio-Based Efficiency Analysis," Management Science, INFORMS, vol. 57(1), pages 200-214, January.
    24. Panayides, Photis M. & Lambertides, Neophytos & Savva, Christos S., 2011. "The relative efficiency of shipping companies," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 47(5), pages 681-694, September.
    25. Barros, Carlos Pestana & Managi, Shunsuke & Matousek, Roman, 2009. "Productivity growth and biased technological change: Credit banks in Japan," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 19(5), pages 924-936, December.
    26. Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
    27. Graham, Daniel J., 2008. "Productivity and efficiency in urban railways: Parametric and non-parametric estimates," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 44(1), pages 84-99, January.
    28. John W. Chinneck, 2008. "Feasibility and Infeasibility in Optimization," International Series in Operations Research and Management Science, Springer, number 978-0-387-74932-7, September.
    29. Kao, Chiang & Liu, Shiang-Tai, 2014. "Multi-period efficiency measurement in data envelopment analysis: The case of Taiwanese commercial banks," Omega, Elsevier, vol. 47(C), pages 90-98.
    30. Zhao, Y. & Triantis, K. & Murray-Tuite, P. & Edara, P., 2011. "Performance measurement of a transportation network with a downtown space reservation system: A network-DEA approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 47(6), pages 1140-1159.
    31. V V Podinovski, 2005. "The explicit role of weight bounds in models of data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(12), pages 1408-1418, December.
    32. Fernandes, Elton & Pacheco, R. R., 2002. "Efficient use of airport capacity," Transportation Research Part A: Policy and Practice, Elsevier, vol. 36(3), pages 225-238, March.
    33. LaPlante, A.E. & Paradi, J.C., 2015. "Evaluation of bank branch growth potential using data envelopment analysis," Omega, Elsevier, vol. 52(C), pages 33-41.
    34. Wang, Ke & Huang, Wei & Wu, Jie & Liu, Ying-Nan, 2014. "Efficiency measures of the Chinese commercial banking system using an additive two-stage DEA," Omega, Elsevier, vol. 44(C), pages 5-20.
    35. Kan Tsui, Wai Hong & Balli, Hatice Ozer & Gilbey, Andrew & Gow, Hamish, 2014. "Operational efficiency of Asia–Pacific airports," Journal of Air Transport Management, Elsevier, vol. 40(C), pages 16-24.
    36. Barros, Carlos Pestana & Weber, William L., 2009. "Productivity growth and biased technological change in UK airports," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 45(4), pages 642-653, July.
    37. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    38. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min, 2016. "Research fronts in data envelopment analysis," Omega, Elsevier, vol. 58(C), pages 33-45.
    39. van Valkenhoef, Gert & Tervonen, Tommi & Postmus, Douwe, 2014. "Notes on ‘Hit-And-Run enables efficient weight generation for simulation-based multiple criteria decision analysis’," European Journal of Operational Research, Elsevier, vol. 239(3), pages 865-867.
    40. Gouveia, M.C. & Dias, L.C. & Antunes, C.H. & Boucinha, J. & Inácio, C.F., 2015. "Benchmarking of maintenance and outage repair in an electricity distribution company using the value-based DEA method," Omega, Elsevier, vol. 53(C), pages 104-114.
    41. Barros, Carlos Pestana & Dieke, Peter U.C., 2008. "Measuring the economic efficiency of airports: A Simar-Wilson methodology analysis," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 44(6), pages 1039-1051, November.
    42. Pels, Eric & Nijkamp, Peter & Rietveld, Piet, 2001. "Relative efficiency of European airports," Transport Policy, Elsevier, vol. 8(3), pages 183-192, July.
    43. Mousseau, Vincent & Figueira, Jose & Dias, Luis & Gomes da Silva, Carlos & Climaco, Joao, 2003. "Resolving inconsistencies among constraints on the parameters of an MCDA model," European Journal of Operational Research, Elsevier, vol. 147(1), pages 72-93, May.
    44. Pels, Eric & Nijkamp, Peter & Rietveld, Piet, 2003. "Inefficiencies and scale economies of European airport operations," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 39(5), pages 341-361, September.
    45. Podinovski, Victor V., 2001. "DEA models for the explicit maximisation of relative efficiency," European Journal of Operational Research, Elsevier, vol. 131(3), pages 572-586, June.
    46. Zhu, Joe, 2001. "Super-efficiency and DEA sensitivity analysis," European Journal of Operational Research, Elsevier, vol. 129(2), pages 443-455, March.
    47. Sarkis, Joseph, 2000. "A comparative analysis of DEA as a discrete alternative multiple criteria decision tool," European Journal of Operational Research, Elsevier, vol. 123(3), pages 543-557, June.
    48. Roy, Bernard, 2010. "Robustness in operational research and decision aiding: A multi-faceted issue," European Journal of Operational Research, Elsevier, vol. 200(3), pages 629-638, February.
    49. Seiford, Lawrence M. & Zhu, Joe, 1998. "Stability regions for maintaining efficiency in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 108(1), pages 127-139, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Govindan, Kannan & Kadziński, Miłosz & Ehling, Ronja & Miebs, Grzegorz, 2019. "Selection of a sustainable third-party reverse logistics provider based on the robustness analysis of an outranking graph kernel conducted with ELECTRE I and SMAA," Omega, Elsevier, vol. 85(C), pages 1-15.
    2. Anna Labijak-Kowalska & Miłosz Kadziński, 2023. "Exact and stochastic methods for robustness analysis in the context of Imprecise Data Envelopment Analysis," Operational Research, Springer, vol. 23(1), pages 1-34, March.
    3. Patrick Gasser & Marco Cinelli & Anna Labijak & Matteo Spada & Peter Burgherr & Miłosz Kadziński & Božidar Stojadinović, 2020. "Quantifying Electricity Supply Resilience of Countries with Robust Efficiency Analysis," Energies, MDPI, vol. 13(7), pages 1-35, March.
    4. R. Pelissari & M. C. Oliveira & S. Ben Amor & A. Kandakoglu & A. L. Helleno, 2020. "SMAA methods and their applications: a literature review and future research directions," Annals of Operations Research, Springer, vol. 293(2), pages 433-493, October.
    5. Wu, Yunna & Ke, Yiming & Zhang, Ting & Liu, Fangtong & Wang, Jing, 2018. "Performance efficiency assessment of photovoltaic poverty alleviation projects in China: A three-phase data envelopment analysis model," Energy, Elsevier, vol. 159(C), pages 599-610.
    6. Toloo, Mehdi & Mensah, Emmanuel Kwasi & Salahi, Maziar, 2022. "Robust optimization and its duality in data envelopment analysis," Omega, Elsevier, vol. 108(C).
    7. García-Cáceres, Rafael Guillermo, 2020. "Stochastic Multicriteria Acceptability Analysis – Matching (SMAA-M)," Operations Research Perspectives, Elsevier, vol. 7(C).
    8. Gobbo, Simone Cristina de Oliveira & Mariano, Enzo Barberio & Gobbo Jr., José Alcides, 2021. "Combining social network and data envelopment analysis: A proposal for a Selection Employment Contracts Effectiveness index in healthcare network applications," Omega, Elsevier, vol. 103(C).
    9. Liesiö, Juuso & Andelmin, Juho & Salo, Ahti, 2020. "Efficient allocation of resources to a portfolio of decision making units," European Journal of Operational Research, Elsevier, vol. 286(2), pages 619-636.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Örkcü, H. Hasan & Balıkçı, Cemal & Dogan, Mustafa Isa & Genç, Aşır, 2016. "An evaluation of the operational efficiency of turkish airports using data envelopment analysis and the Malmquist productivity index: 2009–2014 case," Transport Policy, Elsevier, vol. 48(C), pages 92-104.
    2. Anna Labijak-Kowalska & Miłosz Kadziński, 2023. "Exact and stochastic methods for robustness analysis in the context of Imprecise Data Envelopment Analysis," Operational Research, Springer, vol. 23(1), pages 1-34, March.
    3. Mahmoudi, Reza & Emrouznejad, Ali & Shetab-Boushehri, Seyyed-Nader & Hejazi, Seyed Reza, 2020. "The origins, development and future directions of data envelopment analysis approach in transportation systems," Socio-Economic Planning Sciences, Elsevier, vol. 69(C).
    4. Shojaei, Payam & Seyed Haeri, Seyed Amin & Mohammadi, Sahar, 2018. "Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique," Journal of Air Transport Management, Elsevier, vol. 68(C), pages 4-13.
    5. Gitto, Simone & Mancuso, Paolo, 2012. "Bootstrapping the Malmquist indexes for Italian airports," International Journal of Production Economics, Elsevier, vol. 135(1), pages 403-411.
    6. Gitto, Simone & Mancuso, Paolo, 2009. "Productivity change in Italian airports," MPRA Paper 34367, University Library of Munich, Germany.
    7. Kaya, Gizem & Aydın, Umut & Karadayı, Melis Almula & Ülengin, Füsun & Ülengin, Burç & İçken, Ayhan, 2022. "Integrated methodology for evaluating the efficiency of airports: A case study in Turkey," Transport Policy, Elsevier, vol. 127(C), pages 31-47.
    8. Gouveia, M.C. & Henriques, C.O. & Costa, P., 2021. "Evaluating the efficiency of structural funds: An application in the competitiveness of SMEs across different EU beneficiary regions," Omega, Elsevier, vol. 101(C).
    9. Güner, Samet & İbrahim Cebeci, Halil, 2021. "Multi-period efficiency analysis of major European and Asian airports under fixed proportion technologies," Transport Policy, Elsevier, vol. 107(C), pages 24-42.
    10. Cavaignac, Laurent & Petiot, Romain, 2017. "A quarter century of Data Envelopment Analysis applied to the transport sector: A bibliometric analysis," Socio-Economic Planning Sciences, Elsevier, vol. 57(C), pages 84-96.
    11. Abbott, Malcolm, 2015. "Reform and efficiency of New Zealand's airports," Utilities Policy, Elsevier, vol. 36(C), pages 1-9.
    12. Huynh, Triet Minh & Kim, Gyuseung & Ha, Hun-Koo, 2020. "Comparative analysis of efficiency for major Southeast Asia airports: A two-stage approach," Journal of Air Transport Management, Elsevier, vol. 89(C).
    13. Kan Tsui, Wai Hong & Balli, Hatice Ozer & Gilbey, Andrew & Gow, Hamish, 2014. "Operational efficiency of Asia–Pacific airports," Journal of Air Transport Management, Elsevier, vol. 40(C), pages 16-24.
    14. Barros, Carlos Pestana, 2011. "Cost efficiency of African airports using a finite mixture model," Transport Policy, Elsevier, vol. 18(6), pages 807-813, November.
    15. Assaf, A. George & Gillen, David & Barros, Carlos, 2012. "Performance assessment of UK airports: Evidence from a Bayesian dynamic frontier model," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 48(3), pages 603-615.
    16. Lin, L.C. & Hong, C.H., 2006. "Operational performance evaluation of international major airports: An application of data envelopment analysis," Journal of Air Transport Management, Elsevier, vol. 12(6), pages 342-351.
    17. Cheng, Gang & Qian, Zhenhua & Zervopoulos, Panagiotis, 2011. "Overcoming the infeasibility of super-efficiency DEA model: a model with generalized orientation," MPRA Paper 31991, University Library of Munich, Germany.
    18. Dyckhoff, Harald & Souren, Rainer, 2022. "Integrating multiple criteria decision analysis and production theory for performance evaluation: Framework and review," European Journal of Operational Research, Elsevier, vol. 297(3), pages 795-816.
    19. Zou, Bo & Kafle, Nabin & Chang, Young-Tae & Park, Kevin, 2015. "US airport financial reform and its implications for airport efficiency: An exploratory investigation," Journal of Air Transport Management, Elsevier, vol. 47(C), pages 66-78.
    20. Gutiérrez, Ester & Lozano, Sebastián, 2016. "Efficiency assessment and output maximization possibilities of European small and medium sized airports," Research in Transportation Economics, Elsevier, vol. 56(C), pages 3-14.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:67:y:2017:i:c:p:1-18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.