IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v261y2018i1d10.1007_s10479-017-2628-7.html
   My bibliography  Save this article

Integrating quality into the nonparametric analysis of efficiency: a simulation comparison of popular methods

Author

Listed:
  • Yauheniya Varabyova

    (Universität Hamburg)

  • Jonas Schreyögg

    (Universität Hamburg)

Abstract

Measuring efficiency in service-producing industries is challenging, because output quality may have to be considered in addition to output quantity. Previous studies have relied on different nonparametric methods to model the relationship between efficiency and quality; however, limited work has been done so far to compare and integrate these methods. Our literature search identified the following popular methods: a one-stage approach, a congestion analysis, and a two-stage approach. The first two methods treat quality as an additional output (or input) of the production process, whereas the two-stage approach first estimates efficiency without considering quality and then regresses the efficiency estimates on quality in the second stage. In this study, we compare the performance of these three conventional methods to a fairly novel method, the so-called conditional approach, that can also be used to incorporate quality into the analysis of efficiency. We simulate data using eight data generating processes that reflect potential relationships between efficiency and quality in empirical settings. Our simulation exercise illustrates the dominance of the conditional approach over the conventional methods in terms of both predicting the true efficiency scores and capturing the original relationship between efficiency and quality. The conditional approach represents a powerful and flexible tool that can be used when the theoretical link between efficiency and quality is unclear.

Suggested Citation

  • Yauheniya Varabyova & Jonas Schreyögg, 2018. "Integrating quality into the nonparametric analysis of efficiency: a simulation comparison of popular methods," Annals of Operations Research, Springer, vol. 261(1), pages 365-392, February.
  • Handle: RePEc:spr:annopr:v:261:y:2018:i:1:d:10.1007_s10479-017-2628-7
    DOI: 10.1007/s10479-017-2628-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-017-2628-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-017-2628-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Drake, Leigh & Hall, Maximilian J.B. & Simper, Richard, 2006. "The impact of macroeconomic and regulatory factors on bank efficiency: A non-parametric analysis of Hong Kong's banking system," Journal of Banking & Finance, Elsevier, vol. 30(5), pages 1443-1466, May.
    2. Christian von Hirschhausen & Astrid Cullmann & Andreas Kappeler, 2006. "Efficiency analysis of German electricity distribution utilities - non-parametric and parametric tests," Applied Economics, Taylor & Francis Journals, vol. 38(21), pages 2553-2566.
    3. Kenjegalieva, Karligash & Simper, Richard & Weyman-Jones, Tom & Zelenyuk, Valentin, 2009. "Comparative analysis of banking production frameworks in eastern european financial markets," European Journal of Operational Research, Elsevier, vol. 198(1), pages 326-340, October.
    4. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2012. "How to measure the impact of environmental factors in a nonparametric production model," European Journal of Operational Research, Elsevier, vol. 223(3), pages 818-833.
    5. Léopold Simar & Paul Wilson, 2011. "Two-stage DEA: caveat emptor," Journal of Productivity Analysis, Springer, vol. 36(2), pages 205-218, October.
    6. Christian Growitsch & Tooraj Jamasb & Christine Müller & Matthias Wissner, 2016. "Social Cost Efficient Service Quality: Integrating Customer Valuation in Incentive Regulation—Evidence from the Case of Norway," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, chapter 0, pages 71-91, Springer.
    7. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    8. Kooreman, Peter, 1994. "Nursing home care in The Netherlands: a nonparametric efficiency analysis," Journal of Health Economics, Elsevier, vol. 13(3), pages 301-316, October.
    9. Park, Kang H. & Weber, William L., 2006. "A note on efficiency and productivity growth in the Korean Banking Industry, 1992-2002," Journal of Banking & Finance, Elsevier, vol. 30(8), pages 2371-2386, August.
    10. Calogero Guccio & Marco Ferdinando Martorana & Luisa Monaco, 2016. "Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach," Journal of Productivity Analysis, Springer, vol. 45(3), pages 275-298, June.
    11. Clara Dismuke & Vania Sena, 2001. "Is there a Trade-Off between Quality and Productivity? The Case of Diagnostic Technologies in Portugal," Annals of Operations Research, Springer, vol. 107(1), pages 101-116, October.
    12. Cambini, Carlo & Croce, Annalisa & Fumagalli, Elena, 2014. "Output-based incentive regulation in electricity distribution: Evidence from Italy," Energy Economics, Elsevier, vol. 45(C), pages 205-216.
    13. Juan Du & Justin Wang & Yao Chen & Shin-Yi Chou & Joe Zhu, 2014. "Incorporating health outcomes in Pennsylvania hospital efficiency: an additive super-efficiency DEA approach," Annals of Operations Research, Springer, vol. 221(1), pages 161-172, October.
    14. Abhiman Das & Saibal Ghosh, 2006. "Financial deregulation and efficiency: An empirical analysis of Indian banks during the post reform period," Review of Financial Economics, John Wiley & Sons, vol. 15(3), pages 193-221.
    15. Ihsan Isik & M. Kabir Hassan, 2003. "Efficiency, Ownership and Market Structure, Corporate Control and Governance in the Turkish Banking Industry," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 30(9‐10), pages 1363-1421, December.
    16. Berger, Allen N. & DeYoung, Robert, 1997. "Problem loans and cost efficiency in commercial banks," Journal of Banking & Finance, Elsevier, vol. 21(6), pages 849-870, June.
    17. Luiza Bădin & Cinzia Daraio & Léopold Simar, 2014. "Explaining inefficiency in nonparametric production models: the state of the art," Annals of Operations Research, Springer, vol. 214(1), pages 5-30, March.
    18. Giannakis, Dimitrios & Jamasb, Tooraj & Pollitt, Michael, 2005. "Benchmarking and incentive regulation of quality of service: an application to the UK electricity distribution networks," Energy Policy, Elsevier, vol. 33(17), pages 2256-2271, November.
    19. Chang, Shyr-Juh & Hsiao, Hsing-Chin & Huang, Li-Hua & Chang, Hsihui, 2011. "Taiwan quality indicator project and hospital productivity growth," Omega, Elsevier, vol. 39(1), pages 14-22, January.
    20. Badin, Luiza & Daraio, Cinzia & Simar, Léopold, 2010. "Optimal bandwidth selection for conditional efficiency measures: A data-driven approach," European Journal of Operational Research, Elsevier, vol. 201(2), pages 633-640, March.
    21. Varabyova, Yauheniya & Schreyögg, Jonas, 2013. "International comparisons of the technical efficiency of the hospital sector: Panel data analysis of OECD countries using parametric and non-parametric approaches," Health Policy, Elsevier, vol. 112(1), pages 70-79.
    22. Yauheniya Varabyova & Carl Rudolf Blankart & Jonas Schreyögg, 2017. "Using nonparametric conditional approach to integrate quality into efficiency analysis: empirical evidence from cardiology departments," Health Care Management Science, Springer, vol. 20(4), pages 565-576, December.
    23. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    24. Olesen, O. B. & Petersen, N. C., 1995. "Incorporating quality into data envelopment analysis: a stochastic dominance approach," International Journal of Production Economics, Elsevier, vol. 39(1-2), pages 117-135, April.
    25. Murat Bilsel & Nurhan Davutyan, 2014. "Hospital efficiency with risk adjusted mortality as undesirable output: the Turkish case," Annals of Operations Research, Springer, vol. 221(1), pages 73-88, October.
    26. Matranga, Domenica & Sapienza, Francesca, 2015. "Congestion analysis to evaluate the efficiency and appropriateness of hospitals in Sicily," Health Policy, Elsevier, vol. 119(3), pages 324-332.
    27. Gary Ferrier & Julie Trivitt, 2013. "Incorporating quality into the measurement of hospital efficiency: a double DEA approach," Journal of Productivity Analysis, Springer, vol. 40(3), pages 337-355, December.
    28. Drake, Leigh & Hall, Maximilian J. B., 2003. "Efficiency in Japanese banking: An empirical analysis," Journal of Banking & Finance, Elsevier, vol. 27(5), pages 891-917, May.
    29. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    30. Yang, Jinqiu & Zeng, Wu, 2014. "The trade-offs between efficiency and quality in the hospital production: Some evidence from Shenzhen, China," China Economic Review, Elsevier, vol. 31(C), pages 166-184.
    31. Subhash Ray & Kankana Mukherjee, 1998. "Quantity, Quality, and Efficiency for a Partially Super-Additive Cost Function: Connecticut Public Schools Revisited," Journal of Productivity Analysis, Springer, vol. 10(1), pages 47-62, July.
    32. Chen, Chien-Ming, 2013. "A critique of non-parametric efficiency analysis in energy economics studies," Energy Economics, Elsevier, vol. 38(C), pages 146-152.
    33. Chia-Hsuan Wu & Ching-Cheng Chang & Po-Chi Chen & Ken-Nan Kuo, 2013. "Efficiency and productivity change in Taiwan’s hospitals: a non-radial quality-adjusted measurement," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 21(2), pages 431-453, March.
    34. Thanassoulis, E. & Boussofiane, A. & Dyson, R. G., 1995. "Exploring output quality targets in the provision of perinatal care in England using data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 80(3), pages 588-607, February.
    35. Daraio, Cinzia & Simar, Leopold & Wilson, Paul, 2015. "Testing the "Separability" Condition in Two-Stage Nonparametric Models of Production," LIDAM Discussion Papers ISBA 2015018, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    36. Fare, Rolf & Grosskopf, Shawna, 1983. "Measuring output efficiency," European Journal of Operational Research, Elsevier, vol. 13(2), pages 173-179, June.
    37. Shimshak, Daniel G. & Lenard, Melanie L. & Klimberg, Ronald K., 2009. "Incorporating quality into data envelopment analysis of nursing home performance: A case study," Omega, Elsevier, vol. 37(3), pages 672-685, June.
    38. William Yu & Tooraj Jamasb & Michael Pollitt, 2009. "Willingness-to-Pay for Quality of Service: An Application to Efficiency Analysis of the UK Electricity Distribution Utilities," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 1-48.
    39. Giulia Garavaglia & Emanuele Lettieri & Tommaso Agasisti & Silvano Lopez, 2011. "Efficiency and quality of care in nursing homes: an Italian case study," Health Care Management Science, Springer, vol. 14(1), pages 22-35, March.
    40. Melville McMillan & Wing Chan, 2006. "University Efficiency: A Comparison and Consolidation of Results from Stochastic and Non-stochastic Methods," Education Economics, Taylor & Francis Journals, vol. 14(1), pages 1-30.
    41. Davutyan, Nurhan & Bilsel, Murat & Tarcan, Menderes, 2015. "Migration, Risk-Adjusted Mortality, Varieties of Congestion and Patient Satisfaction in Turkish Provincial General Hospitals," Data Envelopment Analysis Journal, now publishers, vol. 1(2), pages 135-169, July.
    42. Diego Prior, 2006. "Efficiency and total quality management in health care organizations: A dynamic frontier approach," Annals of Operations Research, Springer, vol. 145(1), pages 281-299, July.
    43. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    44. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    45. Rajiv D. Banker & Richard C. Morey, 1986. "Efficiency Analysis for Exogenously Fixed Inputs and Outputs," Operations Research, INFORMS, vol. 34(4), pages 513-521, August.
    46. José Luis Navarro-Espigares & Elisa Hernández Torres, 2008. "Efficiency and quality in health services: a crucial link," The Service Industries Journal, Taylor & Francis Journals, vol. 31(3), pages 385-403, December.
    47. Randy I. Anderson & H. Shelton Weeks & Bradley K. Hobbs & James R. Webb, 2003. "Nursing Home Quality, Chain Affiliation, Profit Status and Performance," Journal of Real Estate Research, American Real Estate Society, vol. 25(1), pages 43-60.
    48. Jamasb, Tooraj & Pollitt, Michael, 2003. "International benchmarking and regulation: an application to European electricity distribution utilities," Energy Policy, Elsevier, vol. 31(15), pages 1609-1622, December.
    49. H. Sherman & Joe Zhu, 2006. "Benchmarking with quality-adjusted DEA (Q-DEA) to seek lower-cost high-quality service: Evidence from a U.S.bank application," Annals of Operations Research, Springer, vol. 145(1), pages 301-319, July.
    50. Nyman, John A & Bricker, Dennis L, 1989. "Profit Incentives and Technical Efficiency in the Production of Nursing Home Care," The Review of Economics and Statistics, MIT Press, vol. 71(4), pages 586-594, November.
    51. Jan Clement & Vivian Valdmanis & Gloria Bazzoli & Mei Zhao & Askar Chukmaitov, 2008. "Is more better? An analysis of hospital outcomes and efficiency with a DEA model of output congestion," Health Care Management Science, Springer, vol. 11(1), pages 67-77, March.
    52. V L Miguéis & A S Camanho & E Bjørndal & M Bjørndal, 2012. "Productivity change and innovation in Norwegian electricity distribution companies," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 63(7), pages 982-990, July.
    53. Kyj, Larissa & Isik, Ihsan, 2008. "Bank x-efficiency in Ukraine: An analysis of service characteristics and ownership," Journal of Economics and Business, Elsevier, vol. 60(4), pages 369-393.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Annika Maren Schneider & Eva-Maria Oppel & Jonas Schreyögg, 2020. "Investigating the link between medical urgency and hospital efficiency – Insights from the German hospital market," Health Care Management Science, Springer, vol. 23(4), pages 649-660, December.
    2. Kuan-Chen Chen & Hong-Ming Chen & Li-Nien Chien & Ming-Miin Yu, 2019. "Productivity growth and quality changes of hospitals in Taiwan: does ownership matter?," Health Care Management Science, Springer, vol. 22(3), pages 451-461, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yauheniya Varabyova & Carl Rudolf Blankart & Jonas Schreyögg, 2017. "Using nonparametric conditional approach to integrate quality into efficiency analysis: empirical evidence from cardiology departments," Health Care Management Science, Springer, vol. 20(4), pages 565-576, December.
    2. Ferreira, D.C. & Marques, R.C., 2019. "Do quality and access to hospital services impact on their technical efficiency?," Omega, Elsevier, vol. 86(C), pages 218-236.
    3. Margit Sommersguter-Reichmann, 2022. "Health care quality in nonparametric efficiency studies: a review," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 30(1), pages 67-131, March.
    4. Diogo Cunha Ferreira & Alexandre Morais Nunes & Rui Cunha Marques, 2020. "Operational efficiency vs clinical safety, care appropriateness, timeliness, and access to health care," Journal of Productivity Analysis, Springer, vol. 53(3), pages 355-375, June.
    5. Núñez, F. & Arcos-Vargas, A. & Villa, G., 2020. "Efficiency benchmarking and remuneration of Spanish electricity distribution companies," Utilities Policy, Elsevier, vol. 67(C).
    6. Ferreira, D.C. & Marques, R.C., 2021. "Public-private partnerships in health care services: Do they outperform public hospitals regarding quality and access? Evidence from Portugal," Socio-Economic Planning Sciences, Elsevier, vol. 73(C).
    7. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2019. "A bootstrap approach for bandwidth selection in estimating conditional efficiency measures," European Journal of Operational Research, Elsevier, vol. 277(2), pages 784-797.
    8. Guangshun Qiao & Zhan-ao Wang, 2021. "Vertical integration vs. specialization: a nonparametric conditional efficiency estimate for the global semiconductor industry," Journal of Productivity Analysis, Springer, vol. 56(2), pages 139-150, December.
    9. Sushanta Mallick & Aarti Rughoo & Nickolaos G. Tzeremes & Wei Xu, 2020. "Technological Change and Catching-Up in the Indian Banking Sector: A Time-Dependent Nonparametric Frontier Approach," Computational Economics, Springer;Society for Computational Economics, vol. 56(1), pages 217-237, June.
    10. Valentin Zelenyuk, 2019. "Data Envelopment Analysis and Business Analytics: The Big Data Challenges and Some Solutions," CEPA Working Papers Series WP072019, School of Economics, University of Queensland, Australia.
    11. Yao, Xin & Huang, Ruting & Du, Kerui, 2019. "The impacts of market power on power grid efficiency: Evidence from China," China Economic Review, Elsevier, vol. 55(C), pages 99-110.
    12. E. Nur Ozkan Gunay, 2012. "Risk Incorporation and Efficiency in Emerging Market Banks During the Global Crisis: Evidence from Turkey, 2002-2009," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 48(S5), pages 91-102, November.
    13. Amir Moradi-Motlagh & Ali Emrouznejad, 2022. "The origins and development of statistical approaches in non-parametric frontier models: a survey of the first two decades of scholarly literature (1998–2020)," Annals of Operations Research, Springer, vol. 318(1), pages 713-741, November.
    14. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    15. Daraio, Cinzia & Simar, Léopold, 2014. "Directional distances and their robust versions: Computational and testing issues," European Journal of Operational Research, Elsevier, vol. 237(1), pages 358-369.
    16. Sebastian Kohl & Jan Schoenfelder & Andreas Fügener & Jens O. Brunner, 2019. "The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals," Health Care Management Science, Springer, vol. 22(2), pages 245-286, June.
    17. Nicola Galluzzo, 2021. "Estimation of the impact of CAP subsidies as environmental variables on Romanian farms," Economia agro-alimentare, FrancoAngeli Editore, vol. 23(3), pages 1-24.
    18. Jose M. Cordero & Cristina Polo & Daniel Santín, 2020. "Assessment of new methods for incorporating contextual variables into efficiency measures: a Monte Carlo simulation," Operational Research, Springer, vol. 20(4), pages 2245-2265, December.
    19. Tzeremes, Nickolaos G., 2015. "Efficiency dynamics in Indian banking: A conditional directional distance approach," European Journal of Operational Research, Elsevier, vol. 240(3), pages 807-818.
    20. López-Torres, Laura & Johnes, Jill & Elliott, Caroline & Polo, Cristina, 2021. "The effects of competition and collaboration on efficiency in the UK independent school sector," Economic Modelling, Elsevier, vol. 96(C), pages 40-53.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:261:y:2018:i:1:d:10.1007_s10479-017-2628-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.