IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v250y2016i3p1026-1036.html
   My bibliography  Save this article

Changes in technical efficiency after quality management certification: A DEA approach using difference-in-difference estimation with genetic matching in the hospital industry

Author

Listed:
  • Lindlbauer, Ivonne
  • Schreyögg, Jonas
  • Winter, Vera

Abstract

Hospitals in Germany have been required to have an internal quality management system (QMS) since 2000. Although formal certification of such systems is voluntary, the number of certifications has increased steadily. The most common standards in Germany are ISO 9001, which is also widely used internationally, and KTQ (Kooperation für Transparenz und Qualität im Gesundheitswesen), which was developed specifically for the German health care sector. While a large body of literature has investigated the impact of QMS certification on performance in many industries, there is only scarce evidence on the causal link between QMS certification and technical efficiency. In the present study, we seek to elucidate this relationship using administrative data from all German hospitals from 2000 through 2010 combined with information on certification. Our analysis has three steps: First, we calculated efficiency scores for each hospital using a bootstrapped data envelopment analysis. Second, we used genetic matching to ensure that any differences observed could be attributed to certification and were not due to differences in sample characteristics between the intervention and control groups. Third, we employed a difference-in-difference specification within a truncated regression to examine whether certification had an impact on hospital efficiency. To shed light on a potential time lag between certification and efficiency gains, we used various periods for comparison. Our results indicate that hospital efficiency was negatively related to ISO 9001 certification and positively related to KTQ certification. Moreover, coefficients were always larger in the period between first certification and recertification.

Suggested Citation

  • Lindlbauer, Ivonne & Schreyögg, Jonas & Winter, Vera, 2016. "Changes in technical efficiency after quality management certification: A DEA approach using difference-in-difference estimation with genetic matching in the hospital industry," European Journal of Operational Research, Elsevier, vol. 250(3), pages 1026-1036.
  • Handle: RePEc:eee:ejores:v:250:y:2016:i:3:p:1026-1036
    DOI: 10.1016/j.ejor.2015.10.029
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221715009558
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2015.10.029?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kathleen Carey & James F. Burgess, 1999. "On measuring the hospital cost/quality trade‐off," Health Economics, John Wiley & Sons, Ltd., vol. 8(6), pages 509-520, September.
    2. McGuire, Stephen J. & Dilts, David M., 2008. "The financial impact of standard stringency: An event study of successive generations of the ISO 9000 standard," International Journal of Production Economics, Elsevier, vol. 113(1), pages 3-22, May.
    3. Bruce Hollingsworth, 2008. "The measurement of efficiency and productivity of health care delivery," Health Economics, John Wiley & Sons, Ltd., vol. 17(10), pages 1107-1128, October.
    4. David I. Levine & Michael W. Toffel, 2010. "Quality Management and Job Quality: How the ISO 9001 Standard for Quality Management Systems Affects Employees and Employers," Management Science, INFORMS, vol. 56(6), pages 978-996, June.
    5. A.M. Lima, Marcos & Resende, Marcelo & Hasenclever, Lia, 2000. "Quality certification and performance of Brazilian firms: An empirical study," International Journal of Production Economics, Elsevier, vol. 66(2), pages 143-147, June.
    6. Oliver Tiemann & Jonas Schreyögg, 2012. "Changes in hospital efficiency after privatization," Health Care Management Science, Springer, vol. 15(4), pages 310-326, December.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Ivonne Lindlbauer & Jonas Schreyögg, 2014. "The relationship between hospital specialization and hospital efficiency: do different measures of specialization lead to different results?," Health Care Management Science, Springer, vol. 17(4), pages 365-378, December.
    9. Charles J. Corbett & María J. Montes-Sancho & David A. Kirsch, 2005. "The Financial Impact of ISO 9000 Certification in the United States: An Empirical Analysis," Management Science, INFORMS, vol. 51(7), pages 1046-1059, July.
    10. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    11. Lukas Steinmann & Gunnar Dittrich & Alexander Karmann & Peter Zweifel, 2004. "Measuring and comparing the (in)efficiency of German and Swiss hospitals," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 5(3), pages 216-226, September.
    12. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    13. Makai, Peter & Klazinga, Niek & Wagner, Cordula & Boncz, Imre & Gulacsi, Lászlo, 2009. "Quality management and patient safety: Survey results from 102 Hungarian hospitals," Health Policy, Elsevier, vol. 90(2-3), pages 175-180, May.
    14. Alexis Diamond & Jasjeet S. Sekhon, 2013. "Genetic Matching for Estimating Causal Effects: A General Multivariate Matching Method for Achieving Balance in Observational Studies," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 932-945, July.
    15. Wilson, Paul W., 2008. "FEAR: A software package for frontier efficiency analysis with R," Socio-Economic Planning Sciences, Elsevier, vol. 42(4), pages 247-254, December.
    16. Sekhon, Jasjeet S., 2011. "Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i07).
    17. Nicolau, Juan Luis & Sellers, Ricardo, 2002. "The stock market's reaction to quality certification: Empirical evidence from Spain," European Journal of Operational Research, Elsevier, vol. 142(3), pages 632-641, November.
    18. Sharma, Divesh S., 2005. "The association between ISO 9000 certification and financial performance," The International Journal of Accounting, Elsevier, vol. 40(2), pages 151-172.
    19. Terziovski, Mile & Power, Damien & Sohal, Amrik S., 2003. "The longitudinal effects of the ISO 9000 certification process on business performance," European Journal of Operational Research, Elsevier, vol. 146(3), pages 580-595, May.
    20. Martinez-Costa, Micaela & Martinez-Lorente, Angel R. & Choi, Thomas Y., 2008. "Simultaneous consideration of TQM and ISO 9000 on performance and motivation: An empirical study of Spanish companies," International Journal of Production Economics, Elsevier, vol. 113(1), pages 23-39, May.
    21. Tamayo-Torres, Javier & Gutierrez-Gutierrez, Leopoldo & Ruiz-Moreno, Antonia, 2014. "The relationship between exploration and exploitation strategies, manufacturing flexibility and organizational learning: An empirical comparison between Non-ISO and ISO certified firms," European Journal of Operational Research, Elsevier, vol. 232(1), pages 72-86.
    22. Tom Stargardt & Jonas Schreyögg & Ivan Kondofersky, 2014. "Measuring The Relationship Between Costs And Outcomes: The Example Of Acute Myocardial Infarction In German Hospitals," Health Economics, John Wiley & Sons, Ltd., vol. 23(6), pages 653-669, June.
    23. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    24. Jasjeet Singh Sekhon & Richard D. Grieve, 2012. "A matching method for improving covariate balance in cost‐effectiveness analyses," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 695-714, June.
    25. Andrew M. Jones, 2007. "Identification of treatment effects in Health Economics," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1127-1131, November.
    26. Dyson, R. G. & Allen, R. & Camanho, A. S. & Podinovski, V. V. & Sarrico, C. S. & Shale, E. A., 2001. "Pitfalls and protocols in DEA," European Journal of Operational Research, Elsevier, vol. 132(2), pages 245-259, July.
    27. Guilhermina Rego & Rui Nunes & José Costa, 2010. "The challenge of corporatisation: the experience of Portuguese public hospitals," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(4), pages 367-381, August.
    28. Rajiv D. Banker & Richard C. Morey, 1986. "Efficiency Analysis for Exogenously Fixed Inputs and Outputs," Operations Research, INFORMS, vol. 34(4), pages 513-521, August.
    29. Andrew M. Jones, 2007. "Identification of treatment effects in Health Economics," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1127-1131.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Onder, O. & Cook, W. & Kristal, M., 2022. "Does quality help the financial viability of hospitals? A data envelopment analysis approach," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    2. Wasim Sultan & José Crispim, 2016. "Evaluating the Productive Efficiency of Jordanian Public Hospitals," International Journal of Business and Management, Canadian Center of Science and Education, vol. 12(1), pages 1-68, December.
    3. Mustafa Jahangoshai Rezaee & Abuzar Karimdadi & Hamidreza Izadbakhsh, 2019. "Road map for progress and attractiveness of Iranian hospitals by integrating self-organizing map and context-dependent DEA," Health Care Management Science, Springer, vol. 22(3), pages 410-436, September.
    4. Anagnostopoulos, Yiannis & Husa, Kjetil A. & Noikokyris, Emmanouil, 2022. "A three-phase comparative efficiency analysis of US and EU banks," International Review of Economics & Finance, Elsevier, vol. 81(C), pages 113-127.
    5. Nguyen, Hong Ngoc & O’Donnell, Christopher, 2023. "Estimating the cost efficiency of public service providers in the presence of demand uncertainty," European Journal of Operational Research, Elsevier, vol. 309(3), pages 1334-1348.
    6. Akkan, Can & Karadayi, Melis Almula & Ekinci, Yeliz & Ülengin, Füsun & Uray, Nimet & Karaosmanoğlu, Elif, 2020. "Efficiency analysis of emergency departments in metropolitan areas," Socio-Economic Planning Sciences, Elsevier, vol. 69(C).
    7. Annika Maren Schneider & Eva-Maria Oppel & Jonas Schreyögg, 2020. "Investigating the link between medical urgency and hospital efficiency – Insights from the German hospital market," Health Care Management Science, Springer, vol. 23(4), pages 649-660, December.
    8. Wanke, Peter & Araujo, Claudia & Tan, Yong & Antunes, Jorge & Pimenta, Roberto, 2023. "Efficiency in university hospitals: A genetic optimized semi-parametric production function," Operations Research Perspectives, Elsevier, vol. 10(C).
    9. Hernandez-Vivanco, Alfonso & Bernardo, Merce, 2023. "Management systems and productive efficiency along the certification life-cycle," International Journal of Production Economics, Elsevier, vol. 266(C).
    10. Martinsson, Elin & Storm, Hugo, 2022. "Evaluating environmental effects of the adoption of automatic milking systems in Norway," 96th Annual Conference, April 4-6, 2022, K U Leuven, Belgium 321199, Agricultural Economics Society - AES.
    11. Daniel Feliciano & Laura López-Torres & Daniel Santín, 2021. "One Laptop per Child? Using Production Frontiers for Evaluating the Escuela 2.0 Program in Spain," Mathematics, MDPI, vol. 9(20), pages 1-17, October.
    12. Xian‐Hui He & Yung‐ho Chiu & Tzu‐Han Chang & Liang‐Chun Lu & Shih‐Yung Chiu, 2021. "Analyzing hospital medical efficiency of administration and medical treatment in China," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(6), pages 1564-1578, September.
    13. Abdullah M. Alsabah & Hassan Haghparast-Bidgoli & Jolene Skordis, 2020. "Measuring the Efficiency of Public Hospitals in Kuwait: A Two-Stage Data Envelopment Analysis and a Qualitative Survey Study," Global Journal of Health Science, Canadian Center of Science and Education, vol. 12(3), pages 121-121, March.
    14. Margit Sommersguter-Reichmann, 2022. "Health care quality in nonparametric efficiency studies: a review," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 30(1), pages 67-131, March.
    15. Christoph Pross & Christoph Strumann & Alexander Geissler & Helmut Herwartz & Nadja Klein, 2018. "Quality and resource efficiency in hospital service provision: A geoadditive stochastic frontier analysis of stroke quality of care in Germany," PLOS ONE, Public Library of Science, vol. 13(9), pages 1-30, September.
    16. Cinaroglu, Songul, 2021. "Changes in hospital efficiency and size: An integrated propensity score matching with data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 76(C).
    17. Guccio, C.; & Pignataro, G.; & Romeo, D.; & Vidoli, F.;, 2022. "Is austerity good for efficiency, at least? A counterfactual assessment for the Italian NHS," Health, Econometrics and Data Group (HEDG) Working Papers 22/28, HEDG, c/o Department of Economics, University of York.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Oliver Tiemann & Jonas Schreyögg, 2012. "Changes in hospital efficiency after privatization," Health Care Management Science, Springer, vol. 15(4), pages 310-326, December.
    2. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    3. Varabyova, Yauheniya & Schreyögg, Jonas, 2013. "International comparisons of the technical efficiency of the hospital sector: Panel data analysis of OECD countries using parametric and non-parametric approaches," Health Policy, Elsevier, vol. 112(1), pages 70-79.
    4. José Cordero Ferrera & Eva Cebada & Luis Murillo Zamorano, 2014. "The effect of quality and socio-demographic variables on efficiency measures in primary health care," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 15(3), pages 289-302, April.
    5. Mª Isabel Ortega-Díaz & Ricardo Ocaña-Riola & Carmen Pérez-Romero & José Jesús Martín-Martín, 2020. "Multilevel Analysis of the Relationship between Ownership Structure and Technical Efficiency Frontier in the Spanish National Health System Hospitals," IJERPH, MDPI, vol. 17(16), pages 1-19, August.
    6. Siougle, Efrosini & Dimelis, Sophia & Economidou, Claire, 2019. "Does ISO 9000 certification matter for firm performance? A group analysis of Greek listed companies," International Journal of Production Economics, Elsevier, vol. 209(C), pages 2-11.
    7. Ivonne Lindlbauer & Jonas Schreyögg, 2014. "The relationship between hospital specialization and hospital efficiency: do different measures of specialization lead to different results?," Health Care Management Science, Springer, vol. 17(4), pages 365-378, December.
    8. Sebastian Kohl & Jan Schoenfelder & Andreas Fügener & Jens O. Brunner, 2019. "The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals," Health Care Management Science, Springer, vol. 22(2), pages 245-286, June.
    9. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.
    10. Galina Besstremyannaya, 2013. "The impact of Japanese hospital financing reform on hospital efficiency: A difference-in-difference approach," The Japanese Economic Review, Japanese Economic Association, vol. 64(3), pages 337-362, September.
    11. Veronese da Silva, Aline & Costa, Marcelo Azevedo & Lopes-Ahn, Ana Lúcia, 2022. "Accounting multiple environmental variables in DEA energy transmission benchmarking modelling: The 2019 Brazilian case," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    12. Berger, Michael & Sommersguter-Reichmann, Margit & Czypionka, Thomas, 2020. "Determinants of soft budget constraints: how public debt affects hospital performance in Austria," LSE Research Online Documents on Economics 116865, London School of Economics and Political Science, LSE Library.
    13. Kosycarz, Ewa & Dędys, Monika & Ekes, Maria & Wranik, Wiesława Dominika, 2023. "The effects of provider contract types and fiscal decentralization on the efficiency of the Polish hospital sector: A data envelopment analysis across 16 health regions," Health Policy, Elsevier, vol. 129(C).
    14. Marc-Arthur Diaye & Nathalie Greenan & Sanja Pekovic, 2014. "Sharing the " fame " of ISO standard adoption : quality supply chain effects evidence [Partager la « réputation » de la certification qualité : l’identification d’un effet de chaîne d’app," Post-Print halshs-01362467, HAL.
    15. Onder, O. & Cook, W. & Kristal, M., 2022. "Does quality help the financial viability of hospitals? A data envelopment analysis approach," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    16. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    17. Rita Bastião & Nuno de Sousa Pereira, 2020. "Performance in the Delivery of Primary Health Care Services: A Longitudinal Analysis," CEF.UP Working Papers 2002, Universidade do Porto, Faculdade de Economia do Porto.
    18. Berger, Michael & Sommersguter-Reichmann, Margit & Czypionka, Thomas, 2020. "Determinants of soft budget constraints: How public debt affects hospital performance in Austria," Social Science & Medicine, Elsevier, vol. 249(C).
    19. Emrouznejad, Ali & De Witte, Kristof, 2010. "COOPER-framework: A unified process for non-parametric projects," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1573-1586, December.
    20. Thomas Czypionka & Markus Kraus & Susanne Mayer & Gerald Röhrling, 2014. "Efficiency, ownership, and financing of hospitals: The case of Austria," Health Care Management Science, Springer, vol. 17(4), pages 331-347, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:250:y:2016:i:3:p:1026-1036. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.