IDEAS home Printed from https://ideas.repec.org/a/eee/hepoli/v120y2016i3p252-263.html
   My bibliography  Save this article

The efficiency of health care production in OECD countries: A systematic review and meta-analysis of cross-country comparisons

Author

Listed:
  • Varabyova, Yauheniya
  • Müller, Julia-Maria

Abstract

There has been an ongoing interest in the analysis and comparison of the efficiency of health care systems using nonparametric and parametric applications. The objective of this study was to review the current state of the literature and to synthesize the findings on health system efficiency in OECD countries. We systematically searched five electronic databases through August 2014 and identified 22 studies that analyzed the efficiency of health care production at the country level. We summarized these studies with view on their sample, methods, and utilized variables. We developed and applied a checklist of 14 items to assess the quality of the reviewed studies along four dimensions: reporting, external validity, bias, and power. Moreover, to examine the internal validity of findings we meta-analyzed the efficiency estimates reported in 35 models from ten studies. The qualitative synthesis of the literature indicated large differences in study designs and methods. The meta-analysis revealed low correlations between country rankings suggesting a lack of internal validity of the efficiency estimates. In conclusion, methodological problems of existing cross-country comparisons of the efficiency of health care systems draw into question the ability of these comparisons to provide meaningful guidance to policy-makers.

Suggested Citation

  • Varabyova, Yauheniya & Müller, Julia-Maria, 2016. "The efficiency of health care production in OECD countries: A systematic review and meta-analysis of cross-country comparisons," Health Policy, Elsevier, vol. 120(3), pages 252-263.
  • Handle: RePEc:eee:hepoli:v:120:y:2016:i:3:p:252-263
    DOI: 10.1016/j.healthpol.2015.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0168851015003073
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.healthpol.2015.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. William Greene, 2010. "A stochastic frontier model with correction for sample selection," Journal of Productivity Analysis, Springer, vol. 34(1), pages 15-24, August.
    2. David Parkin & Bruce Hollingsworth, 1997. "Measuring production efficiency of acute hospitals in Scotland, 1991-94: validity issues in data envelopment analysis," Applied Economics, Taylor & Francis Journals, vol. 29(11), pages 1425-1433.
    3. Banker, Rajiv D. & Gadh, Vandana M. & Gorr, Wilpen L., 1993. "A Monte Carlo comparison of two production frontier estimation methods: Corrected ordinary least squares and data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 67(3), pages 332-343, June.
    4. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    5. Sharon Hadad & Yossi Hadad & Tzahit Simon-Tuval, 2013. "Determinants of healthcare system’s efficiency in OECD countries," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 14(2), pages 253-265, April.
    6. William Greene, 2004. "Distinguishing between heterogeneity and inefficiency: stochastic frontier analysis of the World Health Organization's panel data on national health care systems," Health Economics, John Wiley & Sons, Ltd., vol. 13(10), pages 959-980, October.
    7. Jacobs,Rowena & Smith,Peter C. & Street,Andrew, 2006. "Measuring Efficiency in Health Care," Cambridge Books, Cambridge University Press, number 9780521851442, October.
    8. Chunping Liu & Audrey Laporte & Brian S. Ferguson, 2008. "The quantile regression approach to efficiency measurement: insights from Monte Carlo simulations," Health Economics, John Wiley & Sons, Ltd., vol. 17(9), pages 1073-1087, September.
    9. Pablo Cos & Enrique Moral-Benito, 2014. "Determinants of health-system efficiency: evidence from OECD countries," International Journal of Health Economics and Management, Springer, vol. 14(1), pages 69-93, March.
    10. Afonso, Antonio & St. Aubyn, Miguel, 2005. "Non-Parametric Approaches to Education and Health Efficiency in OECD Countries," Journal of Applied Economics, Universidad del CEMA, vol. 8(2), pages 1-20, November.
    11. Léopold Simar & Paul Wilson, 2011. "Two-stage DEA: caveat emptor," Journal of Productivity Analysis, Springer, vol. 36(2), pages 205-218, October.
    12. Ruggiero, John, 1998. "A new approach for technical efficiency estimation in multiple output production," European Journal of Operational Research, Elsevier, vol. 111(2), pages 369-380, December.
    13. Wranik, Dominika, 2012. "Healthcare policy tools as determinants of health-system efficiency: evidence from the OECD," Health Economics, Policy and Law, Cambridge University Press, vol. 7(2), pages 197-226, April.
    14. Bruce Hollingsworth, 2008. "The measurement of efficiency and productivity of health care delivery," Health Economics, John Wiley & Sons, Ltd., vol. 17(10), pages 1107-1128, October.
    15. Simar, Leopold & Wilson, Paul W., 2002. "Non-parametric tests of returns to scale," European Journal of Operational Research, Elsevier, vol. 139(1), pages 115-132, May.
    16. Luiza Bădin & Cinzia Daraio & Léopold Simar, 2014. "Explaining inefficiency in nonparametric production models: the state of the art," Annals of Operations Research, Springer, vol. 214(1), pages 5-30, March.
    17. Jaume Puig-Junoy, 1998. "Measuring health production performance in the OECD," Applied Economics Letters, Taylor & Francis Journals, vol. 5(4), pages 255-259.
    18. Varabyova, Yauheniya & Schreyögg, Jonas, 2013. "International comparisons of the technical efficiency of the hospital sector: Panel data analysis of OECD countries using parametric and non-parametric approaches," Health Policy, Elsevier, vol. 112(1), pages 70-79.
    19. S. Grosskopf & S. Self & O. Zaim, 2006. "Estimating the efficiency of the system of healthcare financing in achieving better health," Applied Economics, Taylor & Francis Journals, vol. 38(13), pages 1477-1488.
    20. Moran, Valerie & Jacobs, Rowena, 2013. "An international comparison of efficiency of inpatient mental health care systems," Health Policy, Elsevier, vol. 112(1), pages 88-99.
    21. Office of Health Economics, 2007. "The Economics of Health Care," For School 001490, Office of Health Economics.
    22. Bruce Hollingsworth & John Wildman, 2003. "The efficiency of health production: re‐estimating the WHO panel data using parametric and non‐parametric approaches to provide additional information," Health Economics, John Wiley & Sons, Ltd., vol. 12(6), pages 493-504, June.
    23. Vasanthakumar Bhat, 2005. "Institutional arrangements and efficiency of health care delivery systems," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 6(3), pages 215-222, September.
    24. Andrew Street, 2003. "How much confidence should we place in efficiency estimates?," Health Economics, John Wiley & Sons, Ltd., vol. 12(11), pages 895-907, November.
    25. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    26. Retzlaff-Roberts, Donna & Chang, Cyril F. & Rubin, Rose M., 2004. "Technical efficiency in the use of health care resources: a comparison of OECD countries," Health Policy, Elsevier, vol. 69(1), pages 55-72, July.
    27. Park, B.U. & Simar, L. & Weiner, Ch., 2000. "The Fdh Estimator For Productivity Efficiency Scores," Econometric Theory, Cambridge University Press, vol. 16(6), pages 855-877, December.
    28. Peter Smith, 1997. "Model misspecification in Data Envelopment Analysis," Annals of Operations Research, Springer, vol. 73(0), pages 233-252, October.
    29. Jean Spinks & Bruce Hollingsworth, 2009. "Cross-country comparisons of technical efficiency of health production: a demonstration of pitfalls," Applied Economics, Taylor & Francis Journals, vol. 41(4), pages 417-427.
    30. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    31. Battese, G E & Coelli, T J, 1995. "A Model for Technical Inefficiency Effects in a Stochastic Frontier Production Function for Panel Data," Empirical Economics, Springer, vol. 20(2), pages 325-332.
    32. Subal Kumbhakar, 2010. "Efficiency and productivity of world health systems: where does your country stand?," Applied Economics, Taylor & Francis Journals, vol. 42(13), pages 1641-1659.
    33. Kumbhakar,Subal C. & Lovell,C. A. Knox, 2003. "Stochastic Frontier Analysis," Cambridge Books, Cambridge University Press, number 9780521666633, October.
    34. Peter Schmidt, 2011. "One-step and two-step estimation in SFA models," Journal of Productivity Analysis, Springer, vol. 36(2), pages 201-203, October.
    35. Antonio Afonso & Miguel St. Aubyn, 2011. "Assessing health efficiency across countries with a two-step and bootstrap analysis," Applied Economics Letters, Taylor & Francis Journals, vol. 18(15), pages 1427-1430.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Richard Gearhart & Nyakundi Michieka, 2020. "A non-parametric investigation of supply side factors and healthcare efficiency in the U.S," Journal of Productivity Analysis, Springer, vol. 54(1), pages 59-74, August.
    2. Jawad Karamat & Tong Shurong & Naveed Ahmad & Sana Afridi & Shahbaz Khan & Nidha Khan, 2019. "Developing Sustainable Healthcare Systems in Developing Countries: Examining the Role of Barriers, Enablers and Drivers on Knowledge Management Adoption," Sustainability, MDPI, vol. 11(4), pages 1-31, February.
    3. Matthias Klumpp & Dominic Loske & Silvio Bicciato, 2022. "COVID-19 health policy evaluation: integrating health and economic perspectives with a data envelopment analysis approach," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(8), pages 1263-1285, November.
    4. Ozbugday, Fatih Cemil & Tirgil, Abdullah & Kose, Elif Gul, 2020. "Efficiency changes in long-term care in OECD countries: A non-parametric Malmquist Index approach," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    5. Angelo Castaldo & Maria Alessandra Antonelli & Valeria De Bonis & Giorgia Marini, 2020. "Determinants of health sector efficiency: evidence from a two-step analysis on 30 OECD countries," Economics Bulletin, AccessEcon, vol. 40(2), pages 1651-1666.
    6. Alicia Ramírez-Orellana & María del Carmen Valls Martínez & Mayra Soledad Grasso, 2021. "Using Higher-Order Constructs to Estimate Health-Disease Status: The Effect of Health System Performance and Sustainability," Mathematics, MDPI, vol. 9(11), pages 1-23, May.
    7. Santos, João Vasco & Martins, Filipa Santos & Pestana, Joana & Souza, Júlio & Freitas, Alberto & Cylus, Jonathan, 2023. "Should we adjust health expenditure for age structure on health systems efficiency? A worldwide analysis," LSE Research Online Documents on Economics 118298, London School of Economics and Political Science, LSE Library.
    8. Peipei Chai & Quan Wan & Yohannes Kinfu, 2021. "Efficiency and productivity of health systems in prevention and control of non-communicable diseases in China, 2008–2015," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(2), pages 267-279, March.
    9. Halkos, George & Argyropoulou, Georgia, 2024. "Use of indexes in evaluating environmental and health efficiency," MPRA Paper 119800, University Library of Munich, Germany.
    10. Francesco Aiello & Graziella Bonanno, 2019. "Explaining Differences In Efficiency: A Meta‐Study On Local Government Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 999-1027, July.
    11. Gearhart, Richard S. & Michieka, Nyakundi M., 2018. "A comparison of the robust conditional order-m estimation and two stage DEA in measuring healthcare efficiency among California counties," Economic Modelling, Elsevier, vol. 73(C), pages 395-406.
    12. Gearhart Richard, 2019. "The Impact of Secondary Environmental Variables on OECD Healthcare Efficiency: A Robust Conditional Approach," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 19(2), pages 1-16, April.
    13. George Halkos & Georgia Argyropoulou, 2021. "Pollution and Health Effects: A Nonparametric Approach," Computational Economics, Springer;Society for Computational Economics, vol. 58(3), pages 691-714, October.
    14. Gearhart, Richard & Michieka, Nyakundi, 2019. "Natural resource abundance and healthcare efficiency in Appalachia: A robust conditional approach," Energy Policy, Elsevier, vol. 129(C), pages 985-996.
    15. López-Herrera, Carmen & Cordero, José M. & Pedraja-Chaparro, Francisco & Polo, Cristina, 2023. "Fiscal rules and their influence on public sector efficiency," MPRA Paper 119018, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Varabyova, Yauheniya & Schreyögg, Jonas, 2013. "International comparisons of the technical efficiency of the hospital sector: Panel data analysis of OECD countries using parametric and non-parametric approaches," Health Policy, Elsevier, vol. 112(1), pages 70-79.
    2. Angelo Castaldo & Maria Alessandra Antonelli & Valeria De Bonis & Giorgia Marini, 2020. "Determinants of health sector efficiency: evidence from a two-step analysis on 30 OECD countries," Economics Bulletin, AccessEcon, vol. 40(2), pages 1651-1666.
    3. Ozbugday, Fatih Cemil & Tirgil, Abdullah & Kose, Elif Gul, 2020. "Efficiency changes in long-term care in OECD countries: A non-parametric Malmquist Index approach," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    4. Constantin Ogloblin, 2023. "Health care financing and productivity of health care in OECD countries: a stochastic frontier analysis," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 13(2), pages 259-283, June.
    5. Pınar Kaya Samut & Reyhan Cafrı, 2016. "Analysis of the Efficiency Determinants of Health Systems in OECD Countries by DEA and Panel Tobit," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(1), pages 113-132, October.
    6. Dino Rizzi & Michele Zanette, 2021. "Potential efficiency gains and expenditure savings in the Italian Regional Healthcare Systems," Politica economica, Società editrice il Mulino, issue 2, pages 187-214.
    7. Sepideh Abolghasem & Mehdi Toloo & Santiago Amézquita, 2019. "Cross-efficiency evaluation in the presence of flexible measures with an application to healthcare systems," Health Care Management Science, Springer, vol. 22(3), pages 512-533, September.
    8. Gearhart Richard, 2019. "The Impact of Secondary Environmental Variables on OECD Healthcare Efficiency: A Robust Conditional Approach," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 19(2), pages 1-16, April.
    9. Marianela Carrillo & Jesús M. Jorge, 2017. "DEA-Like Efficiency Ranking of Regional Health Systems in Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 133(3), pages 1133-1149, September.
    10. Puertas, Rosa & Marti, Luisa & Guaita-Martinez, José M., 2020. "Innovation, lifestyle, policy and socioeconomic factors: An analysis of European quality of life," Technological Forecasting and Social Change, Elsevier, vol. 160(C).
    11. Marwa Hasni & Safa Bhar Layeb & Najla Omrane Aissaoui & Aymen Mannai, 2022. "Hybrid model for a cross‐department efficiency evaluation in healthcare systems," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(5), pages 1311-1329, July.
    12. Bao Hoang Nguyen & Robin C. Sickles & Valentin Zelenyuk, 2021. "What do we know from the vast literature on efficiency and productivity in healthcare? A Systematic Review and Bibliometric Analysis," CEPA Working Papers Series WP092021, School of Economics, University of Queensland, Australia.
    13. Yauheniya Varabyova & Carl Rudolf Blankart & Jonas Schreyögg, 2017. "Using nonparametric conditional approach to integrate quality into efficiency analysis: empirical evidence from cardiology departments," Health Care Management Science, Springer, vol. 20(4), pages 565-576, December.
    14. Panagiotis Mitropoulos, 2021. "Production and quality performance of healthcare services in EU countries during the economic crisis," Operational Research, Springer, vol. 21(2), pages 857-873, June.
    15. Justyna Kujawska, 2021. "Health System Efficiency in European Countries: Network Data Envelopment Analysis Approach," European Research Studies Journal, European Research Studies Journal, vol. 0(2), pages 1095-1117.
    16. Mustapha D. Ibrahim & Sahand Daneshvar & Mevhibe B. Hocaoğlu & Olasehinde-Williams G. Oluseye, 2019. "An Estimation of the Efficiency and Productivity of Healthcare Systems in Sub-Saharan Africa: Health-Centred Millennium Development Goal-Based Evidence," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(1), pages 371-389, May.
    17. Erika Laranjeira & Helena Szrek, 2016. "Going beyond life expectancy in assessments of health systems’ performance: life expectancy adjusted by perceived health status," International Journal of Health Economics and Management, Springer, vol. 16(2), pages 133-161, June.
    18. Herwartz, Helmut & Schley, Katharina, 2018. "Improving health care service provision by adapting to regional diversity: An efficiency analysis for the case of Germany," Health Policy, Elsevier, vol. 122(3), pages 293-300.
    19. Richard Heijink & Xander Koolman & Gert Westert, 2013. "Spending more money, saving more lives? The relationship between avoidable mortality and healthcare spending in 14 countries," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 14(3), pages 527-538, June.
    20. Valentin Zelenyuk & Zhichao Wang, 2023. "Random vs. Explained Inefficiency in Stochastic Frontier Analysis: The Case of Queensland Hospitals," CEPA Working Papers Series WP052023, School of Economics, University of Queensland, Australia.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:hepoli:v:120:y:2016:i:3:p:252-263. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu or the person in charge (email available below). General contact details of provider: http://www.elsevier.com/locate/healthpol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.