IDEAS home Printed from https://ideas.repec.org/a/eee/hepoli/v124y2020i5p501-510.html
   My bibliography  Save this article

Steering by their own lights: Why regulators across Europe use different indicators to measure healthcare quality

Author

Listed:
  • Beaussier, Anne-Laure
  • Demeritt, David
  • Griffiths, Alex
  • Rothstein, Henry

Abstract

Despite widespread faith that quality indicators are key to healthcare improvement and regulation, surprisingly little is known about what is actually measured in different countries, nor how, nor why. To address that gap, this article compares the official indicator sets--comprising some 1100 quality measures-- used by statutory hospital regulators in England, Germany, France, and the Netherlands. The findings demonstrate that those countries’ regulators strike very different balances in: the dimensions of quality they assess (e.g. between safety, effectiveness, and patient-centredness); the hospital activities they target (e.g. between clinical and non-clinical activities and management); and the ‘Donabedian’ measurement style of their indicators (between structure, process and outcome indicators). We argue that these contrasts reflect: i) how the distinctive problems facing each country’s healthcare system create different ‘demand-side’ pressures on what national indicator sets measure; and ii) how the configuration of national healthcare systems and governance traditions create ‘supply-side’ constraints on the kinds of data that regulators can use for indicator construction. Our analysis suggests fundamental differences in the meaning of quality and its measurement across countries that are likely to impede international efforts to benchmark quality and identify best practice.

Suggested Citation

  • Beaussier, Anne-Laure & Demeritt, David & Griffiths, Alex & Rothstein, Henry, 2020. "Steering by their own lights: Why regulators across Europe use different indicators to measure healthcare quality," Health Policy, Elsevier, vol. 124(5), pages 501-510.
  • Handle: RePEc:eee:hepoli:v:124:y:2020:i:5:p:501-510
    DOI: 10.1016/j.healthpol.2020.02.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0168851020300476
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.healthpol.2020.02.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Soeren Mattke & Edward Kelley & Peter Scherer & Jeremy Hurst & Maria Luisa Gil Lapetra & HCQI Expert Group Members, 2006. "Health Care Quality Indicators Project: Initial Indicators Report," OECD Health Working Papers 22, OECD Publishing.
    2. Wilsford, David, 1994. "Path Dependency, or Why History Makes It Difficult but Not Impossible to Reform Health Care Systems in a Big Way," Journal of Public Policy, Cambridge University Press, vol. 14(3), pages 251-283, July.
    3. de Vos, M.L.G. & Graafmans, W.C. & Kooistra, M. & Meijboom, B.R. & van der Voort, P.H. & Westert, G.P., 2009. "Using quality indicators to improve hospital care : A review of the literature," Other publications TiSEM 5f462bc9-0ac0-47f7-8f97-7, Tilburg University, School of Economics and Management.
    4. David Spiegelhalter & Christopher Sherlaw‐Johnson & Martin Bardsley & Ian Blunt & Christopher Wood & Olivia Grigg, 2012. "Statistical methods for healthcare regulation: rating, screening and surveillance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(1), pages 1-47, January.
    5. Rodwin, V.G., 2003. "The health care system under French national health insurance: Lessons for health reform in the United States," American Journal of Public Health, American Public Health Association, vol. 93(1), pages 31-37.
    6. Bramesfeld, Anke & Wensing, Michel & Bartels, Paul & Bobzin, Henning & Grenier, Catherine & Heugren, Mona & Hirschfield, Dena Jaffe & Langenegger, Manfred & Lindelius, Birgitta & Lucet, Bruno & Manor,, 2016. "Mandatory national quality improvement systems using indicators: An initial assessment in Europe and Israel," Health Policy, Elsevier, vol. 120(11), pages 1256-1269.
    7. Perera, Roshan & Dowell, Anthony & Crampton, Peter, 2012. "Painting by numbers: A guide for systematically developing indicators of performance at any level of health care," Health Policy, Elsevier, vol. 108(1), pages 49-59.
    8. Sanjay Basu & Jason Andrews & Sandeep Kishore & Rajesh Panjabi & David Stuckler, 2012. "Comparative Performance of Private and Public Healthcare Systems in Low- and Middle-Income Countries: A Systematic Review," PLOS Medicine, Public Library of Science, vol. 9(6), pages 1-14, June.
    9. Kodate, Naonori, 2010. "Events, Public Discourses and Responsive Government: Quality Assurance in Health Care in England, Sweden and Japan," Journal of Public Policy, Cambridge University Press, vol. 30(3), pages 263-289, December.
    10. Berg, Marc & Meijerink, Yvonne & Gras, Marit & Goossensen, Anne & Schellekens, Wim & Haeck, Jan & Kallewaard, Marjon & Kingma, Herre, 2005. "Feasibility first: Developing public performance indicators on patient safety and clinical effectiveness for Dutch hospitals," Health Policy, Elsevier, vol. 75(1), pages 59-73, December.
    11. Oliver, Adam, 2012. "The folly of cross-country ranking exercises," Health Economics, Policy and Law, Cambridge University Press, vol. 7(01), pages 15-17, January.
    12. Veillard, Jeremy & Moses McKeag, Alexandra & Tipper, Brenda & Krylova, Olga & Reason, Ben, 2013. "Methods to stimulate national and sub-national benchmarking through international health system performance comparisons: A Canadian approach," Health Policy, Elsevier, vol. 112(1), pages 141-147.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olivier Borraz & Anne‐Laure Beaussier & Mara Wesseling & David Demeritt & Henry Rothstein & Marijke Hermans & Michael Huber & Regine Paul, 2022. "Why regulators assess risk differently: Regulatory style, business organization, and the varied practice of risk‐based food safety inspections across the EU," Regulation & Governance, John Wiley & Sons, vol. 16(1), pages 274-292, January.
    2. Vidoli, F.; & Fusco, E.; & Pignataro, G.; & Guccio, C.;, 2023. "Multi-directional Robust Benefit of the Doubt model: a comprehensive measure for the quality of health care in OECD countries," Health, Econometrics and Data Group (HEDG) Working Papers 23/14, HEDG, c/o Department of Economics, University of York.
    3. Tetiana Vasylieva & Beata Gavurova & Tetiana Dotsenko & Svitlana Bilan & Marcin Strzelec & Samer Khouri, 2023. "The Behavioral and Social Dimension of the Public Health System of European Countries: Descriptive, Canonical, and Factor Analysis," IJERPH, MDPI, vol. 20(5), pages 1-35, March.
    4. Johannes Hengelbrock & Johannes Rauh & Jona Cederbaum & Maximilian Kähler & Michael Höhle, 2023. "Hospital profiling using Bayesian decision theory," Biometrics, The International Biometric Society, vol. 79(3), pages 2757-2769, September.
    5. Pereira, Miguel Alves & Marques, Rui Cunha, 2022. "Is sunshine regulation the new prescription to brighten up public hospitals in Portugal?," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    6. Jamieson Gilmore, Kendall & Corazza, Ilaria & Coletta, Lucrezia & Allin, Sara, 2023. "The uses of Patient Reported Experience Measures in health systems: A systematic narrative review," Health Policy, Elsevier, vol. 128(C), pages 1-10.
    7. Klein, Silvia & Rauh, Johannes & Pauletzki, Jürgen & Klakow-Franck, Regina & Zander-Jentsch, Britta, 2023. "Introduction of quality indicators in German hospital capacity planning – Do results show an improvement in quality?," Health Policy, Elsevier, vol. 133(C).
    8. Li Wang & David Demeritt & Henry Rothstein, 2023. "“Carrying the black pot”: Food safety and risk in China's reactive regulatory state," Regulation & Governance, John Wiley & Sons, vol. 17(2), pages 469-490, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. El-Jardali, Fadi & Saleh, Shadi & Ataya, Nour & Jamal, Diana, 2011. "Design, implementation and scaling up of the balanced scorecard for hospitals in Lebanon: Policy coherence and application lessons for low and middle income countries," Health Policy, Elsevier, vol. 103(2), pages 305-314.
    2. Emma Akpan & Surajudeen Abiola Abdulrahman & Nne Pepple, 2020. "Comparison of the Level of Adherence to Laboratory Quality Management System between Public and Private Secondary Health Facilities in Southern Nigeria," Global Journal of Health Science, Canadian Center of Science and Education, vol. 12(12), pages 1-27, November.
    3. Farshad Behrouzi & Azanizawati Ma'aram, 2019. "Identification and ranking of specific balanced scorecard performance measures for hospitals: A case study of private hospitals in the Klang Valley area, Malaysia," International Journal of Health Planning and Management, Wiley Blackwell, vol. 34(4), pages 1364-1376, October.
    4. Alex R. Horenstein & Manuel S. Santos, 2012. "A Cross-Country Analysis of Health Care Expenditures," Working Papers 2013-05, University of Miami, Department of Economics.
    5. Schwartz, Robert & Deber, Raisa, 2016. "The performance measurement–management divide in public health," Health Policy, Elsevier, vol. 120(3), pages 273-280.
    6. Andrew McNee, 2012. "Illuminating the local: can non-formal institutions be complementary to health system development in Papua New Guinea?," Development Policy Centre Discussion Papers 1215, Development Policy Centre, Crawford School of Public Policy, The Australian National University.
    7. Tafesse, Wiktoria & Chalkley, Martin, 2021. "Faith-based provision of sexual and reproductive healthcare in Malawi," Social Science & Medicine, Elsevier, vol. 282(C).
    8. Mesman, Roos & Faber, Marjan J. & Berden, Bart J.J.M. & Westert, Gert P., 2017. "Evaluation of minimum volume standards for surgery in the Netherlands (2003–2017): A successful policy?," Health Policy, Elsevier, vol. 121(12), pages 1263-1273.
    9. Gort, Marjan & Broekhuis, Manda & Regts, Gerdien, 2013. "How teams use indicators for quality improvement – A multiple-case study on the use of multiple indicators in multidisciplinary breast cancer teams," Social Science & Medicine, Elsevier, vol. 96(C), pages 69-77.
    10. Choi, Jaerim & Lim, Sunghun, 2023. "Ostrom Meets the Pandemic: Lessons from Asian Rice Farming Traditions," 97th Annual Conference, March 27-29, 2023, Warwick University, Coventry, UK 334543, Agricultural Economics Society - AES.
    11. Zoe Dettrick & Hebe N Gouda & Andrew Hodge & Eliana Jimenez-Soto, 2016. "Measuring Quality of Maternal and Newborn Care in Developing Countries Using Demographic and Health Surveys," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-20, June.
    12. Titeca, Hannes, 2016. "Healthcare Spending: The Role of Healthcare Institutions from an International Perspective," MPRA Paper 73678, University Library of Munich, Germany.
    13. Howard A. Palley, 2008. "International Trends in Long-Term Care Policy for the Elderly," International Area Studies Review, Center for International Area Studies, Hankuk University of Foreign Studies, vol. 11(2), pages 267-286, September.
    14. Cherry, Barbara A., 2015. "Technology transitions within telecommunications networks: Lessons from U.S. vs. Canadian policy experimentation under federalism," Telecommunications Policy, Elsevier, vol. 39(6), pages 463-485.
    15. Bloom, Gerald & Wolcott, Sara, 2013. "Building institutions for health and health systems in contexts of rapid change," Social Science & Medicine, Elsevier, vol. 96(C), pages 216-222.
    16. Xu, Weiwei & van de Ven, Wynand P.M.M., 2013. "Consumer choice among Mutual Healthcare Purchasers: A feasible option for China?," Social Science & Medicine, Elsevier, vol. 96(C), pages 277-284.
    17. Sulakshana Nandi & Helen Schneider & Priyanka Dixit, 2017. "Hospital utilization and out of pocket expenditure in public and private sectors under the universal government health insurance scheme in Chhattisgarh State, India: Lessons for universal health cover," PLOS ONE, Public Library of Science, vol. 12(11), pages 1-18, November.
    18. Huguet, Marius, 2020. "Centralization of care in high volume hospitals and inequalities in access to care," Social Science & Medicine, Elsevier, vol. 260(C).
    19. Wang, Jingjing & Zhao, Xian & Guo, Xiaoxin, 2019. "Optimizing wind turbine's maintenance policies under performance-based contract," Renewable Energy, Elsevier, vol. 135(C), pages 626-634.
    20. Juliet Mwanga-Amumpaire & Tobias Alfvén & Celestino Obua & Karin Källander & Richard Migisha & Cecilia Stålsby Lundborg & Grace Ndeezi & Joan Nakayaga Kalyango, 2021. "Appropriateness of Care for Common Childhood Infections at Low-Level Private Health Facilities in a Rural District in Western Uganda," IJERPH, MDPI, vol. 18(15), pages 1-16, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:hepoli:v:124:y:2020:i:5:p:501-510. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu or the person in charge (email available below). General contact details of provider: http://www.elsevier.com/locate/healthpol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.