IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v162y2016icp59-67.html
   My bibliography  Save this article

Developing robust composite measures of healthcare quality – Ranking intervals and dominance relations for Scottish Health Boards

Author

Listed:
  • Schang, Laura
  • Hynninen, Yrjänä
  • Morton, Alec
  • Salo, Ahti

Abstract

Although composite indicators are widely used to inform health system performance comparisons, such measures typically embed contentious assumptions, for instance about the weights assigned to constituent indicators. Moreover, although many comparative measures are constructed as ratios, the choice of denominator is not always straightforward. The conventional approach is to determine a single set of weights and to choose a single denominator, even though this involves considerable methodological difficulties.

Suggested Citation

  • Schang, Laura & Hynninen, Yrjänä & Morton, Alec & Salo, Ahti, 2016. "Developing robust composite measures of healthcare quality – Ranking intervals and dominance relations for Scottish Health Boards," Social Science & Medicine, Elsevier, vol. 162(C), pages 59-67.
  • Handle: RePEc:eee:socmed:v:162:y:2016:i:c:p:59-67
    DOI: 10.1016/j.socscimed.2016.06.026
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953616303100
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socscimed.2016.06.026?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. P.C. Smith, 2002. "Measuring health system performance," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 3(3), pages 145-148, September.
    2. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    3. Rajiv D. Banker & Robert F. Conrad & Robert P. Strauss, 1986. "A Comparative Application of Data Envelopment Analysis and Translog Methods: An Illustrative Study of Hospital Production," Management Science, INFORMS, vol. 32(1), pages 30-44, January.
    4. Sen, Amartya, 1997. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198292975, Decembrie.
    5. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    6. Gwyn Bevan & Richard Hamblin, 2009. "Hitting and missing targets by ambulance services for emergency calls: effects of different systems of performance measurement within the UK," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 161-190, January.
    7. Jacobs,Rowena & Smith,Peter C. & Street,Andrew, 2006. "Measuring Efficiency in Health Care," Cambridge Books, Cambridge University Press, number 9780521851442.
    8. Dolan, Paul, 1997. "A clarificatory note on 'Valuing health states: a comparison of methods'," Journal of Health Economics, Elsevier, vol. 16(5), pages 617-617, October.
    9. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    10. Hauck, Katharina & Street, Andrew, 2006. "Performance assessment in the context of multiple objectives: A multivariate multilevel analysis," Journal of Health Economics, Elsevier, vol. 25(6), pages 1029-1048, November.
    11. Ahti Salo & Antti Punkka, 2011. "Ranking Intervals and Dominance Relations for Ratio-Based Efficiency Analysis," Management Science, INFORMS, vol. 57(1), pages 200-214, January.
    12. Peter C. Smith, 2003. "Formula Funding of Public Services: An Economic Analysis," Oxford Review of Economic Policy, Oxford University Press, vol. 19(2), pages 301-322, Summer.
    13. Bruce Hollingsworth & Andrew Street, 2006. "The market for efficiency analysis of health care organisations," Health Economics, John Wiley & Sons, Ltd., vol. 15(10), pages 1055-1059, October.
    14. Peter Smith, 1997. "Model misspecification in Data Envelopment Analysis," Annals of Operations Research, Springer, vol. 73(0), pages 233-252, October.
    15. Lars Osberg & Andrew Sharpe, 2002. "An Index of Economic Well–Being for Selected OECD Countries," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 48(3), pages 291-316, September.
    16. Francisco Pedraja-Chaparro & Javier Salinas-Jimenez & Peter Smith, 1997. "On the Role of Weight Restrictions in Data Envelopment Analysis," Journal of Productivity Analysis, Springer, vol. 8(2), pages 215-230, May.
    17. Bryan Dowd & Tami Swenson & Robert Kane & Shriram Parashuram & Robert Coulam, 2014. "Can Data Envelopment Analysis Provide A Scalar Index Of ‘Value’?," Health Economics, John Wiley & Sons, Ltd., vol. 23(12), pages 1465-1480, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lucio Esposito & Enrica Chiappero‐Martinetti, 2019. "Eliciting, Applying And Exploring Multidimensional Welfare Weights: Evidence From The Field," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(S1), pages 204-227, November.
    2. Yelin Fu & Yubing Sui & Hao Luo & Biao Han, 2020. "Application of Social Choice Theory to Modify the Value Measure of Health Systems," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(3), pages 1005-1019, April.
    3. Diogo Cunha Ferreira & Alexandre Morais Nunes & Rui Cunha Marques, 2020. "Operational efficiency vs clinical safety, care appropriateness, timeliness, and access to health care," Journal of Productivity Analysis, Springer, vol. 53(3), pages 355-375, June.
    4. Carlo Drago, 2021. "The Analysis and the Measurement of Poverty: An Interval-Based Composite Indicator Approach," Economies, MDPI, vol. 9(4), pages 1-17, October.
    5. Luo, Chunling & Tan, Chin Hon & Liu, Xiao, 2020. "Maximum excess dominance: Identifying impractical solutions in linear problems with interval coefficients," European Journal of Operational Research, Elsevier, vol. 282(2), pages 660-676.
    6. Ferreira, D.C. & Marques, R.C., 2019. "Do quality and access to hospital services impact on their technical efficiency?," Omega, Elsevier, vol. 86(C), pages 218-236.
    7. Angela Meggiolaro & Carl Rudolf Blankart & Tom Stargardt & Jonas Schreyögg, 2023. "An econometric approach to aggregating multiple cardiovascular outcomes in German hospitals," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(5), pages 785-802, July.
    8. Nils Gutacker & Andrew Street, 2018. "Multidimensional performance assessment of public sector organisations using dominance criteria," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 13-27, February.
    9. Ferreira, D.C. & Marques, R.C., 2021. "Public-private partnerships in health care services: Do they outperform public hospitals regarding quality and access? Evidence from Portugal," Socio-Economic Planning Sciences, Elsevier, vol. 73(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nils Gutacker & Andrew Street, 2018. "Multidimensional performance assessment of public sector organisations using dominance criteria," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 13-27, February.
    2. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    3. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    4. Finn Førsund, 2013. "Weight restrictions in DEA: misplaced emphasis?," Journal of Productivity Analysis, Springer, vol. 40(3), pages 271-283, December.
    5. Laudicella, Mauro & Olsen, Kim Rose & Street, Andrew, 2010. "Examining cost variation across hospital departments-a two-stage multi-level approach using patient-level data," Social Science & Medicine, Elsevier, vol. 71(10), pages 1872-1881, November.
    6. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    7. Dino Rizzi & Vincenzo Rebba, 2006. "Measuring Hospital Efficiency through Data Envelopment Analysis when Policy-makers� Preferences Matter. An Application to a sample of Italian NHS hospitals," Working Papers 2006_13, Department of Economics, University of Venice "Ca' Foscari".
    8. Blancard, Stéphane & Hoarau, Jean-François, 2013. "A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis," Economic Modelling, Elsevier, vol. 30(C), pages 623-635.
    9. Nicky Rogge & Ilse Nijverseel, 2019. "Quality of Life in the European Union: A Multidimensional Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(2), pages 765-789, January.
    10. Martin Bod’a & Martin Dlouhý & Emília Zimková, 2018. "Unobservable or omitted production variables in data envelopment analysis through unit-specific production trade-offs," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 26(4), pages 813-846, December.
    11. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    12. Ana Cárcaba & Eduardo González & Juan Ventura, 2017. "Social Progress in Spanish Municipalities (2001–2011)," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 12(4), pages 997-1019, December.
    13. Sebastian Kohl & Jan Schoenfelder & Andreas Fügener & Jens O. Brunner, 2019. "The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals," Health Care Management Science, Springer, vol. 22(2), pages 245-286, June.
    14. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    15. Luis R. Murillo‐Zamorano, 2004. "Economic Efficiency and Frontier Techniques," Journal of Economic Surveys, Wiley Blackwell, vol. 18(1), pages 33-77, February.
    16. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    17. Victor V. Podinovski & Tatiana Bouzdine-Chameeva, 2013. "Weight Restrictions and Free Production in Data Envelopment Analysis," Operations Research, INFORMS, vol. 61(2), pages 426-437, April.
    18. Eduardo González & Ana Cárcaba & Juan Ventura, 2018. "Weight Constrained DEA Measurement of the Quality of Life in Spanish Municipalities in 2011," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 1157-1182, April.
    19. Riccardo Natoli & Segu Zuhair, 2011. "Measuring Progress: A Comparison of the GDP, HDI, GS and the RIE," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 103(1), pages 33-56, August.
    20. Kohl, Sebastian & Brunner, Jens O., 2020. "Benchmarking the benchmarks – Comparing the accuracy of Data Envelopment Analysis models in constant returns to scale settings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1042-1057.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:162:y:2016:i:c:p:59-67. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.