IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v25y2016i5p515-528.html
   My bibliography  Save this article

Addressing Missing Data in Patient‐Reported Outcome Measures (PROMS): Implications for the Use of PROMS for Comparing Provider Performance

Author

Listed:
  • Manuel Gomes
  • Nils Gutacker
  • Chris Bojke
  • Andrew Street

Abstract

Patient‐reported outcome measures (PROMs) are now routinely collected in the English National Health Service and used to compare and reward hospital performance within a high‐powered pay‐for‐performance scheme. However, PROMs are prone to missing data. For example, hospitals often fail to administer the pre‐operative questionnaire at hospital admission, or patients may refuse to participate or fail to return their post‐operative questionnaire. A key concern with missing PROMs is that the individuals with complete information tend to be an unrepresentative sample of patients within each provider and inferences based on the complete cases will be misleading. This study proposes a strategy for addressing missing data in the English PROM survey using multiple imputation techniques and investigates its impact on assessing provider performance. We find that inferences about relative provider performance are sensitive to the assumptions made about the reasons for the missing data. © 2015 The Authors. Health Economics Published by John Wiley & Sons Ltd.

Suggested Citation

  • Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2016. "Addressing Missing Data in Patient‐Reported Outcome Measures (PROMS): Implications for the Use of PROMS for Comparing Provider Performance," Health Economics, John Wiley & Sons, Ltd., vol. 25(5), pages 515-528, May.
    • Handle: RePEc:wly:hlthec:v:25:y:2016:i:5:p:515-528
    DOI: 10.1002/hec.3173
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.3173
    Download Restriction: no
    File URL: https://libkey.io/10.1002/hec.3173?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peter C. Smith & Andrew Street, 2005. "Measuring the efficiency of public services: the limits of analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 401-417, March.
    2. James R. Carpenter & Michael G. Kenward & Stijn Vansteelandt, 2006. "A comparison of multiple imputation and doubly robust estimation for analyses with missing data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 571-584, July.
    3. Schenker, Nathaniel & Raghunathan, Trivellore E. & Chiu, Pei-Lu & Makuc, Diane M. & Zhang, Guangyu & Cohen, Alan J., 2006. "Multiple Imputation of Missing Income Data in the National Health Interview Survey," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 924-933, September.
    4. Manuel Gomes & Karla Díaz-Ordaz & Richard Grieve & Michael G. Kenward, 2013. "Multiple Imputation Methods for Handling Missing Data in Cost-effectiveness Analyses That Use Data from Hierarchical Studies," Medical Decision Making, , vol. 33(8), pages 1051-1063, November.
    5. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    6. Browne, William J., 2006. "MCMC algorithms for constrained variance matrices," Computational Statistics & Data Analysis, Elsevier, vol. 50(7), pages 1655-1677, April.
    7. Daniel, Rhian M. & Kenward, Michael G., 2012. "A method for increasing the robustness of multiple imputation," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1624-1643.
    8. Carpenter, James R. & Goldstein, Harvey & Kenward, Michael G., 2011. "REALCOM-IMPUTE Software for Multilevel Multiple Imputation with Mixed Response Types," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i05).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Silviya Nikolova & Mark Harrison & Matt Sutton, 2016. "The Impact of Waiting Time on Health Gains from Surgery: Evidence from a National Patient‐reported Outcome Dataset," Health Economics, John Wiley & Sons, Ltd., vol. 25(8), pages 955-968, August.
    2. Francesco Longo & Luigi Siciliani & Andrew Street, 2019. "Are cost differences between specialist and general hospitals compensated by the prospective payment system?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 7-26, February.
    3. Nils Gutacker & Andrew Street, 2018. "Multidimensional performance assessment of public sector organisations using dominance criteria," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 13-27, February.
    4. Oliver Hirsch & Norbert Donner-Banzhoff & Maike Schulz & Michael Erhart, 2018. "Detecting and Visualizing Outliers in Provider Profiling Using Funnel Plots and Mixed Effects Models—An Example from Prescription Claims Data," IJERPH, MDPI, vol. 15(9), pages 1-11, September.
    5. Alexina J. Mason & Manuel Gomes & Richard Grieve & James R. Carpenter, 2018. "A Bayesian framework for health economic evaluation in studies with missing data," Health Economics, John Wiley & Sons, Ltd., vol. 27(11), pages 1670-1683, November.
    6. Milstein, Ricarda & Schreyoegg, Jonas, 2016. "Pay for performance in the inpatient sector: A review of 34 P4P programs in 14 OECD countries," Health Policy, Elsevier, vol. 120(10), pages 1125-1140.
    7. Giuseppe Moscelli & Hugh Gravelle & Luigi Siciliani, 2018. "Effects of Market Structure and Patient Choice on Hospital Quality for Planned Patients," School of Economics Discussion Papers 1118, School of Economics, University of Surrey.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2014. "Addressing missing data in patient-reported outcome measures (PROMs): implications for comparing provider performance," Working Papers 101cherp, Centre for Health Economics, University of York.
    2. Nils Gutacker & Andrew Street, 2015. "Multidimensional performance assessment using dominance criteria," Working Papers 115cherp, Centre for Health Economics, University of York.
    3. Speidel, Matthias & Drechsler, Jörg & Jolani, Shahab, 2018. "R package hmi: a convenient tool for hierarchical multiple imputation and beyond," IAB-Discussion Paper 201816, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    4. Nils Gutacker & Andrew Street, 2018. "Multidimensional performance assessment of public sector organisations using dominance criteria," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 13-27, February.
    5. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    6. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    7. Yongwei Chen & Dahai Fu, 2015. "Measuring income inequality using survey data: the case of China," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 13(2), pages 299-307, June.
    8. Gopalakrishnan, Raja & Guevara, C. Angelo & Ben-Akiva, Moshe, 2020. "Combining multiple imputation and control function methods to deal with missing data and endogeneity in discrete-choice models," Transportation Research Part B: Methodological, Elsevier, vol. 142(C), pages 45-57.
    9. Bongsuk Sung & Myung-Bae Yeom & Hong-Gi Kim, 2017. "Eco-Efficiency of Government Policy and Exports in the Bioenergy Technology Market," Sustainability, MDPI, vol. 9(9), pages 1-18, September.
    10. Arpino, Bruno & Varriale, Roberta, 2009. "Assessing the quality of institutions’ rankings obtained through multilevel linear regression models," MPRA Paper 19873, University Library of Munich, Germany.
    11. Hai Zhong, 2010. "The impact of missing data in the estimation of concentration index: a potential source of bias," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(3), pages 255-266, June.
    12. Creemers, An & Aerts, Marc & Hens, Niel & Molenberghs, Geert, 2012. "A nonparametric approach to weighted estimating equations for regression analysis with missing covariates," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 100-113, January.
    13. Marquez, Jose & Qualter, Pamela & Petersen, Kimberly & Humphrey, Neil & Black, Louise, 2022. "In a lonely place: Neighbourhood effects on loneliness among adolescents," SocArXiv hzer5, Center for Open Science.
    14. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    15. Pengyu Ren & Zhaoxia Liu, 2021. "Efficiency Evaluation of China’s Public Sports Services: A Three-Stage DEA Model," IJERPH, MDPI, vol. 18(20), pages 1-12, October.
    16. Laudicella, Mauro & Olsen, Kim Rose & Street, Andrew, 2010. "Examining cost variation across hospital departments-a two-stage multi-level approach using patient-level data," Social Science & Medicine, Elsevier, vol. 71(10), pages 1872-1881, November.
    17. Tatjana Miljkovic & Ying-Ju Chen, 2021. "A new computational approach for estimation of the Gini index based on grouped data," Computational Statistics, Springer, vol. 36(3), pages 2289-2311, September.
    18. Fujishiro, Kaori & Xu, Jun & Gong, Fang, 2010. "What does "occupation" represent as an indicator of socioeconomic status?: Exploring occupational prestige and health," Social Science & Medicine, Elsevier, vol. 71(12), pages 2100-2107, December.
    19. Ricardo AGUADO & Jabier MARTINEZ & Miguel Angel LARRINAGA, 2011. "REGIONAL R&D&i PRODUCTIVITY IN EUROPE. IDENTIFYING REGIONAL TYPOLOGIES AND POLICY RECOMMENDATIONS," ERSA conference papers ersa10p412, European Regional Science Association.
    20. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:25:y:2016:i:5:p:515-528. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.