IDEAS home Printed from https://ideas.repec.org/a/spr/eujhec/v24y2023i6d10.1007_s10198-022-01525-y.html
   My bibliography  Save this article

The handling of missing data in trial-based economic evaluations: should data be multiply imputed prior to longitudinal linear mixed-model analyses?

Author

Listed:
  • Ângela Jornada Ben

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Johanna M. Dongen

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Mohamed El Alili

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Martijn W. Heymans

    (Amsterdam Public Health Research Institute)

  • Jos W. R. Twisk

    (Amsterdam Public Health Research Institute)

  • Janet L. MacNeil-Vroomen

    (Amsterdam Public Health Research Institute, Amsterdam UMC, University of Amsterdam)

  • Maartje Wit

    (Amsterdam UMC, Vrije Universiteit, Amsterdam Public Health Research Institute)

  • Susan E. M. Dijk

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Teddy Oosterhuis

    (Netherlands Society of Occupational Medicine (NVAB))

  • Judith E. Bosmans

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

Abstract

Introduction For the analysis of clinical effects, multiple imputation (MI) of missing data were shown to be unnecessary when using longitudinal linear mixed-models (LLM). It remains unclear whether this also applies to trial-based economic evaluations. Therefore, this study aimed to assess whether MI is required prior to LLM when analyzing longitudinal cost and effect data. Methods Two-thousand complete datasets were simulated containing five time points. Incomplete datasets were generated with 10, 25, and 50% missing data in follow-up costs and effects, assuming a Missing At Random (MAR) mechanism. Six different strategies were compared using empirical bias (EB), root-mean-squared error (RMSE), and coverage rate (CR). These strategies were: LLM alone (LLM) and MI with LLM (MI-LLM), and, as reference strategies, mean imputation with LLM (M-LLM), seemingly unrelated regression alone (SUR-CCA), MI with SUR (MI-SUR), and mean imputation with SUR (M-SUR). Results For costs and effects, LLM, MI-LLM, and MI-SUR performed better than M-LLM, SUR-CCA, and M-SUR, with smaller EBs and RMSEs as well as CRs closers to nominal levels. However, even though LLM, MI-LLM and MI-SUR performed equally well for effects, MI-LLM and MI-SUR were found to perform better than LLM for costs at 10 and 25% missing data. At 50% missing data, all strategies resulted in relatively high EBs and RMSEs for costs. Conclusion LLM should be combined with MI when analyzing trial-based economic evaluation data. MI-SUR is more efficient and can also be used, but then an average intervention effect over time cannot be estimated.

Suggested Citation

  • Ângela Jornada Ben & Johanna M. Dongen & Mohamed El Alili & Martijn W. Heymans & Jos W. R. Twisk & Janet L. MacNeil-Vroomen & Maartje Wit & Susan E. M. Dijk & Teddy Oosterhuis & Judith E. Bosmans, 2023. "The handling of missing data in trial-based economic evaluations: should data be multiply imputed prior to longitudinal linear mixed-model analyses?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(6), pages 951-965, August.
  • Handle: RePEc:spr:eujhec:v:24:y:2023:i:6:d:10.1007_s10198-022-01525-y
    DOI: 10.1007/s10198-022-01525-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10198-022-01525-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10198-022-01525-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrea Gabrio & Michael J. Daniels & Gianluca Baio, 2020. "A Bayesian parametric approach to handle missing longitudinal outcome data in trial‐based health economic evaluations," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(2), pages 607-629, February.
    2. Andrea Gabrio & Alexina J. Mason & Gianluca Baio, 2017. "Handling Missing Data in Within-Trial Cost-Effectiveness Analysis: A Review with Future Recommendations," PharmacoEconomics - Open, Springer, vol. 1(2), pages 79-97, June.
    3. Stuart R. Lipsitz & Garrett M. Fitzmaurice & Joseph G. Ibrahim & Debajyoti Sinha & Michael Parzen & Steven Lipshultz, 2009. "Joint generalized estimating equations for multivariate longitudinal binary outcomes with missing data: an application to acquired immune deficiency syndrome data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 3-20, January.
    4. Drummond, Michael F. & Sculpher, Mark J. & Torrance, George W. & O'Brien, Bernie J. & Stoddart, Greg L., 2005. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 3, number 9780198529453.
    5. Mohamed El Alili & Johanna M. Dongen & Keith S. Goldfeld & Martijn W. Heymans & Maurits W. Tulder & Judith E. Bosmans, 2020. "Taking the Analysis of Trial-Based Economic Evaluations to the Next Level: The Importance of Accounting for Clustering," PharmacoEconomics, Springer, vol. 38(11), pages 1247-1261, November.
    6. Rita Faria & Manuel Gomes & David Epstein & Ian White, 2014. "A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials," PharmacoEconomics, Springer, vol. 32(12), pages 1157-1170, December.
    7. Andrea Gabrio & Alexina J. Mason & Gianluca Baio, 2017. "Erratum to: Handling Missing Data in Within-Trial Cost-Effectiveness Analysis: A Review with Future Recommendations," PharmacoEconomics - Open, Springer, vol. 1(2), pages 143-143, June.
    8. Yucel, Recai M. & Demirtas, Hakan, 2010. "Impact of non-normal random effects on inference by multiple imputation: A simulation assessment," Computational Statistics & Data Analysis, Elsevier, vol. 54(3), pages 790-801, March.
    9. Manuel Gomes & Richard Grieve & Richard Nixon & W. J. Edmunds, 2012. "Statistical Methods for Cost-Effectiveness Analyses That Use Data from Cluster Randomized Trials," Medical Decision Making, , vol. 32(1), pages 209-220, January.
    10. Andrea Manca & Paul C. Lambert & Mark Sculpher & Nigel Rice, 2007. "Cost-Effectiveness Analysis Using Data from Multinational Trials: The Use of Bivariate Hierarchical Modeling," Medical Decision Making, , vol. 27(4), pages 471-490, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Gabrio & Catrin Plumpton & Sube Banerjee & Baptiste Leurent, 2022. "Linear mixed models to handle missing at random data in trial‐based economic evaluations," Health Economics, John Wiley & Sons, Ltd., vol. 31(6), pages 1276-1287, June.
    2. Abualbishr Alshreef & Allan J. Wailoo & Steven R. Brown & James P. Tiernan & Angus J. M. Watson & Katie Biggs & Mike Bradburn & Daniel Hind, 2017. "Cost-Effectiveness of Haemorrhoidal Artery Ligation versus Rubber Band Ligation for the Treatment of Grade II–III Haemorrhoids: Analysis Using Evidence from the HubBLe Trial," PharmacoEconomics - Open, Springer, vol. 1(3), pages 175-184, September.
    3. Alexina J. Mason & Manuel Gomes & James Carpenter & Richard Grieve, 2021. "Flexible Bayesian longitudinal models for cost‐effectiveness analyses with informative missing data," Health Economics, John Wiley & Sons, Ltd., vol. 30(12), pages 3138-3158, December.
    4. Sun Sun & Nan Luo & Erik Stenberg & Lars Lindholm & Klas-Göran Sahlén & Karl A. Franklin & Yang Cao, 2022. "Sequential Multiple Imputation for Real-World Health-Related Quality of Life Missing Data after Bariatric Surgery," IJERPH, MDPI, vol. 19(17), pages 1-16, August.
    5. Mohamed El Alili & Johanna M. van Dongen & Jonas L. Esser & Martijn W. Heymans & Maurits W. van Tulder & Judith E. Bosmans, 2022. "A scoping review of statistical methods for trial‐based economic evaluations: The current state of play," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2680-2699, December.
    6. Ilias Goranitis & Leana Bellanca & Amanda J Daley & Adele Thomas & Helen Stokes-Lampard & Andrea K Roalfe & Sue Jowett, 2017. "Aerobic exercise for vasomotor menopausal symptoms: A cost-utility analysis based on the Active Women trial," PLOS ONE, Public Library of Science, vol. 12(9), pages 1-15, September.
    7. Alexina J. Mason & Manuel Gomes & Richard Grieve & James R. Carpenter, 2018. "A Bayesian framework for health economic evaluation in studies with missing data," Health Economics, John Wiley & Sons, Ltd., vol. 27(11), pages 1670-1683, November.
    8. Paal Joranger & Arild Nesbakken & Halfdan Sorbye & Geir Hoff & Arne Oshaug & Eline Aas, 2020. "Survival and costs of colorectal cancer treatment and effects of changing treatment strategies: a model approach," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(3), pages 321-334, April.
    9. Saha, Sanjib & Gerdtham, Ulf-G. & Toresson, Håkan & Minthon, Lennart & Jarl, Johan, 2018. "Economic Evaluation of Interventions for Screening of Dementia," Working Papers 2018:20, Lund University, Department of Economics.
    10. Mark Oppe & Daniela Ortín-Sulbarán & Carlos Vila Silván & Anabel Estévez-Carrillo & Juan M. Ramos-Goñi, 2021. "Cost-effectiveness of adding Sativex® spray to spasticity care in Belgium: using bootstrapping instead of Monte Carlo simulation for probabilistic sensitivity analyses," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(5), pages 711-721, July.
    11. Laurence M. Djatche & Stefan Varga & Robert D. Lieberthal, 2018. "Cost-Effectiveness of Aspirin Adherence for Secondary Prevention of Cardiovascular Events," PharmacoEconomics - Open, Springer, vol. 2(4), pages 371-380, December.
    12. Ties Hoomans & Johan Severens & Nicole Roer & Gepke Delwel, 2012. "Methodological Quality of Economic Evaluations of New Pharmaceuticals in the Netherlands," PharmacoEconomics, Springer, vol. 30(3), pages 219-227, March.
    13. Khan, Md. Tajuddin & Kishore, Avinash & Joshi, Pramod Kumar, 2016. "Gender dimensions on farmers’ preferences for direct-seeded rice with drum seeder in India:," IFPRI discussion papers 1550, International Food Policy Research Institute (IFPRI).
    14. Noémi Kreif & Richard Grieve & M. Zia Sadique, 2013. "Statistical Methods For Cost‐Effectiveness Analyses That Use Observational Data: A Critical Appraisal Tool And Review Of Current Practice," Health Economics, John Wiley & Sons, Ltd., vol. 22(4), pages 486-500, April.
    15. Barbara Graaff & Lei Si & Amanda L. Neil & Kwang Chien Yee & Kristy Sanderson & Lyle C. Gurrin & Andrew J. Palmer, 2017. "Population Screening for Hereditary Haemochromatosis in Australia: Construction and Validation of a State-Transition Cost-Effectiveness Model," PharmacoEconomics - Open, Springer, vol. 1(1), pages 37-51, March.
    16. Christopher Fitzpatrick & Katherine Floyd, 2012. "A Systematic Review of the Cost and Cost Effectiveness of Treatment for Multidrug-Resistant Tuberculosis," PharmacoEconomics, Springer, vol. 30(1), pages 63-80, January.
    17. Hareth Al-Janabi & Terry N. Flynn & Joanna Coast, 2011. "Estimation of a Preference-Based Carer Experience Scale," Medical Decision Making, , vol. 31(3), pages 458-468, May.
    18. Round, Jeff, 2012. "Is a QALY still a QALY at the end of life?," Journal of Health Economics, Elsevier, vol. 31(3), pages 521-527.
    19. Ching-Yun Wei & Ruben G. W. Quek & Guillermo Villa & Shravanthi R. Gandra & Carol A. Forbes & Steve Ryder & Nigel Armstrong & Sohan Deshpande & Steven Duffy & Jos Kleijnen & Peter Lindgren, 2017. "A Systematic Review of Cardiovascular Outcomes-Based Cost-Effectiveness Analyses of Lipid-Lowering Therapies," PharmacoEconomics, Springer, vol. 35(3), pages 297-318, March.
    20. Jose L Burgos & Thomas L Patterson & Joshua S Graff-Zivin & James G Kahn & M Gudelia Rangel & M Remedios Lozada & Hugo Staines & Steffanie A Strathdee, 2016. "Cost-Effectiveness of Combined Sexual and Injection Risk Reduction Interventions among Female Sex Workers Who Inject Drugs in Two Very Distinct Mexican Border Cities," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-15, February.

    More about this item

    Keywords

    Cost–benefit analysis; Longitudinal studies; Epidemiologic methods; Computer simulation;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:eujhec:v:24:y:2023:i:6:d:10.1007_s10198-022-01525-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.