IDEAS home Printed from https://ideas.repec.org/a/spr/eujhec/v24y2023i6d10.1007_s10198-022-01525-y.html
   My bibliography  Save this article

The handling of missing data in trial-based economic evaluations: should data be multiply imputed prior to longitudinal linear mixed-model analyses?

Author

Listed:
  • Ângela Jornada Ben

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Johanna M. Dongen

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Mohamed El Alili

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Martijn W. Heymans

    (Amsterdam Public Health Research Institute)

  • Jos W. R. Twisk

    (Amsterdam Public Health Research Institute)

  • Janet L. MacNeil-Vroomen

    (Amsterdam Public Health Research Institute, Amsterdam UMC, University of Amsterdam)

  • Maartje Wit

    (Amsterdam UMC, Vrije Universiteit, Amsterdam Public Health Research Institute)

  • Susan E. M. Dijk

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

  • Teddy Oosterhuis

    (Netherlands Society of Occupational Medicine (NVAB))

  • Judith E. Bosmans

    (Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute)

Abstract

Introduction For the analysis of clinical effects, multiple imputation (MI) of missing data were shown to be unnecessary when using longitudinal linear mixed-models (LLM). It remains unclear whether this also applies to trial-based economic evaluations. Therefore, this study aimed to assess whether MI is required prior to LLM when analyzing longitudinal cost and effect data. Methods Two-thousand complete datasets were simulated containing five time points. Incomplete datasets were generated with 10, 25, and 50% missing data in follow-up costs and effects, assuming a Missing At Random (MAR) mechanism. Six different strategies were compared using empirical bias (EB), root-mean-squared error (RMSE), and coverage rate (CR). These strategies were: LLM alone (LLM) and MI with LLM (MI-LLM), and, as reference strategies, mean imputation with LLM (M-LLM), seemingly unrelated regression alone (SUR-CCA), MI with SUR (MI-SUR), and mean imputation with SUR (M-SUR). Results For costs and effects, LLM, MI-LLM, and MI-SUR performed better than M-LLM, SUR-CCA, and M-SUR, with smaller EBs and RMSEs as well as CRs closers to nominal levels. However, even though LLM, MI-LLM and MI-SUR performed equally well for effects, MI-LLM and MI-SUR were found to perform better than LLM for costs at 10 and 25% missing data. At 50% missing data, all strategies resulted in relatively high EBs and RMSEs for costs. Conclusion LLM should be combined with MI when analyzing trial-based economic evaluation data. MI-SUR is more efficient and can also be used, but then an average intervention effect over time cannot be estimated.

Suggested Citation

  • Ângela Jornada Ben & Johanna M. Dongen & Mohamed El Alili & Martijn W. Heymans & Jos W. R. Twisk & Janet L. MacNeil-Vroomen & Maartje Wit & Susan E. M. Dijk & Teddy Oosterhuis & Judith E. Bosmans, 2023. "The handling of missing data in trial-based economic evaluations: should data be multiply imputed prior to longitudinal linear mixed-model analyses?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(6), pages 951-965, August.
  • Handle: RePEc:spr:eujhec:v:24:y:2023:i:6:d:10.1007_s10198-022-01525-y
    DOI: 10.1007/s10198-022-01525-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10198-022-01525-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10198-022-01525-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrew R. Willan & Andrew H. Briggs & Jeffrey S. Hoch, 2004. "Regression methods for covariate adjustment and subgroup analysis for non‐censored cost‐effectiveness data," Health Economics, John Wiley & Sons, Ltd., vol. 13(5), pages 461-475, May.
    2. Andrea Gabrio & Michael J. Daniels & Gianluca Baio, 2020. "A Bayesian parametric approach to handle missing longitudinal outcome data in trial‐based health economic evaluations," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(2), pages 607-629, February.
    3. Andrea Gabrio & Alexina J. Mason & Gianluca Baio, 2017. "Handling Missing Data in Within-Trial Cost-Effectiveness Analysis: A Review with Future Recommendations," PharmacoEconomics - Open, Springer, vol. 1(2), pages 79-97, June.
    4. Andrea Gabrio & Catrin Plumpton & Sube Banerjee & Baptiste Leurent, 2022. "Linear mixed models to handle missing at random data in trial‐based economic evaluations," Health Economics, John Wiley & Sons, Ltd., vol. 31(6), pages 1276-1287, June.
    5. Stuart R. Lipsitz & Garrett M. Fitzmaurice & Joseph G. Ibrahim & Debajyoti Sinha & Michael Parzen & Steven Lipshultz, 2009. "Joint generalized estimating equations for multivariate longitudinal binary outcomes with missing data: an application to acquired immune deficiency syndrome data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 3-20, January.
    6. Drummond, Michael F. & Sculpher, Mark J. & Torrance, George W. & O'Brien, Bernie J. & Stoddart, Greg L., 2005. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 3, number 9780198529453, Decembrie.
    7. Mohamed El Alili & Johanna M. Dongen & Keith S. Goldfeld & Martijn W. Heymans & Maurits W. Tulder & Judith E. Bosmans, 2020. "Taking the Analysis of Trial-Based Economic Evaluations to the Next Level: The Importance of Accounting for Clustering," PharmacoEconomics, Springer, vol. 38(11), pages 1247-1261, November.
    8. Rita Faria & Manuel Gomes & David Epstein & Ian White, 2014. "A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials," PharmacoEconomics, Springer, vol. 32(12), pages 1157-1170, December.
    9. Andrea Gabrio & Alexina J. Mason & Gianluca Baio, 2017. "Erratum to: Handling Missing Data in Within-Trial Cost-Effectiveness Analysis: A Review with Future Recommendations," PharmacoEconomics - Open, Springer, vol. 1(2), pages 143-143, June.
    10. Yucel, Recai M. & Demirtas, Hakan, 2010. "Impact of non-normal random effects on inference by multiple imputation: A simulation assessment," Computational Statistics & Data Analysis, Elsevier, vol. 54(3), pages 790-801, March.
    11. Manuel Gomes & Richard Grieve & Richard Nixon & W. J. Edmunds, 2012. "Statistical Methods for Cost-Effectiveness Analyses That Use Data from Cluster Randomized Trials," Medical Decision Making, , vol. 32(1), pages 209-220, January.
    12. Alexina J. Mason & Manuel Gomes & James Carpenter & Richard Grieve, 2021. "Flexible Bayesian longitudinal models for cost‐effectiveness analyses with informative missing data," Health Economics, John Wiley & Sons, Ltd., vol. 30(12), pages 3138-3158, December.
    13. Andrea Manca & Paul C. Lambert & Mark Sculpher & Nigel Rice, 2007. "Cost-Effectiveness Analysis Using Data from Multinational Trials: The Use of Bivariate Hierarchical Modeling," Medical Decision Making, , vol. 27(4), pages 471-490, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Gabrio & Catrin Plumpton & Sube Banerjee & Baptiste Leurent, 2022. "Linear mixed models to handle missing at random data in trial‐based economic evaluations," Health Economics, John Wiley & Sons, Ltd., vol. 31(6), pages 1276-1287, June.
    2. Abualbishr Alshreef & Allan J. Wailoo & Steven R. Brown & James P. Tiernan & Angus J. M. Watson & Katie Biggs & Mike Bradburn & Daniel Hind, 2017. "Cost-Effectiveness of Haemorrhoidal Artery Ligation versus Rubber Band Ligation for the Treatment of Grade II–III Haemorrhoids: Analysis Using Evidence from the HubBLe Trial," PharmacoEconomics - Open, Springer, vol. 1(3), pages 175-184, September.
    3. Alexina J. Mason & Manuel Gomes & James Carpenter & Richard Grieve, 2021. "Flexible Bayesian longitudinal models for cost‐effectiveness analyses with informative missing data," Health Economics, John Wiley & Sons, Ltd., vol. 30(12), pages 3138-3158, December.
    4. Mohamed El Alili & Johanna M. van Dongen & Jonas L. Esser & Martijn W. Heymans & Maurits W. van Tulder & Judith E. Bosmans, 2022. "A scoping review of statistical methods for trial‐based economic evaluations: The current state of play," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2680-2699, December.
    5. Rachael Hunter & Gianluca Baio & Thomas Butt & Stephen Morris & Jeff Round & Nick Freemantle, 2015. "An Educational Review of the Statistical Issues in Analysing Utility Data for Cost-Utility Analysis," PharmacoEconomics, Springer, vol. 33(4), pages 355-366, April.
    6. Manuel Gomes & Edmond S.-W. Ng & Richard Grieve & Richard Nixon & James Carpenter & Simon G. Thompson, 2012. "Developing Appropriate Methods for Cost-Effectiveness Analysis of Cluster Randomized Trials," Medical Decision Making, , vol. 32(2), pages 350-361, March.
    7. Casey Quinn, 2005. "Generalisable regression methods for costeffectiveness using copulas," Health, Econometrics and Data Group (HEDG) Working Papers 05/13, HEDG, c/o Department of Economics, University of York.
    8. Manuel Gomes & Richard Grieve & Richard Nixon & W. J. Edmunds, 2012. "Statistical Methods for Cost-Effectiveness Analyses That Use Data from Cluster Randomized Trials," Medical Decision Making, , vol. 32(1), pages 209-220, January.
    9. Ilias Goranitis & Leana Bellanca & Amanda J Daley & Adele Thomas & Helen Stokes-Lampard & Andrea K Roalfe & Sue Jowett, 2017. "Aerobic exercise for vasomotor menopausal symptoms: A cost-utility analysis based on the Active Women trial," PLOS ONE, Public Library of Science, vol. 12(9), pages 1-15, September.
    10. Moreno, E. & Girón, F.J. & Martínez, M.L. & Vázquez-Polo, F.J. & Negrín, M.A., 2013. "Optimal treatments in cost-effectiveness analysis in the presence of covariates: Improving patient subgroup definition," European Journal of Operational Research, Elsevier, vol. 226(1), pages 173-182.
    11. Theodoros Mantopoulos & Paul M. Mitchell & Nicky J. Welton & Richard McManus & Lazaros Andronis, 2016. "Choice of statistical model for cost-effectiveness analysis and covariate adjustment: empirical application of prominent models and assessment of their results," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 17(8), pages 927-938, November.
    12. Alexina J. Mason & Manuel Gomes & Richard Grieve & James R. Carpenter, 2018. "A Bayesian framework for health economic evaluation in studies with missing data," Health Economics, John Wiley & Sons, Ltd., vol. 27(11), pages 1670-1683, November.
    13. Noémi Kreif & Richard Grieve & M. Zia Sadique, 2013. "Statistical Methods For Cost‐Effectiveness Analyses That Use Observational Data: A Critical Appraisal Tool And Review Of Current Practice," Health Economics, John Wiley & Sons, Ltd., vol. 22(4), pages 486-500, April.
    14. Moreno, Elías & Girón, F.J. & Vázquez-Polo, F.J. & Negrín, M.A., 2012. "Optimal healthcare decisions: The importance of the covariates in cost–effectiveness analysis," European Journal of Operational Research, Elsevier, vol. 218(2), pages 512-522.
    15. Sun Sun & Nan Luo & Erik Stenberg & Lars Lindholm & Klas-Göran Sahlén & Karl A. Franklin & Yang Cao, 2022. "Sequential Multiple Imputation for Real-World Health-Related Quality of Life Missing Data after Bariatric Surgery," IJERPH, MDPI, vol. 19(17), pages 1-16, August.
    16. Tracey H. Sach & Mary Onoja & Holly Clarke & Miriam Santer & Ingrid Muller & Taeko Becque & Beth Stuart & Julie Hooper & Mary Steele & Sylvia Wilczynska & Matthew J. Ridd & Amanda Roberts & Amina Ahme, 2024. "Cost-effectiveness of two online interventions supporting self-care for eczema for parents/carers and young people," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 25(7), pages 1165-1176, September.
    17. Becky Pennington & Abualbishr Alshreef & Laura Flight & Andrew Metry & Edith Poku & Philip Hykin & Sobha Sivaprasad & A. Toby Prevost & Joana C. Vasconcelos & Caroline Murphy & Joanna Kelly & Yit Yang, 2021. "Cost Effectiveness of Ranibizumab vs Aflibercept vs Bevacizumab for the Treatment of Macular Oedema Due to Central Retinal Vein Occlusion: The LEAVO Study," PharmacoEconomics, Springer, vol. 39(8), pages 913-927, August.
    18. Daisuke Goto & Ya-Chen Tina Shih & Pascal Lecomte & Melvin Olson & Chukwukadibia Udeze & Yujin Park & C. Daniel Mullins, 2017. "Regression-Based Approaches to Patient-Centered Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 35(7), pages 685-695, July.
    19. Manuel Gomes & Richard Grieve & Richard Nixon & Edmond S.‐W. Ng & James Carpenter & Simon G. Thompson, 2012. "Methods For Covariate Adjustment In Cost‐Effectiveness Analysis That Use Cluster Randomised Trials," Health Economics, John Wiley & Sons, Ltd., vol. 21(9), pages 1101-1118, September.
    20. Baptiste Leurent & Manuel Gomes & Suzie Cro & Nicola Wiles & James R. Carpenter, 2020. "Reference‐based multiple imputation for missing data sensitivity analyses in trial‐based cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 29(2), pages 171-184, February.

    More about this item

    Keywords

    Cost–benefit analysis; Longitudinal studies; Epidemiologic methods; Computer simulation;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:eujhec:v:24:y:2023:i:6:d:10.1007_s10198-022-01525-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.