IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v181y2018i3p843-867.html
   My bibliography  Save this article

Sensitivity of treatment recommendations to bias in network meta‐analysis

Author

Listed:
  • David M. Phillippo
  • Sofia Dias
  • A. E. Ades
  • Vanessa Didelez
  • Nicky J. Welton

Abstract

Network meta‐analysis (NMA) pools evidence on multiple treatments to estimate relative treatment effects. Included studies are typically assessed for risk of bias; however, this provides no indication of the impact of potential bias on a decision based on the NMA. We propose methods to derive bias adjustment thresholds which measure the smallest changes to the data that result in a change of treatment decision. The methods use efficient matrix operations and can be applied to explore the consequences of bias in individual studies or aggregate treatment contrasts, in both fixed and random‐effects NMA models. Complex models with multiple types of data input are handled by using an approximation to the hypothetical aggregate likelihood. The methods are illustrated with a simple NMA of thrombolytic treatments and a more complex example comparing social anxiety interventions. An accompanying R package is provided.

Suggested Citation

  • David M. Phillippo & Sofia Dias & A. E. Ades & Vanessa Didelez & Nicky J. Welton, 2018. "Sensitivity of treatment recommendations to bias in network meta‐analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(3), pages 843-867, June.
    • Handle: RePEc:bla:jorssa:v:181:y:2018:i:3:p:843-867
    DOI: 10.1111/rssa.12341
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12341
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12341?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Rebecca M. Turner & David J. Spiegelhalter & Gordon C. S. Smith & Simon G. Thompson, 2009. "Bias modelling in evidence synthesis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 21-47, January.
    2. Lu, Guobing & Ades, A.E., 2006. "Assessing Evidence Inconsistency in Mixed Treatment Comparisons," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 447-459, June.
    3. Gregory C. Critchfield & Keith E. Willard, 1986. "Probabilistic Analysis of Decision Trees Using Monte Carlo Simulation," Medical Decision Making, , vol. 6(2), pages 85-92, June.
    4. N. J. Welton & A. E. Ades & J. B. Carlin & D. G. Altman & J. A. C. Sterne, 2009. "Models for potentially biased evidence in meta‐analysis using empirically based priors," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 119-136, January.
    5. Aaron A. Stinnett & John Mullahy, 1998. "Net Health Benefits: A New Framework for the Analysis of Uncertainty in Cost-Effectiveness Analysis," NBER Technical Working Papers 0227, National Bureau of Economic Research, Inc.
    6. Aaron A. Stinnett & John Mullahy, 1998. "Net Health Benefits," Medical Decision Making, , vol. 18(2_suppl), pages 68-80, April.
    7. S. Dias & N. J. Welton & V. C. C. Marinho & G. Salanti & J. P. T. Higgins & A. E. Ades, 2010. "Estimation and adjustment of bias in randomized evidence by using mixed treatment comparison meta‐analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(3), pages 613-629, July.
    8. Naci, Huseyin & Dias, Sofia & Ades, A. E., 2014. "Industry sponsorship bias in research findings: a network meta-analysis of LDL cholesterol reduction in randomised trials of statins," LSE Research Online Documents on Economics 59798, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. K. M. Rhodes & J. Savović & R. Elbers & H. E. Jones & J. P. T. Higgins & J. A. C. Sterne & N. J. Welton & R. M. Turner, 2020. "Adjusting trial results for biases in meta‐analysis: combining data‐based evidence on bias with detailed trial assessment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 193-209, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. E. Ades & Karl Claxton & Mark Sculpher, 2006. "Evidence synthesis, parameter correlation and probabilistic sensitivity analysis," Health Economics, John Wiley & Sons, Ltd., vol. 15(4), pages 373-381, April.
    2. Karl Claxton & Elisabeth Fenwick & Mark J. Sculpher, 2012. "Decision-making with Uncertainty: The Value of Information," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 51, Edward Elgar Publishing.
    3. Ana P. Johnson-Masotti & Purushottam W. Laud & Raymond G. Hoffmann & Matthew J. Hayat & Steven D. Pinkerton, 2001. "Probabilistic Cost-Effectiveness Analysis of HIV Prevention," Evaluation Review, , vol. 25(4), pages 474-502, August.
    4. S. Dias & N. J. Welton & V. C. C. Marinho & G. Salanti & J. P. T. Higgins & A. E. Ades, 2010. "Estimation and adjustment of bias in randomized evidence by using mixed treatment comparison meta‐analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(3), pages 613-629, July.
    5. Manuel Antonio Espinoza & Andrea Manca & Karl Claxton & Mark Sculpher, 2018. "Social value and individual choice: The value of a choice‐based decision‐making process in a collectively funded health system," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 28-40, February.
    6. Simon Eckermann & Andrew Willan, 2011. "Presenting Evidence and Summary Measures to Best Inform Societal Decisions When Comparing Multiple Strategies," PharmacoEconomics, Springer, vol. 29(7), pages 563-577, July.
    7. Basu, Anirban & Jena, Anupam B. & Philipson, Tomas J., 2011. "The impact of comparative effectiveness research on health and health care spending," Journal of Health Economics, Elsevier, vol. 30(4), pages 695-706, July.
    8. Neil Hawkins & David A. Scott, 2011. "Reimbursement and value‐based pricing: stratified cost‐effectiveness analysis may not be the last word," Health Economics, John Wiley & Sons, Ltd., vol. 20(6), pages 688-698, June.
    9. Lynch, Frances L. & Dickerson, John F. & Pears, Katherine C. & Fisher, Philip A., 2017. "Cost effectiveness of a school readiness intervention for foster children," Children and Youth Services Review, Elsevier, vol. 81(C), pages 63-71.
    10. M. Botteman & M. Meijboom & I. Foley & J. Stephens & Y. Chen & S. Kaura, 2011. "Cost-effectiveness of zoledronic acid in the prevention of skeletal-related events in patients with bone metastases secondary to advanced renal cell carcinoma: application to France, Germany, and the ," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(6), pages 575-588, December.
    11. Basu, Anirban, 2011. "Economics of individualization in comparative effectiveness research and a basis for a patient-centered health care," Journal of Health Economics, Elsevier, vol. 30(3), pages 549-559, May.
    12. Mohan V. Bala & Gary A. Zarkin & Josephine Mauskopf, 2008. "Presenting results of probabilistic sensitivity analysis: the incremental benefit curve," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 435-440, March.
    13. Simon Eckermann & Tim Coelli, 2008. "Including quality attributes in a model of health care efficiency: A net benefit approach," CEPA Working Papers Series WP032008, School of Economics, University of Queensland, Australia.
    14. Mark Sculpher & Karl Claxton, 2012. "Real Economics Needs to Reflect Real Decisions," PharmacoEconomics, Springer, vol. 30(2), pages 133-136, February.
    15. Frank G. Sandmann & Julie V. Robotham & Sarah R. Deeny & W. John Edmunds & Mark Jit, 2018. "Estimating the opportunity costs of bed‐days," Health Economics, John Wiley & Sons, Ltd., vol. 27(3), pages 592-605, March.
    16. Nikki McCaffrey & Meera Agar & Janeane Harlum & Jonathon Karnon & David Currow & Simon Eckermann, 2015. "Better Informing Decision Making with Multiple Outcomes Cost-Effectiveness Analysis under Uncertainty in Cost-Disutility Space," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-19, March.
    17. Danielle Brunenberg & Gwenn Wetzels & Patricia Nelemans & Carmen Dirksen & Johan Severens & Henri Stoffers & Jan Schouten & Martin Prins & Peter Leeuw & Manuela Joore, 2007. "Cost Effectiveness of an Adherence-Improving Programme in Hypertensive Patients," PharmacoEconomics, Springer, vol. 25(3), pages 239-251, March.
    18. Clarke, Philip M. & Hayes, Alison J., 2009. "Measuring achievement: Changes in risk factors for cardiovascular disease in Australia," Social Science & Medicine, Elsevier, vol. 68(3), pages 552-561, February.
    19. Meltzer, David, 2001. "Addressing uncertainty in medical cost-effectiveness analysis: Implications of expected utility maximization for methods to perform sensitivity analysis and the use of cost-effectiveness analysis to s," Journal of Health Economics, Elsevier, vol. 20(1), pages 109-129, January.
    20. Dirk Müller & Lisa Borsi & Claudia Stracke & Stephanie Stock & Björn Stollenwerk, 2015. "Cost-effectiveness of a multifactorial fracture prevention program for elderly people admitted to nursing homes," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 16(5), pages 517-527, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:181:y:2018:i:3:p:843-867. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.