IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v28y2008i5p650-667.html
   My bibliography  Save this article

Integration of Meta-analysis and Economic Decision Modeling for Evaluating Diagnostic Tests

Author

Listed:
  • Alexander J. Sutton

    (Centre for Biostatistics & Genetic Epidemiology, Department of Health Sciences, University of Leicester, 22-28 Princess Road West, Leicester LE1 7RH, UK, ajs22@le.ac.uk)

  • Nicola J. Cooper

    (Department of Health Sciences, University of Leicester, Leicester, England)

  • Steve Goodacre

    (School of Health and Related Research, University of Sheffield, Sheffield, England)

  • Matthew Stevenson

    (School of Health and Related Research, University of Sheffield, Sheffield, England)

Abstract

Meta-analysis of diagnostic test accuracy data is more difficult than of effectiveness data because of 1) statistical challenges of dealing with multiple measures of accuracy (e.g., sensitivity and specificity) simultaneously and 2) incorporating threshold effects. A number of meta-analysis models are in use, ranging from naïve synthesis of independent sensitivity and specificity to optimization of a hierarchical summary receiver operating characteristic (SROC) curve. Little work has been done on how such analyses should inform decision models. This article aims to present a unified framework for the synthesis of primary data and economic evaluation of alternative diagnostic testing strategies using Bayesian Markov Chain Monte Carlo simulation methods. The authors extend this previous work by using systematic review to derive model parameters, fully allowing for uncertainty in their estimation, and formally incorporating variability between study results into the decision analysis. Using a simple decision model comparing alternative testing strategies for suspected deep vein thrombosis as an example, the authors consider how to use outputs of different alternative meta-analysis models in decision models. They also explore the limitations of diagnostic test studies, particularly when there is no obvious threshold value. To correct some of the limitations of diagnostic test studies, they propose that tests with implicit and explicit thresholds should be studied using distinctly different frameworks. Specifically, when a threshold exists, quantitative threshold information should be included in meta-analysis models to aid interpretation of SROCs. Setting policy to relate to a specific point may be much more difficult for studies with implicit thresholds.

Suggested Citation

  • Alexander J. Sutton & Nicola J. Cooper & Steve Goodacre & Matthew Stevenson, 2008. "Integration of Meta-analysis and Economic Decision Modeling for Evaluating Diagnostic Tests," Medical Decision Making, , vol. 28(5), pages 650-667, September.
  • Handle: RePEc:sae:medema:v:28:y:2008:i:5:p:650-667
    DOI: 10.1177/0272989X08324036
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X08324036
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X08324036?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael A. Kohn & Thomas B. Newman, 2001. "What White Blood Cell Count Should Prompt Antibiotic Treatment in a Febrile Child? Tutorial on the Importance of Disease Likelihood to the Interpretation of Diagnostic Tests," Medical Decision Making, , vol. 21(6), pages 479-489, December.
    2. A. E. Ades & G. Lu & J. P. T. Higgins, 2005. "The Interpretation of Random-Effects Meta-Analysis in Decision Models," Medical Decision Making, , vol. 25(6), pages 646-654, November.
    3. George Laking & Joanne Lord & Alastair Fischer, 2006. "The economics of diagnosis," Health Economics, John Wiley & Sons, Ltd., vol. 15(10), pages 1109-1120, October.
    4. L.R. Arends & T.H. Hamza & J.C. van Houwelingen & M.H. Heijenbrok-Kal & M.G.M. Hunink & T. Stijnen, 2008. "Bivariate Random Effects Meta-Analysis of ROC Curves," Medical Decision Making, , vol. 28(5), pages 621-638, September.
    5. Nicola J. Cooper & Alex J. Sutton & Keith R. Abrams & David Turner & Allan Wailoo, 2004. "Comprehensive decision analytical modelling in economic evaluation: a Bayesian approach," Health Economics, John Wiley & Sons, Ltd., vol. 13(3), pages 203-226, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. De Donder, Philippe & Bardey, David & Zaporozhets, Vera, 2024. "The Health Technology Assessment Approach of the Economic Value of Diagnostic Tests - A Literature Review," TSE Working Papers 24-1508, Toulouse School of Economics (TSE).
    2. Xiaowei Gong & Boyun Yuan & Yadong Yuan, 2022. "Incidence and prognostic value of pulmonary embolism in COVID-19: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-16, March.
    3. Yasuhiro Hagiwara & Takeru Shiroiwa, 2022. "Estimating Value-Based Price and Quantifying Uncertainty around It in Health Technology Assessment: Frequentist and Bayesian Approaches," Medical Decision Making, , vol. 42(5), pages 672-683, July.
    4. Fanjie Meng & Xiangpo Pan & Wenzhen Tong, 2018. "Rifampicin versus streptomycin for brucellosis treatment in humans: A meta-analysis of randomized controlled trials," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-12, February.
    5. J. Brown & N. J. Welton & C. Bankhead & S. H. Richards & L. Roberts & C. Tydeman & T. J. Peters, 2006. "A Bayesian approach to analysing the cost‐effectiveness of two primary care interventions aimed at improving attendance for breast screening," Health Economics, John Wiley & Sons, Ltd., vol. 15(5), pages 435-445, May.
    6. Biao Zhou & Gao Feng Feng Cai & Hua Kun Kun Lv & Shuang Fei Fei Xu & Zheng Ting Ting Wang & Zheng Gang Gang Jiang & Chong Gao Gao Hu & Yong Di Di Chen, 2019. "Factors Correlating to the Development of Hepatitis C Virus Infection among Drug Users—Findings from a Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 16(13), pages 1-17, July.
    7. Jie Chen & Mingpeng Wu & Rongbo Liu & Siyi Li & Ronghui Gao & Bin Song, 2015. "Preoperative Evaluation of the Histological Grade of Hepatocellular Carcinoma with Diffusion-Weighted Imaging: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-16, February.
    8. Richard M. Nixon & David Wonderling & Richard D. Grieve, 2010. "Non‐parametric methods for cost‐effectiveness analysis: the central limit theorem and the bootstrap compared," Health Economics, John Wiley & Sons, Ltd., vol. 19(3), pages 316-333, March.
    9. Bijing Mao & Yafei Li & Zhimin Zhang & Chuan Chen & Yuanyuan Chen & Chenchen Ding & Lin Lei & Jian Li & Mei Jiang & Dong Wang & Ge Wang, 2015. "One-Carbon Metabolic Factors and Risk of Renal Cell Cancer: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-10, October.
    10. Richard Grieve & John Cairns & Simon G. Thompson, 2010. "Improving costing methods in multicentre economic evaluation: the use of multiple imputation for unit costs," Health Economics, John Wiley & Sons, Ltd., vol. 19(8), pages 939-954, August.
    11. Gregory S. Zaric, 2008. "Optimal drug pricing, limited use conditions and stratified net benefits for Markov models of disease progression," Health Economics, John Wiley & Sons, Ltd., vol. 17(11), pages 1277-1294, November.
    12. Zoie Shui-Yee Wong & David Goldsman & Kwok-Leung Tsui, 2016. "Economic Evaluation of Individual School Closure Strategies: The Hong Kong 2009 H1N1 Pandemic," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-18, January.
    13. Ruili Wei & Chaonan Wang & Fangping He & Lirong Hong & Jie Zhang & Wangxiao Bao & Fangxia Meng & Benyan Luo, 2019. "Prediction of poor outcome after hypoxic-ischemic brain injury by diffusion-weighted imaging: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 14(12), pages 1-16, December.
    14. Shefali Liyanage & Kiran Saqib & Amber Fozia Khan & Tijhiana Rose Thobani & Wang-Choi Tang & Cameron B. Chiarot & Bara’ Abdallah AlShurman & Zahid Ahmad Butt, 2021. "Prevalence of Anxiety in University Students during the COVID-19 Pandemic: A Systematic Review," IJERPH, MDPI, vol. 19(1), pages 1-13, December.
    15. Andrew Briggs, 2012. "Statistical Methods for Cost-effectiveness Analysis Alongside Clinical Trials," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 50, Edward Elgar Publishing.
    16. Richard Grieve & Richard Nixon & Simon G. Thompson & John Cairns, 2007. "Multilevel models for estimating incremental net benefits in multinational studies," Health Economics, John Wiley & Sons, Ltd., vol. 16(8), pages 815-826, August.
    17. Se Young Kim & Mi-Kyoung Cho, 2022. "The Effect of Nurse Support Programs on Job Satisfaction and Organizational Behaviors among Hospital Nurses: A Meta-Analysis," IJERPH, MDPI, vol. 19(24), pages 1-23, December.
    18. Christopher H. Jackson & Linda D. Sharples & Simon G. Thompson, 2010. "Structural and parameter uncertainty in Bayesian cost‐effectiveness models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 59(2), pages 233-253, March.
    19. Bodnar, Olha & Bodnar, Taras, 2021. "Objective Bayesian meta-analysis based on generalized multivariate random effects model," Working Papers 2021:5, Örebro University, School of Business.
    20. Zafar Zafari & Kristian Thorlund & J. FitzGerald & Carlo Marra & Mohsen Sadatsafavi, 2014. "Network vs. Pairwise Meta-Analyses: A Case Study of the Impact of an Evidence-Synthesis Paradigm on Value of Information Outcomes," PharmacoEconomics, Springer, vol. 32(10), pages 995-1004, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:28:y:2008:i:5:p:650-667. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.