IDEAS home Printed from https://ideas.repec.org/a/spr/pharme/v41y2023i6d10.1007_s40273-023-01242-1.html
   My bibliography  Save this article

Comprehensive Review of Methods to Assess Uncertainty in Health Economic Evaluations

Author

Listed:
  • Thomas Michael Otten

    (Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA))

  • Sabine E. Grimm

    (Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA))

  • Bram Ramaekers

    (Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA))

  • Manuela A. Joore

    (Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA))

Abstract

Uncertainty assessment is a cornerstone in model-based health economic evaluations (HEEs) that inform reimbursement decisions. No comprehensive overview of available uncertainty assessment methods currently exists. We aimed to review methods for uncertainty assessment for use in model-based HEEs, by conducting a snowballing review. We categorised all methods according to their stage of use relating to uncertainty assessment (identification, analysis, communication). Additionally, we classified identification methods according to sources of uncertainty, and subdivided analysis and communication methods according to their purpose. The review identified a total of 80 uncertainty methods: 30 identification, 28 analysis, and 22 communication methods. Uncertainty identification methods exist to address uncertainty from different sources. Most identification methods were developed with the objective to assess related concepts such as validity, model quality, and relevance. Almost all uncertainty analysis and communication methods required uncertainty to be quantified and inclusion of uncertainties in probabilistic analysis. Our review can help analysts and decision makers in selecting uncertainty assessment methods according to their aim and purpose of the assessment. We noted a need for further clarification of terminology and guidance on the use of (combinations of) methods to identify uncertainty and related concepts such as validity and quality. A key finding is that uncertainty assessment relies heavily on quantification, which may necessitate increased use of expert elicitation and/or the development of methods to assess unquantified uncertainty.

Suggested Citation

  • Thomas Michael Otten & Sabine E. Grimm & Bram Ramaekers & Manuela A. Joore, 2023. "Comprehensive Review of Methods to Assess Uncertainty in Health Economic Evaluations," PharmacoEconomics, Springer, vol. 41(6), pages 619-632, June.
  • Handle: RePEc:spr:pharme:v:41:y:2023:i:6:d:10.1007_s40273-023-01242-1
    DOI: 10.1007/s40273-023-01242-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40273-023-01242-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s40273-023-01242-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Janneke Grutters & Marjolein Asselt & Kalipso Chalkidou & Manuela Joore, 2015. "The Authors’ Reply: Comment on “Healthy Decisions: Towards Uncertainty Tolerance in Healthcare Policy”," PharmacoEconomics, Springer, vol. 33(9), pages 983-983, September.
    2. Briggs, Andrew & Sculpher, Mark & Claxton, Karl, 2006. "Decision Modelling for Health Economic Evaluation," OUP Catalogue, Oxford University Press, number 9780198526629.
    3. Aaron A. Stinnett & John Mullahy, 1998. "Net Health Benefits: A New Framework for the Analysis of Uncertainty in Cost-Effectiveness Analysis," NBER Technical Working Papers 0227, National Bureau of Economic Research, Inc.
    4. Janneke Grutters & Marjolein Asselt & Kalipso Chalkidou & Manuela Joore, 2015. "Healthy Decisions: Towards Uncertainty Tolerance in Healthcare Policy," PharmacoEconomics, Springer, vol. 33(1), pages 1-4, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marta O. Soares & Simon Walker & Stephen J. Palmer & Mark J. Sculpher, 2018. "Establishing the Value of Diagnostic and Prognostic Tests in Health Technology Assessment," Medical Decision Making, , vol. 38(4), pages 495-508, May.
    2. David Brain & Ruth Tulleners & Xing Lee & Qinglu Cheng & Nicholas Graves & Rosana Pacella, 2019. "Cost-effectiveness analysis of an innovative model of care for chronic wounds patients," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-13, March.
    3. Claire McKenna & Karl Claxton, 2011. "Addressing Adoption and Research Design Decisions Simultaneously," Medical Decision Making, , vol. 31(6), pages 853-865, November.
    4. Fabienne Abadie & Christian Boehler, 2015. "Monitoring and Assessment Framework for the European Innovation Partnership on Active and Healthy Ageing (MAFEIP) - Conceptual description of the Monitoring and Assessment Framework for the EIP on AHA," JRC Research Reports JRC96205, Joint Research Centre.
    5. David Brain & Jonathan Mitchell & James O’Beirne, 2020. "Cost-effectiveness analysis of an outreach model of Hepatitis C Virus (HCV) assessment to facilitate HCV treatment in primary care," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-13, June.
    6. Lazaros Andronis & Lucinda J. Billingham & Stirling Bryan & Nicholas D. James & Pelham M. Barton, 2016. "A Practical Application of Value of Information and Prospective Payback of Research to Prioritize Evaluative Research," Medical Decision Making, , vol. 36(3), pages 321-334, April.
    7. Henry Glick, 2011. "Sample Size and Power for Cost-Effectiveness Analysis (Part 1)," PharmacoEconomics, Springer, vol. 29(3), pages 189-198, March.
    8. Marta Soares & Luísa Canto e Castro, 2012. "Continuous Time Simulation and Discretized Models for Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 30(12), pages 1101-1117, December.
    9. Marta O. Soares & Luísa Canto e Castro, 2012. "Continuous Time Simulation and Discretized Models for Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 30(12), pages 1101-1117, December.
    10. N. Baptista & José Carlos Pinho & Helena Alves, 2021. "Examining social capital and online social support links: a study in online health communities facing treatment uncertainty," International Review on Public and Nonprofit Marketing, Springer;International Association of Public and Non-Profit Marketing, vol. 18(1), pages 57-94, March.
    11. Wranik, Wiesława Dominika & Gambold, Liesl & Peacock, Stuart, 2021. "Uncertainty tolerance among experts involved in drug reimbursement recommendations: Qualitative evidence from HTA committees in Canada and Poland," Health Policy, Elsevier, vol. 125(3), pages 307-319.
    12. Chiranjeev Sanyal & Don Husereau, 2020. "Systematic Review of Economic Evaluations of Services Provided by Community Pharmacists," Applied Health Economics and Health Policy, Springer, vol. 18(3), pages 375-392, June.
    13. Arantzazu Arrospide & Oliver Ibarrondo & Iván Castilla & Igor Larrañaga & Javier Mar, 2022. "Development and Validation of a Discrete Event Simulation Model to Evaluate the Cardiovascular Impact of Population Policies for Obesity," Medical Decision Making, , vol. 42(2), pages 241-254, February.
    14. Manuel Antonio Espinoza & Andrea Manca & Karl Claxton & Mark Sculpher, 2018. "Social value and individual choice: The value of a choice‐based decision‐making process in a collectively funded health system," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 28-40, February.
    15. Mark Oppe & Daniela Ortín-Sulbarán & Carlos Vila Silván & Anabel Estévez-Carrillo & Juan M. Ramos-Goñi, 2021. "Cost-effectiveness of adding Sativex® spray to spasticity care in Belgium: using bootstrapping instead of Monte Carlo simulation for probabilistic sensitivity analyses," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(5), pages 711-721, July.
    16. Kaitlyn Hastings & Clara Marquina & Jedidiah Morton & Dina Abushanab & Danielle Berkovic & Stella Talic & Ella Zomer & Danny Liew & Zanfina Ademi, 2022. "Projected New-Onset Cardiovascular Disease by Socioeconomic Group in Australia," PharmacoEconomics, Springer, vol. 40(4), pages 449-460, April.
    17. A. E. Ades & Karl Claxton & Mark Sculpher, 2006. "Evidence synthesis, parameter correlation and probabilistic sensitivity analysis," Health Economics, John Wiley & Sons, Ltd., vol. 15(4), pages 373-381, April.
    18. Andrea Marcellusi & Raffaella Viti & Loreta A. Kondili & Stefano Rosato & Stefano Vella & Francesco Saverio Mennini, 2019. "Economic Consequences of Investing in Anti-HCV Antiviral Treatment from the Italian NHS Perspective: A Real-World-Based Analysis of PITER Data," PharmacoEconomics, Springer, vol. 37(2), pages 255-266, February.
    19. Risha Gidwani & Louise B. Russell, 2020. "Estimating Transition Probabilities from Published Evidence: A Tutorial for Decision Modelers," PharmacoEconomics, Springer, vol. 38(11), pages 1153-1164, November.
    20. Basu, Anirban & Jena, Anupam B. & Philipson, Tomas J., 2011. "The impact of comparative effectiveness research on health and health care spending," Journal of Health Economics, Elsevier, vol. 30(4), pages 695-706, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:pharme:v:41:y:2023:i:6:d:10.1007_s40273-023-01242-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.