IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v42y2022i4p421-435.html

Generating, Presenting, and Interpreting Cost-Effectiveness Results in the Context of Uncertainty: A Tutorial for Deeper Knowledge and Better Practice

Author

Listed:
  • Joke Bilcke

    (Centre for Health Economics Research and Modeling Infectious Diseases (CHERMID), Vaccine and Infectious Disease Institute (VAXINFECTIO), University of Antwerp, Wilrijk, Antwerp, Belgium)

  • Philippe Beutels

    (Centre for Health Economics Research and Modeling Infectious Diseases (CHERMID), Vaccine and Infectious Disease Institute (VAXINFECTIO), University of Antwerp, Wilrijk, Antwerp, Belgium
    School of Public Health and Community Medicine, University of New South Wales, Sydney, Australia)

Abstract

This tutorial aims to help make the best available methods for generating and presenting cost-effectiveness results with uncertainty common practice. We believe there is a need for such type of tutorial because some erroneous practices persist (e.g., identifying the cost-effective intervention as the one with the highest probability to be cost-effective), while some of the more advanced methods are hardly used (e.g., the net loss statistic ‘NL’, expected net loss curves and frontier). The tutorial explains with simple examples the pros and cons of using ICER, incremental net benefit and NL to identify the cost-effective intervention, both with and without uncertainty accounted for probabilistically. A flowchart provides practical guidance on when and how to use ICER, incremental net benefit or NL. Different ways to express and present uncertainty in the results are described, including confidence and credible intervals, the probability that a strategy is cost-effective (as usually shown with cost-effectiveness acceptability curves (CEACs)) and the expected value of perfect information (EVPI). The tutorial clarifies and illustrates why EVPI is the only measure accounting fully for decision uncertainty, and why NL curves and the NL frontier may be preferred over CEACs and other plots for presenting cost-effectiveness results in the context of uncertainty. The easy calculations and a worked-out real-life example will help users to thoroughly understand and correctly interpret key cost-effectiveness results. Examples with mathematical calculations, interpretation, plots and R code are provided.

Suggested Citation

  • Joke Bilcke & Philippe Beutels, 2022. "Generating, Presenting, and Interpreting Cost-Effectiveness Results in the Context of Uncertainty: A Tutorial for Deeper Knowledge and Better Practice," Medical Decision Making, , vol. 42(4), pages 421-435, May.
  • Handle: RePEc:sae:medema:v:42:y:2022:i:4:p:421-435
    DOI: 10.1177/0272989X211045070
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X211045070
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X211045070?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Linda Ryen & Mikael Svensson, 2015. "The Willingness to Pay for a Quality Adjusted Life Year: A Review of the Empirical Literature," Health Economics, John Wiley & Sons, Ltd., vol. 24(10), pages 1289-1301, October.
    2. Briggs, Andrew & Sculpher, Mark & Claxton, Karl, 2006. "Decision Modelling for Health Economic Evaluation," OUP Catalogue, Oxford University Press, number 9780198526629.
    3. Simon Eckermann, 2017. "Health Economics from Theory to Practice," Springer Books, Springer, number 978-3-319-50613-5, January.
    4. James C. Felli & Gordon B. Hazen, 1998. "Sensitivity Analysis and the Expected Value of Perfect Information," Medical Decision Making, , vol. 18(1), pages 95-109, January.
    5. Drummond, Michael F. & Sculpher, Mark J. & Claxton, Karl & Stoddart, Greg L. & Torrance, George W., 2015. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 4, number 9780199665884.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiao Li & Joke Bilcke & Alike W. van der Velden & Robin Bruyndonckx & Samuel Coenen & Emily Bongard & Muirrean de Paor & Slawomir Chlabicz & Maciek Godycki-Cwirko & Nick Francis & Rune Aabenhus & Hein, 2023. "Cost-effectiveness of adding oseltamivir to primary care for influenza-like-illness: economic evaluation alongside the randomised controlled ALIC4E trial in 15 European countries," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(6), pages 909-922, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chiranjeev Sanyal & Don Husereau, 2020. "Systematic Review of Economic Evaluations of Services Provided by Community Pharmacists," Applied Health Economics and Health Policy, Springer, vol. 18(3), pages 375-392, June.
    2. Julie A. Campbell & Glen J. Henson & Valery Fuh Ngwa & Hasnat Ahmad & Bruce V. Taylor & Ingrid Mei & Andrew J. Palmer, 2025. "Estimation of Transition Probabilities from a Large Cohort (> 6000) of Australians Living with Multiple Sclerosis (MS) for Changing Disability Severity Classifications, MS Phenotype, and Disease-Modifying Therapy Classifications," PharmacoEconomics, Springer, vol. 43(2), pages 223-239, February.
    3. Qi Cao & Erik Buskens & Hans L. Hillege & Tiny Jaarsma & Maarten Postma & Douwe Postmus, 2019. "Stratified treatment recommendation or one-size-fits-all? A health economic insight based on graphical exploration," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 475-482, April.
    4. McNamara, Simon & Tsuchiya, Aki & Holmes, John, 2025. "Corrigendum to ‘Does the UK-public's aversion to inequalities in health differ by group-labelling and health-gain type? A choice-experiment’ [Soc. Sci. Med. Volume 269, January 2021, 113573]," Social Science & Medicine, Elsevier, vol. 370(C).
    5. David Bardey & Philippe de Donder & Vera Zaporozhets, 2024. "The health technology assessment approach of the economic value of diagnostic tests: a literature review," Working Papers hal-04472485, HAL.
    6. Hossein Haji Ali Afzali & Laura Bojke & Jonathan Karnon, 2018. "Model Structuring for Economic Evaluations of New Health Technologies," PharmacoEconomics, Springer, vol. 36(11), pages 1309-1319, November.
    7. Salah Ghabri & Françoise F. Hamers & Jean Michel Josselin, 2016. "Exploring Uncertainty in Economic Evaluations of Drugs and Medical Devices: Lessons from the First Review of Manufacturers’ Submissions to the French National Authority for Health," PharmacoEconomics, Springer, vol. 34(6), pages 617-624, June.
    8. Yasuhiro Hagiwara & Takeru Shiroiwa, 2022. "Estimating Value-Based Price and Quantifying Uncertainty around It in Health Technology Assessment: Frequentist and Bayesian Approaches," Medical Decision Making, , vol. 42(5), pages 672-683, July.
    9. Amr Makady & Ard Veelen & Páll Jonsson & Owen Moseley & Anne D’Andon & Anthonius Boer & Hans Hillege & Olaf Klungel & Wim Goettsch, 2018. "Using Real-World Data in Health Technology Assessment (HTA) Practice: A Comparative Study of Five HTA Agencies," PharmacoEconomics, Springer, vol. 36(3), pages 359-368, March.
    10. Sara Kaveh & Nashmil Ghadimi & Amirhossein Zarei Alvar & Kamran Roudini & Rajabali Daroudi, 2024. "Trastuzumab plus chemotherapy versus chemotherapy alone in HER2-positive gastric cancer treatment in Iran: a cost-effectiveness analysis," Health Economics Review, Springer, vol. 14(1), pages 1-14, December.
    11. Claxton, Karl & Asaria, Miqdad & Chansa, Collins & Jamison, Julian & Lomas, James & Ochalek, Jessica & Paulden, Mike, 2019. "Accounting for timing when assessing health-related policies," LSE Research Online Documents on Economics 100038, London School of Economics and Political Science, LSE Library.
    12. Matthew Franklin & James Lomas & Gerry Richardson, 2020. "Conducting Value for Money Analyses for Non-randomised Interventional Studies Including Service Evaluations: An Educational Review with Recommendations," PharmacoEconomics, Springer, vol. 38(7), pages 665-681, July.
    13. Joseph Kwon & Ruairidh Milne & Clare Rayner & Román Rocha Lawrence & Jordan Mullard & Ghazala Mir & Brendan Delaney & Manoj Sivan & Stavros Petrou, 2024. "Impact of Long COVID on productivity and informal caregiving," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 25(7), pages 1095-1115, September.
    14. David Brain & Ruth Tulleners & Xing Lee & Qinglu Cheng & Nicholas Graves & Rosana Pacella, 2019. "Cost-effectiveness analysis of an innovative model of care for chronic wounds patients," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-13, March.
    15. Ezeofor Victory & Edwards T. Rhiannon & Burnside Girvan & Adair Pauline & Pine M. Cynthia, 2022. "Cost-effectiveness Analysis of the Dental RECUR Pragmatic Randomized Controlled Trial: Evaluating a Goal-oriented Talking Intervention to Prevent Reoccurrence of Dental Caries in Children," Applied Health Economics and Health Policy, Springer, vol. 20(3), pages 431-445, May.
    16. Astrid Van Muylder & Thomas D’Hooghe & Jeroen Luyten, 2023. "Economic Evaluation of Medically Assisted Reproduction: A Methodological Systematic Review," Medical Decision Making, , vol. 43(7-8), pages 973-991, October.
    17. Sietse Mossel & Rafael Emilio Feria Cardet & Lioe-Fee Geus-Oei & Dennis Vriens & Hendrik Koffijberg & Sopany Saing, 2025. "A Systematic Literature Review of Modelling Approaches to Evaluate the Cost Effectiveness of PET/CT for Therapy Response Monitoring in Oncology," PharmacoEconomics, Springer, vol. 43(2), pages 133-151, February.
    18. Alec Morton & Amanda I. Adler & David Bell & Andrew Briggs & Werner Brouwer & Karl Claxton & Neil Craig & Alastair Fischer & Peter McGregor & Pieter van Baal, 2016. "Unrelated Future Costs and Unrelated Future Benefits: Reflections on NICE Guide to the Methods of Technology Appraisal," Health Economics, John Wiley & Sons, Ltd., vol. 25(8), pages 933-938, August.
    19. Ian Ross & Giulia Greco & Charles Opondo & Zaida Adriano & Rassul Nala & Joe Brown & Robert Dreibelbis & Oliver Cumming, 2022. "Measuring and valuing broader impacts in public health: Development of a sanitation‐related quality of life instrument in Maputo, Mozambique," Health Economics, John Wiley & Sons, Ltd., vol. 31(3), pages 466-480, March.
    20. David D. Kim & Gregory F. Guzauskas & Caroline S. Bennette & Anirban Basu & David L. Veenstra & Scott D. Ramsey & Josh J. Carlson, 2020. "Influence of Modeling Choices on Value of Information Analysis: An Empirical Analysis from a Real-World Experiment," PharmacoEconomics, Springer, vol. 38(2), pages 171-179, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:42:y:2022:i:4:p:421-435. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.