IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v31y2011i4p675-692.html
   My bibliography  Save this article

Accounting for Methodological, Structural, and Parameter Uncertainty in Decision-Analytic Models

Author

Listed:
  • Joke Bilcke
  • Philippe Beutels
  • Marc Brisson
  • Mark Jit

Abstract

Accounting for uncertainty is now a standard part of decision-analytic modeling and is recommended by many health technology agencies and published guidelines. However, the scope of such analyses is often limited, even though techniques have been developed for presenting the effects of methodological, structural, and parameter uncertainty on model results. To help bring these techniques into mainstream use, the authors present a step-by-step guide that offers an integrated approach to account for different kinds of uncertainty in the same model, along with a checklist for assessing the way in which uncertainty has been incorporated. The guide also addresses special situations such as when a source of uncertainty is difficult to parameterize, resources are limited for an ideal exploration of uncertainty, or evidence to inform the model is not available or not reliable. Methods for identifying the sources of uncertainty that influence results most are also described. Besides guiding analysts, the guide and checklist may be useful to decision makers who need to assess how well uncertainty has been accounted for in a decision-analytic model before using the results to make a decision.

Suggested Citation

  • Joke Bilcke & Philippe Beutels & Marc Brisson & Mark Jit, 2011. "Accounting for Methodological, Structural, and Parameter Uncertainty in Decision-Analytic Models," Medical Decision Making, , vol. 31(4), pages 675-692, July.
  • Handle: RePEc:sae:medema:v:31:y:2011:i:4:p:675-692
    DOI: 10.1177/0272989X11409240
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X11409240
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X11409240?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. M. D. Stevenson & J. Oakley & J. B. Chilcott, 2004. "Gaussian Process Modeling in Conjunction with Individual Patient Simulation Modeling: A Case Study Describing the Calculation of Cost-Effectiveness Ratios for the Treatment of Established Osteoporosis," Medical Decision Making, , vol. 24(1), pages 89-100, January.
    2. Drummond, Michael F. & Sculpher, Mark J. & Torrance, George W. & O'Brien, Bernie J. & Stoddart, Greg L., 2005. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 3, number 9780198529453.
    3. Laura Bojke & Karl Claxton & Stephen Palmer & Mark Sculpher, 2006. "Defining and characterising structural uncertainty in decision analytic models," Working Papers 009cherp, Centre for Health Economics, University of York.
    4. Smith, Richard D. & Yago, Milton & Millar, Michael & Coast, Jo, 2005. "Assessing the macroeconomic impact of a healthcare problem: The application of computable general equilibrium analysis to antimicrobial resistance," Journal of Health Economics, Elsevier, vol. 24(6), pages 1055-1075, November.
    5. John A. Cairns & Marjon M. Van Der Pol, 1997. "Saving future lives. A comparison of three discounting models," Health Economics, John Wiley & Sons, Ltd., vol. 6(4), pages 341-350, July.
    6. Briggs, Andrew & Sculpher, Mark & Claxton, Karl, 2006. "Decision Modelling for Health Economic Evaluation," OUP Catalogue, Oxford University Press, number 9780198526629.
    7. Anthony O'Hagan & Matt Stevenson & Jason Madan, 2007. "Monte Carlo probabilistic sensitivity analysis for patient level simulation models: efficient estimation of mean and variance using ANOVA," Health Economics, John Wiley & Sons, Ltd., vol. 16(10), pages 1009-1023, October.
    8. Anthony O'Hagan & Matt Stevenson & Jason Madan, 2007. "Monte Carlo probabilistic sensitivity analysis for patient level simulation models: efficient estimation of mean and variance using ANOVA," Health Economics, John Wiley & Sons, Ltd., vol. 16(10), pages 1009-1023.
    9. A. E. Ades & G. Lu, 2003. "Correlations Between Parameters in Risk Models: Estimation and Propagation of Uncertainty by Markov Chain Monte Carlo," Risk Analysis, John Wiley & Sons, vol. 23(6), pages 1165-1172, December.
    10. A. E. Ades & Karl Claxton & Mark Sculpher, 2006. "Evidence synthesis, parameter correlation and probabilistic sensitivity analysis," Health Economics, John Wiley & Sons, Ltd., vol. 15(4), pages 373-381, April.
    11. Xu, Chonggang & Gertner, George Zdzislaw, 2008. "Uncertainty and sensitivity analysis for models with correlated parameters," Reliability Engineering and System Safety, Elsevier, vol. 93(10), pages 1563-1573.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matteo Richiardi & Ross E. Richardson, 2017. "JAS-mine: A new platform for microsimulation and agent-based modelling," International Journal of Microsimulation, International Microsimulation Association, vol. 10(1), pages 106-134.
    2. Nasuh C. Buyukkaramikli & Peter Wigfield & Men Thi Hoang, 2021. "A MEA is a MEA is a MEA? Sequential decision making and the impact of different managed entry agreements at the manufacturer and payer level, using a case study for an oncology drug in England," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(1), pages 51-73, February.
    3. Anthony Newall & Mark Jit & Philippe Beutels, 2012. "Economic Evaluations of Childhood Influenza Vaccination," PharmacoEconomics, Springer, vol. 30(8), pages 647-660, August.
    4. Ulla Griffiths & Benedict Anigbogu & Kiran Nanchahal, 2012. "Economic evaluations of adult weight management interventions," Applied Health Economics and Health Policy, Springer, vol. 10(3), pages 145-162, May.
    5. Björn Stollenwerk & Afschin Gandjour & Markus Lüngen & Uwe Siebert, 2013. "Accounting for increased non-target-disease-specific mortality in decision-analytic screening models for economic evaluation," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 14(6), pages 1035-1048, December.
    6. Olena Mandrik & Anne I. Hahn & James W. F. Catto & Ann G. Zauber & Marcus Cumberbatch & James Chilcott, 2023. "Critical Appraisal of Decision Models Used for the Economic Evaluation of Bladder Cancer Screening and Diagnosis: A Systematic Review," PharmacoEconomics, Springer, vol. 41(6), pages 633-650, June.
    7. Céline Christiansen-Jucht & Kamil Erguler & Chee Yan Shek & María-Gloria Basáñez & Paul E. Parham, 2015. "Modelling Anopheles gambiae s.s. Population Dynamics with Temperature- and Age-Dependent Survival," IJERPH, MDPI, vol. 12(6), pages 1-31, May.
    8. Morteza BAGHERPOUR, 2015. "Risky Time Driven Activity Based Costing in a Medical Center: A Development, Implementation and Simulation based Optimization Approach," The Journal of Accounting and Management, Danubius University of Galati, issue 2, pages 47-61, August.
    9. Matthew R Behrend & María-Gloria Basáñez & Jonathan I D Hamley & Travis C Porco & Wilma A Stolk & Martin Walker & Sake J de Vlas & for the NTD Modelling Consortium, 2020. "Modelling for policy: The five principles of the Neglected Tropical Diseases Modelling Consortium," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 14(4), pages 1-17, April.
    10. Zhi Qu & Shanshan Zhang & Christian Krauth & Xuenan Liu, 2019. "A systematic review of decision analytic modeling techniques for the economic evaluation of dental caries interventions," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-17, May.
    11. Andrija S Grustam & Nasuh Buyukkaramikli & Ron Koymans & Hubertus J M Vrijhoef & Johan L Severens, 2019. "Value of information analysis in telehealth for chronic heart failure management," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-23, June.
    12. Ross Richardson & Lia Pacelli & Ambra Poggi & Matteo Richiardi, 2018. "Female Labour Force Projections Using Microsimulation for Six EU Countries," International Journal of Microsimulation, International Microsimulation Association, vol. 11(2), pages 5-51.
    13. Giovanni S. P. Malloy & Jeremy D. Goldhaber-Fiebert & Eva A. Enns & Margaret L. Brandeau, 2021. "Predicting the Effectiveness of Endemic Infectious Disease Control Interventions: The Impact of Mass Action versus Network Model Structure," Medical Decision Making, , vol. 41(6), pages 623-640, August.
    14. Daniel da Silva Pereira Curado & Dalila Fernandes Gomes & Thales Brendon Castano Silva & Paulo Henrique Ribeiro Fernandes Almeida & Noemia Urruth Leão Tavares & Camila Alves Areda & Everton Nunes da S, 2021. "Direct cost of systemic arterial hypertension and its complications in the circulatory system from the perspective of the Brazilian public health system in 2019," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-17, June.
    15. Rowan Iskandar & Carlo Federici & Cassandra Berns & Carl Rudolf Blankart, 2022. "An approach to quantify parameter uncertainty in early assessment of novel health technologies," Health Economics, John Wiley & Sons, Ltd., vol. 31(S1), pages 116-134, September.
    16. Richiardi, Matteo & Bronka, Patryk & van de Ven, Justin, 2023. "Back to the future: Agent-based modelling and dynamic microsimulation," Centre for Microsimulation and Policy Analysis Working Paper Series CEMPA8/23, Centre for Microsimulation and Policy Analysis at the Institute for Social and Economic Research.
    17. Tim Goedemé & Karel Van den Bosch & Lina Salanauskaite & Gerlinde Verbist, 2013. "Testing the Statistical Significance of Microsimulation Results: A Plea," International Journal of Microsimulation, International Microsimulation Association, vol. 6(3), pages 50-77.
    18. repec:ijm:journl:v109:y:2017:i:1:p:106-134 is not listed on IDEAS
    19. Biddle, Louise & Miners, Alec & Bozorgmehr, Kayvan, 2019. "Cost-utility of screening for depression among asylum seekers: a modelling study in Germany," Health Policy, Elsevier, vol. 123(9), pages 873-881.
    20. Hester V Eeren & Saskia J Schawo & Ron H J Scholte & Jan J V Busschbach & Leona Hakkaart, 2015. "Value of Information Analysis Applied to the Economic Evaluation of Interventions Aimed at Reducing Juvenile Delinquency: An Illustration," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-15, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marta Soares & Luísa Canto e Castro, 2012. "Continuous Time Simulation and Discretized Models for Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 30(12), pages 1101-1117, December.
    2. Marta O Soares & L Canto e Castro, 2010. "Simulation or cohort models? Continuous time simulation and discretized Markov models to estimate cost-effectiveness," Working Papers 056cherp, Centre for Health Economics, University of York.
    3. Marta O. Soares & Luísa Canto e Castro, 2012. "Continuous Time Simulation and Discretized Models for Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 30(12), pages 1101-1117, December.
    4. Oakley, Jeremy E. & Brennan, Alan & Tappenden, Paul & Chilcott, Jim, 2010. "Simulation sample sizes for Monte Carlo partial EVPI calculations," Journal of Health Economics, Elsevier, vol. 29(3), pages 468-477, May.
    5. Weatherly, Helen & Drummond, Michael & Claxton, Karl & Cookson, Richard & Ferguson, Brian & Godfrey, Christine & Rice, Nigel & Sculpher, Mark & Sowden, Amanda, 2009. "Methods for assessing the cost-effectiveness of public health interventions: Key challenges and recommendations," Health Policy, Elsevier, vol. 93(2-3), pages 85-92, December.
    6. Jeremy D. Goldhaber-Fiebert & Hawre J. Jalal, 2016. "Some Health States Are Better Than Others," Medical Decision Making, , vol. 36(8), pages 927-940, November.
    7. Laura Burgers & William Redekop & Johan Severens, 2014. "Challenges in Modelling the Cost Effectiveness of Various Interventions for Cardiovascular Disease," PharmacoEconomics, Springer, vol. 32(7), pages 627-637, July.
    8. Mark Oppe & Daniela Ortín-Sulbarán & Carlos Vila Silván & Anabel Estévez-Carrillo & Juan M. Ramos-Goñi, 2021. "Cost-effectiveness of adding Sativex® spray to spasticity care in Belgium: using bootstrapping instead of Monte Carlo simulation for probabilistic sensitivity analyses," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(5), pages 711-721, July.
    9. Round, Jeff, 2012. "Is a QALY still a QALY at the end of life?," Journal of Health Economics, Elsevier, vol. 31(3), pages 521-527.
    10. Eleanor Heather & Katherine Payne & Mark Harrison & Deborah Symmons, 2014. "Including Adverse Drug Events in Economic Evaluations of Anti-Tumour Necrosis Factor-α Drugs for Adult Rheumatoid Arthritis: A Systematic Review of Economic Decision Analytic Models," PharmacoEconomics, Springer, vol. 32(2), pages 109-134, February.
    11. Manuel Gomes & Robert Aldridge & Peter Wylie & James Bell & Owen Epstein, 2013. "Cost-Effectiveness Analysis of 3-D Computerized Tomography Colonography Versus Optical Colonoscopy for Imaging Symptomatic Gastroenterology Patients," Applied Health Economics and Health Policy, Springer, vol. 11(2), pages 107-117, April.
    12. Chantal Guilhaume & Delphine Saragoussi & John Cochran & Clément François & Mondher Toumi, 2010. "Modeling stroke management: a qualitative review of cost-effectiveness analyses," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(4), pages 419-426, August.
    13. Theresa Tawiah & Kristian Schultz Hansen & Frank Baiden & Jane Bruce & Mathilda Tivura & Rupert Delimini & Seeba Amengo-Etego & Daniel Chandramohan & Seth Owusu-Agyei & Jayne Webster, 2016. "Cost-Effectiveness Analysis of Test-Based versus Presumptive Treatment of Uncomplicated Malaria in Children under Five Years in an Area of High Transmission in Central Ghana," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-18, October.
    14. Salah Ghabri & Françoise F. Hamers & Jean Michel Josselin, 2016. "Exploring Uncertainty in Economic Evaluations of Drugs and Medical Devices: Lessons from the First Review of Manufacturers’ Submissions to the French National Authority for Health," PharmacoEconomics, Springer, vol. 34(6), pages 617-624, June.
    15. Neily Zakiyah & Antoinette D I van Asselt & Frank Roijmans & Maarten J Postma, 2016. "Economic Evaluation of Family Planning Interventions in Low and Middle Income Countries; A Systematic Review," PLOS ONE, Public Library of Science, vol. 11(12), pages 1-19, December.
    16. Billingsley Kaambwa & Julie Ratcliffe, 2018. "Predicting EuroQoL 5 Dimensions 5 Levels (EQ-5D-5L) Utilities from Older People’s Quality of Life Brief Questionnaire (OPQoL-Brief) Scores," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 11(1), pages 39-54, February.
    17. Billingsley Kaambwa & Gang Chen & Julie Ratcliffe & Angelo Iezzi & Aimee Maxwell & Jeff Richardson, 2017. "Mapping Between the Sydney Asthma Quality of Life Questionnaire (AQLQ-S) and Five Multi-Attribute Utility Instruments (MAUIs)," PharmacoEconomics, Springer, vol. 35(1), pages 111-124, January.
    18. Jonathan Karnon & James Stahl & Alan Brennan & J. Jaime Caro & Javier Mar & Jörgen Möller, 2012. "Modeling Using Discrete Event Simulation," Medical Decision Making, , vol. 32(5), pages 701-711, September.
    19. Paul Tappenden & James Chilcott, 2014. "Avoiding and Identifying Errors and Other Threats to the Credibility of Health Economic Models," PharmacoEconomics, Springer, vol. 32(10), pages 967-979, October.
    20. Maximilian Hatz & Reiner Leidl & Nichola Yates & Björn Stollenwerk, 2014. "A Systematic Review of the Quality of Economic Models Comparing Thrombosis Inhibitors in Patients with Acute Coronary Syndrome Undergoing Percutaneous Coronary Intervention," PharmacoEconomics, Springer, vol. 32(4), pages 377-393, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:31:y:2011:i:4:p:675-692. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.