IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v41y2021i4p453-464.html
   My bibliography  Save this article

Comparison of Decision Modeling Approaches for Health Technology and Policy Evaluation

Author

Listed:
  • John Graves

    (Department of Health Policy, Vanderbilt University School of Medicine Vanderbilt University Medical Center, Nashville, TN, USA)

  • Shawn Garbett

    (Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, USA)

  • Zilu Zhou

    (Department of Health Policy, Vanderbilt University Medical Center, Nashville, TN, USA)

  • Jonathan S. Schildcrout

    (Department of Biostatistics, Vanderbilt University School of Medicine Vanderbilt University Medical Center, Nashville, TN, USA)

  • Josh Peterson

    (Department of Biomedical Informatics, Vanderbilt University School of Medicine Vanderbilt University Medical Center, Nashville, TN, USA)

Abstract

We discuss tradeoffs and errors associated with approaches to modeling health economic decisions. Through an application in pharmacogenomic (PGx) testing to guide drug selection for individuals with a genetic variant, we assessed model accuracy, optimal decisions, and computation time for an identical decision scenario modeled 4 ways: using 1) coupled-time differential equations (DEQ), 2) a cohort-based discrete-time state transition model (MARKOV), 3) an individual discrete-time state transition microsimulation model (MICROSIM), and 4) discrete event simulation (DES). Relative to DEQ, the net monetary benefit for PGx testing (v. a reference strategy of no testing) based on MARKOV with rate-to-probability conversions using commonly used formulas resulted in different optimal decisions. MARKOV was nearly identical to DEQ when transition probabilities were embedded using a transition intensity matrix. Among stochastic models, DES model outputs converged to DEQ with substantially fewer simulated patients (1 million) v. MICROSIM (1 billion). Overall, properly embedded Markov models provided the most favorable mix of accuracy and runtime but introduced additional complexity for calculating cost and quality-adjusted life year outcomes due to the inclusion of “jumpover†states after proper embedding of transition probabilities. Among stochastic models, DES offered the most favorable mix of accuracy, reliability, and speed.

Suggested Citation

  • John Graves & Shawn Garbett & Zilu Zhou & Jonathan S. Schildcrout & Josh Peterson, 2021. "Comparison of Decision Modeling Approaches for Health Technology and Policy Evaluation," Medical Decision Making, , vol. 41(4), pages 453-464, May.
    • Handle: RePEc:sae:medema:v:41:y:2021:i:4:p:453-464
    DOI: 10.1177/0272989X21995805
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X21995805
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0272989X21995805?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. P. Thokala & A. Duenas, 2012. "Multiple Criteria Decision Analysis for Health Technology Assessment," Post-Print hal-00800398, HAL.
    2. Briggs, Andrew & Sculpher, Mark & Claxton, Karl, 2006. "Decision Modelling for Health Economic Evaluation," OUP Catalogue, Oxford University Press, number 9780198526629.
    3. Alan Brennan & Stephen E. Chick & Ruth Davies, 2006. "A taxonomy of model structures for economic evaluation of health technologies," Health Economics, John Wiley & Sons, Ltd., vol. 15(12), pages 1295-1310, December.
    4. Drummond, Michael F. & Sculpher, Mark J. & Claxton, Karl & Stoddart, Greg L. & Torrance, George W., 2015. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 4, number 9780199665884.
    5. Peacock, Stuart & Mitton, Craig & Bate, Angela & McCoy, Bonnie & Donaldson, Cam, 2009. "Overcoming barriers to priority setting using interdisciplinary methods," Health Policy, Elsevier, vol. 92(2-3), pages 124-132, October.
    6. Sheldon H. Jacobson & Shane N. Hall & James R. Swisher, 2006. "Discrete-Event Simulation of Health Care Systems," International Series in Operations Research & Management Science, in: Randolph W. Hall (ed.), Patient Flow: Reducing Delay in Healthcare Delivery, chapter 0, pages 211-252, Springer.
    7. Jonathan Karnon, 2003. "Alternative decision modelling techniques for the evaluation of health care technologies: Markov processes versus discrete event simulation," Health Economics, John Wiley & Sons, Ltd., vol. 12(10), pages 837-848, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carmen María Yago & Francisco Javier Díez, 2023. "DESnets: A Graphical Representation for Discrete Event Simulation and Cost-Effectiveness Analysis," Mathematics, MDPI, vol. 11(7), pages 1-24, March.
    2. Elizabeth A. Handorf & J. Robert Beck & Andres Correa & Chethan Ramamurthy & Daniel M. Geynisman, 2023. "Cost-Effectiveness Analysis for Therapy Sequence in Advanced Cancer: A Microsimulation Approach with Application to Metastatic Prostate Cancer," Medical Decision Making, , vol. 43(7-8), pages 949-960, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marta Soares & Luísa Canto e Castro, 2012. "Continuous Time Simulation and Discretized Models for Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 30(12), pages 1101-1117, December.
    2. Gemma E. Shields & Paul Clarkson & Ash Bullement & Warren Stevens & Mark Wilberforce & Tracey Farragher & Arpana Verma & Linda M. Davies, 2024. "Advances in Addressing Patient Heterogeneity in Economic Evaluation: A Review of the Methods Literature," PharmacoEconomics, Springer, vol. 42(7), pages 737-749, July.
    3. Ashley Layer & Emma McManus & N. J. Levell, 2020. "A Systematic Review of Model-Based Economic Evaluations of Treatments for Venous Leg Ulcers," PharmacoEconomics - Open, Springer, vol. 4(2), pages 211-222, June.
    4. Marta O Soares & L Canto e Castro, 2010. "Simulation or cohort models? Continuous time simulation and discretized Markov models to estimate cost-effectiveness," Working Papers 056cherp, Centre for Health Economics, University of York.
    5. Marta O. Soares & Luísa Canto e Castro, 2012. "Continuous Time Simulation and Discretized Models for Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 30(12), pages 1101-1117, December.
    6. Hossein Haji Ali Afzali & Laura Bojke & Jonathan Karnon, 2018. "Model Structuring for Economic Evaluations of New Health Technologies," PharmacoEconomics, Springer, vol. 36(11), pages 1309-1319, November.
    7. J. Jaime Caro & Andrew H. Briggs & Uwe Siebert & Karen M. Kuntz, 2012. "Modeling Good Research Practices—Overview," Medical Decision Making, , vol. 32(5), pages 667-677, September.
    8. Chiranjeev Sanyal & Don Husereau, 2020. "Systematic Review of Economic Evaluations of Services Provided by Community Pharmacists," Applied Health Economics and Health Policy, Springer, vol. 18(3), pages 375-392, June.
    9. Qi Cao & Erik Buskens & Hans L. Hillege & Tiny Jaarsma & Maarten Postma & Douwe Postmus, 2019. "Stratified treatment recommendation or one-size-fits-all? A health economic insight based on graphical exploration," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 475-482, April.
    10. Bernhard Ultsch & Oliver Damm & Philippe Beutels & Joke Bilcke & Bernd Brüggenjürgen & Andreas Gerber-Grote & Wolfgang Greiner & Germaine Hanquet & Raymond Hutubessy & Mark Jit & Mirjam Knol & Rüdiger, 2016. "Methods for Health Economic Evaluation of Vaccines and Immunization Decision Frameworks: A Consensus Framework from a European Vaccine Economics Community," PharmacoEconomics, Springer, vol. 34(3), pages 227-244, March.
    11. Yasuhiro Hagiwara & Takeru Shiroiwa, 2022. "Estimating Value-Based Price and Quantifying Uncertainty around It in Health Technology Assessment: Frequentist and Bayesian Approaches," Medical Decision Making, , vol. 42(5), pages 672-683, July.
    12. Matthew Franklin & James Lomas & Gerry Richardson, 2020. "Conducting Value for Money Analyses for Non-randomised Interventional Studies Including Service Evaluations: An Educational Review with Recommendations," PharmacoEconomics, Springer, vol. 38(7), pages 665-681, July.
    13. David Brain & Ruth Tulleners & Xing Lee & Qinglu Cheng & Nicholas Graves & Rosana Pacella, 2019. "Cost-effectiveness analysis of an innovative model of care for chronic wounds patients," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-13, March.
    14. Sarah Bates & Thomas Bayley & Paul Norman & Penny Breeze & Alan Brennan, 2020. "A Systematic Review of Methods to Predict Weight Trajectories in Health Economic Models of Behavioral Weight-Management Programs: The Potential Role of Psychosocial Factors," Medical Decision Making, , vol. 40(1), pages 90-105, January.
    15. F. Tomini & F. Prinzen & A. D. I. Asselt, 2016. "A review of economic evaluation models for cardiac resynchronization therapy with implantable cardioverter defibrillators in patients with heart failure," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 17(9), pages 1159-1172, December.
    16. Osvaldo Ulises Garay & Marie Libérée Nishimwe & Marwân-al-Qays Bousmah & Asmaa Janah & Pierre-Marie Girard & Geneviève Chêne & Laetitia Moinot & Luis Sagaon-Teyssier & Jean-Luc Meynard & Bruno Spire &, 2019. "Cost-Effectiveness Analysis of Lopinavir/Ritonavir Monotherapy Versus Standard Combination Antiretroviral Therapy in HIV-1 Infected Patients with Viral Suppression in France (ANRS 140 DREAM)," PharmacoEconomics - Open, Springer, vol. 3(4), pages 505-515, December.
    17. Andrija S Grustam & Nasuh Buyukkaramikli & Ron Koymans & Hubertus J M Vrijhoef & Johan L Severens, 2019. "Value of information analysis in telehealth for chronic heart failure management," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-23, June.
    18. Matthew J. Glover & Edmund Jones & Katya L. Masconi & Michael J. Sweeting & Simon G. Thompson, 2018. "Discrete Event Simulation for Decision Modeling in Health Care: Lessons from Abdominal Aortic Aneurysm Screening," Medical Decision Making, , vol. 38(4), pages 439-451, May.
    19. Caroline S. Clarke & Mariya Melnychuk & Angus I. G. Ramsay & Cecilia Vindrola-Padros & Claire Levermore & Ravi Barod & Axel Bex & John Hines & Muntzer M. Mughal & Kathy Pritchard-Jones & Maxine Tran &, 2022. "Cost-Utility Analysis of Major System Change in Specialist Cancer Surgery in London, England, Using Linked Patient-Level Electronic Health Records and Difference-in-Differences Analysis," Applied Health Economics and Health Policy, Springer, vol. 20(6), pages 905-917, November.
    20. Angelis, Aris & Kanavos, Panos, 2017. "Multiple Criteria Decision Analysis (MCDA) for evaluating new medicines in Health Technology Assessment and beyond: The Advance Value Framework," Social Science & Medicine, Elsevier, vol. 188(C), pages 137-156.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:41:y:2021:i:4:p:453-464. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.