IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v45y2025i8p976-986.html
   My bibliography  Save this article

Meta-Modeling as a Variance-Reduction Technique for Stochastic Model–Based Cost-Effectiveness Analyses

Author

Listed:
  • Zongbo Li

    (Division of Health Policy and Management, University of Minnesota, School of Public Health, Minneapolis, MN, USA)

  • Gregory S. Knowlton

    (Division of Health Policy and Management, University of Minnesota, School of Public Health, Minneapolis, MN, USA)

  • Margo M. Wheatley

    (Division of Health Policy and Management, University of Minnesota, School of Public Health, Minneapolis, MN, USA)

  • Samuel M. Jenness

    (Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, USA)

  • Eva A. Enns

    (Division of Health Policy and Management, University of Minnesota, School of Public Health, Minneapolis, MN, USA)

Abstract

Purpose When using stochastic models for cost-effectiveness analysis (CEA), run-to-run outcome variability arising from model stochasticity can sometimes exceed the change in outcomes resulting from an intervention, especially when individual-level efficacy is small, leading to counterintuitive results. This issue is compounded for probabilistic sensitivity analyses (PSAs), in which stochastic noise can obscure the influence of parameter uncertainty. This study evaluates meta-modeling as a variance-reduction technique to mitigate stochastic noise while preserving parameter uncertainty in PSAs. Methods We applied meta-modeling to 2 simulation models: 1) a 4-state Sick-Sicker model and 2) an agent-based HIV transmission model among men who have sex with men (MSM). We conducted a PSA and applied 3 meta-modeling techniques—linear regression, generalized additive models, and artificial neural networks—to reduce stochastic noise. Model performance was assessed using R 2 and root mean squared error (RMSE) values on a validation dataset. We compared PSA results by examining scatter plots of incremental costs and quality-adjusted life-years (QALYs), cost-effectiveness acceptability curves (CEACs), and the occurrence of unintuitive results, such as interventions appearing to reduce QALYs due to stochastic noise. Results In the Sick-Sicker model, stochastic noise increased variance in incremental costs and QALYs. Applying meta-modeling techniques substantially reduced this variance and nearly eliminated unintuitive results, with R 2 and RMSE values indicating good model fit. In the HIV agent-based model, all 3 meta-models effectively reduced outcome variability while retaining parameter uncertainty, yielding more informative CEACs with higher probabilities of being cost-effective for the optimal strategy. Conclusions Meta-modeling effectively reduces stochastic noise in simulation models while maintaining parameter uncertainty in PSA, enhancing the reliability of CEA results without requiring an impractical number of simulations. Highlights When using complex stochastic models for cost-effectiveness analysis (CEA), stochastic noise can overwhelm intervention effects and obscure the impact of parameter uncertainty on CEA outcomes in probabilistic sensitivity analysis (PSA). Meta-modeling offers a solution by effectively reducing stochastic noise in complex stochastic simulation models without increasing computational burden, thereby improving the interpretability of PSA results.

Suggested Citation

  • Zongbo Li & Gregory S. Knowlton & Margo M. Wheatley & Samuel M. Jenness & Eva A. Enns, 2025. "Meta-Modeling as a Variance-Reduction Technique for Stochastic Model–Based Cost-Effectiveness Analyses," Medical Decision Making, , vol. 45(8), pages 976-986, November.
  • Handle: RePEc:sae:medema:v:45:y:2025:i:8:p:976-986
    DOI: 10.1177/0272989X251352210
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X251352210
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X251352210?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:45:y:2025:i:8:p:976-986. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.