IDEAS home Printed from https://ideas.repec.org/a/spr/aphecp/v23y2025i4d10.1007_s40258-025-00952-1.html
   My bibliography  Save this article

Is the Use of Unanchored Matching-Adjusted Indirect Comparison Always Superior to Naïve Indirect Comparison on Survival Outcomes? A Simulation Study

Author

Listed:
  • Ying Liu

    (Tianjin University
    Tianjin University)

  • Xiaoning He

    (Tianjin University
    Tianjin University)

  • Jia Liu

    (Tianjin University
    Tianjin University)

  • Jing Wu

    (Tianjin University
    Tianjin University)

Abstract

Objective To compare the performance of matching-adjusted indirect comparison (MAIC) and naïve indirect comparison (NIC) under a wide range of data scenarios on survival outcome. Methods A simulation study included 729 (36) single-arm trial data scenarios, which were created by performing a three-level full factorial arrangement of six situational variables, including individual patient data (IPD) sample size, aggregate data (AgD) sample size, covariate strength, covariate correlation, covariate overlap, and relative treatment effect. In each scenario, 1000 repetitions of simulated datasets were generated using the Monte Carlo approach. MAIC and NIC methods were used to estimate the relative treatment effect of each simulated dataset. The performance was evaluated in terms of bias, empirical standard error (ESE), mean squared error (MSE), and confidence interval coverage, respectively. Results MAIC yielded relatively unbiased estimates of relative treatment effect compared with NIC in most scenarios, with better coverage and MSE but higher ESE. None of the situational variables had a significant impact on the bias and coverage of MAIC. However, increasing IPD sample size and covariate overlap significantly reduced the ESE and MSE of MAIC. In scenarios with low covariate overlap and high covariate strength, the bias of MAIC was larger and even greater than that of NIC. Conclusions The performance of MAIC consistently demonstrates advantage over NIC across various scenarios. MAIC often provides more unbiased estimates and achieves confidence interval coverage close to nominal values compared with NIC. While MAIC may exhibit higher ESE in specific scenarios, this additional uncertainty can offer a more accurate reflection of variability, enhancing the robustness of the results. Researchers should thoroughly comprehend the influencing factors and interactions affecting the performance of these methods and judiciously apply research findings.

Suggested Citation

  • Ying Liu & Xiaoning He & Jia Liu & Jing Wu, 2025. "Is the Use of Unanchored Matching-Adjusted Indirect Comparison Always Superior to Naïve Indirect Comparison on Survival Outcomes? A Simulation Study," Applied Health Economics and Health Policy, Springer, vol. 23(4), pages 693-704, July.
    • Handle: RePEc:spr:aphecp:v:23:y:2025:i:4:d:10.1007_s40258-025-00952-1
    DOI: 10.1007/s40258-025-00952-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40258-025-00952-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40258-025-00952-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Dorothea Weber & Katrin Jensen & Meinhard Kieser, 2020. "Comparison of Methods for Estimating Therapy Effects by Indirect Comparisons: A Simulation Study," Medical Decision Making, , vol. 40(5), pages 644-654, July.
    2. David M. Phillippo & Anthony E. Ades & Sofia Dias & Stephen Palmer & Keith R. Abrams & Nicky J. Welton, 2018. "Methods for Population-Adjusted Indirect Comparisons in Health Technology Appraisal," Medical Decision Making, , vol. 38(2), pages 200-211, February.
    3. Joffe, Marshall M. & Ten Have, Thomas R. & Feldman, Harold I. & Kimmel, Stephen E., 2004. "Model Selection, Confounder Control, and Marginal Structural Models: Review and New Applications," The American Statistician, American Statistical Association, vol. 58, pages 272-279, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lechner, Michael & Wunsch, Conny & Huber, Martin & Walter, Thomas, 2009. "Do German Welfare-to-Work Programmes Reduce Welfare and Increase Work?," CEPR Discussion Papers 7238, C.E.P.R. Discussion Papers.
    2. Martin Huber & Michael Lechner & Giovanni Mellace, 2017. "Why Do Tougher Caseworkers Increase Employment? The Role of Program Assignment as a Causal Mechanism," The Review of Economics and Statistics, MIT Press, vol. 99(1), pages 180-183, March.
    3. B. Muresan & C. Mamolo & J. C. Cappelleri & M. J. Postma & B. Heeg, 2021. "Cost-Effectiveness of Bosutinib for the Treatment of Adult Patients with Chronic Phase Chronic Myeloid Leukemia in the Second-Line Setting," Applied Health Economics and Health Policy, Springer, vol. 19(6), pages 929-940, November.
    4. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    5. Dasom Lee & Shu Yang & Lin Dong & Xiaofei Wang & Donglin Zeng & Jianwen Cai, 2023. "Improving trial generalizability using observational studies," Biometrics, The International Biometric Society, vol. 79(2), pages 1213-1225, June.
    6. Stefanie Behncke & Markus Frölich & Michael Lechner, 2010. "Unemployed and their caseworkers: should they be friends or foes?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(1), pages 67-92, January.
    7. Do, D. Phuong & Wang, Lu & Elliott, Michael R., 2013. "Investigating the relationship between neighborhood poverty and mortality risk: A marginal structural modeling approach," Social Science & Medicine, Elsevier, vol. 91(C), pages 58-66.
    8. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The Effect of Firms' Partial Retirement Policies on the Labour Market Outcomes of Their Employees," IZA Discussion Papers 7513, Institute of Labor Economics (IZA).
    9. Hirvonen, Kalle & Machado, Elia & Simons, Andrew M., 2024. "Can social assistance reduce violent conflict and civil unrest? Evidence from a large-scale public works program in Ethiopia," CGIAR Initative Publications 163420, International Food Policy Research Institute (IFPRI).
    10. Andrea Ciccarelli & Elena Fabrizi & Eleonora Romano & Pietro Zoppoli, 2022. "Health, Well-Being and Work History Patterns: Insight on Territorial Differences," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 161(2), pages 629-647, June.
    11. Behncke, Stefanie & Frölich, Markus & Lechner, Michael, 2008. "A Caseworker Like Me: Does the Similarity between Unemployed and Caseworker Increase Job Placements?," IZA Discussion Papers 3437, Institute of Labor Economics (IZA).
    12. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2015. "Workplace health promotion and labour market performance of employees," Journal of Health Economics, Elsevier, vol. 43(C), pages 170-189.
    13. Pål C. Ryalen & Mats J. Stensrud & Kjetil Røysland, 2019. "The additive hazard estimator is consistent for continuous-time marginal structural models," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(4), pages 611-638, October.
    14. Michael Lechner & Conny Wunsch, 2009. "Are Training Programs More Effective When Unemployment Is High?," Journal of Labor Economics, University of Chicago Press, vol. 27(4), pages 653-692, October.
    15. Martin Huber & Michael Lechner & Anthony Strittmatter, 2018. "Direct and indirect effects of training vouchers for the unemployed," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(2), pages 441-463, February.
    16. Lateef B. Amusa & Temesgen Zewotir & Delia North, 2019. "A Weighted Covariate Balancing Method of Estimating Causal Effects in Case-Control Studies," Modern Applied Science, Canadian Center of Science and Education, vol. 13(4), pages 1-40, April.
    17. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    18. Pingyu Chen & Mengjie Luo & Yanqiu Chen & Yanlei Zhang & Chao Wang & Hongchao Li, 2024. "Cost-effectiveness of edaravone dexborneol versus human urinary kallidinogenase for acute ischemic stroke in China," Health Economics Review, Springer, vol. 14(1), pages 1-10, December.
    19. Conny Wunsch & Michael Lechner, 2008. "What Did All the Money Do? On the General Ineffectiveness of Recent West German Labour Market Programmes," Kyklos, Wiley Blackwell, vol. 61(1), pages 134-174, February.
    20. Martin Huber & Michael Lechner & Andreas Steinmayr, 2015. "Radius matching on the propensity score with bias adjustment: tuning parameters and finite sample behaviour," Empirical Economics, Springer, vol. 49(1), pages 1-31, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aphecp:v:23:y:2025:i:4:d:10.1007_s40258-025-00952-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.