IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v40y2020i5p582-595.html
   My bibliography  Save this article

A Systematic Review of Methods Used for Confounding Adjustment in Observational Economic Evaluations in Cardiology Conducted between 2013 and 2017

Author

Listed:
  • Jason R. Guertin

    (Department of Social and Preventive Medicine, Université Laval, Quebec City, Canada
    Axe Santé des populations et pratiques optimales en santé, Centre de recherche du CHU de Québec–Université Laval, Quebec City, Canada)

  • Blanchard Conombo

    (Department of Social and Preventive Medicine, Université Laval, Quebec City, Canada
    Axe Santé des populations et pratiques optimales en santé, Centre de recherche du CHU de Québec–Université Laval, Quebec City, Canada)

  • Raphaël Langevin

    (Department of Economics, McGill University, Montreal, Canada)

  • Frédéric Bergeron

    (Université Laval, Quebec City, Canada)

  • Anne Holbrook

    (Division of Clinical Pharmacology and Toxicology, Department of Medicine, McMaster University, Hamilton, Canada
    Department of Health Evidence and Impact, McMaster University, Hamilton, Canada)

  • Brittany Humphries

    (Department of Health Evidence and Impact, McMaster University, Hamilton, Canada)

  • Alexis Matteau

    (Department of Medicine, Université de Montréal, Montreal, Canada
    Centre de recherche du Centre Hospitalier de l’Université de Montréal, Montreal, Canada
    Centre Hospitalier de l’Université de Montréal, Montreal, Canada)

  • Brian J. Potter

    (Department of Medicine, Université de Montréal, Montreal, Canada
    Centre de recherche du Centre Hospitalier de l’Université de Montréal, Montreal, Canada
    Centre Hospitalier de l’Université de Montréal, Montreal, Canada)

  • Christel Renoux

    (McGill University, Montreal, Canada
    Programs for Assessment of Technology in Health (PATH), The Research Institute of St. Joe’s Hamilton, St. Joseph’s Healthcare Hamilton
    McMaster Chair in Health Technology Management, McMaster University, Hamilton, Canada)

  • Jean-Éric Tarride

    (Department of Health Evidence and Impact, McMaster University, Hamilton, Canada
    Centre for Health Economics and Policy Analysis, McMaster University, Hamilton, Canada
    Department of Economics; McMaster University, Hamilton, Canada
    Programs for Assessment of Technology in Health (PATH), The Research Institute of St. Joe’s Hamilton, St. Joseph’s Healthcare Hamilton)

  • Madeleine Durand

    (Department of Medicine, Université de Montréal, Montreal, Canada
    Centre de recherche du Centre Hospitalier de l’Université de Montréal, Montreal, Canada
    Centre Hospitalier de l’Université de Montréal, Montreal, Canada)

Abstract

Background. Observational economic evaluations (i.e., economic evaluations in which treatment allocation is not randomized) are prone to confounding bias. Prior reviews published in 2013 have shown that adjusting for confounding is poorly done, if done at all. Although these reviews raised awareness on the issues, it is unclear if their results improved the methodological quality of future work. We therefore aimed to investigate whether and how confounding was accounted for in recently published observational economic evaluations in the field of cardiology. Methods. We performed a systematic review of PubMed, Embase, Cochrane Library, Web of Science, and PsycInfo databases using a set of Medical Subject Headings and keywords covering topics in “observational economic evaluations in health within humans†and “cardiovascular diseases.†Any study published in either English or French between January 1, 2013, and December 31, 2017, addressing our search criteria was eligible for inclusion in our review. Our protocol was registered with PROSPERO (CRD42018112391). Results. Forty-two (0.6%) out of 7523 unique citations met our inclusion criteria. Fewer than half of the selected studies adjusted for confounding ( n = 19 [45.2%]). Of those that adjusted for confounding, propensity score matching ( n = 8 [42.1%]) and other matching-based approaches were favored ( n = 8 [42.1%]). Our results also highlighted that most authors who adjusted for confounding rarely justified their methodological choices. Conclusion. Our results indicate that adjustment for confounding is often ignored when conducting an observational economic evaluation. Continued knowledge translation efforts aimed at improving researchers’ knowledge regarding confounding bias and methods aimed at addressing this issue are required and should be supported by journal editors.

Suggested Citation

  • Jason R. Guertin & Blanchard Conombo & Raphaël Langevin & Frédéric Bergeron & Anne Holbrook & Brittany Humphries & Alexis Matteau & Brian J. Potter & Christel Renoux & Jean-Éric Tarride & Madelein, 2020. "A Systematic Review of Methods Used for Confounding Adjustment in Observational Economic Evaluations in Cardiology Conducted between 2013 and 2017," Medical Decision Making, , vol. 40(5), pages 582-595, July.
  • Handle: RePEc:sae:medema:v:40:y:2020:i:5:p:582-595
    DOI: 10.1177/0272989X20937257
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X20937257
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X20937257?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alessandro Corso & Silvia Mangiacavalli & Federica Cocito & Cristiana Pascutto & Virginia Valeria Ferretti & Alessandra Pompa & Roberta Ciampichini & Lara Pochintesta & Lorenzo G Mantovani, 2013. "Long Term Evaluation of the Impact of Autologous Peripheral Blood Stem Cell Transplantation in Multiple Myeloma: A Cost-Effectiveness Analysis," PLOS ONE, Public Library of Science, vol. 8(9), pages 1-6, September.
    2. Reinhard Rychlik & Fabian Kreimendahl & Nicole Schnur & Judith Lambert-Baumann & Dirk Dressler, 2016. "Erratum to: ‘Quality of life and costs of spasticity treatment in German stroke patients’," Health Economics Review, Springer, vol. 6(1), pages 1-4, December.
    3. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    4. Alessandro Liberati & Douglas G Altman & Jennifer Tetzlaff & Cynthia Mulrow & Peter C Gøtzsche & John P A Ioannidis & Mike Clarke & P J Devereaux & Jos Kleijnen & David Moher, 2009. "The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-28, July.
    5. Drummond, Michael F. & Sculpher, Mark J. & Claxton, Karl & Stoddart, Greg L. & Torrance, George W., 2015. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 4, number 9780199665884.
    6. Noémi Kreif & Richard Grieve & M. Zia Sadique, 2013. "Statistical Methods For Cost‐Effectiveness Analyses That Use Observational Data: A Critical Appraisal Tool And Review Of Current Practice," Health Economics, John Wiley & Sons, Ltd., vol. 22(4), pages 486-500, April.
    7. Deidda, Manuela & Geue, Claudia & Kreif, Noemi & Dundas, Ruth & McIntosh, Emma, 2019. "A framework for conducting economic evaluations alongside natural experiments," Social Science & Medicine, Elsevier, vol. 220(C), pages 353-361.
    8. Jeffrey S. Hoch & Andrew H. Briggs & Andrew R. Willan, 2002. "Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 11(5), pages 415-430, July.
    9. Reinhard Rychlik & Fabian Kreimendahl & Nicole Schnur & Judith Lambert-Baumann & Dirk Dressler, 2016. "Quality of life and costs of spasticity treatment in German stroke patients," Health Economics Review, Springer, vol. 6(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cochrane, M. & Watson, P.M. & Timpson, H. & Haycox, A. & Collins, B. & Jones, L. & Martin, A. & Graves, L.E.F., 2019. "Systematic review of the methods used in economic evaluations of targeted physical activity and sedentary behaviour interventions," Social Science & Medicine, Elsevier, vol. 232(C), pages 156-167.
    2. Noemi Kreif & Richard Grieve & Rosalba Radice & Zia Sadique & Roland Ramsahai & Jasjeet S. Sekhon, 2012. "Methods for Estimating Subgroup Effects in Cost-Effectiveness Analyses That Use Observational Data," Medical Decision Making, , vol. 32(6), pages 750-763, November.
    3. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    4. Su Keng Tan & Wai Keung Leung & Alexander Tin Hong Tang & Roger A Zwahlen, 2017. "Effects of mandibular setback with or without maxillary advancement osteotomies on pharyngeal airways: An overview of systematic reviews," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-20, October.
    5. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.
    6. Jacob Elnaggar & Fern Tsien & Lucio Miele & Chindo Hicks & Clayton Yates & Melisa Davis, 2019. "An Integrative Genomics Approach for Associating Genetic Susceptibility with the Tumor Immune Microenvironment in Triple Negative Breast Cancer," Biomedical Journal of Scientific & Technical Research, Biomedical Research Network+, LLC, vol. 15(1), pages 1-12, February.
    7. Hyun Kim & Navneet Kaur Baidwan & David Kriebel & Manuel Cifuentes & Sherry Baron, 2018. "Asthma among World Trade Center First Responders: A Qualitative Synthesis and Bias Assessment," IJERPH, MDPI, vol. 15(6), pages 1-14, May.
    8. Qi Cao & Erik Buskens & Hans L. Hillege & Tiny Jaarsma & Maarten Postma & Douwe Postmus, 2019. "Stratified treatment recommendation or one-size-fits-all? A health economic insight based on graphical exploration," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 475-482, April.
    9. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    10. Frank Peinemann & Ulrich Grouven & Nicolaus Kröger & Carmen Bartel & Max H Pittler & Stefan Lange, 2011. "First-Line Matched Related Donor Hematopoietic Stem Cell Transplantation Compared to Immunosuppressive Therapy in Acquired Severe Aplastic Anemia," PLOS ONE, Public Library of Science, vol. 6(4), pages 1-16, April.
    11. Jonathan Kingsley & Aisling Bailey & Nooshin Torabi & Pauline Zardo & Suzanne Mavoa & Tonia Gray & Danielle Tracey & Philip Pettitt & Nicholas Zajac & Emily Foenander, 2019. "A Systematic Review Protocol Investigating Community Gardening Impact Measures," IJERPH, MDPI, vol. 16(18), pages 1-12, September.
    12. Wei-Wei Chen & Feng Wang & Rui-Hua Xu, 2013. "Platinum-Based Versus Non-Platinum-Based Chemotherapy as First Line Treatment of Inoperable, Advanced Gastric Adenocarcinoma: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-8, July.
    13. Giovanni Vinti & Valerie Bauza & Thomas Clasen & Kate Medlicott & Terry Tudor & Christian Zurbrügg & Mentore Vaccari, 2021. "Municipal Solid Waste Management and Adverse Health Outcomes: A Systematic Review," IJERPH, MDPI, vol. 18(8), pages 1-26, April.
    14. Hanna Górska-Warsewicz, 2022. "Consumer or Patient Determinants of Hospital Brand Equity—A Systematic Literature Review," IJERPH, MDPI, vol. 19(15), pages 1-36, July.
    15. André Ramalho & João Serrano & Rui Paulo & Pedro Duarte-Mendes & António Rosado & João Petrica, 2021. "Emerging Qualitative Research Trends (2010–2021) on Sedentary Behaviour among Older Adults: A Systematic Literature Review Protocol," IJERPH, MDPI, vol. 18(21), pages 1-8, November.
    16. S. Rajsic & H. Gothe & H. H. Borba & G. Sroczynski & J. Vujicic & T. Toell & Uwe Siebert, 2019. "Economic burden of stroke: a systematic review on post-stroke care," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 107-134, February.
    17. Sibonokuhle Ndlovu, 2023. "Preparedness and Response to COVID-19 Disruptions and Learning Challenges for Students with Disabilities in South Africa: A Systematic Review," Sustainability, MDPI, vol. 15(2), pages 1-17, January.
    18. João Carlos Belloti & Aldo Okamura & Jordana Scheeren & Flávio Faloppa & Vinícius Ynoe de Moraes, 2019. "A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-12, January.
    19. Abbas Mardani & Dalia Streimikiene & Edmundas Kazimieras Zavadskas & Fausto Cavallaro & Mehrbakhsh Nilashi & Ahmad Jusoh & Habib Zare, 2017. "Application of Structural Equation Modeling (SEM) to Solve Environmental Sustainability Problems: A Comprehensive Review and Meta-Analysis," Sustainability, MDPI, vol. 9(10), pages 1-65, October.
    20. Luísa Bandeira Lopes & João Albernaz Neves & João Botelho & Vanessa Machado & José João Mendes, 2021. "Regenerative Endodontic Procedures: An Umbrella Review," IJERPH, MDPI, vol. 18(2), pages 1-17, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:40:y:2020:i:5:p:582-595. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.