IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v21y2012i6p695-714.html
   My bibliography  Save this article

A matching method for improving covariate balance in cost‐effectiveness analyses

Author

Listed:
  • Jasjeet Singh Sekhon
  • Richard D. Grieve

Abstract

In cost‐effectiveness analyses (CEA) that use randomized controlled trials (RCTs), covariates of prognostic importance may be imbalanced and warrant adjustment. In CEA that use non‐randomized studies (NRS), the selection on observables assumption must hold for regression and matching methods to be unbiased. Even in restricted circumstances when this assumption is plausible, a key concern is how to adjust for imbalances in observed confounders. If the propensity score is misspecified, the covariates in the matched sample will be imbalanced, which can lead to conditional bias. To address covariate imbalance in CEA based on RCTs and NRS, this paper considers Genetic Matching. This matching method uses a search algorithm to directly maximize covariate balance. We compare Genetic and propensity score matching in Monte Carlo simulations and two case studies, CEA of pulmonary artery catheterization, based on an RCT and an NRS. The simulations show that Genetic Matching reduces the conditional bias and root mean squared error compared with propensity score matching. Genetic Matching achieves better covariate balance than the unadjusted analyses of the RCT data. In the NRS, Genetic Matching improves on the balance obtained from propensity score matching and gives substantively different estimates of incremental cost‐effectiveness. We conclude that Genetic Matching can improve balance on measured covariates in CEA that use RCTs and NRS, but with NRS, this will be insufficient to reduce bias; the selection on observables assumption must also hold. Copyright © 2011 John Wiley & Sons, Ltd.

Suggested Citation

  • Jasjeet Singh Sekhon & Richard D. Grieve, 2012. "A matching method for improving covariate balance in cost‐effectiveness analyses," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 695-714, June.
  • Handle: RePEc:wly:hlthec:v:21:y:2012:i:6:p:695-714
    DOI: 10.1002/hec.1748
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1748
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.1748?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nandita Mitra & Alka Indurkhya, 2005. "A propensity score approach to estimating the cost–effectiveness of medical therapies from observational data," Health Economics, John Wiley & Sons, Ltd., vol. 14(8), pages 805-815, August.
    2. Heinrich, Carolyn J., 2007. "Demand and Supply-Side Determinants of Conditional Cash Transfer Program Effectiveness," World Development, Elsevier, vol. 35(1), pages 121-143, January.
    3. Andrew R. Willan & Andrew H. Briggs & Jeffrey S. Hoch, 2004. "Regression methods for covariate adjustment and subgroup analysis for non‐censored cost‐effectiveness data," Health Economics, John Wiley & Sons, Ltd., vol. 13(5), pages 461-475, May.
    4. Jeffrey S. Hoch & Andrew H. Briggs & Andrew R. Willan, 2002. "Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 11(5), pages 415-430, July.
    5. Mebane Jr., Walter R. & Sekhon, Jasjeet S., 2011. "Genetic Optimization Using Derivatives: The rgenoud Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i11).
    6. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    7. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    8. Sekhon, Jasjeet S., 2011. "Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i07).
    9. Hopkins, Daniel J., 2010. "Politicized Places: Explaining Where and When Immigrants Provoke Local Opposition," American Political Science Review, Cambridge University Press, vol. 104(1), pages 40-60, February.
    10. Andrew Briggs & Richard Nixon & Simon Dixon & Simon Thompson, 2005. "Parametric modelling of cost data: some simulation evidence," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 421-428, April.
    11. Daniel Polsky & Anirban Basu, 2006. "Selection Bias in Observational Data," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, chapter 43, Edward Elgar Publishing.
    12. Anirban Basu & James J. Heckman & Salvador Navarro-Lozano & Sergio Urzua, 2007. "Use of instrumental variables in the presence of heterogeneity and self-selection: an application to treatments of breast cancer patients," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1133-1157.
    13. Gordon, Sanford C., 2009. "Assessing Partisan Bias in Federal Public Corruption Prosecutions," American Political Science Review, Cambridge University Press, vol. 103(4), pages 534-554, November.
    14. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    15. Manning, Willard G. & Mullahy, John, 2001. "Estimating log models: to transform or not to transform?," Journal of Health Economics, Elsevier, vol. 20(4), pages 461-494, July.
    16. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    17. Andrew M. Jones, 2007. "Identification of treatment effects in Health Economics," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1127-1131.
    18. Richard M. Nixon & Simon G. Thompson, 2005. "Methods for incorporating covariate adjustment, subgroup analysis and between‐centre differences into cost‐effectiveness evaluations," Health Economics, John Wiley & Sons, Ltd., vol. 14(12), pages 1217-1229, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Deidda, Manuela & Geue, Claudia & Kreif, Noemi & Dundas, Ruth & McIntosh, Emma, 2019. "A framework for conducting economic evaluations alongside natural experiments," Social Science & Medicine, Elsevier, vol. 220(C), pages 353-361.
    2. Vera Antonia Büchner & Vera Hinz & Jonas Schreyögg, 2016. "Health systems: changes in hospital efficiency and profitability," Health Care Management Science, Springer, vol. 19(2), pages 130-143, June.
    3. Jason J. Sauppe & Sheldon H. Jacobson & Edward C. Sewell, 2014. "Complexity and Approximation Results for the Balance Optimization Subset Selection Model for Causal Inference in Observational Studies," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 547-566, August.
    4. Timothy Tyler Brown & Juan Pablo Atal, 2019. "How robust are reference pricing studies on outpatient medical procedures? Three different preprocessing techniques applied to difference‐in differences," Health Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 280-298, February.
    5. Alarcón, Silverio & Sánchez, Mercedes, 2016. "Is there a virtuous circle relationship between innovation activities and exports? A comparison of food and agricultural firms," Food Policy, Elsevier, vol. 61(C), pages 70-79.
    6. Lindlbauer, Ivonne & Schreyögg, Jonas & Winter, Vera, 2016. "Changes in technical efficiency after quality management certification: A DEA approach using difference-in-difference estimation with genetic matching in the hospital industry," European Journal of Operational Research, Elsevier, vol. 250(3), pages 1026-1036.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Noémi Kreif & Richard Grieve & M. Zia Sadique, 2013. "Statistical Methods For Cost‐Effectiveness Analyses That Use Observational Data: A Critical Appraisal Tool And Review Of Current Practice," Health Economics, John Wiley & Sons, Ltd., vol. 22(4), pages 486-500, April.
    2. Gomes, M & Grieve, R, 2011. "Estimating the Effects of Friendship Networks on Health Behaviors of Adolescents," Health, Econometrics and Data Group (HEDG) Working Papers 11/14, HEDG, c/o Department of Economics, University of York.
    3. Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth & Jeon, Kyung-Seong & Kahvecioglu, Daver C., 2009. "New Estimates of Public Employment and Training Program Net Impacts: A Nonexperimental Evaluation of the Workforce Investment Act Program," IZA Discussion Papers 4569, Institute of Labor Economics (IZA).
    4. Blackman, Allen, 2015. "Strict versus mixed-use protected areas: Guatemala's Maya Biosphere Reserve," Ecological Economics, Elsevier, vol. 112(C), pages 14-24.
    5. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    6. Dudel Christian & Garbuszus Jan Marvin & Ott Notburga & Werding Martin, 2017. "Matching as Non-Parametric Preprocessing for the Estimation of Equivalence Scales," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 237(2), pages 115-141, April.
    7. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    8. Manuel Gomes & Richard Grieve & Richard Nixon & W. J. Edmunds, 2012. "Statistical Methods for Cost-Effectiveness Analyses That Use Data from Cluster Randomized Trials," Medical Decision Making, , vol. 32(1), pages 209-220, January.
    9. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    10. Manuel Gomes & Richard Grieve & Richard Nixon & Edmond S.‐W. Ng & James Carpenter & Simon G. Thompson, 2012. "Methods For Covariate Adjustment In Cost‐Effectiveness Analysis That Use Cluster Randomised Trials," Health Economics, John Wiley & Sons, Ltd., vol. 21(9), pages 1101-1118, September.
    11. Canavire-Bacarreza, Gustavo & Diaz-Gutierrez, Julian Eduardo & Hanauer, Merlin M., 2018. "Unintended consequences of conservation: Estimating the impact of protected areas on violence in Colombia," Journal of Environmental Economics and Management, Elsevier, vol. 89(C), pages 46-70.
    12. Noemi Kreif & Richard Grieve & Rosalba Radice & Zia Sadique & Roland Ramsahai & Jasjeet S. Sekhon, 2012. "Methods for Estimating Subgroup Effects in Cost-Effectiveness Analyses That Use Observational Data," Medical Decision Making, , vol. 32(6), pages 750-763, November.
    13. Tymon Słoczyński, 2015. "The Oaxaca–Blinder Unexplained Component as a Treatment Effects Estimator," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(4), pages 588-604, August.
    14. Martin Huber & Michael Lechner & Giovanni Mellace, 2017. "Why Do Tougher Caseworkers Increase Employment? The Role of Program Assignment as a Causal Mechanism," The Review of Economics and Statistics, MIT Press, vol. 99(1), pages 180-183, March.
    15. Blackman, Allen & Goff, Leonard & Rivera Planter, Marisol, 2018. "Does eco-certification stem tropical deforestation? Forest Stewardship Council certification in Mexico," Journal of Environmental Economics and Management, Elsevier, vol. 89(C), pages 306-333.
    16. Estifanos, Tafesse Kefyalew & Polyakov, Maksym & Pandit, Ram & Hailu, Atakelty & Burton, Michael, 2020. "The impact of protected areas on the rural households’ incomes in Ethiopia," Land Use Policy, Elsevier, vol. 91(C).
    17. Almer, Christian & Winkler, Ralph, 2017. "Analyzing the effectiveness of international environmental policies: The case of the Kyoto Protocol," Journal of Environmental Economics and Management, Elsevier, vol. 82(C), pages 125-151.
    18. Arriagada, Rodrigo & Villaseñor, Adrián & Rubiano, Eliana & Cotacachi, David & Morrison, Judith, 2018. "Analysing the impacts of PES programmes beyond economic rationale: Perceptions of ecosystem services provision associated to the Mexican case," Ecosystem Services, Elsevier, vol. 29(PA), pages 116-127.
    19. Barbopoulos, Leonidas G. & Adra, Samer & Saunders, Anthony, 2020. "Macroeconomic news and acquirer returns in M&As: The impact of investor alertness," Journal of Corporate Finance, Elsevier, vol. 64(C).
    20. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The Effect of Firms' Partial Retirement Policies on the Labour Market Outcomes of Their Employees," IZA Discussion Papers 7513, Institute of Labor Economics (IZA).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:21:y:2012:i:6:p:695-714. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.