IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v183y2020i4p1411-1435.html
   My bibliography  Save this article

Optimal matching approaches in health policy evaluations under rolling enrolment

Author

Listed:
  • Samuel D. Pimentel
  • Lauren Vollmer Forrow
  • Jonathan Gellar
  • Jiaqi Li

Abstract

Comparison group selection is paramount for health policy evaluations, where randomization is seldom practicable. Rolling enrolment is common in these evaluations, introducing challenges for comparison group selection and inference. We propose a novel framework, GroupMatch, for comparison group selection under rolling enrolment, founded on the notion of time agnosticism: two subjects with similar outcome trajectories but different enrolment periods may be more prognostically similar and produce better inference if matched, than two subjects with the same enrolment period but different pre‐enrolment trajectories. We articulate the conceptual advantages of this framework and demonstrate its efficacy in a simulation study and in an application to a study of the effect of falls in Medicare Advantage patients.

Suggested Citation

  • Samuel D. Pimentel & Lauren Vollmer Forrow & Jonathan Gellar & Jiaqi Li, 2020. "Optimal matching approaches in health policy evaluations under rolling enrolment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1411-1435, October.
  • Handle: RePEc:bla:jorssa:v:183:y:2020:i:4:p:1411-1435
    DOI: 10.1111/rssa.12521
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12521
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssa.12521?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bo Lu, 2005. "Propensity Score Matching with Time-Dependent Covariates," Biometrics, The International Biometric Society, vol. 61(3), pages 721-728, September.
    2. repec:mpr:mprres:7298 is not listed on IDEAS
    3. Dan Yang & Dylan S. Small & Jeffrey H. Silber & Paul R. Rosenbaum, 2012. "Optimal Matching with Minimal Deviation from Fine Balance in a Study of Obesity and Surgical Outcomes," Biometrics, The International Biometric Society, vol. 68(2), pages 628-636, June.
    4. Rosenbaum, Paul R., 2010. "Design Sensitivity and Efficiency in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 692-702.
    5. Alberto Abadie & Guido W. Imbens, 2012. "A Martingale Representation for Matching Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 833-843, June.
    6. Deborah Peikes & Grace Anglin & Stacy Dale & Erin Fries Taylor & Ann O'Malley & Arkadipta Ghosh & Kaylyn Swankoski & Jesse Crosson & Rosalind Keith & Anne Mutti & Sheila Hoag & Pragya Singh & Ha Tu & , "undated". "Evaluation of the Comprehensive Primary Care Initiative: Fourth Annual Report," Mathematica Policy Research Reports 31b437e81685456388e78e18b, Mathematica Policy Research.
    7. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    8. Samuel D. Pimentel & Rachel R. Kelz & Jeffrey H. Silber & Paul R. Rosenbaum, 2015. "Large, Sparse Optimal Matching With Refined Covariate Balance in an Observational Study of the Health Outcomes Produced by New Surgeons," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 515-527, June.
    9. Li Y.P. & Propert K. J. & Rosenbaum P. R., 2001. "Balanced Risk Set Matching," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 870-882, September.
    10. Samuel D. Pimentel & Frank Yoon & Luke Keele, 2015. "Variable-Ratio Matching with Fine Balance in a Study of the Peer Health Exchange," Mathematica Policy Research Reports 48f136c594194d14b494b8358, Mathematica Policy Research.
    11. Ben B. Hansen, 2008. "The prognostic analogue of the propensity score," Biometrika, Biometrika Trust, vol. 95(2), pages 481-488.
    12. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bikram Karmakar, 2022. "An approximation algorithm for blocking of an experimental design," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1726-1750, November.
    2. Ruoqi Yu, 2023. "How well can fine balance work for covariate balancing," Biometrics, The International Biometric Society, vol. 79(3), pages 2346-2356, September.
    3. Ferman, Bruno, 2021. "Matching estimators with few treated and many control observations," Journal of Econometrics, Elsevier, vol. 225(2), pages 295-307.
    4. de Luna, Xavier & Johansson, Per & Sjöstedt-de Luna, Sara, 2010. "Bootstrap Inference for K-Nearest Neighbour Matching Estimators," IZA Discussion Papers 5361, Institute of Labor Economics (IZA).
    5. Adam C. Sales & Ben B. Hansen & Brian Rowan, 2018. "Rebar: Reinforcing a Matching Estimator With Predictions From High-Dimensional Covariates," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 3-31, February.
    6. Jason J. Sauppe & Sheldon H. Jacobson, 2017. "The role of covariate balance in observational studies," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(4), pages 323-344, June.
    7. Glazer Amanda K. & Pimentel Samuel D., 2023. "Robust inference for matching under rolling enrollment," Journal of Causal Inference, De Gruyter, vol. 11(1), pages 1-19, January.
    8. Shu Yang & Yunshu Zhang, 2023. "Multiply robust matching estimators of average and quantile treatment effects," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 50(1), pages 235-265, March.
    9. Luke Keele & Steve Harris & Samuel D. Pimentel & Richard Grieve, 2020. "Stronger instruments and refined covariate balance in an observational study of the effectiveness of prompt admission to intensive care units," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1501-1521, October.
    10. Ruoqi Yu, 2021. "Evaluating and improving a matched comparison of antidepressants and bone density," Biometrics, The International Biometric Society, vol. 77(4), pages 1276-1288, December.
    11. Zhexiao Lin & Peng Ding & Fang Han, 2021. "Estimation based on nearest neighbor matching: from density ratio to average treatment effect," Papers 2112.13506, arXiv.org.
    12. José R. Zubizarreta, 2012. "Using Mixed Integer Programming for Matching in an Observational Study of Kidney Failure After Surgery," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(500), pages 1360-1371, December.
    13. Edward Feser, 2013. "Isserman’s Impact," International Regional Science Review, , vol. 36(1), pages 44-68, January.
    14. Roberto Cominetti & Juan Diaz & Jorge Rivera, 2014. "Large sample properties of an optimization-based matching estimator," Working Papers wp389, University of Chile, Department of Economics.
    15. Maya M. Papineau, 2015. "Setting the Standard: Commercial Electricity Consumption Responses to Energy Codes," Carleton Economic Papers 15-05, Carleton University, Department of Economics.
    16. Apps, Patricia & Mendolia, Silvia & Walker, Ian, 2013. "The impact of pre-school on adolescents’ outcomes: Evidence from a recent English cohort," Economics of Education Review, Elsevier, vol. 37(C), pages 183-199.
    17. Jonathon Adams‐Kane & Julián A. Caballero & Jamus Jerome Lim, 2017. "Foreign Bank Behavior during Financial Crises," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(2-3), pages 351-392, March.
    18. Tymon Słoczyński, 2015. "The Oaxaca–Blinder Unexplained Component as a Treatment Effects Estimator," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(4), pages 588-604, August.
    19. Fatema, Naureen, 2019. "Can land title reduce low-intensity interhousehold conflict incidences and associated damages in eastern DRC?," World Development, Elsevier, vol. 123(C), pages 1-1.
    20. Caballero, Julián, 2021. "Corporate dollar debt and depreciations: All’s well that ends well?," Journal of Banking & Finance, Elsevier, vol. 130(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:183:y:2020:i:4:p:1411-1435. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.