IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/tyf7g.html
   My bibliography  Save this paper

Assessing balance in outcome regressions

Author

Listed:
  • Popham, Frank
  • Leyland, Alastair

Abstract

An outcome regression controlling for observed confounders remains a popular way to assess the causal effect of an exposure in epidemiology, despite more modern causal techniques for adjusting for observed confounders, such as inverse probability weighting. A feature of inverse probability weighting is that checking balance of confounders in the control and exposure groups after confounder adjustment is simple. However, researchers using outcome regressions commonly do not check confounder balance after controlling for confounders. Although outcome regressions will balance any confounder specified in the model, the confounder value the model balances at is not transparent. We show that a matrix representation of an outcome regression reveals that an outcome regression includes a weight similar to an inverse probability weight. We also show that outcome regressions may not be balancing at the sample mean of the confounders particularly if interactions are not included with the exposure, which is typically the case in outcome regressions. Finally, we show that the coefficient of the exposure in an outcome regression is simply the difference between two weighted counterfactuals. Thus, there is an important connection between traditional outcome regression and modern causal techniques.

Suggested Citation

  • Popham, Frank & Leyland, Alastair, 2017. "Assessing balance in outcome regressions," OSF Preprints tyf7g, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:tyf7g
    DOI: 10.31219/osf.io/tyf7g
    as

    Download full text from publisher

    File URL: https://osf.io/download/5a018fca594d900263668d39/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/tyf7g?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    2. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    2. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    3. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    4. Hao, Shiming, 2021. "True structure change, spurious treatment effect? A novel approach to disentangle treatment effects from structure changes," MPRA Paper 108679, University Library of Munich, Germany.
    5. Sviták, Jan & Tichem, Jan & Haasbeek, Stefan, 2021. "Price effects of search advertising restrictions," International Journal of Industrial Organization, Elsevier, vol. 77(C).
    6. Goryunov, Alexander & Ageshina, Elena & Lavrentev, Igor & Peretyatko, Polina, 2023. "Estimating the effect of Russia’s development policy in the Far Eastern region: The synthetic control approach," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 72, pages 58-72.
    7. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
    8. Giulio Grossi & Marco Mariani & Alessandra Mattei & Patrizia Lattarulo & Ozge Oner, 2020. "Direct and spillover effects of a new tramway line on the commercial vitality of peripheral streets. A synthetic-control approach," Papers 2004.05027, arXiv.org, revised Nov 2023.
    9. Billy Ferguson & Brad Ross, 2020. "Assessing the Sensitivity of Synthetic Control Treatment Effect Estimates to Misspecification Error," Papers 2012.15367, arXiv.org, revised Feb 2021.
    10. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy [Using synthetic controls: Feasibility, data requirements, and methodological aspects]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    11. Lea Bottmer & Guido Imbens & Jann Spiess & Merrill Warnick, 2021. "A Design-Based Perspective on Synthetic Control Methods," Papers 2101.09398, arXiv.org, revised Jul 2023.
    12. Alice Lépissier & Matto Mildenberger, 2021. "Unilateral climate policies can substantially reduce national carbon pollution," Climatic Change, Springer, vol. 166(3), pages 1-21, June.
    13. Enzo Brox & Riccardo Di Francesco, 2024. "The Cost of Coming Out," CEIS Research Paper 572, Tor Vergata University, CEIS, revised 16 Apr 2024.
    14. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    15. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Mar 2024.
    16. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2023. "Same Root Different Leaves: Time Series and Cross‐Sectional Methods in Panel Data," Econometrica, Econometric Society, vol. 91(6), pages 2125-2154, November.
    17. Enzo Brox & Riccardo Di Francesco, 2024. "The Cost of Coming Out," Papers 2403.03649, arXiv.org.
    18. Markku Maula & Wouter Stam, 2020. "Enhancing Rigor in Quantitative Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 44(6), pages 1059-1090, November.
    19. Fiammetta Menchetti & Fabrizio Cipollini & Fabrizia Mealli, 2023. "Combining counterfactual outcomes and ARIMA models for policy evaluation," The Econometrics Journal, Royal Economic Society, vol. 26(1), pages 1-24.
    20. Corinne Autant-Bernard & Ruben Fotso & Nadine Massard, 2022. "Evaluating the impact of public policies on large firms: a synthetic control approach to science-industry transfer policies," Revue d'économie industrielle, De Boeck Université, vol. 0(4), pages 9-50.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:tyf7g. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.