IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp18903.html

A Unified Framework for Transparent Quasi-Experimental Research

Author

Listed:
  • Stuart, Bryan

    (Federal Reserve Bank of Philadelphia)

  • Taylor, Evan

    (University of Arizona)

Abstract

We develop a framework that allows researchers to describe a wide class of quasi-experimental treatment effect estimates using direct analogs of the features that make a randomized controlled trial transparent. The outcome weight measures how much each observation's outcome contributes to an estimate, and its sign defines effective treatment and control groups. We show estimates take a Wald form, equal to the weighted outcome difference between these groups divided by an effective first stage that quantifies the identifying treatment contrast. Our framework also allows researchers to assess covariate balance, examine how differences throughout the outcome distribution contribute to mean impacts, and identify influential observations. The treatment effect weight--the outcome weight times treatment--instead measures how much each observation's unobserved treatment effect contributes to an estimate, and exactly decomposes an estimate into subgroup-specific components. When the implied weighting of an estimate is undesirable, we show how to construct alternative estimates that satisfy researcher-specified criteria. We illustrate the framework with analyses of democracy and growth, Chinese import competition, and returns to schooling.

Suggested Citation

  • Stuart, Bryan & Taylor, Evan, 2026. "A Unified Framework for Transparent Quasi-Experimental Research," IZA Discussion Papers 18903, IZA Network @ LISER.
  • Handle: RePEc:iza:izadps:dp18903
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp18903.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769, December.
    2. Joshua D. Angrist & Kathryn Graddy & Guido W. Imbens, 2000. "The Interpretation of Instrumental Variables Estimators in Simultaneous Equations Models with an Application to the Demand for Fish," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(3), pages 499-527.
    3. Jiafeng Chen, 2024. "Potential weights and implicit causal designs in linear regression," Papers 2407.21119, arXiv.org, revised Jul 2026.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, IZA Network @ LISER.
    2. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    3. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, IZA Network @ LISER.
    4. Kheiravar, Khaled H, 2019. "Economic and Econometric Analyses of the World Petroleum Industry, Energy Subsidies, and Air Pollution," Institute of Transportation Studies, Working Paper Series qt3gj151w9, Institute of Transportation Studies, UC Davis.
    5. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    6. Graham, Bryan S. & Pinto, Cristine Campos de Xavier, 2022. "Semiparametrically efficient estimation of the average linear regression function," Journal of Econometrics, Elsevier, vol. 226(1), pages 115-138.
    7. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    8. von Hinke Kessler Scholder, Stephanie & Davey Smith, George & Lawlor, Debbie A. & Propper, Carol & Windmeijer, Frank, 2013. "Child height, health and human capital: Evidence using genetic markers," European Economic Review, Elsevier, vol. 57(C), pages 1-22.
    9. von Hinke, Stephanie & Davey Smith, George & Lawlor, Debbie A. & Propper, Carol & Windmeijer, Frank, 2016. "Genetic markers as instrumental variables," Journal of Health Economics, Elsevier, vol. 45(C), pages 131-148.
    10. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    11. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    12. Matteo Alpino & Luca Citino & Annalisa Frigo, 2023. "The effects of the 2021 energy crisis on medium-sized and large industrial firms: evidence from Italy," Questioni di Economia e Finanza (Occasional Papers) 776, Bank of Italy, Economic Research and International Relations Area.
    13. Parente, Paulo M.D.C. & Santos Silva, J.M.C., 2012. "A cautionary note on tests of overidentifying restrictions," Economics Letters, Elsevier, vol. 115(2), pages 314-317.
    14. Alvarez, Luis A.F. & Toneto, Rodrigo, 2024. "The interpretation of 2SLS with a continuous instrument: A weighted LATE representation," Economics Letters, Elsevier, vol. 237(C).
    15. Dieterle, Steven G. & Snell, Andy, 2016. "A simple diagnostic to investigate instrument validity and heterogeneous effects when using a single instrument," Labour Economics, Elsevier, vol. 42(C), pages 76-86.
    16. Joshua D. Angrist, 2022. "Empirical Strategies in Economics: Illuminating the Path From Cause to Effect," Econometrica, Econometric Society, vol. 90(6), pages 2509-2539, November.
    17. Słoczyński, Tymon, 2012. "New Evidence on Linear Regression and Treatment Effect Heterogeneity," MPRA Paper 39524, University Library of Munich, Germany.
    18. Wright, Austin L. & Sonin, Konstantin & Driscoll, Jesse & Wilson, Jarnickae, 2020. "Poverty and economic dislocation reduce compliance with COVID-19 shelter-in-place protocols," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 544-554.
    19. Guido de Blasio & Daniela Vuri, 2019. "Effects of the Joint Custody Law in Italy," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 16(3), pages 479-514, September.
    20. Alston Lee J. & Mueller Bernardo, 2018. "Priests, Conflicts and Property Rights: the Impacts on Tenancy and Land Use in Brazil," Man and the Economy, De Gruyter, vol. 5(1), pages 1-26, June.

    More about this item

    Keywords

    ;
    ;

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp18903. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Fallak (email available below). General contact details of provider: https://edirc.repec.org/data/izaaalu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.