IDEAS home Printed from https://ideas.repec.org/a/tsj/stataj/v24y2024i1p72-92.html
   My bibliography  Save this article

Ordinary least squares and instrumental-variables estimators for any outcome and heterogeneity

Author

Listed:
  • Myoung-jae Lee

    (Korea University)

  • Chirok Han

    (Korea University)

Abstract

Given an exogenous treatment d and covariates x, an ordinary least- squares (OLS) estimator is often applied with a noncontinuous outcome y to find the effect of d, despite the fact that the OLS linear model is invalid. Also, when d is endogenous with an instrument z, an instrumental-variables estimator (IVE) is often applied, again despite the invalid linear model. Furthermore, the treatment effect is likely to be heterogeneous, say, μ1(x), not a constant as assumed in most linear models. Given these problems, the question is then what kind of effect the OLS and IVE actually estimate. Under some restrictive conditions such as a “saturated model”, the estimated effect is known to be a weighted average, say, E{ω(x)μ1(x)}, but in general, OLS and the IVE applied to linear models with a noncontinuous outcome or heterogeneous effect fail to yield a weighted average of heterogeneous treatment effects. Recently, however, it has been found that E{ω(x)μ1(x)} can be estimated by OLS and the IVE without those restrictive conditions if the “propensity-score residual” d − E(d|x) or the “instrument-score residual” z−E(z|x) is used. In this article, we review this recent development and provide a command for OLS and the IVE with the propensity- and instrument-score residuals, which are applicable to any outcome and any heterogeneous effect.

Suggested Citation

  • Myoung-jae Lee & Chirok Han, 2024. "Ordinary least squares and instrumental-variables estimators for any outcome and heterogeneity," Stata Journal, StataCorp LLC, vol. 24(1), pages 72-92, March.
  • Handle: RePEc:tsj:stataj:v:24:y:2024:i:1:p:72-92
    DOI: 10.1177/1536867X241233645
    Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj24-1/st0740/
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1177/1536867X241233645
    Download Restriction: no

    File URL: https://libkey.io/10.1177/1536867X241233645?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Peng Ding & Jiannan Lu, 2017. "Principal stratification analysis using principal scores," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(3), pages 757-777, June.
    2. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    3. Myoung-Jae Lee, 2018. "Simple least squares estimator for treatment effects using propensity score residuals," Biometrika, Biometrika Trust, vol. 105(1), pages 149-164.
    4. Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey & James M. Robins, 2022. "Locally Robust Semiparametric Estimation," Econometrica, Econometric Society, vol. 90(4), pages 1501-1535, July.
    5. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    6. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    7. Peter M. Aronow & Cyrus Samii, 2016. "Does Regression Produce Representative Estimates of Causal Effects?," American Journal of Political Science, John Wiley & Sons, vol. 60(1), pages 250-267, January.
    8. Fan Li & Kari Lock Morgan & Alan M. Zaslavsky, 2018. "Balancing Covariates via Propensity Score Weighting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 390-400, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bora Kim, 2024. "Estimating Spillover Effects in the Presence of Isolated Nodes," Papers 2412.05919, arXiv.org.
    2. Kim, Bora & Lee, Myoung-jae, 2025. "Overlap-weighted difference-in-differences: A simple way to overcome poor propensity score overlap," Economics Letters, Elsevier, vol. 250(C).
    3. Yuxuan Wang & Fulin Fan & Yu Wang & Ke Wang & Jinhai Jiang & Chuanyu Sun & Rui Xue & Kai Song, 2025. "Convective Heat Loss Prediction Using the Concept of Effective Wind Speed for Dynamic Line Rating Studies," Energies, MDPI, vol. 18(16), pages 1-18, August.
    4. Kim, Bora & Lee, Myoung-jae, 2024. "Instrument-residual estimator for multi-valued instruments under full monotonicity," Statistics & Probability Letters, Elsevier, vol. 213(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Bora & Lee, Myoung-jae, 2024. "Instrument-residual estimator for multi-valued instruments under full monotonicity," Statistics & Probability Letters, Elsevier, vol. 213(C).
    2. Myoung‐jae Lee, 2021. "Instrument residual estimator for any response variable with endogenous binary treatment," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(3), pages 612-635, July.
    3. Tymon Słoczyński, 2022. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," The Review of Economics and Statistics, MIT Press, vol. 104(3), pages 501-509, May.
    4. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    5. Victor Chernozhukov & Carlos Cinelli & Whitney Newey & Amit Sharma & Vasilis Syrgkanis, 2021. "Long Story Short: Omitted Variable Bias in Causal Machine Learning," Papers 2112.13398, arXiv.org, revised May 2024.
    6. Aditya Ghosh & Dominik Rothenhausler, 2025. "Assumption-robust Causal Inference," Papers 2505.08729, arXiv.org, revised Jun 2025.
    7. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    8. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    9. Vira Semenova, 2020. "Generalized Lee Bounds," Papers 2008.12720, arXiv.org, revised May 2025.
    10. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    11. Stijn Vansteelandt & Oliver Dukes, 2022. "Assumption‐lean inference for generalised linear model parameters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 657-685, July.
    12. Kim, Bora & Lee, Myoung-jae, 2025. "Overlap-weighted difference-in-differences: A simple way to overcome poor propensity score overlap," Economics Letters, Elsevier, vol. 250(C).
    13. Phillip Heiler, 2022. "Efficient Covariate Balancing for the Local Average Treatment Effect," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1569-1582, October.
    14. Choi, Jin-young & Lee, Goeun & Lee, Myoung-jae, 2023. "Endogenous treatment effect for any response conditional on control propensity score," Statistics & Probability Letters, Elsevier, vol. 196(C).
    15. Alvarez, Luis A.F. & Toneto, Rodrigo, 2024. "The interpretation of 2SLS with a continuous instrument: A weighted LATE representation," Economics Letters, Elsevier, vol. 237(C).
    16. Michael C. Knaus, 2024. "Treatment Effect Estimators as Weighted Outcomes," Papers 2411.11559, arXiv.org, revised Dec 2024.
    17. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP72/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    19. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    20. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:24:y:2024:i:1:p:72-92. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum or Lisa Gilmore (email available below). General contact details of provider: http://www.stata-journal.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.