IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v84y2019i2d10.1007_s11336-019-09665-6.html
   My bibliography  Save this article

Compensation and Amplification of Attenuation Bias in Causal Effect Estimates

Author

Listed:
  • Marie-Ann Sengewald

    (Otto-Friedrich-Universität Bamberg)

  • Steffi Pohl

    (Freie Universität Berlin)

Abstract

Covariate-adjusted treatment effects are commonly estimated in non-randomized studies. It has been shown that measurement error in covariates can bias treatment effect estimates when not appropriately accounted for. So far, these delineations primarily assumed a true data generating model that included just one single covariate. It is, however, more plausible that the true model consists of more than one covariate. We evaluate when a further covariate may reduce bias due to measurement error in another covariate and in which cases it is not recommended to include a further covariate. We analytically derive the amount of bias related to the fallible covariate’s reliability and systematically disentangle bias compensation and amplification due to an additional covariate. With a fallible covariate, it is not always beneficial to include an additional covariate for adjustment, as the additional covariate can extensively increase the bias. The mechanisms for an increased bias due to an additional covariate can be complex, even in a simple setting of just two covariates. A high reliability of the fallible covariate or a high correlation between the covariates cannot in general prevent from substantial bias. We show distorting effects of a fallible covariate in an empirical example and discuss adjustment for latent covariates as a possible solution.

Suggested Citation

  • Marie-Ann Sengewald & Steffi Pohl, 2019. "Compensation and Amplification of Attenuation Bias in Causal Effect Estimates," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 589-610, June.
    • Handle: RePEc:spr:psycho:v:84:y:2019:i:2:d:10.1007_s11336-019-09665-6
    DOI: 10.1007/s11336-019-09665-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-019-09665-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-019-09665-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter M. Steiner & Thomas D. Cook & William R. Shadish, 2011. "On the Importance of Reliable Covariate Measurement in Selection Bias Adjustments Using Propensity Scores," Journal of Educational and Behavioral Statistics, , vol. 36(2), pages 213-236, April.
    2. Hwanhee Hong & Kara E. Rudolph & Elizabeth A. Stuart, 2017. "Bayesian Approach for Addressing Differential Covariate Measurement Error in Propensity Score Methods," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1078-1096, December.
    3. Daniel F. McCaffrey & J. R. Lockwood & Claude M. Setodji, 2013. "Inverse probability weighting with error-prone covariates," Biometrika, Biometrika Trust, vol. 100(3), pages 671-680.
    4. Manabu Kuroki & Judea Pearl, 2014. "Measurement bias and effect restoration in causal inference," Biometrika, Biometrika Trust, vol. 101(2), pages 423-437.
    5. Grace Y. Yi & Yanyuan Ma & Raymond J. Carroll, 2012. "A functional generalized method of moments approach for longitudinal studies with missing responses and covariate measurement error," Biometrika, Biometrika Trust, vol. 99(1), pages 151-165.
    6. Donald B. Rubin, 2005. "Causal Inference Using Potential Outcomes: Design, Modeling, Decisions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 322-331, March.
    7. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    8. J. R. Lockwood & Daniel F. McCaffrey, 2016. "Matching and Weighting With Functions of Error-Prone Covariates for Causal Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1831-1839, October.
    9. Anders Skrondal & Petter Laake, 2001. "Regression among factor scores," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 563-575, December.
    10. J. R. Lockwood & Daniel F. McCaffrey, 2017. "Simulation-Extrapolation with Latent Heteroskedastic Error Variance," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 717-736, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. J. R. Lockwood & Daniel F. McCaffrey, 2019. "Impact Evaluation Using Analysis of Covariance With Error-Prone Covariates That Violate Surrogacy," Evaluation Review, , vol. 43(6), pages 335-369, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. R. Lockwood & Daniel F. McCaffrey, 2019. "Impact Evaluation Using Analysis of Covariance With Error-Prone Covariates That Violate Surrogacy," Evaluation Review, , vol. 43(6), pages 335-369, December.
    2. J. R. Lockwood & D. McCaffrey, 2020. "Using hidden information and performance level boundaries to study student–teacher assignments: implications for estimating teacher causal effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1333-1362, October.
    3. Trang Quynh Nguyen & Elizabeth A. Stuart, 2020. "Propensity Score Analysis With Latent Covariates: Measurement Error Bias Correction Using the Covariate’s Posterior Mean, aka the Inclusive Factor Score," Journal of Educational and Behavioral Statistics, , vol. 45(5), pages 598-636, October.
    4. J. R. Lockwood & Daniel F. McCaffrey, 2017. "Simulation-Extrapolation with Latent Heteroskedastic Error Variance," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 717-736, September.
    5. Matthew Cefalu & Brian G. Vegetabile & Michael Dworsky & Christine Eibner & Federico Girosi, 2020. "Reducing bias in difference-in-differences models using entropy balancing," Papers 2011.04826, arXiv.org.
    6. Hwanhee Hong & Kara E. Rudolph & Elizabeth A. Stuart, 2017. "Bayesian Approach for Addressing Differential Covariate Measurement Error in Propensity Score Methods," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1078-1096, December.
    7. Di Shu & Grace Y. Yi, 2018. "Estimation of Causal Effect Measures in the Presence of Measurement Error in Confounders," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 10(1), pages 233-254, April.
    8. Chun Wang & Gongjun Xu & Xue Zhang, 2019. "Correction for Item Response Theory Latent Trait Measurement Error in Linear Mixed Effects Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 673-700, September.
    9. Vivian C. Wong & Peter M. Steiner & Kylie L. Anglin, 2018. "What Can Be Learned From Empirical Evaluations of Nonexperimental Methods?," Evaluation Review, , vol. 42(2), pages 147-175, April.
    10. Md. Mominur Rahman & Bilkis Akhter, 2021. "The impact of investment in human capital on bank performance: evidence from Bangladesh," Future Business Journal, Springer, vol. 7(1), pages 1-13, December.
    11. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    12. Manabu Kuroki & Hisayoshi Nanmo, 2020. "Variance formulas for estimated mean response and predicted response with external intervention based on the back-door criterion in linear structural equation models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(4), pages 667-685, December.
    13. Salvatore Bimonte & Antonella D’Agostino, 2021. "Tourism development and residents’ well-being: Comparing two seaside destinations in Italy," Tourism Economics, , vol. 27(7), pages 1508-1525, November.
    14. Nathaniel Oliver Iotti & Damiano Menin & Tomas Jungert, 2022. "Early Adolescents’ Motivations to Defend Victims of Cyberbullying," IJERPH, MDPI, vol. 19(14), pages 1-9, July.
    15. Andreea-Ionela Puiu & Anca Monica Ardeleanu & Camelia Cojocaru & Anca Bratu, 2021. "Exploring the Effect of Status Quo, Innovativeness, and Involvement Tendencies on Luxury Fashion Innovations: The Mediation Role of Status Consumption," Mathematics, MDPI, vol. 9(9), pages 1-18, May.
    16. Allen, Jaime & Muñoz, Juan Carlos & Ortúzar, Juan de Dios, 2019. "On evasion behaviour in public transport: Dissatisfaction or contagion?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 130(C), pages 626-651.
    17. Merkle, Edgar C. & Steyvers, Mark & Mellers, Barbara & Tetlock, Philip E., 2017. "A neglected dimension of good forecasting judgment: The questions we choose also matter," International Journal of Forecasting, Elsevier, vol. 33(4), pages 817-832.
    18. Sai-fu Fung & Esther Oi-wah Chow & Chau-kiu Cheung, 2020. "Development and Evaluation of the Psychometric Properties of a Brief Wisdom Development Scale," IJERPH, MDPI, vol. 17(8), pages 1-14, April.
    19. Dang Vu, Hoai Nam & Nielsen, Martin Reinhardt, 2022. "Understanding determinants of the intention to buy rhino horn in Vietnam through the Theory of Planned Behaviour and the Theory of Interpersonal Behaviour," Ecological Economics, Elsevier, vol. 195(C).
    20. Georges Steffgen & Philipp E. Sischka & Martha Fernandez de Henestrosa, 2020. "The Quality of Work Index and the Quality of Employment Index: A Multidimensional Approach of Job Quality and Its Links to Well-Being at Work," IJERPH, MDPI, vol. 17(21), pages 1-31, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:84:y:2019:i:2:d:10.1007_s11336-019-09665-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.