IDEAS home Printed from https://ideas.repec.org/a/bla/jorssc/v69y2020i5p1285-1305.html
   My bibliography  Save this article

A calibrated sensitivity analysis for matched observational studies with application to the effect of second‐hand smoke exposure on blood lead levels in children

Author

Listed:
  • Bo Zhang
  • Dylan S. Small

Abstract

We conducted a matched observational study to investigate the causal relationship between second‐hand smoke and blood lead levels in children. Our first analysis that assumes no unmeasured confounding suggests evidence of a detrimental effect of second‐hand smoke. However, unmeasured confounding is a concern in our study as in other observational studies of second‐hand smoke's effects. A sensitivity analysis asks how sensitive the conclusion is to a hypothesized unmeasured confounder U. For example, in our study, one potential unmeasured confounder is whether the child attends a public or private school. A commonly used sensitivity analysis for matched observational studies adopts a worst‐case perspective, which assumes that, in each matched set, the unmeasured confounder is allocated to make the bias worst: in a matched pair, the child with higher blood lead level always attends public school and the other private school. This worst‐case allocation of U does not correspond to any realistic distribution of U in the population and is difficult to compare with observed covariates. We proposed a new sensitivity analysis method that addresses these concerns. We apply the new method to our study and find that, to explain away the association between second‐hand smoke exposure and blood lead levels as non‐causal, the unmeasured confounder would have to be a bigger confounder than any measured confounder.

Suggested Citation

  • Bo Zhang & Dylan S. Small, 2020. "A calibrated sensitivity analysis for matched observational studies with application to the effect of second‐hand smoke exposure on blood lead levels in children," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(5), pages 1285-1305, November.
  • Handle: RePEc:bla:jorssc:v:69:y:2020:i:5:p:1285-1305
    DOI: 10.1111/rssc.12443
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssc.12443
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssc.12443?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lu, Bo & Greevy, Robert & Xu, Xinyi & Beck, Cole, 2011. "Optimal Nonbipartite Matching and Its Statistical Applications," The American Statistician, American Statistical Association, vol. 65(1), pages 21-30.
    2. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    3. Jesse Y. Hsu & Dylan S. Small, 2013. "Calibrating Sensitivity Analyses to Observed Covariates in Observational Studies," Biometrics, The International Biometric Society, vol. 69(4), pages 803-811, December.
    4. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May.
    5. Middleton, Joel A. & Scott, Marc A. & Diakow, Ronli & Hill, Jennifer L., 2016. "Bias Amplification and Bias Unmasking," Political Analysis, Cambridge University Press, vol. 24(3), pages 307-323, July.
    6. Shiqiang Du & Peijun Shi & Anton Van Rompaey, 2013. "The Relationship between Urban Sprawl and Farmland Displacement in the Pearl River Delta, China," Land, MDPI, vol. 3(1), pages 1-18, December.
    7. Minna Genbäck & Xavier de Luna, 2019. "Causal inference accounting for unobserved confounding after outcome regression and doubly robust estimation," Biometrics, The International Biometric Society, vol. 75(2), pages 506-515, June.
    8. Carlos Cinelli & Chad Hazlett, 2020. "Making sense of sensitivity: extending omitted variable bias," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 39-67, February.
    9. Ben B. Hansen & Paul R. Rosenbaum & Dylan S. Small, 2014. "Clustered Treatment Assignments and Sensitivity to Unmeasured Biases in Observational Studies," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 133-144, March.
    10. Joseph L. Gastwirth & Abba M. Krieger & Paul R. Rosenbaum, 2000. "Asymptotic separability in sensitivity analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(3), pages 545-555.
    11. Ben B. Hansen, 2004. "Full Matching in an Observational Study of Coaching for the SAT," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 609-618, January.
    12. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    13. Rosenbaum, Paul R., 2010. "Design Sensitivity and Efficiency in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 692-702.
    14. Samuel D. Pimentel & Rachel R. Kelz & Jeffrey H. Silber & Paul R. Rosenbaum, 2015. "Large, Sparse Optimal Matching With Refined Covariate Balance in an Observational Study of the Health Outcomes Produced by New Surgeons," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 515-527, June.
    15. José R. Zubizarreta, 2012. "Using Mixed Integer Programming for Matching in an Observational Study of Kidney Failure After Surgery," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(500), pages 1360-1371, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bo Zhang & Eric J. Tchetgen Tchetgen, 2022. "A semi‐parametric approach to model‐based sensitivity analysis in observational studies," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 668-691, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bo Zhang & Eric J. Tchetgen Tchetgen, 2022. "A semi‐parametric approach to model‐based sensitivity analysis in observational studies," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 668-691, December.
    2. Siyu Heng & Hyunseung Kang & Dylan S. Small & Colin B. Fogarty, 2021. "Increasing power for observational studies of aberrant response: An adaptive approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(3), pages 482-504, July.
    3. Bikram Karmakar, 2022. "An approximation algorithm for blocking of an experimental design," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1726-1750, November.
    4. Colnet Bénédicte & Josse Julie & Varoquaux Gaël & Scornet Erwan, 2022. "Causal effect on a target population: A sensitivity analysis to handle missing covariates," Journal of Causal Inference, De Gruyter, vol. 10(1), pages 372-414, January.
    5. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    6. Paul R. Rosenbaum, 2015. "Bahadur Efficiency of Sensitivity Analyses in Observational Studies," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 205-217, March.
    7. Xavier de Luna & Mathias Lundin, 2014. "Sensitivity analysis of the unconfoundedness assumption with an application to an evaluation of college choice effects on earnings," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(8), pages 1767-1784, August.
    8. Matthew A. Masten & Alexandre Poirier & Linqi Zhang, 2024. "Assessing Sensitivity to Unconfoundedness: Estimation and Inference," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(1), pages 1-13, January.
    9. Colin B. Fogarty, 2023. "Testing weak nulls in matched observational studies," Biometrics, The International Biometric Society, vol. 79(3), pages 2196-2207, September.
    10. Giovanni Nattino & Bo Lu, 2018. "Model assisted sensitivity analyses for hidden bias with binary outcomes," Biometrics, The International Biometric Society, vol. 74(4), pages 1141-1149, December.
    11. Michael J. Peel, 2014. "Addressing unobserved endogeneity bias in accounting studies: control and sensitivity methods by variable type," Accounting and Business Research, Taylor & Francis Journals, vol. 44(5), pages 545-571, October.
    12. Ruoqi Yu, 2021. "Evaluating and improving a matched comparison of antidepressants and bone density," Biometrics, The International Biometric Society, vol. 77(4), pages 1276-1288, December.
    13. Paolo Naticchioni & Silvia Loriga, 2011. "Short and Long Term Evaluations of Public Employment Services in Italy," Applied Economics Quarterly (formerly: Konjunkturpolitik), Duncker & Humblot, Berlin, vol. 57(3), pages 201-229.
    14. Sascha O. Becker & Marco Caliendo, 2007. "Sensitivity analysis for average treatment effects," Stata Journal, StataCorp LP, vol. 7(1), pages 71-83, February.
    15. Ashimwe, Olive, 2016. "An Economic Analysis Of Impact Of Weather Index-Based Crop Insurance On Household Income In Huye District Of Rwanda," Research Theses 265675, Collaborative Masters Program in Agricultural and Applied Economics.
    16. Dragana Radicic & Geoffrey Pugh & David Douglas, 2020. "Promoting cooperation in innovation ecosystems: evidence from European traditional manufacturing SMEs," Small Business Economics, Springer, vol. 54(1), pages 257-283, January.
    17. Raiden B. Hasegawa & Sameer K. Deshpande & Dylan S. Small & Paul R. Rosenbaum, 2020. "Causal Inference With Two Versions of Treatment," Journal of Educational and Behavioral Statistics, , vol. 45(4), pages 426-445, August.
    18. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    19. Myoung Lee & Sang Lee, 2009. "Sensitivity analysis of job-training effects on reemployment for Korean women," Empirical Economics, Springer, vol. 36(1), pages 81-107, February.
    20. Lechner, Michael & Felfe, Christina & Steinmayr, Andreas, 2011. "Sports and Child Development," CEPR Discussion Papers 8523, C.E.P.R. Discussion Papers.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssc:v:69:y:2020:i:5:p:1285-1305. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.