IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v42y2017i3p308-340.html

A Weighting Method for Assessing Between-Site Heterogeneity in Causal Mediation Mechanism

Author

Listed:
  • Xu Qin
  • Guanglei Hong

Abstract

When a multisite randomized trial reveals between-site variation in program impact, methods are needed for further investigating heterogeneous mediation mechanisms across the sites. We conceptualize and identify a joint distribution of site-specific direct and indirect effects under the potential outcomes framework. A method-of-moments procedure incorporating ratio-of-mediator-probability weighting (RMPW) consistently estimates the causal parameters. This strategy conveniently relaxes the assumption of no Treatment × Mediator interaction while greatly simplifying the outcome model specification without invoking strong distributional assumptions. We derive asymptotic standard errors that reflect the sampling variability of the estimated weight. We also offer an easy-to-use R package, MultisiteMediation , that implements the proposed method. It is freely available at the Comprehensive R Archive Network ( http://cran.r-project.org/web/packages/MultisiteMediation ).

Suggested Citation

  • Xu Qin & Guanglei Hong, 2017. "A Weighting Method for Assessing Between-Site Heterogeneity in Causal Mediation Mechanism," Journal of Educational and Behavioral Statistics, , vol. 42(3), pages 308-340, June.
    • Handle: RePEc:sae:jedbes:v:42:y:2017:i:3:p:308-340
    DOI: 10.3102/1076998617694879
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998617694879
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998617694879?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Newey, Whitney K., 1984. "A method of moments interpretation of sequential estimators," Economics Letters, Elsevier, vol. 14(2-3), pages 201-206.
    3. Hong, Guanglei & Raudenbush, Stephen W., 2006. "Evaluating Kindergarten Retention Policy: A Case Study of Causal Inference for Multilevel Observational Data," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 901-910, September.
    4. Tyler J. Vanderweele & Guanglei Hong & Stephanie M. Jones & Joshua L. Brown, 2013. "Mediation and Spillover Effects in Group-Randomized Trials: A Case Study of the 4Rs Educational Intervention," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(502), pages 469-482, June.
    5. Garrett M. Fitzmaurice & Stuart R. Lipsitz & Joseph G. Ibrahim, 2007. "A Note on Permutation Tests for Variance Components in Multilevel Generalized Linear Mixed Models," Biometrics, The International Biometric Society, vol. 63(3), pages 942-946, September.
    6. Guanglei Hong & Jonah Deutsch & Heather D. Hill, 2015. "Ratio-of-Mediator-Probability Weighting for Causal Mediation Analysis in the Presence of Treatment-by-Mediator Interaction," Mathematica Policy Research Reports 328b045b48b14d9ea3f7d0fe9, Mathematica Policy Research.
    7. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    8. Carlos A. Flores & Alfonso Flores-Lagunes, 2013. "Partial Identification of Local Average Treatment Effects With an Invalid Instrument," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(4), pages 534-545, October.
    9. repec:mpr:mprres:1966 is not listed on IDEAS
    10. Jeffrey M. Albert & Suchitra Nelson, 2011. "Generalized Causal Mediation Analysis," Biometrics, The International Biometric Society, vol. 67(3), pages 1028-1038, September.
    11. Imai, Kosuke & Yamamoto, Teppei, 2013. "Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments," Political Analysis, Cambridge University Press, vol. 21(2), pages 141-171, April.
    12. Terry Johnson & Mark Gritz & Russell Jackson & John Burghardt & Carol Boussy & Jan Leonard & Carlyn Orians, 1999. "National Job Corps Study: Report on the Process Analysis," Mathematica Policy Research Reports efc0cd05f0524a049779f797f, Mathematica Policy Research.
    13. repec:mpr:mprres:1968 is not listed on IDEAS
    14. Michael J. Weiss & Howard S. Bloom & Thomas Brock, 2014. "A Conceptual Framework For Studying The Sources Of Variation In Program Effects," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(3), pages 778-808, June.
    15. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu Qin & Jonah Deutsch & Guanglei Hong, 2021. "Unpacking Complex Mediation Mechanisms And Their Heterogeneity Between Sites In A Job Corps Evaluation," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(1), pages 158-190, January.
    2. Martin Huber, 2015. "Causal Pitfalls in the Decomposition of Wage Gaps," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 179-191, April.
    3. Martin Huber & Michael Lechner & Giovanni Mellace, 2016. "The Finite Sample Performance of Estimators for Mediation Analysis Under Sequential Conditional Independence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(1), pages 139-160, January.
    4. Guanglei Hong & Fan Yang & Xu Qin, 2023. "Posttreatment confounding in causal mediation studies: A cutting‐edge problem and a novel solution via sensitivity analysis," Biometrics, The International Biometric Society, vol. 79(2), pages 1042-1056, June.
    5. Davide Viviano, 2020. "Experimental Design under Network Interference," Papers 2003.08421, arXiv.org, revised Nov 2025.
    6. Huber, Martin, 2012. "Identifying causal mechanisms in experiments (primarily) based on inverse probability weighting," Economics Working Paper Series 1213, University of St. Gallen, School of Economics and Political Science, revised May 2013.
    7. Gabriella Conti & Kosuke Imai & Cynthia Kinnan & Anup Malani & Morgen Miller & Shailender Swaminathan & Alessandra Voena & Bartosz Woda, 2024. "Evaluating pricing health insurance in lower-income countries: A field experiment in India," IFS Working Papers W24/33, Institute for Fiscal Studies.
    8. Alain Guay & Dalibor Stevanovic, 2025. "Estimation of Non-Gaussian SVAR Using Tensor Singular Value Decomposition," CIRANO Working Papers 2025s-26, CIRANO.
    9. Martin Huber & Michael Lechner & Giovanni Mellace, 2017. "Why Do Tougher Caseworkers Increase Employment? The Role of Program Assignment as a Causal Mechanism," The Review of Economics and Statistics, MIT Press, vol. 99(1), pages 180-183, March.
    10. Graham, Bryan S. & Imbens, Guido W. & Ridder, Geert, 2025. "Measuring the effects of segregation in the presence of social spillovers: A nonparametric approach," Journal of Econometrics, Elsevier, vol. 252(PB).
    11. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118, June.
    12. Prokhorov, Artem & Schmidt, Peter, 2009. "GMM redundancy results for general missing data problems," Journal of Econometrics, Elsevier, vol. 151(1), pages 47-55, July.
    13. Chiba, Yasutaka, 2012. "A note on bounds for the causal infectiousness effect in vaccine trials," Statistics & Probability Letters, Elsevier, vol. 82(7), pages 1422-1429.
    14. John Gardner, 2022. "Two-stage differences in differences," Papers 2207.05943, arXiv.org.
    15. Soojin Park & Peter M. Steiner & David Kaplan, 2018. "Identification and Sensitivity Analysis for Average Causal Mediation Effects with Time-Varying Treatments and Mediators: Investigating the Underlying Mechanisms of Kindergarten Retention Policy," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 298-320, June.
    16. Joachim Inkmann, 2010. "Estimating Firm Size Elasticities of Product and Process R&D," Economica, London School of Economics and Political Science, vol. 77(306), pages 384-402, April.
    17. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Sciences Po Economics Publications (main) hal-03455978, HAL.
    18. William Liu, 2023. "A Theory Guide to Using Control Functions to Instrument Hazard Models," Papers 2312.03165, arXiv.org.
    19. Arnab Bhattacharjee & Sean Holly, 2013. "Understanding Interactions in Social Networks and Committees," Spatial Economic Analysis, Taylor & Francis Journals, vol. 8(1), pages 23-53, March.
    20. Helmut Farbmacher & Martin Huber & Lukáš Lafférs & Henrika Langen & Martin Spindler, 2022. "Causal mediation analysis with double machine learning [Mediation analysis via potential outcomes models]," The Econometrics Journal, Royal Economic Society, vol. 25(2), pages 277-300.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:42:y:2017:i:3:p:308-340. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.