IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2406.13826.html

Testing identification in mediation and dynamic treatment models

Author

Listed:
  • Martin Huber
  • Kevin Kloiber
  • Lukas Laffers

Abstract

We propose a test for the identification of causal effects in mediation and dynamic treatment models that is based on two sets of observed variables, namely covariates to be controlled for and suspected instruments, building on the test by Huber and Kueck (2022) for single treatment models. We consider models with a sequential assignment of a treatment and a mediator to assess the direct treatment effect (net of the mediator), the indirect treatment effect (via the mediator), or the joint effect of both treatment and mediator. We establish testable conditions for identifying such effects in observational data. These conditions jointly imply (1) the exogeneity of the treatment and the mediator conditional on covariates and (2) the validity of distinct instruments for the treatment and the mediator, meaning that the instruments do not directly affect the outcome (other than through the treatment or mediator) and are unconfounded given the covariates. Our framework extends to post-treatment sample selection or attrition problems when replacing the mediator by a selection indicator for observing the outcome, enabling joint testing of the selectivity of treatment and attrition. We propose a machine learning-based test to control for covariates in a data-driven manner and analyze its finite sample performance in a simulation study. Additionally, we apply our method to Slovak labor market data and find that our testable implications are not rejected for a sequence of training programs typically considered in dynamic treatment evaluations.

Suggested Citation

  • Martin Huber & Kevin Kloiber & Lukas Laffers, 2024. "Testing identification in mediation and dynamic treatment models," Papers 2406.13826, arXiv.org.
  • Handle: RePEc:arx:papers:2406.13826
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2406.13826
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lechner, Michael & Scioch, Patrycja & Wunsch, Conny, 2013. "Do Firms Benefit from Active Labour Market Policies?," Working papers 2013/11, Faculty of Business and Economics - University of Basel.
    2. Svabova, Lucia & Kramarova, Katarina, 2021. "An analysis of participation factors and effects of the active labour market measure Graduate practice in Slovakia – Counterfactual approach," Evaluation and Program Planning, Elsevier, vol. 86(C).
    3. Martin Huber, 2014. "Identifying Causal Mechanisms (Primarily) Based On Inverse Probability Weighting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(6), pages 920-943, September.
    4. Imai, Kosuke & Yamamoto, Teppei, 2013. "Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments," Political Analysis, Cambridge University Press, vol. 21(2), pages 141-171, April.
    5. Lechner, Michael, 2009. "Sequential Causal Models for the Evaluation of Labor Market Programs," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 71-83.
    6. Joshua D. Angrist & Miikka Rokkanen, 2015. "Wanna Get Away? Regression Discontinuity Estimation of Exam School Effects Away From the Cutoff," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1331-1344, December.
    7. Hugo Bodory & Martin Huber & Lukáš Lafférs, 2022. "Evaluating (weighted) dynamic treatment effects by double machine learning [Identification of causal effects using instrumental variables]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 628-648.
    8. Markus Frölich & Michael Lechner, 2015. "Combining Matching and Nonparametric Instrumental Variable Estimation: Theory and An Application to the Evaluation of Active Labour Market Policies," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(5), pages 718-738, August.
    9. Jeffery Racine & Jeffrey Hart & Qi Li, 2006. "Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 25(4), pages 523-544.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Huber, 2019. "An introduction to flexible methods for policy evaluation," Papers 1910.00641, arXiv.org.
    2. Martin Huber & Yu‐Chin Hsu & Ying‐Ying Lee & Layal Lettry, 2020. "Direct and indirect effects of continuous treatments based on generalized propensity score weighting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(7), pages 814-840, November.
    3. Xu Qin & Jonah Deutsch & Guanglei Hong, 2021. "Unpacking Complex Mediation Mechanisms And Their Heterogeneity Between Sites In A Job Corps Evaluation," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(1), pages 158-190, January.
    4. Martin Huber & Mark Schelker & Anthony Strittmatter, 2022. "Direct and Indirect Effects based on Changes-in-Changes," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 432-443, January.
    5. Guanglei Hong & Fan Yang & Xu Qin, 2023. "Posttreatment confounding in causal mediation studies: A cutting‐edge problem and a novel solution via sensitivity analysis," Biometrics, The International Biometric Society, vol. 79(2), pages 1042-1056, June.
    6. Martin Huber & Michael Lechner & Anthony Strittmatter, 2018. "Direct and indirect effects of training vouchers for the unemployed," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(2), pages 441-463, February.
    7. Helmut Farbmacher & Martin Huber & Lukáš Lafférs & Henrika Langen & Martin Spindler, 2022. "Causal mediation analysis with double machine learning [Mediation analysis via potential outcomes models]," The Econometrics Journal, Royal Economic Society, vol. 25(2), pages 277-300.
    8. Nicolas Apfel & Julia Hatamyar & Martin Huber & Jannis Kueck, 2024. "Learning control variables and instruments for causal analysis in observational data," Papers 2407.04448, arXiv.org, revised Sep 2025.
    9. Huber, Martin & Steinmayr, Andreas, 2017. "A Framework for Separating Individual Treatment Effects From Spillover, Interaction, and General Equilibrium Effects," Rationality and Competition Discussion Paper Series 21, CRC TRR 190 Rationality and Competition.
    10. Fabian Muny, 2025. "Evaluating Program Sequences with Double Machine Learning: An Application to Labor Market Policies," Papers 2506.11960, arXiv.org.
    11. Hsu Yu-Chin & Huber Martin & Lai Tsung-Chih, 2019. "Nonparametric estimation of natural direct and indirect effects based on inverse probability weighting," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-20, January.
    12. Hans R. A. Koster & Jos N. van Ommeren & Piet Rietveld, 2016. "Historic amenities, income and sorting of households," Journal of Economic Geography, Oxford University Press, vol. 16(1), pages 203-236.
    13. Matthew G. Cox & Yasemin Kisbu-Sakarya & Milica MioÄ ević & David P. MacKinnon, 2013. "Sensitivity Plots for Confounder Bias in the Single Mediator Model," Evaluation Review, , vol. 37(5), pages 405-431, October.
    14. Lechner, Michael & Sari, Nazmi, 2015. "Labor market effects of sports and exercise: Evidence from Canadian panel data," Labour Economics, Elsevier, vol. 35(C), pages 1-15.
    15. Benjamin Marx & Vincent Pons & Vincent Rollet, 2022. "Electoral Turnovers," NBER Working Papers 29766, National Bureau of Economic Research, Inc.
    16. Parker Hevron, 2018. "Judicialization and Its Effects: Experiments as a Way Forward," Laws, MDPI, vol. 7(2), pages 1-21, May.
    17. Madi Mangan & Mauro Mastrogiacomo & Hans Bloemen, 2024. "Residual Mortgage Debt, Insurance, and Defaults in the Netherlands," Working Papers 824, DNB.
    18. Oyenubi, Adeola & Kollamparambil, Umakrishnan, 2023. "Does noncompliance with COVID-19 regulations impact the depressive symptoms of others?," Economic Modelling, Elsevier, vol. 120(C).
    19. Riccardo Crescenzi & Guido de Blasio & Mara Giua, 2020. "Cohesion Policy incentives for collaborative industrial research: evaluation of a Smart Specialisation forerunner programme," Regional Studies, Taylor & Francis Journals, vol. 54(10), pages 1341-1353, October.
    20. Nivala, Annika, 2024. "(No) Effects of Subsidizing the First Employee: Evidence of a Low Take-up Puzzle Among Firms," Working Papers 166, VATT Institute for Economic Research.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2406.13826. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.