IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2603.20464.html

Double Machine Learning for Static Panel Data with Instrumental Variables: New Method and Applications

Author

Listed:
  • Anna Baiardi
  • Paul S. Clarke
  • Andrea A. Naghi
  • Annalivia Polselli

Abstract

Panel data methods are widely used in empirical analysis to address unobserved heterogeneity, but causal inference remains challenging when treatments are endogenous and confounding variables high-dimensional and potentially nonlinear. Standard instrumental variables (IV) estimators, such as two-stage least squares (2SLS), become unreliable when instrument validity requires flexibly conditioning on many covariates with potentially non-linear effects. This paper develops a Double Machine Learning estimator for static panel models with endogenous treatments (panel IV DML), and introduces weak-identification diagnostics for it. We revisit three influential migration studies that use shift-share instruments. In these settings, instrument validity depends on a rich covariate adjustment. In one application, panel IV DML strengthens the predictive power of the instrument and broadly confirms 2SLS results. In the other cases, flexible adjustment makes the instruments weak, leading to substantially more cautious causal inference than conventional 2SLS. Monte Carlo evidence supports these findings, showing that panel IV DML improves estimation accuracy under strong instruments and delivers more reliable inference under weak identification.

Suggested Citation

  • Anna Baiardi & Paul S. Clarke & Andrea A. Naghi & Annalivia Polselli, 2026. "Double Machine Learning for Static Panel Data with Instrumental Variables: New Method and Applications," Papers 2603.20464, arXiv.org.
  • Handle: RePEc:arx:papers:2603.20464
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2603.20464
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tatyana Deryugina & Garth Heutel & Nolan H. Miller & David Molitor & Julian Reif, 2019. "The Mortality and Medical Costs of Air Pollution: Evidence from Changes in Wind Direction," American Economic Review, American Economic Association, vol. 109(12), pages 4178-4219, December.
    2. Anna Mikusheva & Liyang Sun, 2022. "Inference with Many Weak Instruments," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(5), pages 2663-2686.
    3. Annalivia Polselli, 2025. "xtdml: Double Machine Learning Estimation to Static Panel Data Models with Fixed Effects in R," Papers 2512.15965, arXiv.org.
    4. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández‐Val, 2025. "Fisher–Schultz Lecture: Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, With an Application to Immunization in India," Econometrica, Econometric Society, vol. 93(4), pages 1121-1164, July.
    5. Facundo Arga~naraz & Juan Carlos Escanciano, 2025. "Debiased Machine Learning for Unobserved Heterogeneity: High-Dimensional Panels and Measurement Error Models," Papers 2507.13788, arXiv.org.
    6. David S. Lee & Justin McCrary & Marcelo J. Moreira & Jack Porter, 2022. "Valid t-Ratio Inference for IV," American Economic Review, American Economic Association, vol. 112(10), pages 3260-3290, October.
    7. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández‐Val, 2025. "Reply to: Comments on “Fisher–Schultz Lecture: Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, With an Application to Immunization in India”," Econometrica, Econometric Society, vol. 93(4), pages 1177-1181, July.
    8. Cathy Yi‐Hsuan Chen & Abraham Lioui & O. Scaillet, 2025. "Green Silence: Double Machine Learning Carbon Emissions Under Sample Selection Bias," Swiss Finance Institute Research Paper Series 25-66, Swiss Finance Institute.
    9. Isaiah Andrews & James H. Stock & Liyang Sun, 2019. "Weak Instruments in Instrumental Variables Regression: Theory and Practice," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 727-753, August.
    10. Victor Chernozhukov & Iv'an Fern'andez-Val & Chen Huang & Weining Wang, 2024. "Arellano-Bond LASSO Estimator for Dynamic Linear Panel Models," Papers 2402.00584, arXiv.org, revised Mar 2026.
    11. Kirill Borusyak & Peter Hull & Xavier Jaravel, 2025. "A Practical Guide to Shift-Share Instruments," Journal of Economic Perspectives, American Economic Association, vol. 39(1), pages 181-204, Winter.
    12. Kleibergen, Frank & Paap, Richard, 2006. "Generalized reduced rank tests using the singular value decomposition," Journal of Econometrics, Elsevier, vol. 133(1), pages 97-126, July.
    13. Rodrigo Adão & Michal Kolesár & Eduardo Morales, 2019. "Shift-Share Designs: Theory and Inference," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 1949-2010.
    14. Max-Sebastian Dovì & Anders Bredahl Kock & Sophocles Mavroeidis, 2024. "A Ridge-Regularized Jackknifed Anderson-Rubin Test," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 1083-1094, July.
    15. Crudu, Federico & Mellace, Giovanni & Sándor, Zsolt, 2021. "Inference In Instrumental Variable Models With Heteroskedasticity And Many Instruments," Econometric Theory, Cambridge University Press, vol. 37(2), pages 281-310, April.
    16. Anna Baiardi & Andrea A Naghi, 2024. "The value added of machine learning to causal inference: evidence from revisited studies," The Econometrics Journal, Royal Economic Society, vol. 27(2), pages 213-234.
    17. Andrew E Clark & Rong Zhu, 2024. "Taking Back Control? Quasi-Experimental Evidence on the Impact of Retirement on Locus of Control," The Economic Journal, Royal Economic Society, vol. 134(660), pages 1465-1493.
    18. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    19. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    20. Anna Maria Mayda & Giovanni Peri & Walter Steingress, 2022. "The Political Impact of Immigration: Evidence from the United States," American Economic Journal: Applied Economics, American Economic Association, vol. 14(1), pages 358-389, January.
    21. Moriconi, Simone & Peri, Giovanni & Turati, Riccardo, 2022. "Skill of the immigrants and vote of the natives: Immigration and nationalism in European elections 2007–2016," European Economic Review, Elsevier, vol. 141(C).
    22. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    23. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    24. Rodrigo Ad~ao & Michal Koles'ar & Eduardo Morales, 2018. "Shift-Share Designs: Theory and Inference," Papers 1806.07928, arXiv.org, revised Aug 2019.
    25. Lynn, Peter & Fumagalli, Laura & Muñoz-Bugarin, Jair, 2021. "Investigating the role of debt advice on borrowers’ well-being. An encouragement study on a new sample of over-indebted people in Britain," ISER Working Paper Series 2021-08, Institute for Social and Economic Research.
    26. Moriconi, Simone & Peri, Giovanni & Turati, Riccardo, 2019. "Immigration and voting for redistribution: Evidence from European elections," Labour Economics, Elsevier, vol. 61(C).
    27. Strittmatter, Anthony, 2023. "What is the value added by using causal machine learning methods in a welfare experiment evaluation?," Labour Economics, Elsevier, vol. 84(C).
    28. Vira Semenova & Matt Goldman & Victor Chernozhukov & Matt Taddy, 2023. "Inference on heterogeneous treatment effects in high‐dimensional dynamic panels under weak dependence," Quantitative Economics, Econometric Society, vol. 14(2), pages 471-510, May.
    29. Keane, Michael & Neal, Timothy, 2023. "Instrument strength in IV estimation and inference: A guide to theory and practice," Journal of Econometrics, Elsevier, vol. 235(2), pages 1625-1653.
    30. Henrika Langen & Martin Huber, 2023. "How causal machine learning can leverage marketing strategies: Assessing and improving the performance of a coupon campaign," PLOS ONE, Public Library of Science, vol. 18(1), pages 1-37, January.
    31. Michael P. Keane & Timothy Neal, 2024. "A Practical Guide to Weak Instruments," Annual Review of Economics, Annual Reviews, vol. 16(1), pages 185-212, August.
    32. Anatolyev, Stanislav & Gospodinov, Nikolay, 2011. "Specification Testing In Models With Many Instruments," Econometric Theory, Cambridge University Press, vol. 27(2), pages 427-441, April.
    33. Alexandre Belloni & Victor Chernozhukov & Christian Hansen & Damian Kozbur, 2016. "Inference in High-Dimensional Panel Models With an Application to Gun Control," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 590-605, October.
    34. Marine Carrasco & Guy Tchuente, 2016. "Efficient Estimation with Many Weak Instruments Using Regularization Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1609-1637, December.
    35. Ashani Abayasekara & Jun Sung Kim & Liang Choon Wang, 2025. "Impacts of Housing Costs on Health and Satisfaction With Life Circumstances: Evidence From Australia," Health Economics, John Wiley & Sons, Ltd., vol. 34(4), pages 741-757, April.
    36. Windmeijer, Frank, 2025. "The robust F-statistic as a test for weak instruments," Journal of Econometrics, Elsevier, vol. 247(C).
    37. Moreira, Humberto & Moreira, Marcelo J., 2019. "Optimal two-sided tests for instrumental variables regression with heteroskedastic and autocorrelated errors," Journal of Econometrics, Elsevier, vol. 213(2), pages 398-433.
    38. Anna Baiardi & Andrea A. Naghi, 2024. "The effect of plough agriculture on gender roles: A machine learning approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(7), pages 1396-1402, November.
    39. Paul Goldsmith-Pinkham & Isaac Sorkin & Henry Swift, 2020. "Bartik Instruments: What, When, Why, and How," American Economic Review, American Economic Association, vol. 110(8), pages 2586-2624, August.
    40. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    41. Russell Davidson & James G. MacKinnon, 2014. "Confidence sets based on inverting Anderson–Rubin tests," Econometrics Journal, Royal Economic Society, vol. 17(2), pages 39-58, June.
    42. Victor Chernozhukov & Whitney K. Newey & Rahul Singh, 2022. "Automatic Debiased Machine Learning of Causal and Structural Effects," Econometrica, Econometric Society, vol. 90(3), pages 967-1027, May.
    43. Luiz M. Cruz & Marcelo J. Moreira, 2005. "On the Validity of Econometric Techniques with Weak Instruments: Inference on Returns to Education Using Compulsory School Attendance Laws," Journal of Human Resources, University of Wisconsin Press, vol. 40(2).
    44. Lucas Ronconi & Timothy T. Brown & Richard M. Scheffler, 2012. "Social capital and self‐rated health in Argentina," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 201-208, February.
    45. Marco Tabellini, 2020. "Gifts of the Immigrants, Woes of the Natives: Lessons from the Age of Mass Migration," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(1), pages 454-486.
    46. Card, David, 2001. "Immigrant Inflows, Native Outflows, and the Local Labor Market Impacts of Higher Immigration," Journal of Labor Economics, University of Chicago Press, vol. 19(1), pages 22-64, January.
    47. José Luis Montiel Olea & Carolin Pflueger, 2013. "A Robust Test for Weak Instruments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 358-369, July.
    48. Tabellini, Marco, 2020. "Gifts of the Immigrants, Woes of the Natives: Lessons from the Age of Mass Migration," CEPR Discussion Papers 14317, Centre for Economic Policy Research.
    49. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    50. Cragg, John G. & Donald, Stephen G., 1993. "Testing Identifiability and Specification in Instrumental Variable Models," Econometric Theory, Cambridge University Press, vol. 9(2), pages 222-240, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pieroni, Luca & Roig, Melcior Rosselló & Salmasi, Luca, 2023. "Italy: Immigration and the evolution of populism," European Journal of Political Economy, Elsevier, vol. 76(C).
    2. Qu Feng & Sombut Jaidee & Wenjie Wang, 2025. "Robust Inference with High-Dimensional Instruments," Papers 2506.23834, arXiv.org.
    3. Dennis Lim & Wenjie Wang & Yichong Zhang, 2024. "A Dimension-Agnostic Bootstrap Anderson-Rubin Test For Instrumental Variable Regressions," Papers 2412.01603, arXiv.org, revised Sep 2025.
    4. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    5. Liyu Dou & Pengjin Min & Wenjie Wang & Yichong Zhang, 2025. "An Improved Inference for IV Regressions," Papers 2506.23816, arXiv.org, revised Mar 2026.
    6. Wang, Wenjie & Zhang, Yichong, 2024. "Wild bootstrap inference for instrumental variables regressions with weak and few clusters," Journal of Econometrics, Elsevier, vol. 241(1).
    7. Moriconi, Simone & Peri, Giovanni & Turati, Riccardo, 2022. "Skill of the immigrants and vote of the natives: Immigration and nationalism in European elections 2007–2016," European Economic Review, Elsevier, vol. 141(C).
    8. Fremerey, Melinda & Hörnig, Lukas & Schaffner, Sandra, 2024. "Becoming neighbors with refugees and voting for the far-right? The impact of refugee inflows at the small-scale level," Labour Economics, Elsevier, vol. 86(C).
    9. Wenze Li, 2025. "An Empirical Comparison of Weak-IV-Robust Procedures in Just-Identified Models," Papers 2506.18001, arXiv.org.
    10. Lim, Dennis & Wang, Wenjie & Zhang, Yichong, 2024. "A conditional linear combination test with many weak instruments," Journal of Econometrics, Elsevier, vol. 238(2).
    11. Adam Levai & Riccardo Turati, 2021. "The Impact of Immigration on Workers’ Protection," LIDAM Discussion Papers IRES 2021021, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES), revised 07 Sep 2021.
    12. Carlo Medici, 2024. "Closing Ranks: Organized Labor and Immigration," CESifo Working Paper Series 11437, CESifo.
    13. Clifton-Sprigg, Joanna & Homburg, Ines & Vujic, Suncica, 2025. "Refugee Exposure and Political Backlash: Poland during the Russia-Ukraine War," IZA Discussion Papers 18157, IZA Network @ LISER.
    14. Adam Levai & Riccardo Turati, 2025. "International immigration and labor regulation," Scandinavian Journal of Economics, Wiley Blackwell, vol. 127(4), pages 809-851, October.
    15. Zhang, Zhijian & Ding, Yuli & Wu, Shu, 2025. "The impact of birthplace diversity on prosociality: Ingroups versus outgroups," Journal of Comparative Economics, Elsevier, vol. 53(3), pages 643-666.
    16. Dennis Lim & Wenjie Wang & Yichong Zhang, 2022. "A Conditional Linear Combination Test with Many Weak Instruments," Papers 2207.11137, arXiv.org, revised Apr 2023.
    17. Francesco Fasani & Simone Ferro & Alessio Romarri & Elisabetta Pasini, 2025. "A More Conservative Country? Asylum Seekers and Voting in the UK," Working Papers wpdea2520, Department of Applied Economics at Universitat Autonoma of Barcelona.
    18. Calderon, Alvaro & Fouka, Vasiliki & Tabellini, Marco, 2021. "Racial Diversity and Racial Policy Preferences: The Great Migration and Civil Rights," IZA Discussion Papers 14488, IZA Network @ LISER.
    19. Michael Lechner & Jana Mareckova, 2024. "Comprehensive Causal Machine Learning," Papers 2405.10198, arXiv.org, revised Feb 2025.
    20. Paul S. Clarke & Annalivia Polselli, 2023. "Double Machine Learning for Static Panel Models with Fixed Effects," Papers 2312.08174, arXiv.org, revised Dec 2024.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2603.20464. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.