IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2608.01137.html

Double Machine Learning with High-dimensional Interactive Fixed Effects

Author

Listed:
  • Binzhi Chen
  • Annalivia Polselli
  • Paul S. Clarke

Abstract

Factor structures are central to empirical work in economics and finance, and are usually used to model time-varying unobserved heterogeneity through interactive fixed effects (IFE). Existing IFE estimators rest on low-dimensional and linear specifications in the covariates, assumptions which are increasingly restrictive in applications drawing on rich datasets with controls of unknown functional form. This paper develops a Double Machine Learning estimator for the high-dimensional partially linear panel model with interactive fixed effects (panel DML-IFE). The method combines projection-based defactorisation of the data, in the spirit of Common Correlated Effects (CCE), with a Neyman-orthogonal score function and cross-fitting procedure, and accommodates low-rank factor structures in outcomes and treatments alongside high-dimensional, potentially nonlinear covariate effects estimated by machine learning algorithms. Monte Carlo simulations show that panel DML-IFE outperforms conventional IFE estimator outside the correctly-specified linear case, with bias reduction driven primarily by the time and covariate dimensions. An empirical application to U.S. stock returns shows that several effects documented under linear specifications lose statistical significance once high-dimensional nonlinear confounding and the presence of IFE are jointly accounted for.

Suggested Citation

  • Binzhi Chen & Annalivia Polselli & Paul S. Clarke, 2026. "Double Machine Learning with High-dimensional Interactive Fixed Effects," Papers 2608.01137, arXiv.org.
  • Handle: RePEc:arx:papers:2608.01137
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2608.01137
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bertoli, Simone & Fernández-Huertas Moraga, Jesús, 2013. "Multilateral resistance to migration," Journal of Development Economics, Elsevier, vol. 102(C), pages 79-100.
    2. Achim Ahrens & Victor Chernozhukov & Christian Hansen & Damian Kozbur & Mark Schaffer & Thomas Wiemann, 2025. "An Introduction to Double/Debiased Machine Learning," Papers 2504.08324, arXiv.org, revised Feb 2026.
    3. Annalivia Polselli, 2025. "xtdml: Double Machine Learning Estimation to Static Panel Data Models with Fixed Effects in R," Papers 2512.15965, arXiv.org.
    4. Max H. Farrell & Tengyuan Liang & Sanjog Misra, 2021. "Deep Neural Networks for Estimation and Inference," Econometrica, Econometric Society, vol. 89(1), pages 181-213, January.
    5. Jan Ditzen & Yiannis Karavias, 2025. "Interactive, Grouped and Non-separable Fixed Effects: A Practitioner's Guide to the New Panel Data Econometrics," Papers 2507.19099, arXiv.org, revised Oct 2025.
    6. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    7. Maximilian Rücker & Michael Vogt & Oliver Linton & Christopher Walsh, 2025. "Estimation and inference in high‐dimensional panel data models with interactive fixed effects," Quantitative Economics, Econometric Society, vol. 16(4), pages 1457-1509, November.
    8. Moon, Hyungsik Roger & Weidner, Martin, 2017. "Dynamic Linear Panel Regression Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 33(1), pages 158-195, February.
    9. Anna Baiardi & Paul S. Clarke & Andrea A. Naghi & Annalivia Polselli, 2026. "Double Machine Learning for Static Panel Data with Instrumental Variables: New Method and Applications," Papers 2603.20464, arXiv.org.
    10. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    11. Bolat, C. Kaan & Soytas, Ugur & Akinoglu, Bulent & Nazlioglu, Saban, 2023. "Is there a macroeconomic carbon rebound effect in EU ETS?," Energy Economics, Elsevier, vol. 125(C).
    12. Amihud, Yakov & Mendelson, Haim, 1986. "Asset pricing and the bid-ask spread," Journal of Financial Economics, Elsevier, vol. 17(2), pages 223-249, December.
    13. Philipp Bach & Oliver Schacht & Victor Chernozhukov & Sven Klaassen & Martin Spindler, 2024. "Hyperparameter Tuning for Causal Inference with Double Machine Learning: A Simulation Study," Papers 2402.04674, arXiv.org.
    14. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    15. Stephen A. Ross, 2013. "The Arbitrage Theory of Capital Asset Pricing," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 1, pages 11-30, World Scientific Publishing Co. Pte. Ltd..
    16. Callaway, Brantly & Karami, Sonia, 2023. "Treatment effects in interactive fixed effects models with a small number of time periods," Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
    17. Vira Semenova & Matt Goldman & Victor Chernozhukov & Matt Taddy, 2023. "Inference on heterogeneous treatment effects in high‐dimensional dynamic panels under weak dependence," Quantitative Economics, Econometric Society, vol. 14(2), pages 471-510, May.
    18. Tomohiro Ando & Jushan Bai, 2016. "Panel Data Models with Grouped Factor Structure Under Unknown Group Membership," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(1), pages 163-191, January.
    19. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    20. Tomohiro Ando & Jushan Bai, 2017. "Clustering Huge Number of Financial Time Series: A Panel Data Approach With High-Dimensional Predictors and Factor Structures," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1182-1198, July.
    21. Degui Li & Junhui Qian & Liangjun Su, 2016. "Panel Data Models With Interactive Fixed Effects and Multiple Structural Breaks," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1804-1819, October.
    22. Alexander Chudik & M. Hashem Pesaran & Elisa Tosetti, 2011. "Weak and strong cross‐section dependence and estimation of large panels," Econometrics Journal, Royal Economic Society, vol. 14, pages 45-90, February.
    23. Miao, Ke & Li, Kunpeng & Su, Liangjun, 2020. "Panel threshold models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 219(1), pages 137-170.
    24. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    25. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    26. Jan Ditzen & Yiannis Karavias & Joakim Westerlund, 2025. "Multiple Structural Breaks in Interactive Effects Panel Data Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(1), pages 74-88, January.
    27. Brad M. Barber & Terrance Odean, 2008. "All That Glitters: The Effect of Attention and News on the Buying Behavior of Individual and Institutional Investors," The Review of Financial Studies, Society for Financial Studies, vol. 21(2), pages 785-818, April.
    28. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    29. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    30. Gao, Jiti & Liu, Fei & Peng, Bin & Yan, Yayi, 2023. "Binary response models for heterogeneous panel data with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 1654-1679.
    31. Simone Bertoli & J. Fernandes-Huertas Moraga, 2013. "Multilateral resistance to migration," Post-Print halshs-00820169, HAL.
    32. Jeremiah Green & John R. M. Hand & X. Frank Zhang, 2017. "The Characteristics that Provide Independent Information about Average U.S. Monthly Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4389-4436.
    33. Nevo, Aviv, 2001. "Measuring Market Power in the Ready-to-Eat Cereal Industry," Econometrica, Econometric Society, vol. 69(2), pages 307-342, March.
    34. Juodis, Artūras & Karabiyik, Hande & Westerlund, Joakim, 2021. "On the robustness of the pooled CCE estimator," Journal of Econometrics, Elsevier, vol. 220(2), pages 325-348.
    35. Chudik, Alexander & Pesaran, M. Hashem, 2015. "Common correlated effects estimation of heterogeneous dynamic panel data models with weakly exogenous regressors," Journal of Econometrics, Elsevier, vol. 188(2), pages 393-420.
    36. Yiannis Karavias & Paresh Kumar Narayan & Joakim Westerlund, 2023. "Structural Breaks in Interactive Effects Panels and the Stock Market Reaction to COVID-19," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(3), pages 653-666, July.
    37. Rafaty, Ryan & Dolphin, Geoffroy & Pretis, Felix, 2025. "Carbon pricing and the elasticity of CO2 emissions," Energy Economics, Elsevier, vol. 144(C).
    38. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    39. Connor, Gregory & Korajczyk, Robert A., 1986. "Performance measurement with the arbitrage pricing theory : A new framework for analysis," Journal of Financial Economics, Elsevier, vol. 15(3), pages 373-394, March.
    40. Lu, Xun & Su, Liangjun, 2016. "Shrinkage estimation of dynamic panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 190(1), pages 148-175.
    41. Pedro Bordalo & Nicola Gennaioli & Rafael La Porta & Andrei Shleifer, 2024. "Belief Overreaction and Stock Market Puzzles," Journal of Political Economy, University of Chicago Press, vol. 132(5), pages 1450-1484.
    42. Jacob K. Thomas & Huai Zhang, 2002. "Inventory Changes and Future Returns," Review of Accounting Studies, Springer, vol. 7(2), pages 163-187, June.
    43. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:cam:camjip:2429 is not listed on IDEAS
    2. Maximilian Rücker & Michael Vogt & Oliver Linton & Christopher Walsh, 2025. "Estimation and inference in high‐dimensional panel data models with interactive fixed effects," Quantitative Economics, Econometric Society, vol. 16(4), pages 1457-1509, November.
    3. Rücker, M. & Vogt, M. & Linton, O. B., 2026. "High-Dimensional Panel Data Models with Interactive Fixed Effects: Beyond the Linear Case," Cambridge Working Papers in Economics 2665, Faculty of Economics, University of Cambridge.
    4. Maximilian Ruecker & Michael Vogt & Oliver Linton, 2026. "High-Dimensional Panel Data Models with Interactive Fixed Effects: Beyond the Linear Case," Papers 2608.02055, arXiv.org.
    5. Gagliardini, Patrick & Ossola, Elisa & Scaillet, Olivier, 2019. "A diagnostic criterion for approximate factor structure," Journal of Econometrics, Elsevier, vol. 212(2), pages 503-521.
    6. Moon, Hyungsik Roger & Weidner, Martin, 2017. "Dynamic Linear Panel Regression Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 33(1), pages 158-195, February.
    7. Bai, Jushan & Li, Kunpeng, 2021. "Dynamic spatial panel data models with common shocks," Journal of Econometrics, Elsevier, vol. 224(1), pages 134-160.
    8. Cheng, Tingting & Dong, Chaohua & Gao, Jiti & Linton, Oliver, 2024. "GMM estimation for high-dimensional panel data models," Journal of Econometrics, Elsevier, vol. 244(1).
    9. Georg Keilbar & Juan M. Rodriguez-Poo & Alexandra Soberon & Weining Wang, 2022. "A projection based approach for interactive fixed effects panel data models," Papers 2201.11482, arXiv.org, revised Feb 2025.
    10. Ma, Tian & Leong, Wen Jun & Jiang, Fuwei, 2023. "A latent factor model for the Chinese stock market," International Review of Financial Analysis, Elsevier, vol. 87(C).
    11. Ali Mehrabani & Shahnaz Parsaeian, 2026. "Shrinkage Estimation and Identification of Latent Group Structures in Panel Data with Interactive Fixed Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 44(3), pages 928-940, July.
    12. Gagliardini, Patrick & Ossola, Elisa & Scaillet, Olivier, 2020. "Estimation of large dimensional conditional factor models in finance," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 219-282, Elsevier.
    13. Wang,Dieter, 2021. "Natural Capital and Sovereign Bonds," Policy Research Working Paper Series 9606, The World Bank.
    14. Bai, Jushan & Ando, Tomohiro, 2013. "Multifactor asset pricing with a large number of observable risk factors and unobservable common and group-specific factors," MPRA Paper 52785, University Library of Munich, Germany, revised Dec 2013.
    15. Juodis, Artūras & Reese, Simon, 2026. "Five lessons for applied researchers from twenty years of common correlated effects estimation," Journal of Econometrics, Elsevier, vol. 253(C).
    16. Freeman, Hugo & Weidner, Martin, 2023. "Linear panel regressions with two-way unobserved heterogeneity," Journal of Econometrics, Elsevier, vol. 237(1).
    17. Ge, Shuyi & Li, Shaoran & Linton, Oliver, 2023. "News-implied linkages and local dependency in the equity market," Journal of Econometrics, Elsevier, vol. 235(2), pages 779-815.
    18. Uddin, Ajim & Yu, Dantong, 2020. "Latent factor model for asset pricing," Journal of Behavioral and Experimental Finance, Elsevier, vol. 27(C).
    19. Yoshimasa Uematsu & Takashi Yamagata, 2019. "Estimation of Weak Factor Models," ISER Discussion Paper 1053, Institute of Social and Economic Research, The University of Osaka.
    20. Wang, Xia & Jin, Sainan & Li, Yingxing & Qian, Junhui & Su, Liangjun, 2025. "On time-varying panel data models with time-varying interactive fixed effects," Journal of Econometrics, Elsevier, vol. 249(PB).
    21. Lu, Xun & Su, Liangjun & Ba, Yinglong, 2026. "On generalized CCE estimation," Journal of Econometrics, Elsevier, vol. 253(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2608.01137. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.