IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1810.10987.html

Nuclear Norm Regularized Estimation of Panel Regression Models

Author

Listed:
  • Hyungsik Roger Moon
  • Martin Weidner

Abstract

In this paper we investigate panel regression models with interactive fixed effects. We propose two new estimation methods that are based on minimizing convex objective functions. The first method minimizes the sum of squared residuals with a nuclear (trace) norm regularization. The second method minimizes the nuclear norm of the residuals. We establish the consistency of the two resulting estimators. Those estimators have a very important computational advantage compared to the existing least squares (LS) estimator, in that they are defined as minimizers of a convex objective function. In addition, the nuclear norm penalization helps to resolve a potential identification problem for interactive fixed effect models, in particular when the regressors are low-rank and the number of the factors is unknown. We also show how to construct estimators that are asymptotically equivalent to the least squares (LS) estimator in Bai (2009) and Moon and Weidner (2017) by using our nuclear norm regularized or minimized estimators as initial values for a finite number of LS minimizing iteration steps. This iteration avoids any non-convex minimization, while the original LS estimation problem is generally non-convex, and can have multiple local minima.

Suggested Citation

  • Hyungsik Roger Moon & Martin Weidner, 2018. "Nuclear Norm Regularized Estimation of Panel Regression Models," Papers 1810.10987, arXiv.org, revised Feb 2026.
  • Handle: RePEc:arx:papers:1810.10987
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/1810.10987
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Martin Mugnier, 2022. "A Simple and Computationally Trivial Estimator for Grouped Fixed Effects Models," Papers 2203.08879, arXiv.org, revised Apr 2025.
    2. Hong, Shengjie & Su, Liangjun & Jiang, Tao, 2023. "Profile GMM estimation of panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 927-948.
    3. Denis Chetverikov & Elena Manresa, 2022. "Spectral and post-spectral estimators for grouped panel data models," Papers 2212.13324, arXiv.org, revised Dec 2022.
    4. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    5. Ahn, Seung C. & Lee, Young H. & Schmidt, Peter, 2013. "Panel data models with multiple time-varying individual effects," Journal of Econometrics, Elsevier, vol. 174(1), pages 1-14.
    6. Victor Chernozhukov & Christian Hansen & Yuan Liao & Yinchu Zhu, 2021. "Inference for Low-Rank Models," Papers 2107.02602, arXiv.org, revised Jan 2023.
    7. Hugo Freeman & Martin Weidner, 2021. "Low-rank approximations of nonseparable panel models," The Econometrics Journal, Royal Economic Society, vol. 24(2), pages 40-77.
    8. David Powell, 2022. "Synthetic Control Estimation Beyond Comparative Case Studies: Does the Minimum Wage Reduce Employment?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1302-1314, June.
    9. Piracha, Matloob & Tani, Massimiliano & Tchuente, Guy, 2017. "Immigration Policy and Remittance Behaviour," GLO Discussion Paper Series 94, Global Labor Organization (GLO).
    10. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    11. Gary Chamberlain & Marcelo J. Moreira, 2009. "Decision Theory Applied to a Linear Panel Data Model," Econometrica, Econometric Society, vol. 77(1), pages 107-133, January.
    12. Degui Li & Junhui Qian & Liangjun Su, 2016. "Panel Data Models With Interactive Fixed Effects and Multiple Structural Breaks," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1804-1819, October.
    13. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    14. Bai, Jushan & Ng, Serena, 2019. "Rank regularized estimation of approximate factor models," Journal of Econometrics, Elsevier, vol. 212(1), pages 78-96.
    15. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    16. Mugnier, Martin, 2025. "A simple and computationally trivial estimator for grouped fixed effects models," Journal of Econometrics, Elsevier, vol. 250(C).
    17. Holtz-Eakin, Douglas & Newey, Whitney & Rosen, Harvey S, 1988. "Estimating Vector Autoregressions with Panel Data," Econometrica, Econometric Society, vol. 56(6), pages 1371-1395, November.
    18. repec:cam:camjip:2218 is not listed on IDEAS
    19. Gobillon, Laurent & Wolff, François-Charles, 2020. "The local effects of an innovation: Evidence from the French fish market," Ecological Economics, Elsevier, vol. 171(C).
    20. Liangjun Su & Yonghui Zhang, 2016. "Semiparametric Estimation of Partially Linear Dynamic Panel Data Models with Fixed Effects," Advances in Econometrics, in: Essays in Honor of Aman Ullah, volume 36, pages 137-204, Emerald Group Publishing Limited.
    21. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    22. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    23. Jiti Gao & Bin Peng & Yayi Yan, 2024. "Robust Inference for High Dimensional Panel Data Models," Monash Econometrics and Business Statistics Working Papers 9/24, Monash University, Department of Econometrics and Business Statistics.
    24. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    25. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    26. Jad Beyhum & Eric Gautier, 2022. "Factor and Factor Loading Augmented Estimators for Panel Regression With Possibly Nonstrong Factors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(1), pages 270-281, December.
    27. Lu, Xun & Su, Liangjun, 2016. "Shrinkage estimation of dynamic panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 190(1), pages 148-175.
    28. Liangjun Su & Zhentao Shi & Peter C. B. Phillips, 2016. "Identifying Latent Structures in Panel Data," Econometrica, Econometric Society, vol. 84, pages 2215-2264, November.
    29. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    30. Vogt, M. & Walsh, C. & Linton, O., 2022. "CCE Estimation of High-Dimensional Panel Data Models with Interactive Fixed Effects," Cambridge Working Papers in Economics 2242, Faculty of Economics, University of Cambridge.
    31. Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
    32. Hyungsik Roger Moon & Martin Weidner, 2015. "Linear Regression for Panel With Unknown Number of Factors as Interactive Fixed Effects," Econometrica, Econometric Society, vol. 83(4), pages 1543-1579, July.
    33. Moon, Hyungsik Roger & Weidner, Martin, 2017. "Dynamic Linear Panel Regression Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 33(1), pages 158-195, February.
    34. Yimin Yang & Fei Jia & Haoran Li, 2023. "Estimation of Panel Data Models with Mixed Sampling Frequencies," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 514-544, June.
    35. Ahn, Seung Chan & Hoon Lee, Young & Schmidt, Peter, 2001. "GMM estimation of linear panel data models with time-varying individual effects," Journal of Econometrics, Elsevier, vol. 101(2), pages 219-255, April.
    36. Martin Mugnier, 2025. "A simple and computationally trivial estimator for grouped fixed effects models," Post-Print halshs-05163274, HAL.
    37. Xu Cheng & Zhipeng Liao & Frank Schorfheide, 2016. "Shrinkage Estimation of High-Dimensional Factor Models with Structural Instabilities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1511-1543.
    38. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    39. Feng, Junlong, 2024. "Nuclear Norm Regularized Quantile Regression With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 40(6), pages 1391-1421, December.
    40. Onatski, Alexei, 2012. "Asymptotics of the principal components estimator of large factor models with weakly influential factors," Journal of Econometrics, Elsevier, vol. 168(2), pages 244-258.
    41. Franguridi, Grigory & Moon, Hyungsik Roger, 2022. "A Uniform Bound On The Operator Norm Of Sub-Gaussian Random Matrices And Its Applications," Econometric Theory, Cambridge University Press, vol. 38(6), pages 1073-1091, December.
    42. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    43. Miao, Ke & Li, Kunpeng & Su, Liangjun, 2020. "Panel threshold models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 219(1), pages 137-170.
    44. Beyhum, Jad & Gautier, Eric, 2019. "Square-root nuclear norm penalized estimator for panel data models with approximately low-rank unobserved Heterogeneity," TSE Working Papers 19-1008, Toulouse School of Economics (TSE).
    45. Chen, Mingli, "undated". "Estimation of Nonlinear Panel Models with Multiple Unobserved Effects," Economic Research Papers 269326, University of Warwick - Department of Economics.
    46. Miao, Ke & Phillips, Peter C.B. & Su, Liangjun, 2023. "High-dimensional VARs with common factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 155-183.
    47. Xiaohong Chen & Demian Pouzo, 2012. "Estimation of Nonparametric Conditional Moment Models With Possibly Nonsmooth Generalized Residuals," Econometrica, Econometric Society, vol. 80(1), pages 277-321, January.
    48. Chen, Mingli & Fernández-Val, Iván & Weidner, Martin, 2021. "Nonlinear factor models for network and panel data," Journal of Econometrics, Elsevier, vol. 220(2), pages 296-324.
    49. Chan, Mark K. & Kwok, Simon, 2016. "Policy Evaluation with Interactive Fixed Effects," Working Papers 2016-11, University of Sydney, School of Economics.
    50. Lee, Nayoung & Moon, Hyungsik Roger & Zhou, Qiankun, 2017. "Many IVs estimation of dynamic panel regression models with measurement error," Journal of Econometrics, Elsevier, vol. 200(2), pages 251-259.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ando, Tomohiro & Bai, Jushan & Lu, Lina & Vojtech, Cindy M., 2024. "Scenario-based quantile connectedness of the U.S. interbank liquidity risk network," Journal of Econometrics, Elsevier, vol. 244(2).
    2. Jörg Breitung & Philipp Hansen, 2021. "Correction to: Alternative estimation approaches for the factor augmented panel data model with small T," Empirical Economics, Springer, vol. 61(6), pages 3557-3558, December.
    3. Andreas Dzemski & Ryo Okui, 2024. "Confidence set for group membership," Quantitative Economics, Econometric Society, vol. 15(2), pages 245-277, May.
    4. Maximilian Rücker & Michael Vogt & Oliver Linton & Christopher Walsh, 2025. "Estimation and inference in high‐dimensional panel data models with interactive fixed effects," Quantitative Economics, Econometric Society, vol. 16(4), pages 1457-1509, November.
    5. Martin Mugnier, 2022. "Make the Difference! computationally Trivial Estimators for Grouped Fixed Effects Models," Working Papers 2022-07, Center for Research in Economics and Statistics.
    6. Norkutė, Milda & Sarafidis, Vasilis & Yamagata, Takashi & Cui, Guowei, 2021. "Instrumental variable estimation of dynamic linear panel data models with defactored regressors and a multifactor error structure," Journal of Econometrics, Elsevier, vol. 220(2), pages 416-446.
    7. Haoyuan Xu & Wei Miao & Geert Dhaene & Jad Beyhum, 2026. "Bootstrap Inference in Nonlinear Panel Data Models with Interactive Fixed Effects," Papers 2604.26826, arXiv.org.
    8. Nicholas L. Brown & Kyle Butts & Joakim Westerlund, 2026. "Direct and Indirect Treatment Effects With Time‐Varying Covariates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 41(5), pages 567-579, August.
    9. Alexandre Belloni & Mingli Chen & Oscar Hernan Madrid Padilla & Zixuan & Wang, 2019. "High Dimensional Latent Panel Quantile Regression with an Application to Asset Pricing," Papers 1912.02151, arXiv.org, revised Aug 2022.
    10. Miao, Ke & Phillips, Peter C.B. & Su, Liangjun, 2023. "High-dimensional VARs with common factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 155-183.
    11. Denis Chetverikov & Elena Manresa, 2022. "Spectral and post-spectral estimators for grouped panel data models," Papers 2212.13324, arXiv.org, revised Dec 2022.
    12. Luca Margaritella & Joakim Westerlund, 2023. "Using information criteria to select averages in CCE," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 405-421.
    13. repec:cam:camjip:2218 is not listed on IDEAS
    14. Juan M. Rodriguez-Poo & Alexandra Soberon & Stefan Sperlich, 2025. "Inference on panel data models with a generalized factor structure," Papers 2506.10690, arXiv.org.
    15. Junlong Feng, 2019. "Regularized Quantile Regression with Interactive Fixed Effects," Papers 1911.00166, arXiv.org, revised Mar 2021.
    16. Pigini, Claudia & Pionati, Alessandro & Valentini, Francesco, 2023. "Specification testing with grouped fixed effects," MPRA Paper 117821, University Library of Munich, Germany.
    17. Hong, Shengjie & Su, Liangjun & Jiang, Tao, 2023. "Profile GMM estimation of panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 927-948.
    18. repec:cam:camjip:2429 is not listed on IDEAS
    19. Mugnier, Martin, 2025. "A simple and computationally trivial estimator for grouped fixed effects models," Journal of Econometrics, Elsevier, vol. 250(C).
    20. Martin Mugnier, 2022. "A Simple and Computationally Trivial Estimator for Grouped Fixed Effects Models," Papers 2203.08879, arXiv.org, revised Apr 2025.
    21. Vogt, M. & Walsh, C. & Linton, O., 2022. "CCE Estimation of High-Dimensional Panel Data Models with Interactive Fixed Effects," Cambridge Working Papers in Economics 2242, Faculty of Economics, University of Cambridge.
    22. Gobillon, Laurent & Magnac, Thierry & Roux, Sébastien, 2022. "Lifecycle Wages and Human Capital Investments: Selection and Missing Data," TSE Working Papers 22-1299, Toulouse School of Economics (TSE).
    23. Pionati, Alessandro, 2025. "Latent grouped structures in panel data: a review," MPRA Paper 123954, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Timothy B. Armstrong & Martin Weidner & Andrei Zeleneev, 2022. "Robust Estimation and Inference in Panels with Interactive Fixed Effects," Papers 2210.06639, arXiv.org, revised May 2025.
    2. Freeman, Hugo & Weidner, Martin, 2023. "Linear panel regressions with two-way unobserved heterogeneity," Journal of Econometrics, Elsevier, vol. 237(1).
    3. Su, Liangjun & Wang, Fa & Wang, Yiren, 2026. "Estimation and inference for unbalanced panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 255(C).
    4. Hong, Shengjie & Su, Liangjun & Jiang, Tao, 2023. "Profile GMM estimation of panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 927-948.
    5. Hou, Lei & Li, Kunpeng & Li, Qi & Ouyang, Min, 2021. "Revisiting the location of FDI in China: A panel data approach with heterogeneous shocks," Journal of Econometrics, Elsevier, vol. 221(2), pages 483-509.
    6. Andrei Zeleneev & Weisheng Zhang, 2025. "Tractable Estimation of Nonlinear Panels with Interactive Fixed Effects," Papers 2511.15427, arXiv.org, revised Jun 2026.
    7. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    8. Su, Liangjun & Jin, Sainan & Wang, Xia, 2025. "Sieve estimation of state-varying factor models," Journal of Econometrics, Elsevier, vol. 251(C).
    9. Cheng, Tingting & Dong, Chaohua & Gao, Jiti & Linton, Oliver, 2024. "GMM estimation for high-dimensional panel data models," Journal of Econometrics, Elsevier, vol. 244(1).
    10. Ayden Higgins & Federico Martellosio, 2019. "Shrinkage Estimation of Network Spillovers with Factor Structured Errors," Papers 1909.02823, arXiv.org, revised Nov 2021.
    11. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    12. Haoyuan Xu & Wei Miao & Geert Dhaene & Jad Beyhum, 2026. "Bootstrap Inference in Nonlinear Panel Data Models with Interactive Fixed Effects," Papers 2604.26826, arXiv.org.
    13. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    14. Wang, Xia & Jin, Sainan & Li, Yingxing & Qian, Junhui & Su, Liangjun, 2025. "On time-varying panel data models with time-varying interactive fixed effects," Journal of Econometrics, Elsevier, vol. 249(PB).
    15. Li, Kunpeng & Cui, Guowei & Lu, Lina, 2020. "Efficient estimation of heterogeneous coefficients in panel data models with common shocks," Journal of Econometrics, Elsevier, vol. 216(2), pages 327-353.
    16. Shi, Wei & Lee, Lung-fei, 2018. "A spatial panel data model with time varying endogenous weights matrices and common factors," Regional Science and Urban Economics, Elsevier, vol. 72(C), pages 6-34.
    17. Hyungsik Roger Moon & Martin Weidner, 2015. "Linear Regression for Panel With Unknown Number of Factors as Interactive Fixed Effects," Econometrica, Econometric Society, vol. 83(4), pages 1543-1579, July.
    18. Ye, Xiaoqing & Xu, Juan & Wu, Xiangjun, 2018. "Estimation of an unbalanced panel data Tobit model with interactive effects," Journal of choice modelling, Elsevier, vol. 28(C), pages 108-123.
    19. Georg Keilbar & Juan M. Rodriguez-Poo & Alexandra Soberon & Weining Wang, 2022. "A projection based approach for interactive fixed effects panel data models," Papers 2201.11482, arXiv.org, revised Feb 2025.
    20. Wei Shi & Lung-fei Lee, 2018. "The effects of gun control on crimes: a spatial interactive fixed effects approach," Empirical Economics, Springer, vol. 55(1), pages 233-263, August.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1810.10987. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.