IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2503.23165.html
   My bibliography  Save this paper

Estimation of Latent Group Structures in Time-Varying Panel Data Models

Author

Listed:
  • Paul Haimerl
  • Stephan Smeekes
  • Ines Wilms

Abstract

We introduce a panel data model where coefficients vary both over time and the cross-section. Slope coefficients change smoothly over time and follow a latent group structure, being homogeneous within but heterogeneous across groups. The group structure is identified using a pairwise adaptive group fused-Lasso penalty. The trajectories of time-varying coefficients are estimated via polynomial spline functions. We derive the asymptotic distributions of the penalized and post-selection estimators and show their oracle efficiency. A simulation study demonstrates excellent finite sample properties. An application to the emission intensity of GDP highlights the relevance of addressing cross-sectional heterogeneity and time-variance in empirical settings.

Suggested Citation

  • Paul Haimerl & Stephan Smeekes & Ines Wilms, 2025. "Estimation of Latent Group Structures in Time-Varying Panel Data Models," Papers 2503.23165, arXiv.org.
  • Handle: RePEc:arx:papers:2503.23165
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2503.23165
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Perron, Pierre & Wada, Tatsuma, 2009. "Let's take a break: Trends and cycles in US real GDP," Journal of Monetary Economics, Elsevier, vol. 56(6), pages 749-765, September.
    2. Cashin, Paul & Mohaddes, Kamiar & Raissi, Maziar & Raissi, Mehdi, 2014. "The differential effects of oil demand and supply shocks on the global economy," Energy Economics, Elsevier, vol. 44(C), pages 113-134.
    3. Jakob, Michael & Haller, Markus & Marschinski, Robert, 2012. "Will history repeat itself? Economic convergence and convergence in energy use patterns," Energy Economics, Elsevier, vol. 34(1), pages 95-104.
    4. Liangjun Su & Zhentao Shi & Peter C. B. Phillips, 2016. "Identifying Latent Structures in Panel Data," Econometrica, Econometric Society, vol. 84, pages 2215-2264, November.
    5. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage Estimation Of Regression Models With Multiple Structural Changes," Econometric Theory, Cambridge University Press, vol. 32(6), pages 1376-1433, December.
    6. Denis Chetverikov & Elena Manresa, 2022. "Spectral and post-spectral estimators for grouped panel data models," Papers 2212.13324, arXiv.org, revised Dec 2022.
    7. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    8. Freyaldenhoven, Simon, 2022. "Factor models with local factors — Determining the number of relevant factors," Journal of Econometrics, Elsevier, vol. 229(1), pages 80-102.
    9. Vasilis Sarafidis & Neville Weber, 2015. "A Partially Heterogeneous Framework for Analyzing Panel Data," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(2), pages 274-296, April.
    10. Diebold, Francis X. & Li, Canlin & Yue, Vivian Z., 2008. "Global yield curve dynamics and interactions: A dynamic Nelson-Siegel approach," Journal of Econometrics, Elsevier, vol. 146(2), pages 351-363, October.
    11. Azomahou, Theophile & Laisney, Francois & Nguyen Van, Phu, 2006. "Economic development and CO2 emissions: A nonparametric panel approach," Journal of Public Economics, Elsevier, vol. 90(6-7), pages 1347-1363, August.
    12. Chang, Yoosoon & Kaufmann, Robert K. & Kim, Chang Sik & Miller, J. Isaac & Park, Joon Y. & Park, Sungkeun, 2020. "Evaluating trends in time series of distributions: A spatial fingerprint of human effects on climate," Journal of Econometrics, Elsevier, vol. 214(1), pages 274-294.
    13. Bennedsen, Mikkel & Hillebrand, Eric & Jensen, Sebastian, 2023. "A neural network approach to the environmental Kuznets curve," Energy Economics, Elsevier, vol. 126(C).
    14. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    15. Stéphane Bonhomme & Elena Manresa, 2015. "Grouped Patterns of Heterogeneity in Panel Data," Econometrica, Econometric Society, vol. 83(3), pages 1147-1184, May.
    16. Tomohiro Ando & Jushan Bai, 2016. "Panel Data Models with Grouped Factor Structure Under Unknown Group Membership," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(1), pages 163-191, January.
    17. Baltagi, Badi H. & Feng, Qu & Kao, Chihwa, 2016. "Estimation of heterogeneous panels with structural breaks," Journal of Econometrics, Elsevier, vol. 191(1), pages 176-195.
    18. Phillips, Peter C.B. & Sul, Donggyu, 2007. "Bias in dynamic panel estimation with fixed effects, incidental trends and cross section dependence," Journal of Econometrics, Elsevier, vol. 137(1), pages 162-188, March.
    19. Wuyi Wang & Peter C. B. Phillips & Liangjun Su, 2018. "Homogeneity pursuit in panel data models: Theory and application," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(6), pages 797-815, September.
    20. Lee, Kevin & Pesaran, M Hashem & Smith, Ron, 1997. "Growth and Convergence in Multi-country Empirical Stochastic Solow Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 12(4), pages 357-392, July-Aug..
    21. Van Than Dung & Tegoeh Tjahjowidodo, 2017. "A direct method to solve optimal knots of B-spline curves: An application for non-uniform B-spline curves fitting," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-24, March.
    22. Leeb, Hannes & Potscher, Benedikt M., 2008. "Sparse estimators and the oracle property, or the return of Hodges' estimator," Journal of Econometrics, Elsevier, vol. 142(1), pages 201-211, January.
    23. Su, Liangjun & Jin, Sainan, 2012. "Sieve estimation of panel data models with cross section dependence," Journal of Econometrics, Elsevier, vol. 169(1), pages 34-47.
    24. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage estimation of common breaks in panel data models via adaptive group fused Lasso," Journal of Econometrics, Elsevier, vol. 191(1), pages 86-109.
    25. Harvey, A C, 1985. "Trends and Cycles in Macroeconomic Time Series," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 216-227, June.
    26. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    27. Andreas Dzemski & Ryo Okui, 2024. "Confidence set for group membership," Quantitative Economics, Econometric Society, vol. 15(2), pages 245-277, May.
    28. Liu, Ruiqi & Shang, Zuofeng & Zhang, Yonghui & Zhou, Qiankun, 2020. "Identification and estimation in panel models with overspecified number of groups," Journal of Econometrics, Elsevier, vol. 215(2), pages 574-590.
    29. Mehrabani, Ali, 2023. "Estimation and identification of latent group structures in panel data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1464-1482.
    30. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    31. Miao, Ke & Phillips, Peter C.B. & Su, Liangjun, 2023. "High-dimensional VARs with common factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 155-183.
    32. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    33. Jia Chen, 2019. "Estimating latent group structure in time-varying coefficient panel data models," The Econometrics Journal, Royal Economic Society, vol. 22(3), pages 223-240.
    34. Gene M. Grossman & Alan B. Krueger, 1995. "Economic Growth and the Environment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(2), pages 353-377.
    35. Adamek, Robert & Smeekes, Stephan & Wilms, Ines, 2023. "Lasso inference for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 235(2), pages 1114-1143.
    36. Cai, Zongwu, 2007. "Trending time-varying coefficient time series models with serially correlated errors," Journal of Econometrics, Elsevier, vol. 136(1), pages 163-188, January.
    37. M. Ayhan Kose & Christopher Otrok & Charles H. Whiteman, 2003. "International Business Cycles: World, Region, and Country-Specific Factors," American Economic Review, American Economic Association, vol. 93(4), pages 1216-1239, September.
    38. Michael Vogt & Oliver Linton, 2017. "Classification of non-parametric regression functions in longitudinal data models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 5-27, January.
    39. Jinyong Hahn & Guido Kuersteiner, 2002. "Asymptotically Unbiased Inference for a Dynamic Panel Model with Fixed Effects when Both "n" and "T" Are Large," Econometrica, Econometric Society, vol. 70(4), pages 1639-1657, July.
    40. Antonio F. Galvao & Kengo Kato, 2014. "Estimation and Inference for Linear Panel Data Models Under Misspecification When Both n and T are Large," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(2), pages 285-309, April.
    41. Friedrich, Marina & Lin, Yicong, 2024. "Sieve bootstrap inference for linear time-varying coefficient models," Journal of Econometrics, Elsevier, vol. 239(1).
    42. Victor Chernozhukov & Christian Hansen & Yuan Liao & Yinchu Zhu, 2019. "Inference for heterogeneous effects using low-rank estimations," CeMMAP working papers CWP31/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    43. Churchill, Sefa Awaworyi & Inekwe, John & Ivanovski, Kris & Smyth, Russell, 2018. "The Environmental Kuznets Curve in the OECD: 1870–2014," Energy Economics, Elsevier, vol. 75(C), pages 389-399.
    44. Hahn, Jinyong & Kuersteiner, Guido, 2011. "Bias Reduction For Dynamic Nonlinear Panel Models With Fixed Effects," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1152-1191, December.
    45. Lumsdaine, Robin L. & Okui, Ryo & Wang, Wendun, 2023. "Estimation of panel group structure models with structural breaks in group memberships and coefficients," Journal of Econometrics, Elsevier, vol. 233(1), pages 45-65.
    46. Bella, Giovanni & Massidda, Carla & Mattana, Paolo, 2014. "The relationship among CO2 emissions, electricity power consumption and GDP in OECD countries," Journal of Policy Modeling, Elsevier, vol. 36(6), pages 970-985.
    47. Marina Friedrich & Eric Beutner & Hanno Reuvers & Stephan Smeekes & Jean-Pierre Urbain & Whitney Bader & Bruno Franco & Bernard Lejeune & Emmanuel Mahieu, 2020. "A statistical analysis of time trends in atmospheric ethane," Climatic Change, Springer, vol. 162(1), pages 105-125, September.
    48. Martin Wagner, 2015. "The Environmental Kuznets Curve, Cointegration and Nonlinearity," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(6), pages 948-967, September.
    49. Bai, Jushan, 2010. "Common breaks in means and variances for panel data," Journal of Econometrics, Elsevier, vol. 157(1), pages 78-92, July.
    50. Lin Chang-Ching & Ng Serena, 2012. "Estimation of Panel Data Models with Parameter Heterogeneity when Group Membership is Unknown," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 42-55, August.
    51. Robinson, Peter M., 2012. "Nonparametric trending regression with cross-sectional dependence," Journal of Econometrics, Elsevier, vol. 169(1), pages 4-14.
    52. Kiviet, Jan F., 1995. "On bias, inconsistency, and efficiency of various estimators in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 68(1), pages 53-78, July.
    53. Wendun Wang & Xinyu Zhang & Richard Paap, 2019. "To pool or not to pool: What is a good strategy for parameter estimation and forecasting in panel regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(5), pages 724-745, August.
    54. Shujie Ma & Jian Huang, 2017. "A Concave Pairwise Fusion Approach to Subgroup Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 410-423, January.
    55. Liangjun Su & Xia Wang & Sainan Jin, 2019. "Sieve Estimation of Time-Varying Panel Data Models With Latent Structures," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 334-349, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mehrabani, Ali, 2023. "Estimation and identification of latent group structures in panel data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1464-1482.
    2. Pionati, Alessandro, 2025. "Latent grouped structures in panel data: a review," MPRA Paper 123954, University Library of Munich, Germany.
    3. Wang, Yiren & Phillips, Peter C.B. & Su, Liangjun, 2024. "Panel data models with time-varying latent group structures," Journal of Econometrics, Elsevier, vol. 240(1).
    4. Miao, Ke & Su, Liangjun & Wang, Wendun, 2020. "Panel threshold regressions with latent group structures," Journal of Econometrics, Elsevier, vol. 214(2), pages 451-481.
    5. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    6. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    7. Vasilis Sarafidis & Tom Wansbeek, 2020. "Celebrating 40 Years of Panel Data Analysis: Past, Present and Future," Monash Econometrics and Business Statistics Working Papers 6/20, Monash University, Department of Econometrics and Business Statistics.
    8. Saptorshee Kanto Chakraborty & Massimiliano Mazzanti, 2021. "Revisiting the literature on the dynamic Environmental Kuznets Curves using a latent structure approach," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 923-941, October.
    9. Andreas Dzemski & Ryo Okui, 2024. "Confidence set for group membership," Quantitative Economics, Econometric Society, vol. 15(2), pages 245-277, May.
    10. Lumsdaine, Robin L. & Okui, Ryo & Wang, Wendun, 2023. "Estimation of panel group structure models with structural breaks in group memberships and coefficients," Journal of Econometrics, Elsevier, vol. 233(1), pages 45-65.
    11. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    12. Yanbo Liu & Peter C. B. Phillips & Jun Yu, 2023. "A Panel Clustering Approach To Analyzing Bubble Behavior," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(4), pages 1347-1395, November.
    13. Su, Liangjun & Ju, Gaosheng, 2018. "Identifying latent grouped patterns in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 554-573.
    14. Yi Li & Xingxing Luo & Mengqi Liao, 2025. "Incorporating Prior Information in Latent Structures Identification for Panel Data Models," Mathematics, MDPI, vol. 13(9), pages 1-26, May.
    15. Leng, Xuan & Chen, Heng & Wang, Wendun, 2023. "Multi-dimensional latent group structures with heterogeneous distributions," Journal of Econometrics, Elsevier, vol. 233(1), pages 1-21.
    16. Langevin, R.;, 2024. "Consistent Estimation of Finite Mixtures: An Application to Latent Group Panel Structures," Health, Econometrics and Data Group (HEDG) Working Papers 24/16, HEDG, c/o Department of Economics, University of York.
    17. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    18. Smith, Simon C. & Timmermann, Allan & Zhu, Yinchu, 2019. "Variable selection in panel models with breaks," Journal of Econometrics, Elsevier, vol. 212(1), pages 323-344.
    19. Yu, Lu & Gu, Jiaying & Volgushev, Stanislav, 2024. "Spectral clustering with variance information for group structure estimation in panel data," Journal of Econometrics, Elsevier, vol. 241(1).
    20. Huang, Wenxin & Jin, Sainan & Phillips, Peter C.B. & Su, Liangjun, 2021. "Nonstationary panel models with latent group structures and cross-section dependence," Journal of Econometrics, Elsevier, vol. 221(1), pages 198-222.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2503.23165. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.