IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.18550.html

Robust Inference Methods for Latent Group Panel Models under Possible Group Non-Separation

Author

Listed:
  • Oguzhan Akgun
  • Ryo Okui

Abstract

This paper presents robust inference methods for general linear hypotheses in linear panel data models with latent group structure in the coefficients. We employ a selective conditional inference approach, deriving the conditional distribution of coefficient estimates given the group structure estimated from the data. Our procedure provides valid inference under possible violations of group separation, where distributional properties of group-specific coefficients remain unestablished. Furthermore, even when group separation does hold, our method demonstrates superior finite-sample properties compared to traditional asymptotic approaches. This improvement stems from our procedure's ability to account for statistical uncertainty in the estimation of group structure. We demonstrate the effectiveness of our approach through Monte Carlo simulations and apply the methods to two datasets on: (i) the relationship between income and democracy, and (ii) the cyclicality of firm-level R&D investment.

Suggested Citation

  • Oguzhan Akgun & Ryo Okui, 2025. "Robust Inference Methods for Latent Group Panel Models under Possible Group Non-Separation," Papers 2511.18550, arXiv.org.
  • Handle: RePEc:arx:papers:2511.18550
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.18550
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Antonio Raiola & Nazarii Salish, 2025. "Testing for Grouped Patterns in Panel Data Models," Papers 2510.22841, arXiv.org.
    2. Peter C. B. Phillips & Donggyu Sul, 2007. "Transition Modeling and Econometric Convergence Tests," Econometrica, Econometric Society, vol. 75(6), pages 1771-1855, November.
    3. Denis Chetverikov & Elena Manresa, 2022. "Spectral and post-spectral estimators for grouped panel data models," Papers 2212.13324, arXiv.org, revised Dec 2022.
    4. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    5. Xu Cheng & Frank Schorfheide & Peng Shao, 2023. "Clustering for Multi-Dimensional Heterogeneity with an Application to Production Function Estimation," PIER Working Paper Archive 23-016, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    6. Vasilis Sarafidis & Neville Weber, 2015. "A Partially Heterogeneous Framework for Analyzing Panel Data," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(2), pages 274-296, April.
    7. Adil M. Bagirov & Julien Ugon & Hijran G. Mirzayeva, 2015. "Nonsmooth Optimization Algorithm for Solving Clusterwise Linear Regression Problems," Journal of Optimization Theory and Applications, Springer, vol. 164(3), pages 755-780, March.
    8. Jhordano Aguilar Loyo & Tom Boot, 2025. "Grouped Heterogeneity in Linear Panel Data Models with Heterogeneous Error Variances," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 43(1), pages 68-80, January.
    9. Carbonneau, Réal A. & Caporossi, Gilles & Hansen, Pierre, 2011. "Globally optimal clusterwise regression by mixed logical-quadratic programming," European Journal of Operational Research, Elsevier, vol. 212(1), pages 213-222, July.
    10. Andrews, Isaiah & Kitagawa, Toru & McCloskey, Adam, 2021. "Inference after estimation of breaks," Journal of Econometrics, Elsevier, vol. 224(1), pages 39-59.
    11. Ingrassia, Salvatore & Minotti, Simona C. & Punzo, Antonio, 2014. "Model-based clustering via linear cluster-weighted models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 159-182.
    12. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    13. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    14. R?diger Bachmann & Christian Bayer, 2014. "Investment Dispersion and the Business Cycle," American Economic Review, American Economic Association, vol. 104(4), pages 1392-1416, April.
    15. Fabio Canova, 2004. "Testing for Convergence Clubs in Income Per Capita: A Predictive Density Approach," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(1), pages 49-77, February.
    16. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    17. Max Cytrynbaum, 2020. "Blocked Clusterwise Regression," Papers 2001.11130, arXiv.org.
    18. Kira R. Fabrizio & Ulya Tsolmon, 2014. "An Empirical Examination of the Procyclicality of R&D Investment and Innovation," The Review of Economics and Statistics, MIT Press, vol. 96(4), pages 662-675, October.
    19. Andrew J. Patton & Brian M. Weller, 2023. "Testing for Unobserved Heterogeneity via k-means Clustering," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(3), pages 737-751, July.
    20. Tomohiro Ando & Jushan Bai, 2016. "Panel Data Models with Grouped Factor Structure Under Unknown Group Membership," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(1), pages 163-191, January.
    21. Huang, Wenxin & Jin, Sainan & Su, Liangjun, 2020. "Identifying Latent Grouped Patterns In Cointegrated Panels," Econometric Theory, Cambridge University Press, vol. 36(3), pages 410-456, June.
    22. Hashem Pesaran, M. & Yamagata, Takashi, 2008. "Testing slope homogeneity in large panels," Journal of Econometrics, Elsevier, vol. 142(1), pages 50-93, January.
    23. Hans van Ophem & Noud van Giersbergen & Kees Jan van Garderen & Maurice Bun, 2019. "The cyclicality of R&D investment revisited," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(2), pages 315-324, March.
    24. Wuyi Wang & Peter C. B. Phillips & Liangjun Su, 2018. "Homogeneity pursuit in panel data models: Theory and application," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(6), pages 797-815, September.
    25. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2022. "Discretizing Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 90(2), pages 625-643, March.
    26. Zhang, Yingying & Wang, Huixia Judy & Zhu, Zhongyi, 2019. "Quantile-regression-based clustering for panel data," Journal of Econometrics, Elsevier, vol. 213(1), pages 54-67.
    27. Wang, Yiren & Phillips, Peter C.B. & Su, Liangjun, 2024. "Panel data models with time-varying latent group structures," Journal of Econometrics, Elsevier, vol. 240(1).
    28. Xun Lu & Liangjun Su, 2017. "Determining the number of groups in latent panel structures with an application to income and democracy," Quantitative Economics, Econometric Society, vol. 8(3), pages 729-760, November.
    29. Stéphane Bonhomme & Elena Manresa, 2015. "Grouped Patterns of Heterogeneity in Panel Data," Econometrica, Econometric Society, vol. 83(3), pages 1147-1184, May.
    30. Lucy L. Gao & Jacob Bien & Daniela Witten, 2024. "Selective Inference for Hierarchical Clustering," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(545), pages 332-342, January.
    31. Lumsdaine, Robin L. & Okui, Ryo & Wang, Wendun, 2023. "Estimation of panel group structure models with structural breaks in group memberships and coefficients," Journal of Econometrics, Elsevier, vol. 233(1), pages 45-65.
    32. Pesaran, M. Hashem & Smith, Ron, 1995. "Estimating long-run relationships from dynamic heterogeneous panels," Journal of Econometrics, Elsevier, vol. 68(1), pages 79-113, July.
    33. repec:hal:journl:peer-00796743 is not listed on IDEAS
    34. Lu, Xun & Su, Liangjun, 2023. "Uniform inference in linear panel data models with two-dimensional heterogeneity," Journal of Econometrics, Elsevier, vol. 235(2), pages 694-719.
    35. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage estimation of common breaks in panel data models via adaptive group fused Lasso," Journal of Econometrics, Elsevier, vol. 191(1), pages 86-109.
    36. Ando, Tomohiro & Bai, Jushan, 2015. "A simple new test for slope homogeneity in panel data models with interactive effects," Economics Letters, Elsevier, vol. 136(C), pages 112-117.
    37. Isaiah Andrews & Toru Kitagawa & Adam McCloskey, 2024. "Inference on Winners," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(1), pages 305-358.
    38. Lin Chang-Ching & Ng Serena, 2012. "Estimation of Panel Data Models with Parameter Heterogeneity when Group Membership is Unknown," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 42-55, August.
    39. Oguzhan Akgun & Alain Pirotte & Giovanni Urga & Zhenlin Yang, 2025. "Testing Clustered Equal Predictive Ability with Unknown Clusters," Papers 2507.14621, arXiv.org, revised Jul 2025.
    40. Pesaran, M. Hashem & Tosetti, Elisa, 2011. "Large panels with common factors and spatial correlation," Journal of Econometrics, Elsevier, vol. 161(2), pages 182-202, April.
    41. Su, Liangjun & Ju, Gaosheng, 2018. "Identifying latent grouped patterns in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 554-573.
    42. Yu, Lu & Gu, Jiaying & Volgushev, Stanislav, 2024. "Spectral clustering with variance information for group structure estimation in panel data," Journal of Econometrics, Elsevier, vol. 241(1).
    43. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    44. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    45. Réal Carbonneau & Gilles Caporossi & Pierre Hansen, 2014. "Globally Optimal Clusterwise Regression By Column Generation Enhanced with Heuristics, Sequencing and Ending Subset Optimization," Journal of Classification, Springer;The Classification Society, vol. 31(2), pages 219-241, July.
    46. Young Woong Park & Yan Jiang & Diego Klabjan & Loren Williams, 2017. "Algorithms for Generalized Clusterwise Linear Regression," INFORMS Journal on Computing, INFORMS, vol. 29(2), pages 301-317, May.
    47. Liangjun Su & Xia Wang & Sainan Jin, 2019. "Sieve Estimation of Time-Varying Panel Data Models With Latent Structures," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 334-349, April.
    48. Liangjun Su & Zhentao Shi & Peter C. B. Phillips, 2016. "Identifying Latent Structures in Panel Data," Econometrica, Econometric Society, vol. 84, pages 2215-2264, November.
    49. John C. Driscoll & Aart C. Kraay, 1998. "Consistent Covariance Matrix Estimation With Spatially Dependent Panel Data," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 549-560, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yiren & Phillips, Peter C.B. & Su, Liangjun, 2024. "Panel data models with time-varying latent group structures," Journal of Econometrics, Elsevier, vol. 240(1).
    2. Pionati, Alessandro, 2025. "Latent grouped structures in panel data: a review," MPRA Paper 123954, University Library of Munich, Germany.
    3. Ali Mehrabani & Shahnaz Parsaeian, 2025. "Shrinkage Estimation and Identification of Latent Group Structures in Panel Data with Interactive Fixed Effects," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202516, University of Kansas, Department of Economics.
    4. Paul Haimerl & Stephan Smeekes & Ines Wilms, 2025. "Estimation of Latent Group Structures in Time-Varying Panel Data Models," Papers 2503.23165, arXiv.org, revised Nov 2025.
    5. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    6. Yi Li & Xingxing Luo & Mengqi Liao, 2025. "Incorporating Prior Information in Latent Structures Identification for Panel Data Models," Mathematics, MDPI, vol. 13(9), pages 1-26, May.
    7. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    8. Mehrabani, Ali, 2023. "Estimation and identification of latent group structures in panel data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1464-1482.
    9. Hasraddin Guliyev, 2025. "Using Machine Learning Techniques to Test the Load Capacity Curve Hypothesis: A Classifier-Lasso Application on Global Panel Data," Biophysical Economics and Resource Quality, Springer, vol. 10(1), pages 1-18, June.
    10. Boyuan Zhang, 2022. "Incorporating Prior Knowledge of Latent Group Structure in Panel Data Models," Papers 2211.16714, arXiv.org, revised Oct 2023.
    11. Langevin, R.;, 2024. "Consistent Estimation of Finite Mixtures: An Application to Latent Group Panel Structures," Health, Econometrics and Data Group (HEDG) Working Papers 24/16, HEDG, c/o Department of Economics, University of York.
    12. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    13. Miao, Ke & Su, Liangjun & Wang, Wendun, 2020. "Panel threshold regressions with latent group structures," Journal of Econometrics, Elsevier, vol. 214(2), pages 451-481.
    14. Ando, Tomohiro & Bai, Jushan, 2021. "Large-scale generalized linear longitudinal data models with grouped patterns of unobserved heterogeneity," MPRA Paper 111431, University Library of Munich, Germany.
    15. Zhonghui Zhang & Chihwa Kao & Jungbin Hwang, 2025. "High-Dimensional Weighted K-Means with Serial Dependence," Working papers 2025-09, University of Connecticut, Department of Economics.
    16. Yu, Lu & Gu, Jiaying & Volgushev, Stanislav, 2024. "Spectral clustering with variance information for group structure estimation in panel data," Journal of Econometrics, Elsevier, vol. 241(1).
    17. Bian, Yulin & Su, Liangjun, 2025. "A note on factor models with latent group structures," Economics Letters, Elsevier, vol. 252(C).
    18. Mikihito Nishi, 2025. "K-Means Panel Data Clustering in the Presence of Small Groups," Papers 2508.15408, arXiv.org.
    19. Leng, Xuan & Chen, Heng & Wang, Wendun, 2023. "Multi-dimensional latent group structures with heterogeneous distributions," Journal of Econometrics, Elsevier, vol. 233(1), pages 1-21.
    20. Huang, Wenxin & Jin, Sainan & Phillips, Peter C.B. & Su, Liangjun, 2021. "Nonstationary panel models with latent group structures and cross-section dependence," Journal of Econometrics, Elsevier, vol. 221(1), pages 198-222.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.18550. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.