IDEAS home Printed from https://ideas.repec.org/p/ris/smuesw/2017_019.html
   My bibliography  Save this paper

Identifying Latent Group Structures in Nonlinear Panels

Author

Listed:
  • Wang, Wuyi

    (School of Economics, Singapore Management University)

  • Su, Liangjun

    (School of Economics, Singapore Management University)

Abstract

We propose a procedure to identify latent group structures in nonlinear panel data models where some regression coefficients are heterogeneous across groups but homogeneous within a group and the group number and membership are unknown. To identify the group structures, we consider the order statistics for the preliminary unconstrained consistent estimators of the regression coefficients and translate the problem of classification into the problem of break detection. Then we extend the sequential binary segmentation algorithm of Bai (1997) for break detection from the time series setup to the panel data framework. We demonstrate that our method is able to identify the true latent group structures with probability approaching one and the post-classification estimators are oracle-efficient. The method has the advantage of more convenient implementation compared with some alternative methods, which is a desirable feature in nonlinear panel applications. To improve the finite sample performance, we also consider an alternative version based on the spectral decomposition of certain estimated matrix and link the group identification issue to the community detection problem in the network literature. Simulations show that our method has good finite sample performance. We apply this method to explore how individuals' portfolio choices respond to their financial status and other characteristics using the Netherlands household panel data from year 1993 to 2015, and find three latent groups.

Suggested Citation

  • Wang, Wuyi & Su, Liangjun, 2017. "Identifying Latent Group Structures in Nonlinear Panels," Economics and Statistics Working Papers 19-2017, Singapore Management University, School of Economics.
  • Handle: RePEc:ris:smuesw:2017_019
    as

    Download full text from publisher

    File URL: http://ink.library.smu.edu.sg/soe_research/2120/
    File Function: Full text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Peter C. B. Phillips & Donggyu Sul, 2007. "Transition Modeling and Econometric Convergence Tests," Econometrica, Econometric Society, vol. 75(6), pages 1771-1855, November.
    2. Fernández-Val, Iván & Weidner, Martin, 2016. "Individual and time effects in nonlinear panel models with large N, T," Journal of Econometrics, Elsevier, vol. 192(1), pages 291-312.
    3. Vasilis Sarafidis & Neville Weber, 2015. "A Partially Heterogeneous Framework for Analyzing Panel Data," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(2), pages 274-296, April.
    4. Geert Dhaene & Koen Jochmans, 2015. "Split-panel Jackknife Estimation of Fixed-effect Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(3), pages 991-1030.
    5. Stéphane Bonhomme & Elena Manresa, 2015. "Grouped Patterns of Heterogeneity in Panel Data," Econometrica, Econometric Society, vol. 83(3), pages 1147-1184, May.
    6. Su, Liangjun & Chen, Qihui, 2013. "Testing Homogeneity In Panel Data Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 29(6), pages 1079-1135, December.
    7. Valery Polkovnichenko, 2007. "Life-Cycle Portfolio Choice with Additive Habit Formation Preferences and Uninsurable Labor Income Risk," Review of Financial Studies, Society for Financial Studies, vol. 20(1), pages 83-124, January.
    8. Shen, Xiaotong & Huang, Hsin-Cheng, 2010. "Grouping Pursuit Through a Regularization Solution Surface," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 727-739.
    9. Wuyi Wang & Peter C. B. Phillips & Liangjun Su, 2018. "Homogeneity pursuit in panel data models: Theory and application," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(6), pages 797-815, September.
    10. Xun Lu & Liangjun Su, 2017. "Determining the number of groups in latent panel structures with an application to income and democracy," Quantitative Economics, Econometric Society, vol. 8(3), pages 729-760, November.
    11. Liangjun Su & Zhentao Shi & Peter C. B. Phillips, 2016. "Identifying Latent Structures in Panel Data," Econometrica, Econometric Society, vol. 84, pages 2215-2264, November.
    12. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871532.
    13. Alan Sule & Honoré Bo E. & Hu Luojia & Leth-Petersen Søren, 2014. "Estimation of Panel Data Regression Models with Two-Sided Censoring or Truncation," Journal of Econometric Methods, De Gruyter, vol. 3(1), pages 1-20, January.
    14. Bester, C. Alan & Hansen, Christian B., 2016. "Grouped effects estimators in fixed effects models," Journal of Econometrics, Elsevier, vol. 190(1), pages 197-208.
    15. Y. Yu & T. Wang & R. J. Samworth, 2015. "A useful variant of the Davis–Kahan theorem for statisticians," Biometrika, Biometrika Trust, vol. 102(2), pages 315-323.
    16. Bai, Jushan, 1997. "Estimating Multiple Breaks One at a Time," Econometric Theory, Cambridge University Press, vol. 13(3), pages 315-352, June.
    17. Subramanian, Arvind & Wei, Shang-Jin, 2007. "The WTO promotes trade, strongly but unevenly," Journal of International Economics, Elsevier, vol. 72(1), pages 151-175, May.
    18. Jason Abrevaya & Shu Shen, 2014. "Estimation Of Censored Panel‐Data Models With Slope Heterogeneity," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 523-548, June.
    19. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692106.
    20. Chen, Mingli, 2016. "Estimation of Nonlinear Panel Models with Multiple Unobserved Effects," The Warwick Economics Research Paper Series (TWERPS) 1120, University of Warwick, Department of Economics.
    21. Tomohiro Ando & Jushan Bai, 2016. "Panel Data Models with Grouped Factor Structure Under Unknown Group Membership," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(1), pages 163-191, January.
    22. Lin Chang-Ching & Ng Serena, 2012. "Estimation of Panel Data Models with Parameter Heterogeneity when Group Membership is Unknown," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 1-14, August.
    23. Peter Radchenko & Gourab Mukherjee, 2017. "Convex clustering via l 1 fusion penalization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1527-1546, November.
    24. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692090.
    25. Liangjun Su & Xia Wang & Sainan Jin, 2019. "Sieve Estimation of Time-Varying Panel Data Models With Latent Structures," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 334-349, April.
    26. Juan Shen & Xuming He, 2015. "Inference for Subgroup Analysis With a Structured Logistic-Normal Mixture Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 303-312, March.
    27. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage Estimation Of Regression Models With Multiple Structural Changes," Econometric Theory, Cambridge University Press, vol. 32(6), pages 1376-1433, December.
    28. Luojia Hu, 2002. "Estimation of a Censored Dynamic Panel Data Model," Econometrica, Econometric Society, vol. 70(6), pages 2499-2517, November.
    29. Lam, Clifford & Fan, Jianqing, 2008. "Profile-kernel likelihood inference with diverging number of parameters," LSE Research Online Documents on Economics 31548, London School of Economics and Political Science, LSE Library.
    30. Paul A. Samuelson, 2011. "Lifetime Portfolio Selection by Dynamic Stochastic Programming," World Scientific Book Chapters, in: Leonard C MacLean & Edward O Thorp & William T Ziemba (ed.), THE KELLY CAPITAL GROWTH INVESTMENT CRITERION THEORY and PRACTICE, chapter 31, pages 465-472, World Scientific Publishing Co. Pte. Ltd..
    31. Jinyong Hahn & Whitney Newey, 2004. "Jackknife and Analytical Bias Reduction for Nonlinear Panel Models," Econometrica, Econometric Society, vol. 72(4), pages 1295-1319, July.
    32. Joao F. Cocco, 2005. "Consumption and Portfolio Choice over the Life Cycle," Review of Financial Studies, Society for Financial Studies, vol. 18(2), pages 491-533.
    33. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    34. Su, Liangjun & Ju, Gaosheng, 2018. "Identifying latent grouped patterns in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 554-573.
    35. Jianqing Fan & Jinchi Lv & Lei Qi, 2011. "Sparse High-Dimensional Models in Economics," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 291-317, September.
    36. Wang, Wuyi & Phillips, Peter C.B. & Su, Liangjun, 2019. "The heterogeneous effects of the minimum wage on employment across states," Economics Letters, Elsevier, vol. 174(C), pages 179-185.
    37. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871549.
    38. Hahn, Jinyong & Kuersteiner, Guido, 2011. "Bias Reduction For Dynamic Nonlinear Panel Models With Fixed Effects," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1152-1191, December.
    39. Zheng Tracy Ke & Jianqing Fan & Yichao Wu, 2015. "Homogeneity Pursuit," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 175-194, March.
    40. Shujie Ma & Jian Huang, 2017. "A Concave Pairwise Fusion Approach to Subgroup Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 410-423, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiaorong Yang & Jia Chen & Degui Li & Runze Li, 2023. "Functional-Coefficient Quantile Regression for Panel Data with Latent Group Structure," Papers 2303.13218, arXiv.org.
    2. Leng, Xuan & Chen, Heng & Wang, Wendun, 2023. "Multi-dimensional latent group structures with heterogeneous distributions," Journal of Econometrics, Elsevier, vol. 233(1), pages 1-21.
    3. Ando, Tomohiro & Bai, Jushan, 2021. "Large-scale generalized linear longitudinal data models with grouped patterns of unobserved heterogeneity," MPRA Paper 111431, University Library of Munich, Germany.
    4. Yiren Wang & Peter C B Phillips & Liangjun Su, 2023. "Panel Data Models with Time-Varying Latent Group Structures," Papers 2307.15863, arXiv.org.
    5. Bofei Xiao & Bo Lei & Wei Lan & Bin Guo, 2022. "A blockwise network autoregressive model with application for fraud detection," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(6), pages 1043-1065, December.
    6. Mehrabani, Ali, 2023. "Estimation and identification of latent group structures in panel data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1464-1482.
    7. Boyuan Zhang, 2022. "Incorporating Prior Knowledge of Latent Group Structure in Panel Data Models," Papers 2211.16714, arXiv.org, revised Oct 2023.
    8. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    9. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    10. Chen, Elynn Y. & Fan, Jianqing & Zhu, Xuening, 2023. "Community network auto-regression for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 235(2), pages 1239-1256.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miao, Ke & Su, Liangjun & Wang, Wendun, 2020. "Panel threshold regressions with latent group structures," Journal of Econometrics, Elsevier, vol. 214(2), pages 451-481.
    2. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    3. Mehrabani, Ali, 2023. "Estimation and identification of latent group structures in panel data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1464-1482.
    4. Liu, Ruiqi & Shang, Zuofeng & Zhang, Yonghui & Zhou, Qiankun, 2020. "Identification and estimation in panel models with overspecified number of groups," Journal of Econometrics, Elsevier, vol. 215(2), pages 574-590.
    5. Yiren Wang & Peter C B Phillips & Liangjun Su, 2023. "Panel Data Models with Time-Varying Latent Group Structures," Papers 2307.15863, arXiv.org.
    6. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    7. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    8. Thibaut Lamadon & Elena Manresa & Stephane Bonhomme, 2016. "Discretizing Unobserved Heterogeneity," 2016 Meeting Papers 1536, Society for Economic Dynamics.
    9. Su, Liangjun & Ju, Gaosheng, 2018. "Identifying latent grouped patterns in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 554-573.
    10. Geert Dhaene & Koen Jochmans, 2015. "Split-panel Jackknife Estimation of Fixed-effect Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(3), pages 991-1030.
    11. Schumann, Martin & Severini, Thomas A. & Tripathi, Gautam, 2021. "Integrated likelihood based inference for nonlinear panel data models with unobserved effects," Journal of Econometrics, Elsevier, vol. 223(1), pages 73-95.
    12. Pakel, Cavit, 2019. "Bias reduction in nonlinear and dynamic panels in the presence of cross-section dependence," Journal of Econometrics, Elsevier, vol. 213(2), pages 459-492.
    13. Saptorshee Kanto Chakraborty & Massimiliano Mazzanti, 2021. "Revisiting the literature on the dynamic Environmental Kuznets Curves using a latent structure approach," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 923-941, October.
    14. repec:hal:spmain:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    15. Jochmans, Koen & Higgins, Ayden, 2022. "Bootstrap inference for fixed-effect models," TSE Working Papers 22-1328, Toulouse School of Economics (TSE), revised Dec 2023.
    16. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09ij4j0h0h1 is not listed on IDEAS
    17. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2022. "Discretizing Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 90(2), pages 625-643, March.
    18. Boyuan Zhang, 2022. "Incorporating Prior Knowledge of Latent Group Structure in Panel Data Models," Papers 2211.16714, arXiv.org, revised Oct 2023.
    19. Mingyang Li & Linlin Niu & Andrew Pua, 2020. "Market Pricing of Fundamentals at the Shanghai Stock Exchange: Evidence from a Dividend Discount Model with Adaptive Expectations," Working Papers 2020-12-30, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    20. Vasilis Sarafidis & Tom Wansbeek, 2020. "Celebrating 40 Years of Panel Data Analysis: Past, Present and Future," Monash Econometrics and Business Statistics Working Papers 6/20, Monash University, Department of Econometrics and Business Statistics.
    21. repec:hal:wpspec:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    22. Andersen, Torben G. & Fusari, Nicola & Todorov, Viktor & Varneskov, Rasmus T., 2019. "Unified inference for nonlinear factor models from panels with fixed and large time span," Journal of Econometrics, Elsevier, vol. 212(1), pages 4-25.
    23. L. Hospido, 2012. "Modelling heterogeneity and dynamics in the volatility of individual wages," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(3), pages 386-414, April.

    More about this item

    Keywords

    Binary segmentation algorithm; clustering; community detection; network; oracle estimator; panel structure model; parameter heterogeneity; singular value decomposition.;
    All these keywords.

    JEL classification:

    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ris:smuesw:2017_019. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Cheong Pei Qi (email available below). General contact details of provider: https://edirc.repec.org/data/sesmusg.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.