IDEAS home Printed from https://ideas.repec.org/p/hhs/ifauwp/2017_021.html
   My bibliography  Save this paper

Discretizing Unobserved Heterogeneity

Author

Listed:
  • Bonhomme, Stéphane

    (University of Chicago)

  • Lamadon, Thibaut

    (University of Chicago)

  • Manresa, Elena

    (Massachusetts Institute of Technology and The Sloan School of Mangement)

Abstract

We study panel data estimators based on a discretization of unobserved heterogeneity when individual heterogeneity is not necessarily discrete in the population. We focus on two-step grouped-fixed effects estimators, where individuals are classified into groups in a first step using kmeans clustering, and the model is estimated in a second step allowing for group-specific heterogeneity. We analyze the asymptotic properties of these discrete estimators as the number of groups grows with the sample size, and we show that bias reduction techniques can improve their performance. In addition to reducing the number of parameters, grouped fixed-effects methods provide effective regularization. When allowing for the presence of time-varying unobserved heterogeneity, we show they enjoy fast rates of convergence depending of the underlying dimension of heterogeneity. Finally, we document the finite sample properties of two-step grouped fixed-effects estimators in two applications: a structural dynamic discrete choice model of migration, and a model of wages with worker and firm heterogeneity.

Suggested Citation

  • Bonhomme, Stéphane & Lamadon, Thibaut & Manresa, Elena, 2017. "Discretizing Unobserved Heterogeneity," Working Paper Series 2017:21, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    • Handle: RePEc:hhs:ifauwp:2017_021
    as

    Download full text from publisher

    File URL: http://www.ifau.se/globalassets/pdf/se/2017/wp2017-21-discretizing-unobserved-heterogeneity.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David Card & Jörg Heining & Patrick Kline, 2013. "Workplace Heterogeneity and the Rise of West German Wage Inequality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 967-1015.
    2. Fernández-Val, Iván & Weidner, Martin, 2016. "Individual and time effects in nonlinear panel models with large N, T," Journal of Econometrics, Elsevier, vol. 192(1), pages 291-312.
    3. D. S. Choi & P. J. Wolfe & E. M. Airoldi, 2012. "Stochastic blockmodels with a growing number of classes," Biometrika, Biometrika Trust, vol. 99(2), pages 273-284.
    4. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    5. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    6. Stéphane Bonhomme & Elena Manresa, 2015. "Grouped Patterns of Heterogeneity in Panel Data," Econometrica, Econometric Society, vol. 83(3), pages 1147-1184, May.
    7. Che‐Lin Su & Kenneth L. Judd, 2012. "Constrained Optimization Approaches to Estimation of Structural Models," Econometrica, Econometric Society, vol. 80(5), pages 2213-2230, September.
    8. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    9. Chen, Mingli & Fernández-Val, Iván & Weidner, Martin, 2021. "Nonlinear factor models for network and panel data," Journal of Econometrics, Elsevier, vol. 220(2), pages 296-324.
    10. John M. Abowd & Francis Kramarz & David N. Margolis, 1999. "High Wage Workers and High Wage Firms," Econometrica, Econometric Society, vol. 67(2), pages 251-334, March.
    11. Koen Jochmans & Martin Weidner, 2019. "Fixed‐Effect Regressions on Network Data," Econometrica, Econometric Society, vol. 87(5), pages 1543-1560, September.
    12. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692106, September.
    13. Xiaohong Chen & Lars Peter Hansen & Jos´e A. Scheinkman, 2005. "Principal Components and the Long Run," Levine's Bibliography 122247000000000997, UCLA Department of Economics.
    14. Manuel Arellano & Jinyong Hahn, 2016. "A likelihood-Based Approximate Solution to the Incidental Parameter Problem in Dynamic Nonlinear Models with Multiple Effects," Global Economic Review, Taylor & Francis Journals, vol. 45(3), pages 251-274, July.
    15. Robert Shimer & Lones Smith, 2000. "Assortative Matching and Search," Econometrica, Econometric Society, vol. 68(2), pages 343-370, March.
    16. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    17. Isaac Sorkin, 2018. "Ranking Firms Using Revealed Preference," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(3), pages 1331-1393.
    18. Tomohiro Ando & Jushan Bai, 2016. "Panel Data Models with Grouped Factor Structure Under Unknown Group Membership," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(1), pages 163-191, January.
    19. Hahn, Jinyong & Moon, Hyungsik Roger, 2010. "Panel Data Models With Finite Number Of Multiple Equilibria," Econometric Theory, Cambridge University Press, vol. 26(3), pages 863-881, June.
    20. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2019. "A Distributional Framework for Matched Employer Employee Data," Econometrica, Econometric Society, vol. 87(3), pages 699-739, May.
    21. Jinyong Hahn & Whitney Newey, 2004. "Jackknife and Analytical Bias Reduction for Nonlinear Panel Models," Econometrica, Econometric Society, vol. 72(4), pages 1295-1319, July.
    22. Moon, Hyungsik Roger & Shum, Matthew & Weidner, Martin, 2018. "Estimation of random coefficients logit demand models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 613-644.
    23. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871549, September.
    24. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    25. Hiroyuki Kasahara & Katsumi Shimotsu, 2009. "Nonparametric Identification of Finite Mixture Models of Dynamic Discrete Choices," Econometrica, Econometric Society, vol. 77(1), pages 135-175, January.
    26. Michael Vogt & Oliver Linton, 2015. "Classification of nonparametric regression functions in heterogeneous panels," CeMMAP working papers CWP06/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    27. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    28. Peter Arcidiacono & John Bailey Jones, 2003. "Finite Mixture Distributions, Sequential Likelihood and the EM Algorithm," Econometrica, Econometric Society, vol. 71(3), pages 933-946, May.
    29. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871532, September.
    30. Xiaohong Chen & Lars Peter Hansen & Jose Scheinkman, 2009. "Principal Components and Long Run Implications of Multivariate Diffusions," Cowles Foundation Discussion Papers 1694, Cowles Foundation for Research in Economics, Yale University.
    31. Peter Arcidiacono & Robert A. Miller, 2011. "Conditional Choice Probability Estimation of Dynamic Discrete Choice Models With Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 79(6), pages 1823-1867, November.
    32. Yu Zheng & Juan Pantano, 2012. "Using Subjective Expectations Data to Allow for Unobserved Heterogeneity in Hotz-Miller Estimation Strategies," 2012 Meeting Papers 940, Society for Economic Dynamics.
    33. Lin Chang-Ching & Ng Serena, 2012. "Estimation of Panel Data Models with Parameter Heterogeneity when Group Membership is Unknown," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 42-55, August.
    34. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    35. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692090, September.
    36. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    37. Hahn, Jinyong & Kuersteiner, Guido, 2011. "Bias Reduction For Dynamic Nonlinear Panel Models With Fixed Effects," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1152-1191, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2022. "Discretizing Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 90(2), pages 625-643, March.
    2. Stéphane Bonhomme & Elena Manresa, 2015. "Grouped Patterns of Heterogeneity in Panel Data," Econometrica, Econometric Society, vol. 83(3), pages 1147-1184, May.
    3. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    4. Andersen, Torben G. & Fusari, Nicola & Todorov, Viktor & Varneskov, Rasmus T., 2019. "Unified inference for nonlinear factor models from panels with fixed and large time span," Journal of Econometrics, Elsevier, vol. 212(1), pages 4-25.
    5. Pakel, Cavit, 2019. "Bias reduction in nonlinear and dynamic panels in the presence of cross-section dependence," Journal of Econometrics, Elsevier, vol. 213(2), pages 459-492.
    6. Miao, Ke & Su, Liangjun & Wang, Wendun, 2020. "Panel threshold regressions with latent group structures," Journal of Econometrics, Elsevier, vol. 214(2), pages 451-481.
    7. Geert Dhaene & Koen Jochmans, 2015. "Split-panel Jackknife Estimation of Fixed-effect Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(3), pages 991-1030.
    8. Manuel Arellano & Stéphane Bonhomme, 2017. "Nonlinear Panel Data Methods for Dynamic Heterogeneous Agent Models," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 471-496, September.
    9. repec:hal:spmain:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    10. repec:spo:wpmain:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    11. repec:spo:wpecon:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    12. repec:hal:wpspec:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    13. Schumann, Martin & Severini, Thomas A. & Tripathi, Gautam, 2021. "Integrated likelihood based inference for nonlinear panel data models with unobserved effects," Journal of Econometrics, Elsevier, vol. 223(1), pages 73-95.
    14. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    15. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    16. Claudia Pigini & Alessandro Pionati & Francesco Valentini, 2023. "Specification testing with grouped fixed effects," Papers 2310.01950, arXiv.org.
    17. Shuowen Chen, 2022. "Indirect Inference for Nonlinear Panel Models with Fixed Effects," Papers 2203.10683, arXiv.org, revised Apr 2022.
    18. Lee, Yoonseok & Phillips, Peter C.B., 2015. "Model selection in the presence of incidental parameters," Journal of Econometrics, Elsevier, vol. 188(2), pages 474-489.
    19. Jochmans, Koen & Higgins, Ayden, 2022. "Bootstrap inference for fixed-effect models," TSE Working Papers 22-1328, Toulouse School of Economics (TSE), revised Dec 2023.
    20. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    21. Mingyang Li & Linlin Niu & Andrew Pua, 2020. "Market Pricing of Fundamentals at the Shanghai Stock Exchange: Evidence from a Dividend Discount Model with Adaptive Expectations," Working Papers 2020-12-30, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    22. repec:spo:wpmain:info:hdl:2441/eu4vqp9ompqllr09ij4j0h0h1 is not listed on IDEAS
    23. Jesus M. Carro & Alejandra Traferri, 2014. "State Dependence And Heterogeneity In Health Using A Bias‐Corrected Fixed‐Effects Estimator," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(2), pages 181-207, March.
    24. Fernández-Val, Iván, 2009. "Fixed effects estimation of structural parameters and marginal effects in panel probit models," Journal of Econometrics, Elsevier, vol. 150(1), pages 71-85, May.
    25. L. Hospido, 2012. "Modelling heterogeneity and dynamics in the volatility of individual wages," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(3), pages 386-414, April.

    More about this item

    Keywords

    dimension reduction; panel data; structural models; kmeans clustering;
    All these keywords.

    JEL classification:

    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:ifauwp:2017_021. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ali Ghooloo (email available below). General contact details of provider: https://edirc.repec.org/data/ifagvse.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.