IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/11-26.html

The projection solution to the incidental parameter problem

Author

Listed:
  • Andrew Chesher
  • Adam Rosen
  • Yuanqi Zhang

Abstract

This paper introduces a new approach to econometric analysis of nonlinear panel data models when the number of observations per observational unit is small. In such models the presence of variables that are constant within, while varying across, units results in an incidental parameter problem. The approach taken in this paper removes these incidental parameters via projection, which produces a correspondence specifying all combinations of observed variables and within-unit-varying unobserved heterogeneity that are achievable by choice of some value of the unit-specific incidental parameters. With unit specific variables removed, there is no need for assumptions concerning their joint distribution with other variables. The result is an incomplete model which is typically partially identifying. Identified sets are characterized via moment inequalities using tools of random set theory. Examples of application to static and dynamic models with discrete or continuous outcomes using distribution free restrictions on within-unit-varying unobserved heterogeneity are presented.

Suggested Citation

  • Andrew Chesher & Adam Rosen & Yuanqi Zhang, 2026. "The projection solution to the incidental parameter problem," CeMMAP working papers 11/26, Institute for Fiscal Studies.
    • Handle: RePEc:azt:cemmap:11/26
    DOI: 10.47004/wp.cem.2026.1126
    as

    Download full text from publisher

    File URL: https://cemmap.ac.uk/wp-content/uploads/2026/07/CWP1126-The-projection-solution-to-the-incidental-parameter-problem.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.47004/wp.cem.2026.1126?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ariel Pakes & Jack Porter, 2024. "Moment inequalities for multinomial choice with fixed effects," Quantitative Economics, Econometric Society, vol. 15(1), pages 1-25, January.
    2. Yuehao Bai & Andres Santos & Azeem M. Shaikh, 2022. "A Two-Step Method for Testing Many Moment Inequalities," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1070-1080, June.
    3. Beresteanu, Arie & Molchanov, Ilya & Molinari, Francesca, 2012. "Partial identification using random set theory," Journal of Econometrics, Elsevier, vol. 166(1), pages 17-32.
    4. Chamberlain, Gary, 2022. "Feedback in panel data models," Journal of Econometrics, Elsevier, vol. 226(1), pages 4-20.
    5. Luojia Hu, 2002. "Estimation of a Censored Dynamic Panel Data Model," Econometrica, Econometric Society, vol. 70(6), pages 2499-2517, November.
    6. Gary Chamberlain, 2010. "Binary Response Models for Panel Data: Identification and Information," Econometrica, Econometric Society, vol. 78(1), pages 159-168, January.
    7. Stéphane Bonhomme & Kevin Dano & Bryan S. Graham, 2023. "Identification in a Binary Choice Panel Data Model with a Predetermined Covariate," NBER Working Papers 31027, National Bureau of Economic Research, Inc.
    8. Aristodemou, Eleni, 2021. "Semiparametric identification in panel data discrete response models," Journal of Econometrics, Elsevier, vol. 220(2), pages 253-271.
    9. Manski, Charles F, 1987. "Semiparametric Analysis of Random Effects Linear Models from Binary Panel Data," Econometrica, Econometric Society, vol. 55(2), pages 357-362, March.
    10. Khan, Shakeeb & Ponomareva, Maria & Tamer, Elie, 2016. "Identification of panel data models with endogenous censoring," Journal of Econometrics, Elsevier, vol. 194(1), pages 57-75.
    11. Alfred Galichon & Marc Henry, 2011. "Set Identification in Models with Multiple Equilibria," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(4), pages 1264-1298.
    12. Stéphane Bonhomme & Kevin Dano & Bryan S. Graham, 2023. "Identification in a binary choice panel data model with a predetermined covariate," CeMMAP working papers 17/23, Institute for Fiscal Studies.
    13. Lixiong Li, 2026. "Identification and Counterfactual Analysis in Incomplete Models with Support and Moment Restrictions," Papers 2603.07722, arXiv.org.
    14. Abrevaya, Jason, 2000. "Rank estimation of a generalized fixed-effects regression model," Journal of Econometrics, Elsevier, vol. 95(1), pages 1-23, March.
    15. Chris Muris & Pedro Raposo & Sotiris Vandoros, 2025. "A Dynamic Ordered Logit Model with Fixed Effects," The Review of Economics and Statistics, MIT Press, vol. 107(4), pages 1104-1114, July.
    16. St'ephane Bonhomme & Kevin Dano & Bryan S. Graham, 2023. "Identification in a Binary Choice Panel Data Model with a Predetermined Covariate," Papers 2301.05733, arXiv.org, revised Jul 2023.
    17. Andrew Chesher & Adam Rosen, 2015. "Characterizations of identified sets delivered by structural econometric models," CeMMAP working papers CWP63/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Wooyong Lee, 2025. "Identification and estimation of dynamic random coefficient models," Papers 2505.01600, arXiv.org, revised Apr 2026.
    19. Andrews, Donald W.K. & Shi, Xiaoxia, 2017. "Inference based on many conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 196(2), pages 275-287.
    20. Jason Abrevaya & Chris Muris, 2020. "Interval censored regression with fixed effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(2), pages 198-216, March.
    21. Kevin Dano, 2023. "Transition Probabilities and Moment Restrictions in Dynamic Fixed Effects Logit Models," Papers 2303.00083, arXiv.org, revised Dec 2023.
    22. Bo E. Honoré & Elie Tamer, 2006. "Bounds on Parameters in Panel Dynamic Discrete Choice Models," Econometrica, Econometric Society, vol. 74(3), pages 611-629, May.
    23. repec:spo:wpmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4ao8ocg is not listed on IDEAS
    24. repec:spo:wpecon:info:hdl:2441/5rkqqmvrn4tl22s9mc4ao8ocg is not listed on IDEAS
    25. Bo E. Honoré & Ekaterini Kyriazidou, 2000. "Panel Data Discrete Choice Models with Lagged Dependent Variables," Econometrica, Econometric Society, vol. 68(4), pages 839-874, July.
    26. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    27. Susanne M. Schennach, 2014. "Entropic Latent Variable Integration via Simulation," Econometrica, Econometric Society, vol. 82(1), pages 345-385, January.
    28. Stéphane Bonhomme & Kevin Dano & Bryan S. Graham, 2023. "Identification in a binary choice panel data model with a predetermined covariate," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 14(3), pages 315-351, December.
    29. Arie Beresteanu & Ilya Molchanov & Francesca Molinari, 2011. "Sharp Identification Regions in Models With Convex Moment Predictions," Econometrica, Econometric Society, vol. 79(6), pages 1785-1821, November.
    30. Khan, S. & Ponomareva, M. & Tamer, E., 2023. "Identification of dynamic binary response models," Journal of Econometrics, Elsevier, vol. 237(1).
    31. Marcoux, Mathieu & Russell, Thomas M. & Wan, Yuanyuan, 2024. "A simple specification test for models with many conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 242(1).
    32. Bo E. Honoré & Chris Muris & Martin Weidner, 2025. "Dynamic ordered panel logit models," Quantitative Economics, Econometric Society, vol. 16(3), pages 899-945, July.
    33. Victor Chernozhukov & Denis Chetverikov & Kengo Kato & Aureo de Paula, 2019. "Inference on Causal and Structural Parameters using Many Moment Inequalities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(5), pages 1867-1900.
    34. Chesher, Andrew & Kim, Dongwoo & Rosen, Adam M., 2023. "IV methods for Tobit models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1700-1724.
    35. Andrew Chesher & Adam M. Rosen, 2017. "Generalized Instrumental Variable Models," Econometrica, Econometric Society, vol. 85, pages 959-989, May.
    36. Stephane Bonhomme, 2025. "Back to Feedback: Dynamics and Heterogeneity in Panel Data," Papers 2512.17576, arXiv.org, revised Jul 2026.
    37. Lancaster, Tony, 2000. "The incidental parameter problem since 1948," Journal of Econometrics, Elsevier, vol. 95(2), pages 391-413, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew Chesher & Adam Rosen & Yuanqi Zhang, 2024. "Robust analysis of short panels," CeMMAP working papers 01/24, Institute for Fiscal Studies.
    2. Gao, Wayne Yuan & Wang, Rui, 2026. "Identification in nonlinear dynamic panel models under partial stationarity," Journal of Econometrics, Elsevier, vol. 253(C).
    3. Kevin Dano & Bo E. Honor'e & Martin Weidner, 2025. "Binary choice logit models with general fixed effects for panel and network data," Papers 2508.11556, arXiv.org.
    4. Molinari, Francesca, 2020. "Microeconometrics with partial identification," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 355-486, Elsevier.
    5. Stéphane Bonhomme & Kevin Dano & Bryan S. Graham, 2025. "Moment restrictions for nonlinear panel data models with feedback," CeMMAP working papers 12/25, Institute for Fiscal Studies.
    6. St'ephane Bonhomme & Kevin Dano & Bryan S. Graham, 2025. "Moment Restrictions for Nonlinear Panel Data Models with Feedback," Papers 2506.12569, arXiv.org, revised Sep 2026.
    7. Botosaru, Irene & Muris, Chris, 2025. "Identification of time-varying counterfactual parameters in nonlinear panel models," Journal of Econometrics, Elsevier, vol. 252(PB).
    8. Sukgyu Shin, 2025. "Sufficient Statistics for Markovian Feedback Processes and Unobserved Heterogeneity in Dynamic Panel Logit Models," Papers 2511.02816, arXiv.org, revised Apr 2026.
    9. Khan, S. & Ponomareva, M. & Tamer, E., 2023. "Identification of dynamic binary response models," Journal of Econometrics, Elsevier, vol. 237(1).
    10. Botosaru, Irene & Muris, Chris & Pendakur, Krishna, 2023. "Identification of time-varying transformation models with fixed effects, with an application to unobserved heterogeneity in resource shares," Journal of Econometrics, Elsevier, vol. 232(2), pages 576-597.
    11. Thomas M. Russell, 2020. "Policy Transforms and Learning Optimal Policies," Papers 2012.11046, arXiv.org.
    12. Pietro Tebaldi & Alexander Torgovitsky & Hanbin Yang, 2023. "Nonparametric Estimates of Demand in the California Health Insurance Exchange," Econometrica, Econometric Society, vol. 91(1), pages 107-146, January.
    13. Chesher, Andrew & Rosen, Adam M., 2020. "Generalized instrumental variable models, methods, and applications," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 1-110, Elsevier.
    14. Bo E Honoré & Áureo de Paula, 2021. "Identification in simple binary outcome panel data models," The Econometrics Journal, Royal Economic Society, vol. 24(2), pages 78-93.
    15. Geert Dhaene & Martin Weidner, 2023. "Approximate functional differencing," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 14(3), pages 379-416, December.
    16. Williams, Benjamin, 2020. "Nonparametric identification of discrete choice models with lagged dependent variables," Journal of Econometrics, Elsevier, vol. 215(1), pages 286-304.
    17. Steven T Berry & Giovanni Compiani, 2023. "An Instrumental Variable Approach to Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(4), pages 1724-1758.
    18. Aguirregabiria, Victor & Gu, Jiaying & Luo, Yao, 2021. "Sufficient statistics for unobserved heterogeneity in structural dynamic logit models," Journal of Econometrics, Elsevier, vol. 223(2), pages 280-311.
    19. Irene Botosaru & Chris Muris, 2017. "Binarization for panel models with fixed effects," CeMMAP working papers 31/17, Institute for Fiscal Studies.
    20. Stéphane Bonhomme & Kevin Dano & Bryan S. Graham, 2023. "Identification in a binary choice panel data model with a predetermined covariate," CeMMAP working papers 17/23, Institute for Fiscal Studies.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:11/26. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.