IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2507.13788.html
   My bibliography  Save this paper

Debiased Machine Learning for Unobserved Heterogeneity: High-Dimensional Panels and Measurement Error Models

Author

Listed:
  • Facundo Arga~naraz
  • Juan Carlos Escanciano

Abstract

Developing robust inference for models with nonparametric Unobserved Heterogeneity (UH) is both important and challenging. We propose novel Debiased Machine Learning (DML) procedures for valid inference on functionals of UH, allowing for partial identification of multivariate target and high-dimensional nuisance parameters. Our main contribution is a full characterization of all relevant Neyman-orthogonal moments in models with nonparametric UH, where relevance means informativeness about the parameter of interest. Under additional support conditions, orthogonal moments are globally robust to the distribution of the UH. They may still involve other high-dimensional nuisance parameters, but their local robustness reduces regularization bias and enables valid DML inference. We apply these results to: (i) common parameters, average marginal effects, and variances of UH in panel data models with high-dimensional controls; (ii) moments of the common factor in the Kotlarski model with a factor loading; and (iii) smooth functionals of teacher value-added. Monte Carlo simulations show substantial efficiency gains from using efficient orthogonal moments relative to ad-hoc choices. We illustrate the practical value of our approach by showing that existing estimates of the average and variance effects of maternal smoking on child birth weight are robust.

Suggested Citation

  • Facundo Arga~naraz & Juan Carlos Escanciano, 2025. "Debiased Machine Learning for Unobserved Heterogeneity: High-Dimensional Panels and Measurement Error Models," Papers 2507.13788, arXiv.org.
  • Handle: RePEc:arx:papers:2507.13788
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2507.13788
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fatih Guvenen, 2009. "An Empirical Investigation of Labor Income Processes," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 12(1), pages 58-79, January.
    2. Fox, Jeremy T. & Kim, Kyoo il & Yang, Chenyu, 2016. "A simple nonparametric approach to estimating the distribution of random coefficients in structural models," Journal of Econometrics, Elsevier, vol. 195(2), pages 236-254.
    3. Santos, Andres, 2011. "Instrumental variable methods for recovering continuous linear functionals," Journal of Econometrics, Elsevier, vol. 161(2), pages 129-146, April.
    4. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.
    5. Bo E. Honoré & Elie Tamer, 2006. "Bounds on Parameters in Panel Dynamic Discrete Choice Models," Econometrica, Econometric Society, vol. 74(3), pages 611-629, May.
    6. Joachim Freyberger, 2018. "Non-parametric Panel Data Models with Interactive Fixed Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1824-1851.
    7. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    8. Jason Abrevaya, 2006. "Estimating the effect of smoking on birth outcomes using a matched panel data approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(4), pages 489-519.
    9. Victor Chernozhukov & Iván Fernández‐Val & Jinyong Hahn & Whitney Newey, 2013. "Average and Quantile Effects in Nonseparable Panel Models," Econometrica, Econometric Society, vol. 81(2), pages 535-580, March.
    10. Rosemary Hyson & Janet Currie, 1999. "Is the Impact of Health Shocks Cushioned by Socioeconomic Status? The Case of Low Birthweight," American Economic Review, American Economic Association, vol. 89(2), pages 245-250, May.
    11. Jason M. Fletcher & Leora I. Horwitz & Elizabeth Bradley, 2014. "Estimating the Value Added of Attending Physicians on Patient Outcomes," NBER Working Papers 20534, National Bureau of Economic Research, Inc.
    12. Hope Corman, 1995. "The Effects of Low Birthweight and Other Medical Risk Factors on Resource Utilization in the Pre-School Years," NBER Working Papers 5273, National Bureau of Economic Research, Inc.
    13. Joseph Doyle & John Graves & Jonathan Gruber, 2019. "Evaluating Measures of Hospital Quality: Evidence from Ambulance Referral Patterns," The Review of Economics and Statistics, MIT Press, vol. 101(5), pages 841-852, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manuel Arellano & Stéphane Bonhomme, 2012. "Identifying Distributional Characteristics in Random Coefficients Panel Data Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 987-1020.
    2. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    3. Williams, Benjamin, 2020. "Nonparametric identification of discrete choice models with lagged dependent variables," Journal of Econometrics, Elsevier, vol. 215(1), pages 286-304.
    4. Jackson Bunting, 2022. "Continuous permanent unobserved heterogeneity in dynamic discrete choice models," Papers 2202.03960, arXiv.org, revised Sep 2025.
    5. Aguirregabiria, Victor & Gu, Jiaying & Luo, Yao, 2021. "Sufficient statistics for unobserved heterogeneity in structural dynamic logit models," Journal of Econometrics, Elsevier, vol. 223(2), pages 280-311.
    6. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    7. Olivier De Groote, 2025. "Dynamic Effort Choice in High School: Costs and Benefits of an Academic Track," Journal of Labor Economics, University of Chicago Press, vol. 43(2), pages 467-502.
    8. Kate Ho & Adam M. Rosen, 2015. "Partial Identification in Applied Research: Benefits and Challenges," NBER Working Papers 21641, National Bureau of Economic Research, Inc.
    9. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    10. Xavier d'Haultfoeuille & Stefan Hoderlein & Yuya Sasaki, 2013. "Nonlinear difference-in-differences in repeated cross sections with continuous treatments," CeMMAP working papers CWP40/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Escanciano, Juan Carlos, 2023. "Irregular identification of structural models with nonparametric unobserved heterogeneity," Journal of Econometrics, Elsevier, vol. 234(1), pages 106-127.
    12. Molinari, Francesca, 2020. "Microeconometrics with partial identification," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 355-486, Elsevier.
    13. Johannes S. Kunz & Kevin E. Staub & Rainer Winkelmann, 2021. "Predicting individual effects in fixed effects panel probit models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(3), pages 1109-1145, July.
    14. Irene Botosaru & Chris Muris & Senay Sokullu, 2022. "Time-Varying Linear Transformation Models with Fixed Effects and Endogeneity for Short Panels," Department of Economics Working Papers 2022-01, McMaster University.
    15. Laurent Davezies & Xavier D'Haultf{oe}uille & Louise Laage, 2021. "Identification and Estimation of Average Causal Effects in Fixed Effects Logit Models," Papers 2105.00879, arXiv.org, revised Dec 2024.
    16. Haeck, Catherine & Lefebvre, Pierre, 2016. "A simple recipe: The effect of a prenatal nutrition program on child health at birth," Labour Economics, Elsevier, vol. 41(C), pages 77-89.
    17. Kevin Dano, 2023. "Transition Probabilities and Moment Restrictions in Dynamic Fixed Effects Logit Models," Papers 2303.00083, arXiv.org, revised Dec 2023.
    18. Benjamin Williams, 2019. "Identification of a nonseparable model under endogeneity using binary proxies for unobserved heterogeneity," Quantitative Economics, Econometric Society, vol. 10(2), pages 527-563, May.
    19. Fernández-Val, Iván & Weidner, Martin, 2016. "Individual and time effects in nonlinear panel models with large N, T," Journal of Econometrics, Elsevier, vol. 192(1), pages 291-312.
    20. St'ephane Bonhomme & Martin Weidner, 2018. "Minimizing Sensitivity to Model Misspecification," Papers 1807.02161, arXiv.org, revised Oct 2021.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2507.13788. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.