IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2410.18381.html

Inference on High Dimensional Selective Labeling Models

Author

Listed:
  • Shakeeb Khan
  • Elie Tamer
  • Qingsong Yao

Abstract

A class of simultaneous equation models arise in the many domains where observed binary outcomes are themselves a consequence of the existing choices of of one of the agents in the model. These models are gaining increasing interest in the computer science and machine learning literatures where they refer the potentially endogenous sample selection as the {\em selective labels} problem. Empirical settings for such models arise in fields as diverse as criminal justice, health care, and insurance. For important recent work in this area, see for example Lakkaruju et al. (2017), Kleinberg et al. (2018), and Coston et al.(2021) where the authors focus on judicial bail decisions, and where one observes the outcome of whether a defendant filed to return for their court appearance only if the judge in the case decides to release the defendant on bail. Identifying and estimating such models can be computationally challenging for two reasons. One is the nonconcavity of the bivariate likelihood function, and the other is the large number of covariates in each equation. Despite these challenges, in this paper we propose a novel distribution free estimation procedure that is computationally friendly in many covariates settings. The new method combines the semiparametric batched gradient descent algorithm introduced in Khan et al.(2023) with a novel sorting algorithms incorporated to control for selection bias. Asymptotic properties of the new procedure are established under increasing dimension conditions in both equations, and its finite sample properties are explored through a simulation study and an application using judicial bail data.

Suggested Citation

  • Shakeeb Khan & Elie Tamer & Qingsong Yao, 2024. "Inference on High Dimensional Selective Labeling Models," Papers 2410.18381, arXiv.org, revised Dec 2025.
  • Handle: RePEc:arx:papers:2410.18381
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2410.18381
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jason Abrevaya & Jerry A. Hausman & Shakeeb Khan, 2010. "Testing for Causal Effects in a Generalized Regression Model With Endogenous Regressors," Econometrica, Econometric Society, vol. 78(6), pages 2043-2061, November.
    2. Arellano, Manuel & Honore, Bo, 2001. "Panel data models: some recent developments," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 53, pages 3229-3296, Elsevier.
    3. Bo E. Honoré & Ekaterini Kyriazidou, 2000. "Panel Data Discrete Choice Models with Lagged Dependent Variables," Econometrica, Econometric Society, vol. 68(4), pages 839-874, July.
    4. Klein, Roger W & Spady, Richard H, 1993. "An Efficient Semiparametric Estimator for Binary Response Models," Econometrica, Econometric Society, vol. 61(2), pages 387-421, March.
    5. Yatchew, A., 1997. "An elementary estimator of the partial linear model," Economics Letters, Elsevier, vol. 57(2), pages 135-143, December.
    6. Azeem M. Shaikh & Edward J. Vytlacil, 2011. "Partial Identification in Triangular Systems of Equations With Binary Dependent Variables," Econometrica, Econometric Society, vol. 79(3), pages 949-955, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2020. "Inference on Semiparametric Multinomial Response Models," Discussion Papers Series 627, School of Economics, University of Queensland, Australia.
    2. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2019. "Inference on Semiparametric Multinomial Response Models," Boston College Working Papers in Economics 980, Boston College Department of Economics.
    3. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2021. "Inference on semiparametric multinomial response models," Quantitative Economics, Econometric Society, vol. 12(3), pages 743-777, July.
    4. Aguirregabiria, Victor & Gu, Jiaying & Luo, Yao, 2021. "Sufficient statistics for unobserved heterogeneity in structural dynamic logit models," Journal of Econometrics, Elsevier, vol. 223(2), pages 280-311.
    5. Jere Behrman & Hans-Peter Kohler & Susan C. Watkins, 2003. "Social Networks, HIV/AIDS and Risk Perceptions," PIER Working Paper Archive 03-007, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    6. Anirban Basu & Norma Coe & Cole G. Chapman, 2017. "Comparing 2SLS vs 2SRI for Binary Outcomes and Binary Exposures," NBER Working Papers 23840, National Bureau of Economic Research, Inc.
    7. Arellano, Manuel & Carrasco, Raquel, 2003. "Binary choice panel data models with predetermined variables," Journal of Econometrics, Elsevier, vol. 115(1), pages 125-157, July.
    8. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    9. Irene Botosaru & Chris Muris & Senay Sokullu, 2022. "Time-Varying Linear Transformation Models with Fixed Effects and Endogeneity for Short Panels," Department of Economics Working Papers 2022-01, McMaster University.
    10. Aradillas-Lopez, Andres, 2010. "Semiparametric estimation of a simultaneous game with incomplete information," Journal of Econometrics, Elsevier, vol. 157(2), pages 409-431, August.
    11. Ambra Poggi, 2007. "Does persistence of social exclusion exist in Spain?," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 5(1), pages 53-72, April.
    12. Jochmans, Koen, 2015. "Multiplicative-error models with sample selection," Journal of Econometrics, Elsevier, vol. 184(2), pages 315-327.
    13. Manuel Arellano, 2003. "Discrete choices with panel data," Investigaciones Economicas, Fundación SEPI, vol. 27(3), pages 423-458, September.
    14. Majid M. Al-Sadoon & Tong Li & M. Hashem Pesaran, 2017. "Exponential class of dynamic binary choice panel data models with fixed effects," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 898-927, October.
    15. Xiaohong Chen & Elie Tamer & Qingsong Yao, 2026. "Fast Online Inference On Semiparametric Models," Cowles Foundation Discussion Papers 2548, Cowles Foundation for Research in Economics, Yale University.
    16. Ting Ji & Laura Liu & Yulong Wang & Jiahe Xing, 2026. "A Simple and Powerful Diagnostic Test for Binary Choice Models," Papers 2603.27881, arXiv.org, revised Sep 2026.
    17. d’Artis Kancs, 2006. "The economic geography of labour migration: Competition, competitiveness and development," EERI Research Paper Series EERI_RP_2006_01, Economics and Econometrics Research Institute (EERI), Brussels.
    18. Carro, Jesus M., 2007. "Estimating dynamic panel data discrete choice models with fixed effects," Journal of Econometrics, Elsevier, vol. 140(2), pages 503-528, October.
    19. Panos, Sousounis, 2008. "State dependence in work-related training participation among British employees: A comparison of different random effects probit estimators," MPRA Paper 14261, University Library of Munich, Germany, revised Mar 2009.
    20. Stefan Hoderlein & Yuya Sasaki, 2011. "On the role of time in nonseparable panel data models," CeMMAP working papers CWP15/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2410.18381. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.