IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2110.04388.html
   My bibliography  Save this paper

Estimating High Dimensional Monotone Index Models by Iterative Convex Optimization1

Author

Listed:
  • Shakeeb Khan
  • Xiaoying Lan
  • Elie Tamer
  • Qingsong Yao

Abstract

In this paper we propose new approaches to estimating large dimensional monotone index models. This class of models has been popular in the applied and theoretical econometrics literatures as it includes discrete choice, nonparametric transformation, and duration models. A main advantage of our approach is computational. For instance, rank estimation procedures such as those proposed in Han (1987) and Cavanagh and Sherman (1998) that optimize a nonsmooth, non convex objective function are difficult to use with more than a few regressors and so limits their use in with economic data sets. For such monotone index models with increasing dimension, we propose to use a new class of estimators based on batched gradient descent (BGD) involving nonparametric methods such as kernel estimation or sieve estimation, and study their asymptotic properties. The BGD algorithm uses an iterative procedure where the key step exploits a strictly convex objective function, resulting in computational advantages. A contribution of our approach is that our model is large dimensional and semiparametric and so does not require the use of parametric distributional assumptions.

Suggested Citation

  • Shakeeb Khan & Xiaoying Lan & Elie Tamer & Qingsong Yao, 2021. "Estimating High Dimensional Monotone Index Models by Iterative Convex Optimization1," Papers 2110.04388, arXiv.org, revised Feb 2023.
  • Handle: RePEc:arx:papers:2110.04388
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2110.04388
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Youngki Shin & Zvezdomir Todorov, 2021. "Exact computation of maximum rank correlation estimator," The Econometrics Journal, Royal Economic Society, vol. 24(3), pages 589-607.
    2. Wang, Hansheng, 2007. "A note on iterative marginal optimization: a simple algorithm for maximum rank correlation estimation," Computational Statistics & Data Analysis, Elsevier, vol. 51(6), pages 2803-2812, March.
    3. Newey, Whitney K, 1994. "The Asymptotic Variance of Semiparametric Estimators," Econometrica, Econometric Society, vol. 62(6), pages 1349-1382, November.
    4. Xiaohong Chen & Oliver Linton & Ingrid Van Keilegom, 2003. "Estimation of Semiparametric Models when the Criterion Function Is Not Smooth," Econometrica, Econometric Society, vol. 71(5), pages 1591-1608, September.
    5. Caner, Mehmet, 2014. "Near exogeneity and weak identification in generalized empirical likelihood estimators: Many moment asymptotics," Journal of Econometrics, Elsevier, vol. 182(2), pages 247-268.
    6. Komarova, Tatiana, 2013. "Binary choice models with discrete regressors: Identification and misspecification," Journal of Econometrics, Elsevier, vol. 177(1), pages 14-33.
    7. Lee, Lung-fei, 1995. "Semiparametric maximum likelihood estimation of polychotomous and sequential choice models," Journal of Econometrics, Elsevier, vol. 65(2), pages 381-428, February.
    8. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    9. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    10. A. Belloni & V. Chernozhukov & I. Fernández‐Val & C. Hansen, 2017. "Program Evaluation and Causal Inference With High‐Dimensional Data," Econometrica, Econometric Society, vol. 85, pages 233-298, January.
    11. Whitney K. Newey & Frank Windmeijer, 2009. "Generalized Method of Moments With Many Weak Moment Conditions," Econometrica, Econometric Society, vol. 77(3), pages 687-719, May.
    12. Han, Aaron K., 1987. "Non-parametric analysis of a generalized regression model : The maximum rank correlation estimator," Journal of Econometrics, Elsevier, vol. 35(2-3), pages 303-316, July.
    13. Dominitz, Jeff & Sherman, Robert P., 2005. "Some Convergence Theory For Iterative Estimation Procedures With An Application To Semiparametric Estimation," Econometric Theory, Cambridge University Press, vol. 21(4), pages 838-863, August.
    14. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2019. "Inference on Semiparametric Multinomial Response Models," Boston College Working Papers in Economics 980, Boston College Department of Economics.
    15. Heckman, James J, 1974. "Shadow Prices, Market Wages, and Labor Supply," Econometrica, Econometric Society, vol. 42(4), pages 679-694, July.
    16. Klein, Roger W & Spady, Richard H, 1993. "An Efficient Semiparametric Estimator for Binary Response Models," Econometrica, Econometric Society, vol. 61(2), pages 387-421, March.
    17. Jason Abrevaya & Jerry A. Hausman & Shakeeb Khan, 2010. "Testing for Causal Effects in a Generalized Regression Model With Endogenous Regressors," Econometrica, Econometric Society, vol. 78(6), pages 2043-2061, November.
    18. Khan, Shakeeb & Tamer, Elie, 2007. "Partial rank estimation of duration models with general forms of censoring," Journal of Econometrics, Elsevier, vol. 136(1), pages 251-280, January.
    19. Lancaster, Tony, 1979. "Econometric Methods for the Duration of Unemployment," Econometrica, Econometric Society, vol. 47(4), pages 939-956, July.
    20. Hyungtaik Ahn & Hidehiko Ichimura & James L. Powell & Paul A. Ruud, 2018. "Simple Estimators for Invertible Index Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 1-10, January.
    21. Abrevaya, Jason, 1999. "Leapfrog estimation of a fixed-effects model with unknown transformation of the dependent variable," Journal of Econometrics, Elsevier, vol. 93(2), pages 203-228, December.
    22. Fan, Yanqin & Han, Fang & Li, Wei & Zhou, Xiao-Hua, 2020. "On rank estimators in increasing dimensions," Journal of Econometrics, Elsevier, vol. 214(2), pages 379-412.
    23. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
    24. Cosslett, Stephen R, 1983. "Distribution-Free Maximum Likelihood Estimator of the Binary Choice Model," Econometrica, Econometric Society, vol. 51(3), pages 765-782, May.
    25. Sherman, Robert P, 1993. "The Limiting Distribution of the Maximum Rank Correlation Estimator," Econometrica, Econometric Society, vol. 61(1), pages 123-137, January.
    26. Ruud, Paul A, 1983. "Sufficient Conditions for the Consistency of Maximum Likelihood Estimation Despite Misspecifications of Distribution in Multinomial Discrete Choice Models," Econometrica, Econometric Society, vol. 51(1), pages 225-228, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Han, Jinyue & Wang, Jun & Gao, Wei & Tang, Man-Lai, 2023. "Estimation of the directions for unknown parameters in semiparametric models," MPRA Paper 116365, University Library of Munich, Germany.
    2. Qingsong Yao, 2023. "Stochastic Learning of Semiparametric Monotone Index Models with Large Sample Size," Papers 2309.06693, arXiv.org, revised Oct 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    2. Fu Ouyang & Thomas Tao Yang, 2020. "Semiparametric Discrete Choice Models for Bundles," Discussion Papers Series 625, School of Economics, University of Queensland, Australia.
    3. Magnac, Thierry & Maurin, Eric, 2007. "Identification and information in monotone binary models," Journal of Econometrics, Elsevier, vol. 139(1), pages 76-104, July.
    4. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2019. "Inference on Semiparametric Multinomial Response Models," Boston College Working Papers in Economics 980, Boston College Department of Economics.
    5. Youngki Shin & Zvezdomir Todorov, 2021. "Exact computation of maximum rank correlation estimator," The Econometrics Journal, Royal Economic Society, vol. 24(3), pages 589-607.
    6. Chen, Le-Yu & Lee, Sokbae, 2019. "Breaking the curse of dimensionality in conditional moment inequalities for discrete choice models," Journal of Econometrics, Elsevier, vol. 210(2), pages 482-497.
    7. Coppejans, Mark, 2001. "Estimation of the binary response model using a mixture of distributions estimator (MOD)," Journal of Econometrics, Elsevier, vol. 102(2), pages 231-269, June.
    8. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2020. "Inference on Semiparametric Multinomial Response Models," Discussion Papers Series 627, School of Economics, University of Queensland, Australia.
    9. Wayne Yuan Gao & Ming Li, 2020. "Robust Semiparametric Estimation in Panel Multinomial Choice Models," Papers 2009.00085, arXiv.org.
    10. Yanqin Fan & Fang Han & Wei Li & Xiao-Hua Zhou, 2019. "On rank estimators in increasing dimensions," Papers 1908.05255, arXiv.org.
    11. Fan, Yanqin & Han, Fang & Li, Wei & Zhou, Xiao-Hua, 2020. "On rank estimators in increasing dimensions," Journal of Econometrics, Elsevier, vol. 214(2), pages 379-412.
    12. Yan, Jin & Yoo, Hong Il, 2019. "Semiparametric estimation of the random utility model with rank-ordered choice data," Journal of Econometrics, Elsevier, vol. 211(2), pages 414-438.
    13. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2021. "Inference on semiparametric multinomial response models," Quantitative Economics, Econometric Society, vol. 12(3), pages 743-777, July.
    14. Christoph Breunig & Stephan Martin, 2020. "Nonclassical Measurement Error in the Outcome Variable," Papers 2009.12665, arXiv.org, revised May 2021.
    15. Hidehiko Ichimura & Whitney K. Newey, 2022. "The influence function of semiparametric estimators," Quantitative Economics, Econometric Society, vol. 13(1), pages 29-61, January.
    16. Subbotin, Viktor, 2007. "Asymptotic and bootstrap properties of rank regressions," MPRA Paper 9030, University Library of Munich, Germany, revised 20 Mar 2008.
    17. Aradillas-Lopez, Andres, 2012. "Pairwise-difference estimation of incomplete information games," Journal of Econometrics, Elsevier, vol. 168(1), pages 120-140.
    18. Qingsong Yao, 2023. "Stochastic Learning of Semiparametric Monotone Index Models with Large Sample Size," Papers 2309.06693, arXiv.org, revised Oct 2023.
    19. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    20. Taisuke Otsu & Mengshan Xu, 2022. "Isotonic propensity score matching," STICERD - Econometrics Paper Series 623, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2110.04388. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.