IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/2548.html

Fast Online Inference On Semiparametric Models

Author

Listed:
  • Xiaohong Chen

    (Yale University)

  • Elie Tamer

    (Harvard University)

  • Qingsong Yao

    (Louisiana State University)

Abstract

This paper develops a framework for fast online inference on semiparametric models with large sample sizes and possibly many covariates. The computational algorithm itself is the object of statistical study: after a globally consistent warm start in the first phase, the path of averaged online iterates generated in the second phase automatically delivers estimators with optimal convergence rates and valid confidence sets. Both phases require only a single pass over the data stream and are well suited to streaming data or to settings with storage/privacy constraints. For semiparametric monotone index models, the averaged trajectory of the second phase lead to estimators that are automatically orthogonalized and satisfy the laws of the iterated logarithms, and policy functionals are updated along the same trajectory at negligible additional cost. The averaged trajectories satisfy functional central limit theorems, which yield fast online inference via random scaling and bypass the explicit variance estimation that complicates inference for semiparametric models. Applied to a fixed large sample, our online algorithm achieves substantial computational gains over corresponding offline procedures without sacrificing statistical performance. Monte Carlo experiments show adequate behavior. Our methods are applied to 19 million traffic-stop online records from the North Carolina State Patrol (Pierson et al. 2020) and to the international trade data of Helpman et al. (2008) with over 300 regressors. We also compare our estimator to its parametric benchmark in both empirical illustrations.

Suggested Citation

  • Xiaohong Chen & Elie Tamer & Qingsong Yao, 2026. "Fast Online Inference On Semiparametric Models," Cowles Foundation Discussion Papers 2548, Cowles Foundation for Research in Economics, Yale University.
  • Handle: RePEc:cwl:cwldpp:2548
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/2026-07/d2548.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bierens, Herman J., 2014. "Consistency And Asymptotic Normality Of Sieve Ml Estimators Under Low-Level Conditions," Econometric Theory, Cambridge University Press, vol. 30(5), pages 1021-1076, October.
    2. Khan, Shakeeb & Lan, Xiaoying & Tamer, Elie & Yao, Qingsong, 2025. "Estimating high dimensional monotone index models by iterative convex optimization," Journal of Econometrics, Elsevier, vol. 252(PB).
    3. Gabriel Jiménez & Steven Ongena & José‐Luis Peydró & Jesús Saurina, 2014. "Hazardous Times for Monetary Policy: What Do Twenty‐Three Million Bank Loans Say About the Effects of Monetary Policy on Credit Risk‐Taking?," Econometrica, Econometric Society, vol. 82(2), pages 463-505, March.
    4. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Kato, Kengo, 2015. "Some new asymptotic theory for least squares series: Pointwise and uniform results," Journal of Econometrics, Elsevier, vol. 186(2), pages 345-366.
    5. Lee, Sokbae & Liao, Yuan & Seo, Myung Hwan & Shin, Youngki, 2025. "Fast inference for quantile regression with tens of millions of observations," Journal of Econometrics, Elsevier, vol. 249(PA).
    6. David Atkin & Benjamin Faber & Marco Gonzalez-Navarro, 2018. "Retail Globalization and Household Welfare: Evidence from Mexico," Journal of Political Economy, University of Chicago Press, vol. 126(1), pages 1-73.
    7. Stefano DellaVigna & Matthew Gentzkow, 2019. "Uniform Pricing in U.S. Retail Chains," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 2011-2084.
    8. Powell, James L & Stock, James H & Stoker, Thomas M, 1989. "Semiparametric Estimation of Index Coefficients," Econometrica, Econometric Society, vol. 57(6), pages 1403-1430, November.
    9. Elhanan Helpman & Marc Melitz & Yona Rubinstein, 2008. "Estimating Trade Flows: Trading Partners and Trading Volumes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(2), pages 441-487.
    10. Han, Aaron K., 1987. "Non-parametric analysis of a generalized regression model : The maximum rank correlation estimator," Journal of Econometrics, Elsevier, vol. 35(2-3), pages 303-316, July.
    11. Heckman, James J, 1974. "Shadow Prices, Market Wages, and Labor Supply," Econometrica, Econometric Society, vol. 42(4), pages 679-694, July.
    12. Chen Xiaohong & White Halbert, 2002. "Asymptotic Properties of Some Projection-based Robbins-Monro Procedures in a Hilbert Space," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 6(1), pages 1-55, April.
    13. Yin, G. & Zhu, Y. M., 1990. "On H-valued Robbins-Monro processes," Journal of Multivariate Analysis, Elsevier, vol. 34(1), pages 116-140, July.
    14. Alberto Cavallo, 2017. "Are Online and Offline Prices Similar? Evidence from Large Multi-channel Retailers," American Economic Review, American Economic Association, vol. 107(1), pages 283-303, January.
    15. Jason Abrevaya & Jerry A. Hausman & Shakeeb Khan, 2010. "Testing for Causal Effects in a Generalized Regression Model With Endogenous Regressors," Econometrica, Econometric Society, vol. 78(6), pages 2043-2061, November.
    16. Sumit Agarwal & Souphala Chomsisengphet & Neale Mahoney & Johannes Stroebel, 2018. "Do Banks Pass through Credit Expansions to Consumers Who want to Borrow?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 129-190.
    17. Hyungtaik Ahn & Hidehiko Ichimura & James L. Powell & Paul A. Ruud, 2018. "Simple Estimators for Invertible Index Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 1-10, January.
    18. Chunrong Ai & Xiaohong Chen, 2003. "Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions," Econometrica, Econometric Society, vol. 71(6), pages 1795-1843, November.
    19. Christian Broda & David E. Weinstein, 2010. "Product Creation and Destruction: Evidence and Price Implications," American Economic Review, American Economic Association, vol. 100(3), pages 691-723, June.
    20. Chen, Xiaohong & Christensen, Timothy M., 2015. "Optimal uniform convergence rates and asymptotic normality for series estimators under weak dependence and weak conditions," Journal of Econometrics, Elsevier, vol. 188(2), pages 447-465.
    21. Fan, Yanqin & Han, Fang & Li, Wei & Zhou, Xiao-Hua, 2020. "On rank estimators in increasing dimensions," Journal of Econometrics, Elsevier, vol. 214(2), pages 379-412.
    22. Hyungtaik Ahn & Hidehiko Ichimura & James L. Powell & Paul A. Ruud, 2018. "Rejoinder for “Simple Estimators for Invertible Index Models”," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 22-23, January.
    23. Klein, Roger W & Spady, Richard H, 1993. "An Efficient Semiparametric Estimator for Binary Response Models," Econometrica, Econometric Society, vol. 61(2), pages 387-421, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiaohong Chen & Elie Tamer & Qingsong Yao, 2026. "Fast Online Inference on Semiparametric Models," Papers 2603.08614, arXiv.org, revised Jul 2026.
    2. Khan, Shakeeb & Lan, Xiaoying & Tamer, Elie & Yao, Qingsong, 2025. "Estimating high dimensional monotone index models by iterative convex optimization," Journal of Econometrics, Elsevier, vol. 252(PB).
    3. Qingsong Yao, 2023. "Stochastic Learning of Semiparametric Monotone Index Models with Large Sample Size," Papers 2309.06693, arXiv.org, revised Oct 2023.
    4. Shakeeb Khan & Xiaoying Lan & Elie Tamer & Qingsong Yao, 2021. "Estimating High Dimensional Monotone Index Models by Iterative Convex Optimization1," Papers 2110.04388, arXiv.org, revised Feb 2023.
    5. Ackerberg, Daniel A. & Xu, Haiqing, 2024. "On extending Powell, Stock, and Stoker (1989) to indexes with functionally dependent covariates," Economics Letters, Elsevier, vol. 242(C).
    6. Breunig, Christoph & Mammen, Enno & Simoni, Anna, 2018. "Nonparametric estimation in case of endogenous selection," Journal of Econometrics, Elsevier, vol. 202(2), pages 268-285.
    7. Botosaru, Irene & Muris, Chris, 2025. "Identification of time-varying counterfactual parameters in nonlinear panel models," Journal of Econometrics, Elsevier, vol. 252(PB).
    8. Subbotin, Viktor, 2007. "Asymptotic and bootstrap properties of rank regressions," MPRA Paper 9030, University Library of Munich, Germany, revised 20 Mar 2008.
    9. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2019. "Inference on Semiparametric Multinomial Response Models," Boston College Working Papers in Economics 980, Boston College Department of Economics.
    10. repec:cam:camjip:2408 is not listed on IDEAS
    11. Hoste, Joris & Verboven, Frank, 2024. "Uncovering the Sources of Geographic Market Segmentation: Evidence from the EU and the US," CEPR Discussion Papers 18911, Centre for Economic Policy Research.
    12. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    13. Aradillas-Lopez, Andres, 2024. "Inference in models with partially identified control functions," Journal of Econometrics, Elsevier, vol. 238(1).
    14. Dong, Chaohua & Linton, Oliver & Peng, Bin, 2021. "A weighted sieve estimator for nonparametric time series models with nonstationary variables," Journal of Econometrics, Elsevier, vol. 222(2), pages 909-932.
    15. Subbotin, Viktor, 2008. "Essays on the econometric theory of rank regressions," MPRA Paper 14086, University Library of Munich, Germany.
    16. Aradillas-López, Andrés, 2021. "Computing semiparametric efficiency bounds in discrete choice models with strategic-interactions and rational expectations," Journal of Econometrics, Elsevier, vol. 221(1), pages 25-42.
    17. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355, December.
    18. Ai, Chunrong & Chen, Xiaohong, 2007. "Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables," Journal of Econometrics, Elsevier, vol. 141(1), pages 5-43, November.
    19. Ming-Yueh Huang & Chin-Tsang Chiang, 2017. "Estimation and Inference Procedures for Semiparametric Distribution Models with Varying Linear-Index," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(2), pages 396-424, June.
    20. Chen, Le-Yu & Lee, Sokbae, 2019. "Breaking the curse of dimensionality in conditional moment inequalities for discrete choice models," Journal of Econometrics, Elsevier, vol. 210(2), pages 482-497.
    21. Coppejans, Mark, 2001. "Estimation of the binary response model using a mixture of distributions estimator (MOD)," Journal of Econometrics, Elsevier, vol. 102(2), pages 231-269, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:2548. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.