IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2302.08097.html

New $\sqrt{n}$-consistent, numerically stable higher-order influence function estimators

Author

Listed:
  • Lin Liu
  • Chang Li

Abstract

Higher-Order Influence Functions (HOIFs) provide a unified theory for constructing rate-optimal estimators for a large class of low-dimensional (smooth) statistical functionals/parameters (and sometimes even infinite-dimensional functions) that arise in substantive fields including epidemiology, economics, and the social sciences. Since the introduction of HOIFs by Robins et al. (2008), they have been viewed mostly as a theoretical benchmark rather than a useful tool for statistical practice. Works aimed to flip the script are scant, but a few recent papers Liu et al. (2017, 2021b) make some partial progress. In this paper, we take a fresh attempt at achieving this goal by constructing new, numerically stable HOIF estimators (or sHOIF estimators for short with ``s'' standing for ``stable'') with provable statistical, numerical, and computational guarantees. This new class of sHOIF estimators (up to the 2nd order) was foreshadowed in synthetic experiments conducted by Liu et al. (2020a).

Suggested Citation

  • Lin Liu & Chang Li, 2023. "New $\sqrt{n}$-consistent, numerically stable higher-order influence function estimators," Papers 2302.08097, arXiv.org.
    • Handle: RePEc:arx:papers:2302.08097
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2302.08097
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Max H. Farrell & Tengyuan Liang & Sanjog Misra, 2021. "Deep Neural Networks for Estimation and Inference," Econometrica, Econometric Society, vol. 89(1), pages 181-213, January.
    2. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Kato, Kengo, 2015. "Some new asymptotic theory for least squares series: Pointwise and uniform results," Journal of Econometrics, Elsevier, vol. 186(2), pages 345-366.
    3. Rajarshi Mukherjee & Whitney K. Newey & James Robins, 2017. "Semiparametric efficient empirical higher order influence function estimators," CeMMAP working papers CWP30/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. A Rotnitzky & E Smucler & J M Robins, 2021. "Characterization of parameters with a mixed bias property," Biometrika, Biometrika Trust, vol. 108(1), pages 231-238.
    5. Rajarshi Mukherjee & Whitney K. Newey & James Robins, 2017. "Semiparametric efficient empirical higher order influence function estimators," CeMMAP working papers 30/17, Institute for Fiscal Studies.
    6. Chunrong Ai & Oliver Linton & Kaiji Motegi & Zheng Zhang, 2021. "A unified framework for efficient estimation of general treatment models," Quantitative Economics, Econometric Society, vol. 12(3), pages 779-816, July.
    7. Bhattacharya, Rabi N. & Ghosh, Jayanta K., 1992. "A class of U-statistics and asymptotic normality of the number of k-clusters," Journal of Multivariate Analysis, Elsevier, vol. 43(2), pages 300-330, November.
    8. Newey, Whitney K, 1990. "Semiparametric Efficiency Bounds," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(2), pages 99-135, April-Jun.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Lin & Mukherjee, Rajarshi & Robins, James M., 2024. "Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators," Journal of Econometrics, Elsevier, vol. 240(2).
    2. Xingyu Chen & Lin Liu & Rajarshi Mukherjee, 2024. "Method-of-Moments Inference for GLMs and Doubly Robust Functionals under Proportional Asymptotics," Papers 2408.06103, arXiv.org, revised May 2025.
    3. Jikai Jin & Vasilis Syrgkanis, 2024. "Structure-agnostic Optimality of Doubly Robust Learning for Treatment Effect Estimation," Papers 2402.14264, arXiv.org, revised Jun 2025.
    4. Michael Jansson & Demian Pouzo, 2017. "Towards a General Large Sample Theory for Regularized Estimators," Papers 1712.07248, arXiv.org, revised Jul 2020.
    5. Yukitoshi Matsushita & Taisuke Otsu & Keisuke Takahata, 2022. "Estimating density ratio of marginals to joint: Applications to causal inference," STICERD - Econometrics Paper Series 619, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    6. Liu, Nan & Liu, Yanbo & Sasaki, Yuya, 2026. "Estimation and inference for causal functions with multi-way clustered data," Journal of Econometrics, Elsevier, vol. 253(C).
    7. Phillip Heiler & Michael C. Knaus, 2021. "Effect or Treatment Heterogeneity? Policy Evaluation with Aggregated and Disaggregated Treatments," Papers 2110.01427, arXiv.org, revised Aug 2023.
    8. Chen, Xiaohong & Liu, Ying & Ma, Shujie & Zhang, Zheng, 2024. "Causal inference of general treatment effects using neural networks with a diverging number of confounders," Journal of Econometrics, Elsevier, vol. 238(1).
    9. Whitney K. Newey & James M. Robins, 2017. "Cross-fitting and fast remainder rates for semiparametric estimation," CeMMAP working papers 41/17, Institute for Fiscal Studies.
    10. Kazuhiko Shinoda & Takahiro Hoshino, 2022. "Orthogonal Series Estimation for the Ratio of Conditional Expectation Functions," Papers 2212.13145, arXiv.org.
    11. Yanqin Fan & Yuan Qi & Gaoqian Xu, 2025. "Policy Learning with $\alpha$-Expected Welfare," Papers 2505.00256, arXiv.org.
    12. Max H. Farrell & Tengyuan Liang & Sanjog Misra, 2020. "Deep Learning for Individual Heterogeneity," Papers 2010.14694, arXiv.org, revised Apr 2025.
    13. Chunrong Ai & Yue Fang & Haitian Xie, 2024. "Data-Driven Policy Learning for Continuous Treatments," Papers 2402.02535, arXiv.org, revised Dec 2025.
    14. Sihui Zhao & Xinbo Wang & Lin Liu & Xin Zhang, 2024. "Covariate Adjustment in Randomized Experiments Motivated by Higher-Order Influence Functions," Papers 2411.08491, arXiv.org, revised Nov 2025.
    15. Christoph Breunig & Ruixuan Liu & Zhengfei Yu, 2022. "Double Robust Bayesian Inference on Average Treatment Effects," Papers 2211.16298, arXiv.org, revised Feb 2025.
    16. Whitney K. Newey & James M. Robins, 2017. "Cross-fitting and fast remainder rates for semiparametric estimation," CeMMAP working papers CWP41/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Y Cui & E J Tchetgen Tchetgen, 2024. "Selective machine learning of doubly robust functionals," Biometrika, Biometrika Trust, vol. 111(2), pages 517-535.
    18. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    19. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP72/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Mona Azadkia & Leihao Chen & Fang Han, 2025. "Bias correction for Chatterjee's graph-based correlation coefficient," Papers 2508.09040, arXiv.org, revised Jan 2026.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2302.08097. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.