IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v84y2022i5p1821-1850.html
   My bibliography  Save this article

Conditional independence testing in Hilbert spaces with applications to functional data analysis

Author

Listed:
  • Anton Rask Lundborg
  • Rajen D. Shah
  • Jonas Peters

Abstract

We study the problem of testing the null hypothesis that X and Y are conditionally independent given Z, where each of X, Y and Z may be functional random variables. This generalises testing the significance of X in a regression model of scalar response Y on functional regressors X and Z. We show, however, that even in the idealised setting where additionally (X, Y, Z) has a Gaussian distribution, the power of any test cannot exceed its size. Further modelling assumptions are needed and we argue that a convenient way of specifying these assumptions is based on choosing methods for regressing each of X and Y on Z. We propose a test statistic involving inner products of the resulting residuals that is simple to compute and calibrate: type I error is controlled uniformly when the in‐sample prediction errors are sufficiently small. We show this requirement is met by ridge regression in functional linear model settings without requiring any eigen‐spacing conditions or lower bounds on the eigenvalues of the covariance of the functional regressor. We apply our test in constructing confidence intervals for truncation points in truncated functional linear models and testing for edges in a functional graphical model for EEG data.

Suggested Citation

  • Anton Rask Lundborg & Rajen D. Shah & Jonas Peters, 2022. "Conditional independence testing in Hilbert spaces with applications to functional data analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1821-1850, November.
  • Handle: RePEc:bla:jorssb:v:84:y:2022:i:5:p:1821-1850
    DOI: 10.1111/rssb.12544
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssb.12544
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssb.12544?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    2. Duchesne, Pierre & Lafaye De Micheaux, Pierre, 2010. "Computing the distribution of quadratic forms: Further comparisons between the Liu-Tang-Zhang approximation and exact methods," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 858-862, April.
    3. Qiao, Xinghao & Qian, Cheng & James, Gareth M. & Guo, Shaojun, 2020. "Doubly functional graphical models in high dimensions," LSE Research Online Documents on Economics 103120, London School of Economics and Political Science, LSE Library.
    4. Reiss Philip T. & Huang Lei & Mennes Maarten, 2010. "Fast Function-on-Scalar Regression with Penalized Basis Expansions," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-30, August.
    5. Fang Yao & Hans-Georg Müller, 2010. "Functional quadratic regression," Biometrika, Biometrika Trust, vol. 97(1), pages 49-64.
    6. Benatia, David & Carrasco, Marine & Florens, Jean-Pierre, 2017. "Functional linear regression with functional response," Journal of Econometrics, Elsevier, vol. 201(2), pages 269-291.
    7. Jonas Peters & Peter Bühlmann & Nicolai Meinshausen, 2016. "Causal inference by using invariant prediction: identification and confidence intervals," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(5), pages 947-1012, November.
    8. L. Ingber, 1997. "Statistical mechanics of neocortical interactions: Applications of canonical momenta indicators to electroencephalography," Lester Ingber Papers 97ni, Lester Ingber.
    9. Ming Yuan & Yi Lin, 2007. "Model selection and estimation in the Gaussian graphical model," Biometrika, Biometrika Trust, vol. 94(1), pages 19-35.
    10. Andrada Ivanescu & Ana-Maria Staicu & Fabian Scheipl & Sonja Greven, 2015. "Penalized function-on-function regression," Computational Statistics, Springer, vol. 30(2), pages 539-568, June.
    11. Xinghao Qiao & Shaojun Guo & Gareth M. James, 2019. "Functional Graphical Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 211-222, January.
    12. Reiss, Philip T. & Ogden, R. Todd, 2007. "Functional Principal Component Regression and Functional Partial Least Squares," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 984-996, September.
    13. L. Ingber, 1998. "Statistical mechanics of neocortical interactions: Training and testing canonical momenta indicators of EEG," Lester Ingber Papers 98ni, Lester Ingber.
    14. Chen, Xiaohong & White, Halbert, 1998. "Central Limit And Functional Central Limit Theorems For Hilbert-Valued Dependent Heterogeneous Arrays With Applications," Econometric Theory, Cambridge University Press, vol. 14(2), pages 260-284, April.
    15. Peter Hall & Giles Hooker, 2016. "Truncated linear models for functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 637-653, June.
    16. Xinghao Qiao & Cheng Qian & Gareth M James & Shaojun Guo, 2020. "Doubly functional graphical models in high dimensions," Biometrika, Biometrika Trust, vol. 107(2), pages 415-431.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ufuk Beyaztas & Han Lin Shang, 2021. "A partial least squares approach for function-on-function interaction regression," Computational Statistics, Springer, vol. 36(2), pages 911-939, June.
    2. Fangting Zhou & Kejun He & Kunbo Wang & Yanxun Xu & Yang Ni, 2023. "Functional Bayesian networks for discovering causality from multivariate functional data," Biometrics, The International Biometric Society, vol. 79(4), pages 3279-3293, December.
    3. Philip T. Reiss & Jeff Goldsmith & Han Lin Shang & R. Todd Ogden, 2017. "Methods for Scalar-on-Function Regression," International Statistical Review, International Statistical Institute, vol. 85(2), pages 228-249, August.
    4. Goldsmith, Jeff & Scheipl, Fabian, 2014. "Estimator selection and combination in scalar-on-function regression," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 362-372.
    5. Codazzi, Laura & Colombi, Alessandro & Gianella, Matteo & Argiento, Raffaele & Paci, Lucia & Pini, Alessia, 2022. "Gaussian graphical modeling for spectrometric data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    6. Ruoxuan Xiong & Allison Koenecke & Michael Powell & Zhu Shen & Joshua T. Vogelstein & Susan Athey, 2021. "Federated Causal Inference in Heterogeneous Observational Data," Papers 2107.11732, arXiv.org, revised Apr 2023.
    7. L. Ingber, 2016. "Statistical mechanics of neocortical interactions: Large-scale EEG influences on molecular processes," Lester Ingber Papers 16ls, Lester Ingber.
    8. Kim, Kyongwon, 2022. "On principal graphical models with application to gene network," Computational Statistics & Data Analysis, Elsevier, vol. 166(C).
    9. L. Ingber, 2015. "Biological Impact on Military Intelligence: Application or Metaphor?," Lester Ingber Papers 15bi, Lester Ingber.
    10. S Klaassen & J Kueck & M Spindler & V Chernozhukov, 2023. "Uniform inference in high-dimensional Gaussian graphical models," Biometrika, Biometrika Trust, vol. 110(1), pages 51-68.
    11. Andrew B. Martinez, 2020. "Forecast Accuracy Matters for Hurricane Damage," Econometrics, MDPI, vol. 8(2), pages 1-24, May.
    12. repec:lei:ingber:14cp is not listed on IDEAS
    13. repec:lei:ingber:15cr is not listed on IDEAS
    14. L. Ingber, 2020. "Revisiting Our Quantum World," Lester Ingber Papers 20rq, Lester Ingber.
    15. Zhou, Zhiyang, 2021. "Fast implementation of partial least squares for function-on-function regression," Journal of Multivariate Analysis, Elsevier, vol. 185(C).
    16. Fabio Centofanti & Antonio Lepore & Alessandra Menafoglio & Biagio Palumbo & Simone Vantini, 2023. "Adaptive smoothing spline estimator for the function-on-function linear regression model," Computational Statistics, Springer, vol. 38(1), pages 191-216, March.
    17. L. Ingber, 1999. "A simple options training model," Lester Ingber Papers 99so, Lester Ingber.
    18. Manuel Febrero-Bande & Pedro Galeano & Wenceslao González-Manteiga, 2017. "Functional Principal Component Regression and Functional Partial Least-squares Regression: An Overview and a Comparative Study," International Statistical Review, International Statistical Institute, vol. 85(1), pages 61-83, April.
    19. Lakraj, Gamage Pemantha & Ruymgaart, Frits, 2017. "Some asymptotic theory for Silverman’s smoothed functional principal components in an abstract Hilbert space," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 122-132.
    20. Fang, Qin & Guo, Shaojun & Qiao, Xinghao, 2022. "Finite sample theory for high-dimensional functional/scalar time series with applications," LSE Research Online Documents on Economics 114637, London School of Economics and Political Science, LSE Library.
    21. Qi, Xin & Luo, Ruiyan, 2018. "Function-on-function regression with thousands of predictive curves," Journal of Multivariate Analysis, Elsevier, vol. 163(C), pages 51-66.
    22. Lester Ingber, 2020. "Developing Bid-Ask Probabilities for High-Frequency Trading," Virtual Economics, The London Academy of Science and Business, vol. 3(2), pages 7-24, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:84:y:2022:i:5:p:1821-1850. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.