IDEAS home Printed from https://ideas.repec.org/a/plo/pbio00/3002758.html
   My bibliography  Save this article

A rigorous and versatile statistical test for correlations between stationary time series

Author

Listed:
  • Alex E Yuan
  • Wenying Shou

Abstract

In disciplines from biology to climate science, a routine task is to compute a correlation between a pair of time series and determine whether the correlation is statistically significant (i.e., unlikely under the null hypothesis that the time series are independent). This problem is challenging because time series typically exhibit autocorrelation and thus cannot be properly analyzed with the standard iid-oriented statistical tests. Although there are well-known parametric tests for time series, these are designed for linear correlation statistics and thus not suitable for the increasingly popular nonlinear correlation statistics. There are also nonparametric tests that can be used with any correlation statistic, but for these, the conditions that guarantee correct false positive rates are either restrictive or unclear. Here, we describe the truncated time-shift (TTS) test, a nonparametric procedure to test for dependence between 2 time series. We prove that this test correctly controls the false positive rate as long as one of the time series is stationary, a minimally restrictive requirement among current tests. The TTS test is versatile because it can be used with any correlation statistic. Using synthetic data, we demonstrate that this test performs correctly even while other tests suffer high false positive rates. In simulation examples, simple guidelines for parameter choices allow high statistical power to be achieved with sufficient data. We apply the test to datasets from climatology, animal behavior, and microbiome science, verifying previously discovered dependence relationships and detecting additional relationships.Testing the significance of a correlation between time series without substantial assumptions is a longstanding challenge. This study presents the truncated time-shift (TTS) test, a conservative significance test that is valid as long as one time series is statistically stationary.

Suggested Citation

  • Alex E Yuan & Wenying Shou, 2024. "A rigorous and versatile statistical test for correlations between stationary time series," PLOS Biology, Public Library of Science, vol. 22(8), pages 1-26, August.
  • Handle: RePEc:plo:pbio00:3002758
    DOI: 10.1371/journal.pbio.3002758
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3002758
    Download Restriction: no

    File URL: https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.3002758&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pbio.3002758?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mark Maslin, 2016. "Forty years of linking orbits to ice ages," Nature, Nature, vol. 540(7632), pages 208-209, December.
    2. Sean M Gibbons & Sean M Kearney & Chris S Smillie & Eric J Alm, 2017. "Two dynamic regimes in the human gut microbiome," PLOS Computational Biology, Public Library of Science, vol. 13(2), pages 1-20, February.
    3. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    4. Russell Davidson & James MacKinnon, 2000. "Bootstrap tests: how many bootstraps?," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 55-68.
    5. Masayuki Ushio & Chih-hao Hsieh & Reiji Masuda & Ethan R Deyle & Hao Ye & Chun-Wei Chang & George Sugihara & Michio Kondoh, 2018. "Fluctuating interaction network and time-varying stability of a natural fish community," Nature, Nature, vol. 554(7692), pages 360-363, February.
    6. Peter Huybers & Carl Wunsch, 2005. "Obliquity pacing of the late Pleistocene glacial terminations," Nature, Nature, vol. 434(7032), pages 491-494, March.
    7. David P Shorten & Richard E Spinney & Joseph T Lizier, 2021. "Estimating Transfer Entropy in Continuous Time Between Neural Spike Trains or Other Event-Based Data," PLOS Computational Biology, Public Library of Science, vol. 17(4), pages 1-45, April.
    8. Jakob Runge & Sebastian Bathiany & Erik Bollt & Gustau Camps-Valls & Dim Coumou & Ethan Deyle & Clark Glymour & Marlene Kretschmer & Miguel D. Mahecha & Jordi Muñoz-Marí & Egbert H. Nes & Jonas Peters, 2019. "Inferring causation from time series in Earth system sciences," Nature Communications, Nature, vol. 10(1), pages 1-13, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fang Guo & Pei Zhang & Vivian Do & Jakob Runge & Kun Zhang & Zheshen Han & Shenxi Deng & Hongli Lin & Sheikh Taslim Ali & Ruchong Chen & Yuming Guo & Linwei Tian, 2024. "Ozone as an environmental driver of influenza," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    2. M.L. Nores & M.P. Díaz, 2016. "Bootstrap hypothesis testing in generalized additive models for comparing curves of treatments in longitudinal studies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(5), pages 810-826, April.
    3. Debasish Roy, 2024. "An Exploration in Sustainability and Lifespan of Enterprise: A Cross–Country Empirical Study (2011–2020)," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 5307-5328, June.
    4. Levent, Korap, 2007. "Modeling purchasing power parity using co-integration: evidence from Turkey," MPRA Paper 19584, University Library of Munich, Germany.
    5. Goodall, Amanda H., 2009. "Highly cited leaders and the performance of research universities," Research Policy, Elsevier, vol. 38(7), pages 1079-1092, September.
    6. Wang, Shanchao & Alston, Julian M. & Pardey, Philip G., 2023. "R&D Lags in Economic Models," Staff Papers 330085, University of Minnesota, Department of Applied Economics.
    7. Yap, Wei Yim & Lam, Jasmine S.L., 2006. "Competition dynamics between container ports in East Asia," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(1), pages 35-51, January.
    8. Oscar Bajo-Rubio & Carmen Diaz-Roldan & Vicente Esteve, 2005. "Is the Fisher effect non-linear? some evidence for Spain, 1963-2002," Applied Financial Economics, Taylor & Francis Journals, vol. 15(12), pages 849-854.
    9. Nicholas Taylor, 1998. "Precious metals and inflation," Applied Financial Economics, Taylor & Francis Journals, vol. 8(2), pages 201-210.
    10. Md. Sharif Hossain & Md. Thasinul Abedin, 2016. "Multivariate Dynamic Co-integration and Causality Analysis between Inflation and its Determinants," Journal of Economics and Behavioral Studies, AMH International, vol. 8(5), pages 240-250.
    11. Lego, Brian & Gebremedhin, Tesfa & Cushing, Brian, 2000. "A Multi-Sector Export Base Model of Long-Run Regional Employment Growth," Agricultural and Resource Economics Review, Cambridge University Press, vol. 29(2), pages 192-197, October.
    12. R. Santos Alimi, 2014. "ARDL Bounds Testing Approach to Cointegration: A Re-Examination of Augmented Fisher Hypothesis in an Open Economy," Asian Journal of Economic Modelling, Asian Economic and Social Society, vol. 2(2), pages 103-114, June.
    13. Sollis, Robert, 2011. "Spurious regression: A higher-order problem," Economics Letters, Elsevier, vol. 111(2), pages 141-143, May.
    14. repec:zbw:rwirep:0557 is not listed on IDEAS
    15. Löschel Andreas & Oberndorfer Ulrich, 2009. "Oil and Unemployment in Germany," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 229(2-3), pages 146-162, April.
    16. Andreas Stephan, 1997. "The Impact of Road Infrastructure on Productivity and Growth: Some Preliminary Results for the German Manufacturing Sector," CIG Working Papers FS IV 97-47, Wissenschaftszentrum Berlin (WZB), Research Unit: Competition and Innovation (CIG).
    17. Guntram B. Wolff & Alexander Schulz, 2008. "Sovereign bond market integration: the euro, trading platforms and globalisation," European Economy - Economic Papers 2008 - 2015 332, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    18. Ivan Kitov & Oleg Kitov, 2013. "Does Banque de France control inflation and unemployment?," Papers 1311.1097, arXiv.org.
    19. Erida Curraj, 2019. "Vintage Design Furniture in Albania, a New Retro Design Paradigm in the Post-Communist Era," European Journal of Engineering and Formal Sciences Articles, Revistia Research and Publishing, vol. 2, ejef_19.
    20. Milena М. Kovachevich, 2021. "Economic Growth In The Eurozone And On The Balkans: A Cointegration Analysis," Economic Archive, D. A. Tsenov Academy of Economics, Svishtov, Bulgaria, issue 3 Year 20, pages 59-70.
    21. Valérie Mignon & Christophe Hurlin, 2007. "Une synthèse des tests de cointégration sur données de panel," Économie et Prévision, Programme National Persée, vol. 180(4), pages 241-265.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pbio00:3002758. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosbiology (email available below). General contact details of provider: https://journals.plos.org/plosbiology/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.