IDEAS home Printed from https://ideas.repec.org/a/plo/pbio00/3002758.html
   My bibliography  Save this article

A rigorous and versatile statistical test for correlations between stationary time series

Author

Listed:
  • Alex E Yuan
  • Wenying Shou

Abstract

In disciplines from biology to climate science, a routine task is to compute a correlation between a pair of time series and determine whether the correlation is statistically significant (i.e., unlikely under the null hypothesis that the time series are independent). This problem is challenging because time series typically exhibit autocorrelation and thus cannot be properly analyzed with the standard iid-oriented statistical tests. Although there are well-known parametric tests for time series, these are designed for linear correlation statistics and thus not suitable for the increasingly popular nonlinear correlation statistics. There are also nonparametric tests that can be used with any correlation statistic, but for these, the conditions that guarantee correct false positive rates are either restrictive or unclear. Here, we describe the truncated time-shift (TTS) test, a nonparametric procedure to test for dependence between 2 time series. We prove that this test correctly controls the false positive rate as long as one of the time series is stationary, a minimally restrictive requirement among current tests. The TTS test is versatile because it can be used with any correlation statistic. Using synthetic data, we demonstrate that this test performs correctly even while other tests suffer high false positive rates. In simulation examples, simple guidelines for parameter choices allow high statistical power to be achieved with sufficient data. We apply the test to datasets from climatology, animal behavior, and microbiome science, verifying previously discovered dependence relationships and detecting additional relationships.Testing the significance of a correlation between time series without substantial assumptions is a longstanding challenge. This study presents the truncated time-shift (TTS) test, a conservative significance test that is valid as long as one time series is statistically stationary.

Suggested Citation

  • Alex E Yuan & Wenying Shou, 2024. "A rigorous and versatile statistical test for correlations between stationary time series," PLOS Biology, Public Library of Science, vol. 22(8), pages 1-26, August.
  • Handle: RePEc:plo:pbio00:3002758
    DOI: 10.1371/journal.pbio.3002758
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3002758
    Download Restriction: no

    File URL: https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.3002758&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pbio.3002758?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mark Maslin, 2016. "Forty years of linking orbits to ice ages," Nature, Nature, vol. 540(7632), pages 208-209, December.
    2. Sean M Gibbons & Sean M Kearney & Chris S Smillie & Eric J Alm, 2017. "Two dynamic regimes in the human gut microbiome," PLOS Computational Biology, Public Library of Science, vol. 13(2), pages 1-20, February.
    3. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    4. Russell Davidson & James MacKinnon, 2000. "Bootstrap tests: how many bootstraps?," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 55-68.
    5. Masayuki Ushio & Chih-hao Hsieh & Reiji Masuda & Ethan R Deyle & Hao Ye & Chun-Wei Chang & George Sugihara & Michio Kondoh, 2018. "Fluctuating interaction network and time-varying stability of a natural fish community," Nature, Nature, vol. 554(7692), pages 360-363, February.
    6. Peter Huybers & Carl Wunsch, 2005. "Obliquity pacing of the late Pleistocene glacial terminations," Nature, Nature, vol. 434(7032), pages 491-494, March.
    7. David P Shorten & Richard E Spinney & Joseph T Lizier, 2021. "Estimating Transfer Entropy in Continuous Time Between Neural Spike Trains or Other Event-Based Data," PLOS Computational Biology, Public Library of Science, vol. 17(4), pages 1-45, April.
    8. Jakob Runge & Sebastian Bathiany & Erik Bollt & Gustau Camps-Valls & Dim Coumou & Ethan Deyle & Clark Glymour & Marlene Kretschmer & Miguel D. Mahecha & Jordi Muñoz-Marí & Egbert H. Nes & Jonas Peters, 2019. "Inferring causation from time series in Earth system sciences," Nature Communications, Nature, vol. 10(1), pages 1-13, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fang Guo & Pei Zhang & Vivian Do & Jakob Runge & Kun Zhang & Zheshen Han & Shenxi Deng & Hongli Lin & Sheikh Taslim Ali & Ruchong Chen & Yuming Guo & Linwei Tian, 2024. "Ozone as an environmental driver of influenza," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    2. M.L. Nores & M.P. Díaz, 2016. "Bootstrap hypothesis testing in generalized additive models for comparing curves of treatments in longitudinal studies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(5), pages 810-826, April.
    3. Levent, Korap, 2007. "Modeling purchasing power parity using co-integration: evidence from Turkey," MPRA Paper 19584, University Library of Munich, Germany.
    4. Yap, Wei Yim & Lam, Jasmine S.L., 2006. "Competition dynamics between container ports in East Asia," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(1), pages 35-51, January.
    5. Nicholas Taylor, 1998. "Precious metals and inflation," Applied Financial Economics, Taylor & Francis Journals, vol. 8(2), pages 201-210.
    6. Md. Sharif Hossain & Md. Thasinul Abedin, 2016. "Multivariate Dynamic Co-integration and Causality Analysis between Inflation and its Determinants," Journal of Economics and Behavioral Studies, AMH International, vol. 8(5), pages 240-250.
    7. Lego, Brian & Gebremedhin, Tesfa & Cushing, Brian, 2000. "A Multi-Sector Export Base Model of Long-Run Regional Employment Growth," Agricultural and Resource Economics Review, Cambridge University Press, vol. 29(2), pages 192-197, October.
    8. R. Santos Alimi, 2014. "ARDL Bounds Testing Approach to Cointegration: A Re-Examination of Augmented Fisher Hypothesis in an Open Economy," Asian Journal of Economic Modelling, Asian Economic and Social Society, vol. 2(2), pages 103-114, June.
    9. Guntram B. Wolff & Alexander Schulz, 2008. "Sovereign bond market integration: the euro, trading platforms and globalisation," European Economy - Economic Papers 2008 - 2015 332, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    10. Erida Curraj, 2019. "Vintage Design Furniture in Albania, a New Retro Design Paradigm in the Post-Communist Era," European Journal of Engineering and Formal Sciences Articles, Revistia Research and Publishing, vol. 2, ejef_19.
    11. Valérie Mignon & Christophe Hurlin, 2007. "Une synthèse des tests de cointégration sur données de panel," Économie et Prévision, Programme National Persée, vol. 180(4), pages 241-265.
    12. Maurice Obstfeld & Jay C. Shambaugh & Alan M. Taylor, 2005. "The Trilemma in History: Tradeoffs Among Exchange Rates, Monetary Policies, and Capital Mobility," The Review of Economics and Statistics, MIT Press, vol. 87(3), pages 423-438, August.
    13. Chun-Chang Lee & Chih-Min Liang & Hsing-Jung Chou, 2013. "Identifying Taiwan real estate cycle turning points- An application of the multivariate Markov-switching autoregressive Model," Advances in Management and Applied Economics, SCIENPRESS Ltd, vol. 3(2), pages 1-1.
    14. Roberto Cellini & Tiziana Cuccia, 2013. "Museum and monument attendance and tourism flow: a time series analysis approach," Applied Economics, Taylor & Francis Journals, vol. 45(24), pages 3473-3482, August.
    15. Mishkin, Frederic S, 1982. "Does Anticipated Monetary Policy Matter? An Econometric Investigation," Journal of Political Economy, University of Chicago Press, vol. 90(1), pages 22-51, February.
    16. Mr. Jacques Bouhga-Hagbe, 2004. "A Theory of Workers' Remittances with An Application to Morocco," IMF Working Papers 2004/194, International Monetary Fund.
    17. Dierk Herzer & Philipp Hühne & Peter Nunnenkamp, 2014. "FDI and Income Inequality—Evidence from Latin American Economies," Review of Development Economics, Wiley Blackwell, vol. 18(4), pages 778-793, November.
    18. Bühler, Wolfgang & Korn, Olaf, 1998. "Hedging langfristiger Lieferverpflichtungen mit kurzfristigen Futures: möglich oder unmöglich?," ZEW Discussion Papers 98-20, ZEW - Leibniz Centre for European Economic Research.
    19. Kangyin Dong & Yalin Han & Yue Dou & Muhammad Shahbaz, 2022. "Moving toward carbon neutrality: Assessing natural gas import security and its impact on CO2 emissions," Sustainable Development, John Wiley & Sons, Ltd., vol. 30(4), pages 751-770, August.
    20. Lukmanova, Elizaveta & Tondl, Gabriele, 2017. "Macroeconomic imbalances and business cycle synchronization. Why common economic governance is imperative for the Eurozone," Economic Modelling, Elsevier, vol. 62(C), pages 130-144.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pbio00:3002758. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosbiology (email available below). General contact details of provider: https://journals.plos.org/plosbiology/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.