IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/119352.html

Testing for the Markov property in time series via deep conditional generative learning

Author

Listed:
  • Zhou, Yunzhe
  • Shi, Chengchun
  • Li, Lexin
  • Yao, Qiwei

Abstract

The Markov property is widely imposed in analysis of time series data. Correspondingly, testing the Markov property, and relatedly, inferring the order of a Markov model, are of paramount importance. In this article, we propose a nonparametric test for the Markov property in high-dimensional time series via deep conditional generative learning. We also apply the test sequentially to determine the order of the Markov model. We show that the test controls the type-I error asymptotically, and has the power approaching one. Our proposal makes novel contributions in several ways. We utilise and extend state-of-the-art deep generative learning to estimate the conditional density functions, and establish a sharp upper bound on the approximation error of the estimators. We derive a doubly robust test statistic, which employs a nonparametric estimation but achieves a parametric convergence rate. We further adopt sample splitting and cross-fitting to minimise the conditions required to ensure the consistency of the test. We demonstrate the efficacy of the test through both simulations and the three data applications.

Suggested Citation

  • Zhou, Yunzhe & Shi, Chengchun & Li, Lexin & Yao, Qiwei, 2023. "Testing for the Markov property in time series via deep conditional generative learning," LSE Research Online Documents on Economics 119352, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:119352
    as

    Download full text from publisher

    File URL: https://researchonline.lse.ac.uk/id/eprint/119352/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Max H. Farrell & Tengyuan Liang & Sanjog Misra, 2021. "Deep Neural Networks for Estimation and Inference," Econometrica, Econometric Society, vol. 89(1), pages 181-213, January.
    2. Jonas Rothfuss & Fabio Ferreira & Simon Walther & Maxim Ulrich, 2019. "Conditional Density Estimation with Neural Networks: Best Practices and Benchmarks," Papers 1903.00954, arXiv.org, revised Apr 2019.
    3. Chengchun Shi & Rui Song & Wenbin Lu & Runze Li, 2021. "Statistical Inference for High-Dimensional Models via Recursive Online-Score Estimation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(535), pages 1307-1318, July.
    4. James Taylor & Jochen Einbeck, 2013. "Challenging the curse of dimensionality in multivariate local linear regression," Computational Statistics, Springer, vol. 28(3), pages 955-976, June.
    5. Yao, Qiwei & Tong, Howell, 1994. "On subset selection in non-parametric stochastic regression," LSE Research Online Documents on Economics 6409, London School of Economics and Political Science, LSE Library.
    6. Eckhard Liebscher, 2005. "Towards a Unified Approach for Proving Geometric Ergodicity and Mixing Properties of Nonlinear Autoregressive Processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 26(5), pages 669-689, September.
    7. Chengchun Shi & Sheng Zhang & Wenbin Lu & Rui Song, 2022. "Statistical inference of the value function for reinforcement learning in infinite‐horizon settings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 765-793, July.
    8. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Lag Selection for Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(4), pages 457-487, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Zheng & Meng, Haoming & Ma, Chengyuan & Ma, Ke & Li, Xiaopeng, 2026. "Assessing Markov property in driving behaviors: Insights from statistical tests," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 209(C).
    2. Li, Mengbing & Shi, Chengchun & Wu, Zhenke & Fryzlewicz, Piotr, 2025. "Testing stationarity and change point detection in reinforcement learning," LSE Research Online Documents on Economics 127507, London School of Economics and Political Science, LSE Library.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    2. Lütkepohl,Helmut & Krätzig,Markus (ed.), 2004. "Applied Time Series Econometrics," Cambridge Books, Cambridge University Press, number 9780521547871, June.
    3. Rech, Gianluigi & Teräsvirta, Timo & Tschernig, Rolf, 1999. "A simple variable selection technique for nonlinear models," SSE/EFI Working Paper Series in Economics and Finance 296, Stockholm School of Economics, revised 06 Apr 2000.
    4. Tschernig, Rolf & Yang, Lijian, 2000. "Nonparametric estimation of generalized impulse response function," SFB 373 Discussion Papers 2000,89, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    5. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    6. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    7. Shi, Chengchun & Zhou, Yunzhe & Li, Lexin, 2024. "Testing directed acyclic graph via structural, supervised and generative adversarial learning," LSE Research Online Documents on Economics 119446, London School of Economics and Political Science, LSE Library.
    8. Victor Chernozhukov & Whitney K. Newey & Victor Quintas-Martinez & Vasilis Syrgkanis, 2021. "Automatic Debiased Machine Learning via Riesz Regression," Papers 2104.14737, arXiv.org, revised Mar 2024.
    9. Zikun Ye & Zhiqi Zhang & Dennis J. Zhang & Heng Zhang & Renyu Zhang, 2026. "Deep Learning-Based Causal Inference for Large-Scale Combinatorial Experiments: Theory and Empirical Evidence," Management Science, INFORMS, vol. 72(7), pages 5611-5634, July.
    10. Guo, Zheng-Feng & Shintani, Mototsugu, 2011. "Nonparametric lag selection for nonlinear additive autoregressive models," Economics Letters, Elsevier, vol. 111(2), pages 131-134, May.
    11. Binzhi Chen & Annalivia Polselli & Paul S. Clarke, 2026. "Double Machine Learning with High-dimensional Interactive Fixed Effects," Papers 2608.01137, arXiv.org.
    12. Hao, Meiling & Su, Pingfan & Hu, Liyuan & Szabo, Zoltan & Zhao, Qianyu & Shi, Chengchun, 2024. "Forward and backward state abstractions for off-policy evaluation," LSE Research Online Documents on Economics 124074, London School of Economics and Political Science, LSE Library.
    13. Semenova, Vira, 2023. "Debiased machine learning of set-identified linear models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1725-1746.
    14. Philippe Goulet Coulombe & Mikael Frenette & Karin Klieber, 2023. "From Reactive to Proactive Volatility Modeling with Hemisphere Neural Networks," Papers 2311.16333, arXiv.org, revised Apr 2024.
    15. Hector F. Calvo-Pardo & Tullio Mancini & Jose Olmo, 2020. "Neural Network Models for Empirical Finance," JRFM, MDPI, vol. 13(11), pages 1-22, October.
    16. Ziwei Mei & Zhentao Shi & Peter C. B. Phillips, 2022. "The boosted HP filter is more general than you might think," Cowles Foundation Discussion Papers 2348, Cowles Foundation for Research in Economics, Yale University.
    17. Kyle Colangelo & Ying-Ying Lee, 2020. "Double Debiased Machine Learning Nonparametric Inference with Continuous Treatments," Papers 2004.03036, arXiv.org, revised Sep 2023.
    18. Lijian Yang & Wolfgang Hardle & Jens Nielsen, 1999. "Nonparametric Autoregression with Multiplicative Volatility and Additive mean," Journal of Time Series Analysis, Wiley Blackwell, vol. 20(5), pages 579-604, September.
    19. Daniel Jacob, 2021. "CATE meets ML -- The Conditional Average Treatment Effect and Machine Learning," Papers 2104.09935, arXiv.org, revised Apr 2021.
    20. Zequn Jin & Gaoqian Xu & Xi Zheng & Yahong Zhou, 2025. "Policy Learning under Unobserved Confounding: A Robust and Efficient Approach," Papers 2507.20550, arXiv.org, revised Jul 2026.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:119352. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.