IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v54y2019i2d10.1007_s10614-019-09881-3.html
   My bibliography  Save this article

Jump Detection and Noise Separation by a Singular Wavelet Method for Predictive Analytics of High-Frequency Data

Author

Listed:
  • Yi-Ting Chen

    (InfoTech
    National Chiao Tung University)

  • Wan-Ni Lai

    (Université Côte d’Azur)

  • Edward W. Sun

    (KEDGE Business School)

Abstract

High-frequency data is a big data in finance in which a large amount of intra-day transactions arriving irregularly in financial markets are recorded. Given the high frequency and irregularity, such data require efficient tools to filter out the noise (i.e. jumps) arising from the anomaly, irregularity, and heterogeneity of financial markets. In this article, we use a recurrently adaptive separation algorithm, which is based on the maximal overlap discrete wavelet transform (MODWT) and that can effectively: (1) identify the time-variant jumps, (2) extract the time-consistent patterns from the noise (jumps), and (3) denoise the marginal perturbations. In addition, the proposed algorithm enables reinforcement learning to optimize a multiple-criteria decision or convex programming when reconstructing the wavelet-denoised data. Using simulated data, we show the proposed approach can perform efficiently in comparison with other conventional methods documented in the literature. We also apply our method in an empirical study by using high-frequency data from the US stock market and confirm that the proposed method can significantly improve the accuracy of predictive analytics models for financial market returns.

Suggested Citation

  • Yi-Ting Chen & Wan-Ni Lai & Edward W. Sun, 2019. "Jump Detection and Noise Separation by a Singular Wavelet Method for Predictive Analytics of High-Frequency Data," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 809-844, August.
  • Handle: RePEc:kap:compec:v:54:y:2019:i:2:d:10.1007_s10614-019-09881-3
    DOI: 10.1007/s10614-019-09881-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-019-09881-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-019-09881-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zied Ftiti & Aviral Tiwari & Amél Belanès & Khaled Guesmi, 2015. "Tests of Financial Market Contagion: Evolutionary Cospectral Analysis Versus Wavelet Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 46(4), pages 575-611, December.
    2. Christensen, Kim & Oomen, Roel C.A. & Podolskij, Mark, 2014. "Fact or friction: Jumps at ultra high frequency," Journal of Financial Economics, Elsevier, vol. 114(3), pages 576-599.
    3. Bollerslev, Tim & Todorov, Viktor & Xu, Lai, 2015. "Tail risk premia and return predictability," Journal of Financial Economics, Elsevier, vol. 118(1), pages 113-134.
    4. Ole E. Barndorff-Nielsen & Neil Shephard, 2006. "Econometrics of Testing for Jumps in Financial Economics Using Bipower Variation," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 1-30.
    5. Zhang, Lan & Mykland, Per A. & Ait-Sahalia, Yacine, 2005. "A Tale of Two Time Scales: Determining Integrated Volatility With Noisy High-Frequency Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1394-1411, December.
    6. Edward Sun & Timm Kruse & Min-Teh Yu, 2014. "High frequency trading, liquidity, and execution cost," Annals of Operations Research, Springer, vol. 223(1), pages 403-432, December.
    7. Cecilia Mancini, 2009. "Non‐parametric Threshold Estimation for Models with Stochastic Diffusion Coefficient and Jumps," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(2), pages 270-296, June.
    8. Suzanne S. Lee & Per A. Mykland, 2008. "Jumps in Financial Markets: A New Nonparametric Test and Jump Dynamics," The Review of Financial Studies, Society for Financial Studies, vol. 21(6), pages 2535-2563, November.
    9. Chen Yi-Ting & Sun Edward W. & Yu Min-Teh, 2015. "Improving model performance with the integrated wavelet denoising method," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(4), pages 445-467, September.
    10. Todorov, Viktor & Tauchen, George & Grynkiv, Iaryna, 2014. "Volatility activity: Specification and estimation," Journal of Econometrics, Elsevier, vol. 178(P1), pages 180-193.
    11. Foued Saâdaoui, 2013. "The Price and Trading Volume Dynamics Relationship in the EEX Power Market: A Wavelet Modeling," Computational Economics, Springer;Society for Computational Economics, vol. 42(1), pages 47-69, June.
    12. Yi-Ting Chen & Edward W. Sun & Min-Teh Yu, 2018. "Risk Assessment with Wavelet Feature Engineering for High-Frequency Portfolio Trading," Computational Economics, Springer;Society for Computational Economics, vol. 52(2), pages 653-684, August.
    13. Hans Föllmer & Alexander Schied, 2002. "Convex measures of risk and trading constraints," Finance and Stochastics, Springer, vol. 6(4), pages 429-447.
    14. Sun, Edward W. & Meinl, Thomas, 2012. "A new wavelet-based denoising algorithm for high-frequency financial data mining," European Journal of Operational Research, Elsevier, vol. 217(3), pages 589-599.
    15. Darrell Duffie & Jun Pan & Kenneth Singleton, 2000. "Transform Analysis and Asset Pricing for Affine Jump-Diffusions," Econometrica, Econometric Society, vol. 68(6), pages 1343-1376, November.
    16. Lu Han & Ruihuan Ge, 2017. "Wavelets Analysis on Structural Model for Default Prediction," Computational Economics, Springer;Society for Computational Economics, vol. 50(1), pages 111-140, June.
    17. Teemu Pennanen, 2011. "Arbitrage and deflators in illiquid markets," Finance and Stochastics, Springer, vol. 15(1), pages 57-83, January.
    18. Meinl Thomas & Sun Edward W., 2012. "A Nonlinear Filtering Algorithm based on Wavelet Transforms for High-Frequency Financial Data Analysis," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(3), pages 1-24, September.
    19. Olaolu Richard Olayeni, 2016. "Causality in Continuous Wavelet Transform Without Spectral Matrix Factorization: Theory and Application," Computational Economics, Springer;Society for Computational Economics, vol. 47(3), pages 321-340, March.
    20. Todorov, Viktor, 2009. "Estimation of continuous-time stochastic volatility models with jumps using high-frequency data," Journal of Econometrics, Elsevier, vol. 148(2), pages 131-148, February.
    21. Sun, Edward W. & Chen, Yi-Ting & Yu, Min-Teh, 2015. "Generalized optimal wavelet decomposing algorithm for big financial data," International Journal of Production Economics, Elsevier, vol. 165(C), pages 194-214.
    22. Roman Marsalek & Jitka Pomenkova & Svatopluk Kapounek, 2014. "A Wavelet-Based Approach to Filter Out Symmetric Macroeconomic Shocks," Computational Economics, Springer;Society for Computational Economics, vol. 44(4), pages 477-488, December.
    23. Sun, Wei & Rachev, Svetlozar & Fabozzi, Frank J., 2007. "Fractals or I.I.D.: Evidence of long-range dependence and heavy tailedness from modeling German equity market returns," Journal of Economics and Business, Elsevier, vol. 59(6), pages 575-595.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hussain, Syed Mujahid & Ahmad, Nisar & Ahmed, Sheraz, 2023. "Applications of high-frequency data in finance: A bibliometric literature review," International Review of Financial Analysis, Elsevier, vol. 89(C).
    2. Wan-Ni Lai & Yi-Ting Chen & Edward W. Sun, 2021. "Comonotonicity and low volatility effect," Annals of Operations Research, Springer, vol. 299(1), pages 1057-1099, April.
    3. Dong, Zhiliang & An, Haizhong & Liu, Sen & Li, Zhengyang & Yuan, Meng, 2020. "Research on the time-varying network structure evolution of the stock indices of the BRICS countries based on fluctuation correlation," International Review of Economics & Finance, Elsevier, vol. 69(C), pages 63-74.
    4. Lucian Liviu Albu & Radu Lupu, 2020. "Anomaly detection in stock market indices with neural networks," Journal of Financial Studies, Institute of Financial Studies, vol. 9(5), pages 10-23, November.
    5. Wang, Qi & Ma, Jing & Yu, Siyuan & Tan, Liying, 2020. "Noise detection and image denoising based on fractional calculus," Chaos, Solitons & Fractals, Elsevier, vol. 131(C).
    6. Radu LUPU & Iulia LUPU & Tanase STAMULE & Mihai ROMAN, 2022. "Entropy as Leading Indicator for Extreme Systemic Risk Events," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(4), pages 58-73, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yi-Ting Chen & Edward W. Sun & Min-Teh Yu, 2018. "Risk Assessment with Wavelet Feature Engineering for High-Frequency Portfolio Trading," Computational Economics, Springer;Society for Computational Economics, vol. 52(2), pages 653-684, August.
    2. Kim Christensen & Ulrich Hounyo & Mark Podolskij, 2017. "Is the diurnal pattern sufficient to explain the intraday variation in volatility? A nonparametric assessment," CREATES Research Papers 2017-30, Department of Economics and Business Economics, Aarhus University.
    3. Christensen, Kim & Thyrsgaard, Martin & Veliyev, Bezirgen, 2019. "The realized empirical distribution function of stochastic variance with application to goodness-of-fit testing," Journal of Econometrics, Elsevier, vol. 212(2), pages 556-583.
    4. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    5. Zhang, Chuanhai & Liu, Zhi & Liu, Qiang, 2021. "Jumps at ultra-high frequency: Evidence from the Chinese stock market," Pacific-Basin Finance Journal, Elsevier, vol. 68(C).
    6. Almut Veraart, 2011. "How precise is the finite sample approximation of the asymptotic distribution of realised variation measures in the presence of jumps?," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(3), pages 253-291, September.
    7. Pelger, Markus, 2019. "Large-dimensional factor modeling based on high-frequency observations," Journal of Econometrics, Elsevier, vol. 208(1), pages 23-42.
    8. Jan Novotn?? & Jan Hanousek & Ev??en Ko??enda, 2013. "Price Jump Indicators: Stock Market Empirics During the Crisis," William Davidson Institute Working Papers Series wp1050, William Davidson Institute at the University of Michigan.
    9. Liu, Yi & Liu, Huifang & Zhang, Lei, 2019. "Modeling and forecasting return jumps using realized variation measures," Economic Modelling, Elsevier, vol. 76(C), pages 63-80.
    10. Fulvio Corsi & Roberto Renò, 2012. "Discrete-Time Volatility Forecasting With Persistent Leverage Effect and the Link With Continuous-Time Volatility Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 368-380, January.
    11. Juho Kanniainen & Ye Yue, 2019. "The Arrival of News and Return Jumps in Stock Markets: A Nonparametric Approach," Papers 1901.02691, arXiv.org.
    12. Almut Veraart & Luitgard Veraart, 2012. "Stochastic volatility and stochastic leverage," Annals of Finance, Springer, vol. 8(2), pages 205-233, May.
    13. Christensen, Kim & Oomen, Roel C.A. & Podolskij, Mark, 2014. "Fact or friction: Jumps at ultra high frequency," Journal of Financial Economics, Elsevier, vol. 114(3), pages 576-599.
    14. Maneesoonthorn, Worapree & Martin, Gael M. & Forbes, Catherine S., 2020. "High-frequency jump tests: Which test should we use?," Journal of Econometrics, Elsevier, vol. 219(2), pages 478-487.
    15. Corsi, Fulvio & Pirino, Davide & Renò, Roberto, 2010. "Threshold bipower variation and the impact of jumps on volatility forecasting," Journal of Econometrics, Elsevier, vol. 159(2), pages 276-288, December.
    16. Deniz Erdemlioglu & Sébastien Laurent & Christopher J. Neely, 2013. "Econometric modeling of exchange rate volatility and jumps," Chapters, in: Adrian R. Bell & Chris Brooks & Marcel Prokopczuk (ed.), Handbook of Research Methods and Applications in Empirical Finance, chapter 16, pages 373-427, Edward Elgar Publishing.
    17. Christensen, K. & Podolskij, M. & Thamrongrat, N. & Veliyev, B., 2017. "Inference from high-frequency data: A subsampling approach," Journal of Econometrics, Elsevier, vol. 197(2), pages 245-272.
    18. Torben G. Andersen & Viktor Todorov, 2009. "Realized Volatility and Multipower Variation," CREATES Research Papers 2009-49, Department of Economics and Business Economics, Aarhus University.
    19. Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2020. "Machine learning with parallel neural networks for analyzing and forecasting electricity demand," Computational Economics, Springer;Society for Computational Economics, vol. 56(2), pages 569-597, August.
    20. Zhihong Jian & Zhican Zhu & Jie Zhou & Shuai Wu, 2018. "The Magnet Effect of Circuit Breakers: A role of price jumps and market liquidity," Departmental Working Papers 2018-01, The University of Winnipeg, Department of Economics.

    More about this item

    Keywords

    Convex optimization; Forecasting; Jump detection; High-frequency data; Reinforcement learning; Wavelet;
    All these keywords.

    JEL classification:

    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:54:y:2019:i:2:d:10.1007_s10614-019-09881-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.