IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.19243.html
   My bibliography  Save this paper

Comparative analysis of financial data differentiation techniques using LSTM neural network

Author

Listed:
  • Dominik Stempie'n
  • Janusz Gajda

Abstract

We compare traditional approach of computing logarithmic returns with the fractional differencing method and its tempered extension as methods of data preparation before their usage in advanced machine learning models. Differencing parameters are estimated using multiple techniques. The empirical investigation is conducted on data from four major stock indices covering the most recent 10-year period. The set of explanatory variables is additionally extended with technical indicators. The effectiveness of the differencing methods is evaluated using both forecast error metrics and risk-adjusted return trading performance metrics. The findings suggest that fractional differentiation methods provide a suitable data transformation technique, improving the predictive model forecasting performance. Furthermore, the generated predictions appeared to be effective in constructing profitable trading strategies for both individual assets and a portfolio of stock indices. These results underline the importance of appropriate data transformation techniques in financial time series forecasting, supporting the application of memory-preserving techniques.

Suggested Citation

  • Dominik Stempie'n & Janusz Gajda, 2025. "Comparative analysis of financial data differentiation techniques using LSTM neural network," Papers 2505.19243, arXiv.org.
  • Handle: RePEc:arx:papers:2505.19243
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2505.19243
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christos Floros & Shabbar Jaffry & Goncalo Valle Lima, 2007. "Long memory in the Portuguese stock market," Studies in Economics and Finance, Emerald Group Publishing Limited, vol. 24(3), pages 220-232, August.
    2. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Working Papers 111, Princeton University, Department of Economics, Center for Economic Policy Studies..
    3. Bhardwaj, Geetesh & Swanson, Norman R., 2006. "An empirical investigation of the usefulness of ARFIMA models for predicting macroeconomic and financial time series," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 539-578.
    4. Pedro M. Mirete-Ferrer & Alberto Garcia-Garcia & Juan Samuel Baixauli-Soler & Maria A. Prats, 2022. "A Review on Machine Learning for Asset Management," Risks, MDPI, vol. 10(4), pages 1-46, April.
    5. repec:pri:cepsud:91malkiel is not listed on IDEAS
    6. Sabzikar, Farzad & Wang, Qiying & Phillips, Peter C.B., 2020. "Asymptotic theory for near integrated processes driven by tempered linear processes," Journal of Econometrics, Elsevier, vol. 216(1), pages 192-202.
    7. Roel C.A. OOMEN, 2001. "Using high frequency stock market index data to calculate, model and forecast realized return variance," Economics Working Papers ECO2001/06, European University Institute.
    8. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    9. Bouteska, Ahmed & Abedin, Mohammad Zoynul & Hajek, Petr & Yuan, Kunpeng, 2024. "Cryptocurrency price forecasting – A comparative analysis of ensemble learning and deep learning methods," International Review of Financial Analysis, Elsevier, vol. 92(C).
    10. Sergio Castellano Gómez & Robert Ślepaczuk, 2021. "Robust optimisation in algorithmic investment strategies," Working Papers 2021-27, Faculty of Economic Sciences, University of Warsaw.
    11. Maria Rosa Borges, 2010. "Efficient market hypothesis in European stock markets," The European Journal of Finance, Taylor & Francis Journals, vol. 16(7), pages 711-726.
    12. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    13. Erdinc Akyildirim & Oguzhan Cepni & Shaen Corbet & Gazi Salah Uddin, 2023. "Forecasting mid-price movement of Bitcoin futures using machine learning," Annals of Operations Research, Springer, vol. 330(1), pages 553-584, November.
    14. Bartosz Bieganowski & Robert 'Slepaczuk, 2024. "Supervised Autoencoders with Fractionally Differentiated Features and Triple Barrier Labelling Enhance Predictions on Noisy Data," Papers 2411.12753, arXiv.org, revised Nov 2024.
    15. Chlebus Marcin & Dyczko Michał & Woźniak Michał, 2021. "Nvidia's Stock Returns Prediction Using Machine Learning Techniques for Time Series Forecasting Problem," Central European Economic Journal, Sciendo, vol. 8(55), pages 44-62, January.
    16. repec:eme:sef000:10867370710817400 is not listed on IDEAS
    17. Wei Bao & Jun Yue & Yulei Rao, 2017. "A deep learning framework for financial time series using stacked autoencoders and long-short term memory," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-24, July.
    18. Lo, Andrew W, 1991. "Long-Term Memory in Stock Market Prices," Econometrica, Econometric Society, vol. 59(5), pages 1279-1313, September.
    19. Harvey,Andrew C., 1991. "Forecasting, Structural Time Series Models and the Kalman Filter," Cambridge Books, Cambridge University Press, number 9780521405737, September.
    20. Granger, Clive W. J. & Ding, Zhuanxin, 1996. "Varieties of long memory models," Journal of Econometrics, Elsevier, vol. 73(1), pages 61-77, July.
    21. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    22. John Barkoulas & Christopher Baum & Nickolaos Travlos, 2000. "Long memory in the Greek stock market," Applied Financial Economics, Taylor & Francis Journals, vol. 10(2), pages 177-184.
    23. Cheung, Yin-Wong & Lai, Kon S., 1995. "A search for long memory in international stock market returns," Journal of International Money and Finance, Elsevier, vol. 14(4), pages 597-615, August.
    24. Huijian Dong & Helen Bowers & William R. Latham, 2013. "Evidence on the Efficient Market Hypothesis from 44 Global Financial Market Indexes," Working Papers 13-07, University of Delaware, Department of Economics.
    25. Koustas, Zisimos & Serletis, Apostolos, 2005. "Rational bubbles or persistent deviations from market fundamentals?," Journal of Banking & Finance, Elsevier, vol. 29(10), pages 2523-2539, October.
    26. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    27. Farzad Sabzikar & Piotr Kokoszka, 2023. "Tempered functional time series," Journal of Time Series Analysis, Wiley Blackwell, vol. 44(3), pages 280-293, May.
    28. C. Lento & N. Gradojevic & C. S. Wright, 2007. "Investment information content in Bollinger Bands?," Applied Financial Economics Letters, Taylor & Francis Journals, vol. 3(4), pages 263-267.
    29. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Journal of Economic Perspectives, American Economic Association, vol. 17(1), pages 59-82, Winter.
    30. Janusz Gajda & Rafał Walasek, 2020. "Fractional differentiation and its use in machine learning," Working Papers 2020-32, Faculty of Economic Sciences, University of Warsaw.
    31. Carmen López-Martín & Sonia Benito Muela & Raquel Arguedas, 2021. "Efficiency in cryptocurrency markets: new evidence," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 11(3), pages 403-431, September.
    32. Christos Floros & Shabbar Jaffry & Goncalo Valle Lima, 2007. "Long memory in the Portuguese stock market," Studies in Economics and Finance, Emerald Group Publishing Limited, vol. 24(3), pages 220-232, August.
    33. Dev Shah & Haruna Isah & Farhana Zulkernine, 2019. "Stock Market Analysis: A Review and Taxonomy of Prediction Techniques," IJFS, MDPI, vol. 7(2), pages 1-22, May.
    34. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Working Papers 111, Princeton University, Department of Economics, Center for Economic Policy Studies..
    35. Fama, Eugene F, 1991. "Efficient Capital Markets: II," Journal of Finance, American Finance Association, vol. 46(5), pages 1575-1617, December.
    36. Fischer, Thomas & Krauss, Christopher, 2018. "Deep learning with long short-term memory networks for financial market predictions," European Journal of Operational Research, Elsevier, vol. 270(2), pages 654-669.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Stempie'n & Robert 'Slepaczuk, 2025. "Hybrid Models for Financial Forecasting: Combining Econometric, Machine Learning, and Deep Learning Models," Papers 2505.19617, arXiv.org.
    2. Heni Boubaker & Giorgio Canarella & Rangan Gupta & Stephen M. Miller, 2023. "A Hybrid ARFIMA Wavelet Artificial Neural Network Model for DJIA Index Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 62(4), pages 1801-1843, December.
    3. Ashok Chanabasangouda Patil & Shailesh Rastogi, 2019. "Time-Varying Price–Volume Relationship and Adaptive Market Efficiency: A Survey of the Empirical Literature," JRFM, MDPI, vol. 12(2), pages 1-18, June.
    4. Narayan, Seema & Smyth, Russell, 2015. "The financial econometrics of price discovery and predictability," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 380-393.
    5. Sensoy, Ahmet & Tabak, Benjamin M., 2015. "Time-varying long term memory in the European Union stock markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 436(C), pages 147-158.
    6. Akber, Ushna & Muhammad, Nabeel, 2013. "Is Pakistan Stock Market moving towards Weak-form efficiency? Evidence from the Karachi Stock Exchange and the Random Walk Nature of free-float of shares of KSE 30 Index," MPRA Paper 49128, University Library of Munich, Germany.
    7. Firat Melih Yilmaz & Engin Yildiztepe, 2024. "Statistical Evaluation of Deep Learning Models for Stock Return Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 63(1), pages 221-244, January.
    8. Marianna Brunetti & Roberta Luca, 2023. "Correction to: Pairs trading in the index options market," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 13(1), pages 175-176, March.
    9. Stéphane Goutte & David Guerreiro & Bilel Sanhaji & Sophie Saglio & Julien Chevallier, 2019. "International Financial Markets," Post-Print halshs-02183053, HAL.
    10. Montserrat Reyna Miranda & Ricardo Massa Roldán & Vicente Gómez Salcido, 2022. "Neuro-wavelet Model for price prediction in high-frequency data in the Mexican Stock market," Remef - Revista Mexicana de Economía y Finanzas Nueva Época REMEF (The Mexican Journal of Economics and Finance), Instituto Mexicano de Ejecutivos de Finanzas, IMEF, vol. 17(1), pages 1-23, Enero - M.
    11. Asif, Raheel & Frömmel, Michael, 2022. "Testing Long memory in exchange rates and its implications for the adaptive market hypothesis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 593(C).
    12. Jitka Veselá & Alžběta Zíková, 2022. "Are the Czech, Polish, German and Dutch markets taking a random walk? [Konají český, polský, německý a nizozemský trh náhodnou procházku?]," Český finanční a účetní časopis, Prague University of Economics and Business, vol. 2022(2), pages 19-38.
    13. Taufiq Choudhry & Ranadeva Jayasekera, 2015. "Level of efficiency in the UK equity market: empirical study of the effects of the global financial crisis," Review of Quantitative Finance and Accounting, Springer, vol. 44(2), pages 213-242, February.
    14. Admin Starcevic & Timothy Rodgers, 2011. "Market Efficiency within the German Stock Market: A Comparative Study of the Relative Efficiencies of the DAX, MDAX, SDAX and ASE Indices," International Econometric Review (IER), Econometric Research Association, vol. 3(1), pages 25-37, April.
    15. Saqib Farid & Rubeena Tashfeen & Tahseen Mohsan & Arsal Burhan, 2023. "Forecasting stock prices using a data mining method: Evidence from emerging market," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 1911-1917, April.
    16. Ziliotto, Arianna & Serati, Massimiliano, 2015. "The semi-strong efficiency debate: In search of a new testing framework," Research in International Business and Finance, Elsevier, vol. 34(C), pages 412-438.
    17. Fayssal Jamhamed & Franck Martin & Fabien Rondeau & Josué Thélissaint & Stéphane Tufféry, 2024. "Regime-Specific Dynamics and Informational Efficiency in Cryptomarkets: Evidence from Gaussian Mixture Models," Economics Working Paper Archive (University of Rennes & University of Caen) 2024-13, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
    18. Brice Corgnet & Cary Deck & Mark DeSantis & David Porter, 2022. "Forecasting Skills in Experimental Markets: Illusion or Reality?," Management Science, INFORMS, vol. 68(7), pages 5216-5232, July.
    19. Chaker Aloui & Duc Khuong Nguyen, 2014. "On the detection of extreme movements and persistent behaviour in Mediterranean stock markets: a wavelet-based approach," Applied Economics, Taylor & Francis Journals, vol. 46(22), pages 2611-2622, August.
    20. Rompotis, Gerasimos G., 2011. "Testing weak-form efficiency of exchange traded funds market," MPRA Paper 36020, University Library of Munich, Germany.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.19243. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.