IDEAS home Printed from https://ideas.repec.org/a/ibn/ijbmjn/v19y2024i4p80.html

Deep Learning Applied to Stock Prices: Epoch Adjustment in Training an LSTM Neural Network

Author

Listed:
  • Napoleão Verardi Galegale
  • Camilo Ilzo Shimabukuro

Abstract

Research on recurrent neural networks applied to financial time series is still underexplored, even more so for series on Brazilian stock prices. The research gap was identified in studies on regularization with early stopping to improve predictive capacity and reduce overfitting for the type of neural network used. This study aims to analyze the effect of the number of epochs on the prediction error dispersion of a recurrent neural network using the Long Short-Term Memory – LSTM approach on the stock prices of a Brazilian company, aiming to minimize prediction error and reduce the risk of overfitting. The method is of an applied nature with a quantitative approach and uses an experimental procedure to analyze the behavior of the prediction error of a recurrent neural network as a function of the number of epochs. As a result, a range of the number of epochs was identified that extracts the best trade-off relation between predictive capacity and overfitting risk for a given network configuration. It was also identified how the dispersion of prediction error initially declines sharply and then stabilizes asymptotically. The study offers a greater understanding of the behavior of the prediction error, seeking greater efficiency in predictive techniques on financial time series in order to add value and reduce uncertainties in the decision-making process for asset managers and investors.

Suggested Citation

  • Napoleão Verardi Galegale & Camilo Ilzo Shimabukuro, 2024. "Deep Learning Applied to Stock Prices: Epoch Adjustment in Training an LSTM Neural Network," International Journal of Business and Management, Canadian Center of Science and Education, vol. 19(4), pages 1-80, July.
  • Handle: RePEc:ibn:ijbmjn:v:19:y:2024:i:4:p:80
    as

    Download full text from publisher

    File URL: https://ccsenet.org/journal/index.php/ijbm/article/download/0/0/50304/54461
    Download Restriction: no

    File URL: https://ccsenet.org/journal/index.php/ijbm/article/view/0/50304
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    2. Shiller, Robert J, 1995. "Conversation, Information, and Herd Behavior," American Economic Review, American Economic Association, vol. 85(2), pages 181-185, May.
    3. Justin A. Sirignano, 2019. "Deep learning for limit order books," Quantitative Finance, Taylor & Francis Journals, vol. 19(4), pages 549-570, April.
    4. Fischer, Thomas & Krauss, Christopher, 2018. "Deep learning with long short-term memory networks for financial market predictions," European Journal of Operational Research, Elsevier, vol. 270(2), pages 654-669.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Erdinc Akyildirim & Oguzhan Cepni & Shaen Corbet & Gazi Salah Uddin, 2023. "Forecasting mid-price movement of Bitcoin futures using machine learning," Annals of Operations Research, Springer, vol. 330(1), pages 553-584, November.
    2. Abraham Itzhak Weinberg, 2025. "Hybrid Quantum-Classical Ensemble Learning for S\&P 500 Directional Prediction," Papers 2512.15738, arXiv.org.
    3. Green, Lawrence & Sung, Ming-Chien & Ma, Tiejun & Johnson, Johnnie E. V., 2019. "To what extent can new web-based technology improve forecasts? Assessing the economic value of information derived from Virtual Globes and its rate of diffusion in a financial market," European Journal of Operational Research, Elsevier, vol. 278(1), pages 226-239.
    4. Bartosz Bieganowski & Robert 'Slepaczuk, 2024. "Supervised Autoencoders with Fractionally Differentiated Features and Triple Barrier Labelling Enhance Predictions on Noisy Data," Papers 2411.12753, arXiv.org, revised Nov 2024.
    5. Keer Yang & Guanqun Zhang & Chuan Bi & Qiang Guan & Hailu Xu & Shuai Xu, 2023. "Improving CNN-base Stock Trading By Considering Data Heterogeneity and Burst," Papers 2303.09407, arXiv.org.
    6. Buiter, Willem H., 2000. "Optimal currency areas: why does the exchange rate regime matter? (with an application to UK membership in EMU)," LSE Research Online Documents on Economics 20178, London School of Economics and Political Science, LSE Library.
    7. Arnswald, Torsten, 2001. "Investment Behaviour of German Equity Fund Managers - An Exploratory Analysis of Survey Data," Discussion Paper Series 1: Economic Studies 2001,08, Deutsche Bundesbank.
    8. Kentaro Imajo & Kentaro Minami & Katsuya Ito & Kei Nakagawa, 2020. "Deep Portfolio Optimization via Distributional Prediction of Residual Factors," Papers 2012.07245, arXiv.org.
    9. Akash Deep & Abootaleb Shirvani & Chris Monico & Svetlozar Rachev & Frank J. Fabozzi, 2024. "Risk-Adjusted Performance of Random Forest Models in High-Frequency Trading," Papers 2412.15448, arXiv.org, revised Feb 2025.
    10. Amin Aminimehr & Ali Raoofi & Akbar Aminimehr & Amirhossein Aminimehr, 2022. "A Comprehensive Study of Market Prediction from Efficient Market Hypothesis up to Late Intelligent Market Prediction Approaches," Computational Economics, Springer;Society for Computational Economics, vol. 60(2), pages 781-815, August.
    11. Haberer, Markus, 2004. "Might a Securities Transactions Tax Mitigate Excess Volatility? Some Evidence From the Literature," CoFE Discussion Papers 04/06, University of Konstanz, Center of Finance and Econometrics (CoFE).
    12. Shalini Sharma & Víctor Elvira & Emilie Chouzenoux & Angshul Majumdar, 2021. "Recurrent Dictionary Learning for State-Space Models with an Application in Stock Forecasting," Post-Print hal-03184841, HAL.
    13. Schnaubelt, Matthias & Fischer, Thomas G. & Krauss, Christopher, 2018. "Separating the signal from the noise - financial machine learning for Twitter," FAU Discussion Papers in Economics 14/2018, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    14. Ben Moews, 2023. "On random number generators and practical market efficiency," Papers 2305.17419, arXiv.org, revised Jul 2023.
    15. Mustapha Ez-zaiym & Yassine Senhaji & Meriem Rachid & Karim El Moutaouakil & Vasile Palade, 2025. "Fractional Optimizers for LSTM Networks in Financial Time Series Forecasting," Mathematics, MDPI, vol. 13(13), pages 1-44, June.
    16. Zhang, Yongjie & Chu, Gang & Shen, Dehua, 2021. "The role of investor attention in predicting stock prices: The long short-term memory networks perspective," Finance Research Letters, Elsevier, vol. 38(C).
    17. Bartosz Bieganowski & Robert Ślepaczuk, 2024. "Supervised Autoencoder MLP for Financial Time Series Forecasting," Working Papers 2024-03, Faculty of Economic Sciences, University of Warsaw.
    18. Romain Bocher, 2022. "The Intersubjective Markets Hypothesis," Journal of Interdisciplinary Economics, , vol. 34(1), pages 35-50, January.
    19. Coskun, Esra Alp & Lau, Chi Keung Marco & Kahyaoglu, Hakan, 2020. "Uncertainty and herding behavior: evidence from cryptocurrencies," Research in International Business and Finance, Elsevier, vol. 54(C).
    20. Montserrat Reyna Miranda & Ricardo Massa Roldán & Vicente Gómez Salcido, 2022. "Neuro-wavelet Model for price prediction in high-frequency data in the Mexican Stock market," Remef - Revista Mexicana de Economía y Finanzas Nueva Época REMEF (The Mexican Journal of Economics and Finance), Instituto Mexicano de Ejecutivos de Finanzas, IMEF, vol. 17(1), pages 1-23, Enero - M.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:ijbmjn:v:19:y:2024:i:4:p:80. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.