IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2009.10819.html
   My bibliography  Save this paper

Stock Price Prediction Using Machine Learning and LSTM-Based Deep Learning Models

Author

Listed:
  • Sidra Mehtab
  • Jaydip Sen
  • Abhishek Dutta

Abstract

Prediction of stock prices has been an important area of research for a long time. While supporters of the efficient market hypothesis believe that it is impossible to predict stock prices accurately, there are formal propositions demonstrating that accurate modeling and designing of appropriate variables may lead to models using which stock prices and stock price movement patterns can be very accurately predicted. In this work, we propose an approach of hybrid modeling for stock price prediction building different machine learning and deep learning-based models. For the purpose of our study, we have used NIFTY 50 index values of the National Stock Exchange (NSE) of India, during the period December 29, 2014 till July 31, 2020. We have built eight regression models using the training data that consisted of NIFTY 50 index records during December 29, 2014 till December 28, 2018. Using these regression models, we predicted the open values of NIFTY 50 for the period December 31, 2018 till July 31, 2020. We, then, augment the predictive power of our forecasting framework by building four deep learning-based regression models using long-and short-term memory (LSTM) networks with a novel approach of walk-forward validation. We exploit the power of LSTM regression models in forecasting the future NIFTY 50 open values using four different models that differ in their architecture and in the structure of their input data. Extensive results are presented on various metrics for the all the regression models. The results clearly indicate that the LSTM-based univariate model that uses one-week prior data as input for predicting the next week open value of the NIFTY 50 time series is the most accurate model.

Suggested Citation

  • Sidra Mehtab & Jaydip Sen & Abhishek Dutta, 2020. "Stock Price Prediction Using Machine Learning and LSTM-Based Deep Learning Models," Papers 2009.10819, arXiv.org.
  • Handle: RePEc:arx:papers:2009.10819
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2009.10819
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jaydip SEN & Tamal DATTA CHAUDHURI, 2016. "An Alternative Framework for Time Series Decomposition and Forecastingand its Relevance for Portfolio Choice – A Comparative Study of the Indian Consumer Durable and Small Cap Sectors," Journal of Economics Library, KSP Journals, vol. 3(2), pages 303-326, June.
    2. Jaydip SEN & Tamal DATTA CHAUDHURI, 2017. "A Predictive Analysis of the Indian FMCG Sector using Time Series Decomposition - Based Approach," Journal of Economics Library, KSP Journals, vol. 4(2), pages 206-226, June.
    3. Basu, Sanjoy, 1983. "The relationship between earnings' yield, market value and return for NYSE common stocks : Further evidence," Journal of Financial Economics, Elsevier, vol. 12(1), pages 129-156, June.
    4. Jaydip Sen & Tamal Datta Chaudhuri, 2016. "Decomposition of Time Series Data of Stock Markets and its Implications for Prediction: An Application for the Indian Auto Sector," Papers 1601.02407, arXiv.org.
    5. Jaydip Sen & Tamal Datta Chaudhuri, 2018. "Understanding the sectors of Indian economy for portfolio choice," International Journal of Business Forecasting and Marketing Intelligence, Inderscience Enterprises Ltd, vol. 4(2), pages 178-222.
    6. Sidra Mehtab & Jaydip Sen, 2019. "A Robust Predictive Model for Stock Price Prediction Using Deep Learning and Natural Language Processing," Papers 1912.07700, arXiv.org.
    7. Jaydip Sen & Tamal Datta Chaudhuri, 2017. "A Time Series Analysis-Based Forecasting Framework for the Indian Healthcare Sector," Papers 1705.01144, arXiv.org.
    8. Jaffe, Jeffrey & Keim, Donald B & Westerfield, Randolph, 1989. " Earnings Yields, Market Values, and Stock Returns," Journal of Finance, American Finance Association, vol. 44(1), pages 135-148, March.
    9. Fama, Eugene F & French, Kenneth R, 1995. "Size and Book-to-Market Factors in Earnings and Returns," Journal of Finance, American Finance Association, vol. 50(1), pages 131-155, March.
    10. Chui, Andy C. W. & Wei, K. C. John, 1998. "Book-to-market, firm size, and the turn-of-the-year effect: Evidence from Pacific-Basin emerging markets," Pacific-Basin Finance Journal, Elsevier, vol. 6(3-4), pages 275-293, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jaydip Sen & Sidra Mehtab & Abhishek Dutta & Saikat Mondal, 2022. "Hierarchical Risk Parity and Minimum Variance Portfolio Design on NIFTY 50 Stocks," Papers 2202.02728, arXiv.org.
    2. Jaydip Sen & Arpit Awad & Aaditya Raj & Gourav Ray & Pusparna Chakraborty & Sanket Das & Subhasmita Mishra, 2022. "Stock Performance Evaluation for Portfolio Design from Different Sectors of the Indian Stock Market," Papers 2208.07166, arXiv.org.
    3. Jaydip Sen & Aditya Jaiswal & Anshuman Pathak & Atish Kumar Majee & Kushagra Kumar & Manas Kumar Sarkar & Soubhik Maji, 2023. "A Comparative Analysis of Portfolio Optimization Using Mean-Variance, Hierarchical Risk Parity, and Reinforcement Learning Approaches on the Indian Stock Market," Papers 2305.17523, arXiv.org.
    4. Jaydip Sen & Arup Dasgupta & Subhasis Dasgupta & Sayantani Roychoudhury, 2023. "A Portfolio Rebalancing Approach for the Indian Stock Market," Papers 2310.09770, arXiv.org.
    5. Sidra Mehtab & Jaydip Sen, 2020. "A Time Series Analysis-Based Stock Price Prediction Using Machine Learning and Deep Learning Models," Papers 2004.11697, arXiv.org, revised May 2021.
    6. Yiyang Zheng, 2022. "Neural Network and Order Flow, Technical Analysis: Predicting short-term direction of futures contract," Papers 2203.12457, arXiv.org.
    7. Jaydip Sen & Arup Dasgupta & Partha Pratim Sengupta & Sayantani Roy Choudhury, 2023. "A Comparative Study of Portfolio Optimization Methods for the Indian Stock Market," Papers 2310.14748, arXiv.org.
    8. Jaydip Sen & Saikat Mondal & Sidra Mehtab, 2021. "Analysis of Sectoral Profitability of the Indian Stock Market Using an LSTM Regression Model," Papers 2111.04976, arXiv.org.
    9. Jaydip Sen & Ashwin Kumar R S & Geetha Joseph & Kaushik Muthukrishnan & Koushik Tulasi & Praveen Varukolu, 2022. "Precise Stock Price Prediction for Robust Portfolio Design from Selected Sectors of the Indian Stock Market," Papers 2201.05570, arXiv.org.
    10. Jaydip Sen & Rajdeep Sen & Abhishek Dutta, 2021. "Machine Learning in Finance-Emerging Trends and Challenges," Papers 2110.11999, arXiv.org.
    11. Abhiraj Sen & Jaydip Sen, 2023. "Performance Evaluation of Equal-Weight Portfolio and Optimum Risk Portfolio on Indian Stocks," Papers 2309.13696, arXiv.org.
    12. Jaydip Sen & Abhishek Dutta, 2022. "A Comparative Study of Hierarchical Risk Parity Portfolio and Eigen Portfolio on the NIFTY 50 Stocks," Papers 2210.00984, arXiv.org.
    13. Jaydip Sen & Sidra Mehtab, 2021. "Design and Analysis of Robust Deep Learning Models for Stock Price Prediction," Papers 2106.09664, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sidra Mehtab & Jaydip Sen, 2020. "Stock Price Prediction Using Convolutional Neural Networks on a Multivariate Timeseries," Papers 2001.09769, arXiv.org.
    2. Sidra Mehtab & Jaydip Sen, 2020. "A Time Series Analysis-Based Stock Price Prediction Using Machine Learning and Deep Learning Models," Papers 2004.11697, arXiv.org, revised May 2021.
    3. Sidra Mehtab & Jaydip Sen, 2019. "A Robust Predictive Model for Stock Price Prediction Using Deep Learning and Natural Language Processing," Papers 1912.07700, arXiv.org.
    4. Jaydip Sen & Sidra Mehtab, 2021. "Design and Analysis of Robust Deep Learning Models for Stock Price Prediction," Papers 2106.09664, arXiv.org.
    5. Jaydip Sen & Saikat Mondal & Sidra Mehtab, 2021. "Analysis of Sectoral Profitability of the Indian Stock Market Using an LSTM Regression Model," Papers 2111.04976, arXiv.org.
    6. Ananda Chatterjee & Hrisav Bhowmick & Jaydip Sen, 2021. "Stock Price Prediction Using Time Series, Econometric, Machine Learning, and Deep Learning Models," Papers 2111.01137, arXiv.org.
    7. Jaydip Sen & Arpit Awad & Aaditya Raj & Gourav Ray & Pusparna Chakraborty & Sanket Das & Subhasmita Mishra, 2022. "Stock Performance Evaluation for Portfolio Design from Different Sectors of the Indian Stock Market," Papers 2208.07166, arXiv.org.
    8. Jaydip Sen & Ashwin Kumar R S & Geetha Joseph & Kaushik Muthukrishnan & Koushik Tulasi & Praveen Varukolu, 2022. "Precise Stock Price Prediction for Robust Portfolio Design from Selected Sectors of the Indian Stock Market," Papers 2201.05570, arXiv.org.
    9. Jaydip Sen & Aditya Jaiswal & Anshuman Pathak & Atish Kumar Majee & Kushagra Kumar & Manas Kumar Sarkar & Soubhik Maji, 2023. "A Comparative Analysis of Portfolio Optimization Using Mean-Variance, Hierarchical Risk Parity, and Reinforcement Learning Approaches on the Indian Stock Market," Papers 2305.17523, arXiv.org.
    10. Tasnim Uddin Chowdhury & Md. Shahidul Islam, 2021. "ARIMA Time Series Analysis in Forecasting Daily Stock Price of Chittagong Stock Exchange (CSE)," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 5(6), pages 214-233, June.
    11. Eero Pätäri & Timo Leivo, 2017. "A Closer Look At Value Premium: Literature Review And Synthesis," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 79-168, February.
    12. Kent Daniel & Sheridan Titman, 2006. "Market Reactions to Tangible and Intangible Information," Journal of Finance, American Finance Association, vol. 61(4), pages 1605-1643, August.
    13. Trabelsi, Mohamed Ali, 2010. "Choix de portefeuille: comparaison des différentes stratégies [Portfolio selection: comparison of different strategies]," MPRA Paper 82946, University Library of Munich, Germany, revised 01 Dec 2010.
    14. Wang, Yuenan & Di Iorio, Amalia, 2007. "The cross section of expected stock returns in the Chinese A-share market," Global Finance Journal, Elsevier, vol. 17(3), pages 335-349, March.
    15. Martin Lettau & Jessica A. Wachter, 2007. "Why Is Long‐Horizon Equity Less Risky? A Duration‐Based Explanation of the Value Premium," Journal of Finance, American Finance Association, vol. 62(1), pages 55-92, February.
    16. Tanveer Ahmad; Syed Muhammad Amir Shah, 2017. "The Value-Growth Indicators and Value Premium: Evidence from Pakistan Stock Exchange," South Asian Journal of Management Sciences (SAJMS), Iqra University, Iqra University, vol. 11(2), pages 124-139, Fall.
    17. Xia, Hui & Min, Xinyu & Deng, Shijie, 2015. "Effectiveness of earnings forecasts in efficient global portfolio construction," International Journal of Forecasting, Elsevier, vol. 31(2), pages 568-574.
    18. Jaydip Sen, 2018. "Stock composition of mutual funds and fund style: a time series decomposition approach towards testing for consistency," International Journal of Business Forecasting and Marketing Intelligence, Inderscience Enterprises Ltd, vol. 4(3), pages 235-292.
    19. Michael E. Drew & Tony Naughton & Madhu Veeraraghavan, 2003. "Asset Pricing in China: Evidence from the Shanghai Stock Exchange," School of Economics and Finance Discussion Papers and Working Papers Series 128, School of Economics and Finance, Queensland University of Technology.
    20. Jaydip Sen & Arup Dasgupta & Partha Pratim Sengupta & Sayantani Roy Choudhury, 2023. "A Comparative Study of Portfolio Optimization Methods for the Indian Stock Market," Papers 2310.14748, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2009.10819. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.