IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2210.03469.html

Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning

Author

Listed:
  • Naseh Majidi
  • Mahdi Shamsi
  • Farokh Marvasti

Abstract

Price movement prediction has always been one of the traders' concerns in financial market trading. In order to increase their profit, they can analyze the historical data and predict the price movement. The large size of the data and complex relations between them lead us to use algorithmic trading and artificial intelligence. This paper aims to offer an approach using Twin-Delayed DDPG (TD3) and the daily close price in order to achieve a trading strategy in the stock and cryptocurrency markets. Unlike previous studies using a discrete action space reinforcement learning algorithm, the TD3 is continuous, offering both position and the number of trading shares. Both the stock (Amazon) and cryptocurrency (Bitcoin) markets are addressed in this research to evaluate the performance of the proposed algorithm. The achieved strategy using the TD3 is compared with some algorithms using technical analysis, reinforcement learning, stochastic, and deterministic strategies through two standard metrics, Return and Sharpe ratio. The results indicate that employing both position and the number of trading shares can improve the performance of a trading system based on the mentioned metrics.

Suggested Citation

  • Naseh Majidi & Mahdi Shamsi & Farokh Marvasti, 2022. "Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning," Papers 2210.03469, arXiv.org.
    • Handle: RePEc:arx:papers:2210.03469
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2210.03469
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Liu, Qingfu & Tao, Zhenyi & Tse, Yiuman & Wang, Chuanjie, 2022. "Stock market prediction with deep learning: The case of China," Finance Research Letters, Elsevier, vol. 46(PA).
    2. Liu, Mingxi & Li, Guowen & Li, Jianping & Zhu, Xiaoqian & Yao, Yinhong, 2021. "Forecasting the price of Bitcoin using deep learning," Finance Research Letters, Elsevier, vol. 40(C).
    3. Aniruddha Dutta & Saket Kumar & Meheli Basu, 2020. "A Gated Recurrent Unit Approach to Bitcoin Price Prediction," JRFM, MDPI, vol. 13(2), pages 1-16, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ellwanger, Reinhard & Snudden, Stephen, 2025. "Putting VAR forecasts of the real price of crude oil to the test," Finance Research Letters, Elsevier, vol. 77(C).
    2. Nezir Köse & Yunus Emre Gür & Emre Ünal, 2025. "Deep Learning and Machine Learning Insights Into the Global Economic Drivers of the Bitcoin Price," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(5), pages 1666-1698, August.
    3. Pedro Reis & Ana Paula Serra & Jo~ao Gama, 2025. "The Role of Deep Learning in Financial Asset Management: A Systematic Review," Papers 2503.01591, arXiv.org.
    4. Christian Fieberg & Daniel Metko & Thorsten Poddig & Thomas Loy, 2023. "Machine learning techniques for cross-sectional equity returns’ prediction," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 45(1), pages 289-323, March.
    5. Będowska-Sójka, Barbara & Wójcik, Piotr & Pele, Daniel Traian, 2026. "Early warning systems for cryptocurrency markets: Predicting ‘zombie’ assets using machine learning," The North American Journal of Economics and Finance, Elsevier, vol. 81(C).
    6. Tej Bahadur Shahi & Ashish Shrestha & Arjun Neupane & William Guo, 2020. "Stock Price Forecasting with Deep Learning: A Comparative Study," Mathematics, MDPI, vol. 8(9), pages 1-15, August.
    7. Htet Htet Htun & Michael Biehl & Nicolai Petkov, 2024. "Forecasting relative returns for S&P 500 stocks using machine learning," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-16, December.
    8. Pawan Kumar Singh & Alok Kumar Pandey & S. C. Bose, 2023. "A new grey system approach to forecast closing price of Bitcoin, Bionic, Cardano, Dogecoin, Ethereum, XRP Cryptocurrencies," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(3), pages 2429-2446, June.
    9. Alvarez-Ramirez, Jose & Espinosa-Paredes, Gilberto & Vernon-Carter, E. Jaime, 2025. "Causal wavelet analysis of the Bitcoin price dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 658(C).
    10. Goodell, John W. & Ben Jabeur, Sami & Saâdaoui, Foued & Nasir, Muhammad Ali, 2023. "Explainable artificial intelligence modeling to forecast bitcoin prices," International Review of Financial Analysis, Elsevier, vol. 88(C).
    11. Sudersan Behera & Sarat Chandra Nayak & A. V. S. Pavan Kumar, 2024. "Evaluating the Performance of Metaheuristic Based Artificial Neural Networks for Cryptocurrency Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 64(2), pages 1219-1258, August.
    12. Samuka Mohanty & Rajashree Dash, 2023. "A New Dual Normalization for Enhancing the Bitcoin Pricing Capability of an Optimized Low Complexity Neural Net with TOPSIS Evaluation," Mathematics, MDPI, vol. 11(5), pages 1-28, February.
    13. Lu, Zhichao & Xu, Yuhong & Zhang, Yue & Zhao, Xinyao, 2025. "Is it difficult to predict the price movements of high-volatility assets," Finance Research Letters, Elsevier, vol. 85(PB).
    14. Lili Pan & Lin Wang & Qianqian Feng, 2022. "A Bibliometric Analysis of Risk Management in Foreign Direct Investment: Insights and Implications," Sustainability, MDPI, vol. 14(12), pages 1-18, June.
    15. Kang, Mingu & Hong, Joongi & Kim, Suntae, 2025. "Harnessing technical indicators with deep learning based price forecasting for cryptocurrency trading," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 660(C).
    16. Huang, Chiou-Jye & Shen, Yamin & Kuo, Ping-Huan & Chen, Yung-Hsiang, 2022. "Novel spatiotemporal feature extraction parallel deep neural network for forecasting confirmed cases of coronavirus disease 2019," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    17. Guo, Wei & Liu, Qingfu & Luo, Zhidan & Tse, Yiuman, 2022. "Forecasts for international financial series with VMD algorithms," Journal of Asian Economics, Elsevier, vol. 80(C).
    18. Esam Mahdi & Carlos Martin-Barreiro & Xavier Cabezas, 2025. "A Novel Hybrid Approach Using an Attention-Based Transformer + GRU Model for Predicting Cryptocurrency Prices," Mathematics, MDPI, vol. 13(9), pages 1-19, April.
    19. Parth Daxesh Modi & Kamyar Arshi & Pertami J. Kunz & Abdelhak M. Zoubir, 2023. "A Data-driven Deep Learning Approach for Bitcoin Price Forecasting," Papers 2311.06280, arXiv.org.
    20. Jinghua Wang & Geoffrey M. Ngene & Yan Shi & Ann Nduati Mungai, 2023. "An Investigation of the Predictability of Uncertainty Indices on Bitcoin Returns," JRFM, MDPI, vol. 16(10), pages 1-12, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2210.03469. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.