IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.20678.html

Cryptocurrency Portfolio Management with Reinforcement Learning: Soft Actor--Critic and Deep Deterministic Policy Gradient Algorithms

Author

Listed:
  • Kamal Paykan

    (Department of Mathematics, Tafresh University, Tafresh, Iran)

Abstract

This paper proposes a reinforcement learning--based framework for cryptocurrency portfolio management using the Soft Actor--Critic (SAC) and Deep Deterministic Policy Gradient (DDPG) algorithms. Traditional portfolio optimization methods often struggle to adapt to the highly volatile and nonlinear dynamics of cryptocurrency markets. To address this, we design an agent that learns continuous trading actions directly from historical market data through interaction with a simulated trading environment. The agent optimizes portfolio weights to maximize cumulative returns while minimizing downside risk and transaction costs. Experimental evaluations on multiple cryptocurrencies demonstrate that the SAC and DDPG agents outperform baseline strategies such as equal-weighted and mean--variance portfolios. The SAC algorithm, with its entropy-regularized objective, shows greater stability and robustness in noisy market conditions compared to DDPG. These results highlight the potential of deep reinforcement learning for adaptive and data-driven portfolio management in cryptocurrency markets.

Suggested Citation

  • Kamal Paykan, 2025. "Cryptocurrency Portfolio Management with Reinforcement Learning: Soft Actor--Critic and Deep Deterministic Policy Gradient Algorithms," Papers 2511.20678, arXiv.org.
  • Handle: RePEc:arx:papers:2511.20678
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.20678
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Katsiampa, Paraskevi, 2017. "Volatility estimation for Bitcoin: A comparison of GARCH models," Economics Letters, Elsevier, vol. 158(C), pages 3-6.
    2. Dyhrberg, Anne Haubo, 2016. "Bitcoin, gold and the dollar – A GARCH volatility analysis," Finance Research Letters, Elsevier, vol. 16(C), pages 85-92.
    3. Marie Briere & Kim Oosterlinck & Ariane Szafarz, 2015. "Virtual Currency, Tangible Return: Portfolio Diversification with Bitcoins," Post-Print CEB, ULB -- Universite Libre de Bruxelles, vol. 16(6), pages 365-373.
    4. Yukun Liu & Aleh Tsyvinski, 2021. "Risks and Returns of Cryptocurrency," The Review of Financial Studies, Society for Financial Studies, vol. 34(6), pages 2689-2727.
    5. Baur, Dirk G. & Hong, KiHoon & Lee, Adrian D., 2018. "Bitcoin: Medium of exchange or speculative assets?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 54(C), pages 177-189.
    6. Cheah, Eng-Tuck & Fry, John, 2015. "Speculative bubbles in Bitcoin markets? An empirical investigation into the fundamental value of Bitcoin," Economics Letters, Elsevier, vol. 130(C), pages 32-36.
    7. Wei Bao & Jun Yue & Yulei Rao, 2017. "A deep learning framework for financial time series using stacked autoencoders and long-short term memory," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-24, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dunbar, Kwamie & Owusu-Amoako, Johnson, 2023. "Predictability of crypto returns: The impact of trading behavior," Journal of Behavioral and Experimental Finance, Elsevier, vol. 39(C).
    2. Corbet, Shaen & Katsiampa, Paraskevi & Lau, Chi Keung Marco, 2020. "Measuring quantile dependence and testing directional predictability between Bitcoin, altcoins and traditional financial assets," International Review of Financial Analysis, Elsevier, vol. 71(C).
    3. Panagiotidis, Theodore & Stengos, Thanasis & Vravosinos, Orestis, 2019. "The effects of markets, uncertainty and search intensity on bitcoin returns," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 220-242.
    4. Symitsi, Efthymia & Chalvatzis, Konstantinos J., 2019. "The economic value of Bitcoin: A portfolio analysis of currencies, gold, oil and stocks," Research in International Business and Finance, Elsevier, vol. 48(C), pages 97-110.
    5. Chu, Jeffrey & Chan, Stephen & Zhang, Yuanyuan, 2021. "Bitcoin versus high-performance technology stocks in diversifying against global stock market indices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 580(C).
    6. Yue, Yao & Li, Xuerong & Zhang, Dingxuan & Wang, Shouyang, 2021. "How cryptocurrency affects economy? A network analysis using bibliometric methods," International Review of Financial Analysis, Elsevier, vol. 77(C).
    7. Toan Luu Duc Huynh & Rizwan Ahmed & Muhammad Ali Nasir & Muhammad Shahbaz & Ngoc Quang Anh Huynh, 2024. "The nexus between black and digital gold: evidence from US markets," Annals of Operations Research, Springer, vol. 334(1), pages 521-546, March.
    8. Christie Smith & Aaron Kumar, 2018. "Crypto‐Currencies – An Introduction To Not‐So‐Funny Moneys," Journal of Economic Surveys, Wiley Blackwell, vol. 32(5), pages 1531-1559, December.
    9. Aniruddha Dutta & Saket Kumar & Meheli Basu, 2020. "A Gated Recurrent Unit Approach to Bitcoin Price Prediction," JRFM, MDPI, vol. 13(2), pages 1-16, February.
    10. Kajtazi, Anton & Moro, Andrea, 2019. "The role of bitcoin in well diversified portfolios: A comparative global study," International Review of Financial Analysis, Elsevier, vol. 61(C), pages 143-157.
    11. Aurelio F. Bariviera & Ignasi Merediz‐Solà, 2021. "Where Do We Stand In Cryptocurrencies Economic Research? A Survey Based On Hybrid Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 377-407, April.
    12. Wang, Xuetong & Fang, Fang & Ma, Shiqun & Xiang, Lijin & Xiao, Zumian, 2024. "Dynamic volatility spillover among cryptocurrencies and energy markets: An empirical analysis based on a multilevel complex network," The North American Journal of Economics and Finance, Elsevier, vol. 69(PA).
    13. Abakah, Emmanuel Joel Aikins & Gil-Alana, Luis Alberiko & Madigu, Godfrey & Romero-Rojo, Fatima, 2020. "Volatility persistence in cryptocurrency markets under structural breaks," International Review of Economics & Finance, Elsevier, vol. 69(C), pages 680-691.
    14. Silky Vigg Kushwah & Shab Hundal & Payal Goel, 2024. "Unveiling Interconnectedness and Volatility Transmission: A Novel GARCH Analysis of Leading Global Cryptocurrencies," International Journal of Economics and Financial Issues, Econjournals, vol. 14(3), pages 132-139, May.
    15. Gil-Alana, Luis Alberiko & Abakah, Emmanuel Joel Aikins & Rojo, María Fátima Romero, 2020. "Cryptocurrencies and stock market indices. Are they related?," Research in International Business and Finance, Elsevier, vol. 51(C).
    16. ORĂȘTEAN Ramona & MĂRGINEAN Silvia Cristina & SAVA Raluca, 2019. "Bitcoin In The Scientific Literature – A Bibliometric Study," Studies in Business and Economics, Lucian Blaga University of Sibiu, Faculty of Economic Sciences, vol. 14(3), pages 160-174, December.
    17. Andreas Hackethal & Tobin Hanspal & Dominique M Lammer & Kevin Rink, 2022. "The Characteristics and Portfolio Behavior of Bitcoin Investors: Evidence from Indirect Cryptocurrency Investments [The investor in structured retail products: advice driven or gambling oriented]," Review of Finance, European Finance Association, vol. 26(4), pages 855-898.
    18. Zhou, Siwen, 2018. "Exploring the Driving Forces of the Bitcoin Exchange Rate Dynamics: An EGARCH Approach," MPRA Paper 89445, University Library of Munich, Germany.
    19. Ji Ho Kwon, 2021. "On the factors of Bitcoin’s value at risk," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-31, December.
    20. Podhorsky, Andrea, 2024. "Bursting the bitcoin bubble: Do market prices reflect fundamental bitcoin value?," International Review of Financial Analysis, Elsevier, vol. 93(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.20678. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.