IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i21p5350-d1508027.html
   My bibliography  Save this article

Short-Term Electricity Futures Investment Strategies for Power Producers Based on Multi-Agent Deep Reinforcement Learning

Author

Listed:
  • Yizheng Wang

    (Economic Research Institute of State Grid, Zhejiang Electric Power Company, Hangzhou 310000, China
    These authors contributed equally to this work.)

  • Enhao Shi

    (College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China
    These authors contributed equally to this work.)

  • Yang Xu

    (State Grid Zhejiang Electric Power Co., Ltd., Hangzhou 310000, China)

  • Jiahua Hu

    (State Grid Zhejiang Electric Power Co., Ltd., Hangzhou 310000, China)

  • Changsen Feng

    (College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China)

Abstract

The global development and enhancement of electricity financial markets aim to mitigate price risk in the electricity spot market. Power producers utilize financial derivatives for both hedging and speculation, necessitating careful selection of portfolio strategies. Current research on investment strategies for power financial derivatives primarily emphasizes risk management, resulting in a lack of a comprehensive investment framework. This study analyzes six short-term electricity futures contracts: base day, base week, base weekend, peak day, peak week, and peak weekend. A multi-agent deep reinforcement learning algorithm, Dual-Q MADDPG, is employed to learn from interactions with both the spot and futures market environments, considering the hedging and speculative behaviors of power producers. Upon completion of model training, the algorithm enables power producers to derive optimal portfolio strategies. Numerical experiments conducted in the Nordic electricity spot and futures markets indicate that the proposed Dual-Q MADDPG algorithm effectively reduces price risk in the spot market while generating substantial speculative returns. This study contributes to lowering barriers for power generators in the power finance market, thereby facilitating the widespread adoption of financial instruments, which enhances market liquidity and stability.

Suggested Citation

  • Yizheng Wang & Enhao Shi & Yang Xu & Jiahua Hu & Changsen Feng, 2024. "Short-Term Electricity Futures Investment Strategies for Power Producers Based on Multi-Agent Deep Reinforcement Learning," Energies, MDPI, vol. 17(21), pages 1-23, October.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:21:p:5350-:d:1508027
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/21/5350/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/21/5350/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zhipeng Liang & Hao Chen & Junhao Zhu & Kangkang Jiang & Yanran Li, 2018. "Adversarial Deep Reinforcement Learning in Portfolio Management," Papers 1808.09940, arXiv.org, revised Nov 2018.
    2. Yucekaya, A., 2022. "Electricity trading for coal-fired power plants in Turkish power market considering uncertainty in spot, derivatives and bilateral contract market," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    3. Xiao, Jihong & Wang, Yudong, 2022. "Macroeconomic uncertainty, speculation, and energy futures returns: Evidence from a quantile regression," Energy, Elsevier, vol. 241(C).
    4. Jaeck, Edouard & Lautier, Delphine, 2016. "Volatility in electricity derivative markets: The Samuelson effect revisited," Energy Economics, Elsevier, vol. 59(C), pages 300-313.
    5. Deng, S.J. & Oren, S.S., 2006. "Electricity derivatives and risk management," Energy, Elsevier, vol. 31(6), pages 940-953.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Wenhui & Zhang, Jiuyang & Li, Ruan & Zha, Ruiming, 2021. "A transaction case analysis of the development of generation rights trading and existing shortages in China," Energy Policy, Elsevier, vol. 149(C).
    2. C. K. Woo & K. H. Cao & H. Qi & J. Zarnikau & R. Li, 2024. "Price responsiveness of solar and wind capacity demands," Post-Print hal-04597188, HAL.
    3. Pietz, Matthäus, 2009. "Risk premia in electricity wholesale spot markets: empirical evidence from Germany," CEFS Working Paper Series 2009-11, Technische Universität München (TUM), Center for Entrepreneurial and Financial Studies (CEFS).
    4. Han, Lin & Kordzakhia, Nino & Trück, Stefan, 2020. "Volatility spillovers in Australian electricity markets," Energy Economics, Elsevier, vol. 90(C).
    5. Heo, Deung-Yong & Tesfatsion, Leigh, 2013. "Standardized Contracts with Swing for the Market-Supported Procurement of Energy and Reserve: Illustrative Examples," Staff General Research Papers Archive 36747, Iowa State University, Department of Economics.
    6. Eric Benhamou & David Saltiel & Sandrine Ungari & Abhishek Mukhopadhyay & Jamal Atif, 2020. "AAMDRL: Augmented Asset Management with Deep Reinforcement Learning," Papers 2010.08497, arXiv.org.
    7. Thomas Deschatre & Xavier Warin, 2023. "A Common Shock Model for multidimensional electricity intraday price modelling with application to battery valuation," Papers 2307.16619, arXiv.org.
    8. Chi-Keung Woo, Ira Horowitz, Brian Horii, Ren Orans, and Jay Zarnikau, 2012. "Blowing in the Wind: Vanishing Payoffs of a Tolling Agreement for Natural-gas-fired Generation of Electricity in Texas," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    9. Holmberg, Pär & Willems, Bert, 2015. "Relaxing competition through speculation: Committing to a negative supply slope," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 236-266.
    10. Apergis, Nicholas & Baruník, Jozef & Lau, Marco Chi Keung, 2017. "Good volatility, bad volatility: What drives the asymmetric connectedness of Australian electricity markets?," Energy Economics, Elsevier, vol. 66(C), pages 108-115.
    11. Moradi, Amir & Salehi, Javad & Shafie-khah, Miadreza, 2024. "An interactive framework for strategic participation of a price-maker energy hub in the local gas and power markets based on the MPEC method," Energy, Elsevier, vol. 307(C).
    12. Peña, Juan Ignacio & Rodríguez, Rosa & Mayoral, Silvia, 2020. "Tail risk of electricity futures," Energy Economics, Elsevier, vol. 91(C).
    13. Jacobs, Kris & Li, Yu & Pirrong, Craig, 2022. "Supply, demand, and risk premiums in electricity markets," Journal of Banking & Finance, Elsevier, vol. 135(C).
    14. Amir Mosavi & Pedram Ghamisi & Yaser Faghan & Puhong Duan, 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," Papers 2004.01509, arXiv.org.
    15. Adebayo Oshingbesan & Eniola Ajiboye & Peruth Kamashazi & Timothy Mbaka, 2022. "Model-Free Reinforcement Learning for Asset Allocation," Papers 2209.10458, arXiv.org.
    16. Woo, C.K. & Zarnikau, J. & Moore, J. & Horowitz, I., 2011. "Wind generation and zonal-market price divergence: Evidence from Texas," Energy Policy, Elsevier, vol. 39(7), pages 3928-3938, July.
    17. Hongling, Liu & Chuanwen, Jiang & Yan, Zhang, 2008. "A review on risk-constrained hydropower scheduling in deregulated power market," Renewable and Sustainable Energy Reviews, Elsevier, vol. 12(5), pages 1465-1475, June.
    18. Xiao, Jihong & Wen, Fenghua & He, Zhifang, 2023. "Impact of geopolitical risks on investor attention and speculation in the oil market: Evidence from nonlinear and time-varying analysis," Energy, Elsevier, vol. 267(C).
    19. Kursad Derinkuyu & Fehmi Tanrisever & Nermin Kurt & Gokhan Ceyhan, 2020. "Optimizing Day-Ahead Electricity Market Prices: Increasing the Total Surplus for Energy Exchange Istanbul," Manufacturing & Service Operations Management, INFORMS, vol. 22(4), pages 700-716, July.
    20. Ricardo Raineri, 2025. "Power Shift: Decarbonization and the New Dynamics of Energy Markets," Energies, MDPI, vol. 18(3), pages 1-52, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:21:p:5350-:d:1508027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.