IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.16021.html

Feature-driven reinforcement learning for photovoltaic in continuous intraday trading

Author

Listed:
  • Arega Getaneh Abate
  • Xiao-Bing Zhang
  • Xiufeng Liu
  • Ruyu Liu

Abstract

Sequential intraday electricity trading allows photovoltaic (PV) operators to reduce imbalance settlement costs as forecasts improve throughout the day. Yet deployable trading policies must jointly handle forecast uncertainty, intraday prices, liquidity, and the asymmetric economics of PV imbalance exposure. This paper proposes a feature-driven reinforcement learning (FDRL) framework for intraday PV trading in the Nordic market. Its main methodological contribution is a corrected reward that evaluates performance relative to a no-trade baseline, removing policy-independent noise that can otherwise push reinforcement learning toward inactive policies in high-price regimes. The framework combines this objective with a predominantly linear policy and a closed-form execution surrogate for efficient, interpretable training. In a strict walk-forward evaluation over 2021-2024 across four Nordic bidding zones (DK1, DK2, SE3, SE4), the method delivers statistically significant profit improvements over the spot-only baseline in every zone. Portfolio experiments show that a pooled cross-zone policy can match zone-specific models, while transfer-learning results indicate a two-cluster market structure and effective deployment in new zones with limited local data. The proposed framework offers an interpretable and computationally practical way to reduce imbalance costs, while the transfer results provide guidance for scaling strategies across bidding zones with different market designs.

Suggested Citation

  • Arega Getaneh Abate & Xiao-Bing Zhang & Xiufeng Liu & Ruyu Liu, 2025. "Feature-driven reinforcement learning for photovoltaic in continuous intraday trading," Papers 2510.16021, arXiv.org, revised Mar 2026.
  • Handle: RePEc:arx:papers:2510.16021
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2510.16021
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hirth, Lion, 2013. "The market value of variable renewables," Energy Economics, Elsevier, vol. 38(C), pages 218-236.
    2. Deniz Kenan Kılıç & Peter Nielsen & Amila Thibbotuwawa, 2024. "Intraday Electricity Price Forecasting via LSTM and Trading Strategy for the Power Market: A Case Study of the West Denmark DK1 Grid Region," Energies, MDPI, vol. 17(12), pages 1-15, June.
    3. Sánchez de la Nieta, Agustín A. & Paterakis, Nikolaos G. & Gibescu, Madeleine, 2020. "Participation of photovoltaic power producers in short-term electricity markets based on rescheduling and risk-hedging mapping," Applied Energy, Elsevier, vol. 266(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul Simshauser, 2025. "Are gas turbines 'bankable' in transitioning energy-only markets?," Working Papers EPRG2601, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    2. Keppler, Jan Horst & Quemin, Simon & Saguan, Marcelo, 2022. "Why the sustainable provision of low-carbon electricity needs hybrid markets," Energy Policy, Elsevier, vol. 171(C).
    3. Christoph Wolter & Henrik Klinge Jacobsen & Lorenzo Zeni & Georgios Rogdakis & Nicolaos A. Cutululis, 2020. "Overplanting in offshore wind power plants in different regulatory regimes," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 9(3), May.
    4. Wang, Jingxing & Chung, Seokhyun & AlShelahi, Abdullah & Kontar, Raed & Byon, Eunshin & Saigal, Romesh, 2021. "Look-ahead decision making for renewable energy: A dynamic “predict and store” approach," Applied Energy, Elsevier, vol. 296(C).
    5. Benedikt Finnah, 2022. "Optimal bidding functions for renewable energies in sequential electricity markets," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 44(1), pages 1-27, March.
    6. Thao Pham & Killian Lemoine, 2020. "Impacts of subsidized renewable electricity generation on spot market prices in Germany : Evidence from a GARCH model with panel data," Working Papers hal-02568268, HAL.
    7. Karsten Neuhoff & Nils May & Jörn C. Richstein, 2018. "Renewable Energy Policy in the Age of Falling Technology Costs," Discussion Papers of DIW Berlin 1746, DIW Berlin, German Institute for Economic Research.
    8. Wilkinson, Sam & Maticka, Martin J. & Liu, Yue & John, Michele, 2021. "The duck curve in a drying pond: The impact of rooftop PV on the Western Australian electricity market transition," Utilities Policy, Elsevier, vol. 71(C).
    9. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    10. Würzburg, Klaas & Labandeira, Xavier & Linares, Pedro, 2013. "Renewable generation and electricity prices: Taking stock and new evidence for Germany and Austria," Energy Economics, Elsevier, vol. 40(S1), pages 159-171.
    11. Angel L. Cedeño & Reinier López Ahuar & José Rojas & Gonzalo Carvajal & César Silva & Juan C. Agüero, 2022. "Model Predictive Control for Photovoltaic Plants with Non-Ideal Energy Storage Using Mixed Integer Linear Programming," Energies, MDPI, vol. 15(17), pages 1-21, September.
    12. Klie, Leo & Madlener, Reinhard, 2022. "Optimal configuration and diversification of wind turbines: A hybrid approach to improve the penetration of wind power," Energy Economics, Elsevier, vol. 105(C).
    13. Merrick, James H. & Bistline, John E.T. & Blanford, Geoffrey J., 2024. "On representation of energy storage in electricity planning models," Energy Economics, Elsevier, vol. 136(C).
    14. Mwampashi, Muthe Mathias & Nikitopoulos, Christina Sklibosios & Konstandatos, Otto & Rai, Alan, 2021. "Wind generation and the dynamics of electricity prices in Australia," Energy Economics, Elsevier, vol. 103(C).
    15. Griffiths, Steven, 2017. "A review and assessment of energy policy in the Middle East and North Africa region," Energy Policy, Elsevier, vol. 102(C), pages 249-269.
    16. Winkler, Jenny & Gaio, Alberto & Pfluger, Benjamin & Ragwitz, Mario, 2016. "Impact of renewables on electricity markets – Do support schemes matter?," Energy Policy, Elsevier, vol. 93(C), pages 157-167.
    17. René Aïd & Matteo Basei & Huyên Pham, 2020. "A McKean–Vlasov approach to distributed electricity generation development," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 91(2), pages 269-310, April.
    18. Jiang, Hou & Zhang, Xiaotong & Yao, Ling & Lu, Ning & Qin, Jun & Liu, Tang & Zhou, Chenghu, 2023. "High-resolution analysis of rooftop photovoltaic potential based on hourly generation simulations and load profiles," Applied Energy, Elsevier, vol. 348(C).
    19. Davis, Dominic & Brear, Michael J., 2024. "Impact of short-term wind forecast accuracy on the performance of decarbonising wholesale electricity markets," Energy Economics, Elsevier, vol. 130(C).
    20. Paul Simshauser & Farhad Billimoria & Craig Rogers, 2021. "Optimising VRE plant capacity in Renewable Energy Zones," Working Papers EPRG2121, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.16021. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.