IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.16021.html
   My bibliography  Save this paper

Feature-driven reinforcement learning for photovoltaic in continuous intraday trading

Author

Listed:
  • Arega Getaneh Abate
  • Xiufeng Liu
  • Ruyu Liu
  • Xiaobing Zhang

Abstract

Photovoltaic (PV) operators face substantial uncertainty in generation and short-term electricity prices. Continuous intraday markets enable producers to adjust their positions in real time, potentially improving revenues and reducing imbalance costs. We propose a feature-driven reinforcement learning (RL) approach for PV intraday trading that integrates data-driven features into the state and learns bidding policies in a sequential decision framework. The problem is cast as a Markov Decision Process with a reward that balances trading profit and imbalance penalties and is solved with Proximal Policy Optimization (PPO) using a predominantly linear, interpretable policy. Trained on historical market data and evaluated out-of-sample, the strategy consistently outperforms benchmark baselines across diverse scenarios. Extensive validation shows rapid convergence, real-time inference, and transparent decision rules. Learned weights highlight the central role of market microstructure and historical features. Taken together, these results indicate that feature-driven RL offers a practical, data-efficient, and operationally deployable pathway for active intraday participation by PV producers.

Suggested Citation

  • Arega Getaneh Abate & Xiufeng Liu & Ruyu Liu & Xiaobing Zhang, 2025. "Feature-driven reinforcement learning for photovoltaic in continuous intraday trading," Papers 2510.16021, arXiv.org, revised Oct 2025.
  • Handle: RePEc:arx:papers:2510.16021
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2510.16021
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Deniz Kenan Kılıç & Peter Nielsen & Amila Thibbotuwawa, 2024. "Intraday Electricity Price Forecasting via LSTM and Trading Strategy for the Power Market: A Case Study of the West Denmark DK1 Grid Region," Energies, MDPI, vol. 17(12), pages 1-15, June.
    2. Sánchez de la Nieta, Agustín A. & Paterakis, Nikolaos G. & Gibescu, Madeleine, 2020. "Participation of photovoltaic power producers in short-term electricity markets based on rescheduling and risk-hedging mapping," Applied Energy, Elsevier, vol. 266(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benedikt Finnah, 2022. "Optimal bidding functions for renewable energies in sequential electricity markets," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 44(1), pages 1-27, March.
    2. Angel L. Cedeño & Reinier López Ahuar & José Rojas & Gonzalo Carvajal & César Silva & Juan C. Agüero, 2022. "Model Predictive Control for Photovoltaic Plants with Non-Ideal Energy Storage Using Mixed Integer Linear Programming," Energies, MDPI, vol. 15(17), pages 1-21, September.
    3. Jiang, Hou & Zhang, Xiaotong & Yao, Ling & Lu, Ning & Qin, Jun & Liu, Tang & Zhou, Chenghu, 2023. "High-resolution analysis of rooftop photovoltaic potential based on hourly generation simulations and load profiles," Applied Energy, Elsevier, vol. 348(C).
    4. Thomas Kuppelwieser & David Wozabal, 2023. "Intraday power trading: toward an arms race in weather forecasting?," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 45(1), pages 57-83, March.
    5. Jiang, Hou & Lu, Ning & Yao, Ling & Qin, Jun & Liu, Tang, 2023. "Impact of climate changes on the stability of solar energy: Evidence from observations and reanalysis," Renewable Energy, Elsevier, vol. 208(C), pages 726-736.
    6. Nieta, Agustín A. Sánchez de la & Ilieva, Iliana & Gibescu, Madeleine & Bremdal, Bernt & Simonsen, Stig & Gramme, Eivind, 2021. "Optimal midterm peak shaving cost in an electricity management system using behind customers’ smart meter configuration," Applied Energy, Elsevier, vol. 283(C).
    7. Vasileios Laitsos & Georgios Vontzos & Paschalis Paraschoudis & Eleftherios Tsampasis & Dimitrios Bargiotas & Lefteri H. Tsoukalas, 2024. "The State of the Art Electricity Load and Price Forecasting for the Modern Wholesale Electricity Market," Energies, MDPI, vol. 17(22), pages 1-37, November.
    8. He, Shuaijia & Gao, Hongjun & Chen, Zhe & Liu, Junyong, 2023. "Data-driven worst conditional value at risk energy management model of energy station," Energy, Elsevier, vol. 266(C).
    9. Hou Jiang & Ning Lu & Xuecheng Wang, 2023. "Assessing Carbon Reduction Potential of Rooftop PV in China through Remote Sensing Data-Driven Simulations," Sustainability, MDPI, vol. 15(4), pages 1-16, February.
    10. Fu, Yang & Shan, Jie & Li, Zhenkun & Xie, BoLin & Pan, Jeng-Shyang, 2025. "The optimal bidding strategy for multi-energy prosumers in the double auction electricity-heat market: A bidding space model," Energy, Elsevier, vol. 314(C).
    11. Wang, Ying & Wang, Xinru & Li, Shunyi & Ma, Xiaoyang & Chen, Yunzhu & Liu, Shuming, 2024. "Optimization model for harmonic mitigation based on PV-ESS collaboration in small distribution systems," Applied Energy, Elsevier, vol. 356(C).
    12. Ciaran O’Connor & Mohamed Bahloul & Steven Prestwich & Andrea Visentin, 2025. "A Review of Electricity Price Forecasting Models in the Day-Ahead, Intra-Day, and Balancing Markets," Energies, MDPI, vol. 18(12), pages 1-40, June.
    13. Rajesh Panda & Prashant Kumar Tiwari, 2022. "An economic risk based optimal bidding strategy for various market players considering optimal wind placements in day-ahead and real-time competitive power market," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(1), pages 347-362, February.
    14. du Plessis, A.A. & Strauss, J.M. & Rix, A.J., 2021. "Short-term solar power forecasting: Investigating the ability of deep learning models to capture low-level utility-scale Photovoltaic system behaviour," Applied Energy, Elsevier, vol. 285(C).
    15. Gandhi, Oktoviano & Zhang, Wenjie & Kumar, Dhivya Sampath & Rodríguez-Gallegos, Carlos D. & Yagli, Gokhan Mert & Yang, Dazhi & Reindl, Thomas & Srinivasan, Dipti, 2024. "The value of solar forecasts and the cost of their errors: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.16021. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.