IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v290y2021ics0306261921002142.html
   My bibliography  Save this article

Advanced price forecasting in agent-based electricity market simulation

Author

Listed:
  • Fraunholz, Christoph
  • Kraft, Emil
  • Keles, Dogan
  • Fichtner, Wolf

Abstract

Machine learning and agent-based modeling are two popular tools in energy research. In this article, we propose an innovative methodology that combines these methods. For this purpose, we develop an electricity price forecasting technique using artificial neural networks and integrate the novel approach into the established agent-based electricity market simulation model PowerACE. In a case study covering ten interconnected European countries and a time horizon from 2020 until 2050 at hourly resolution, we benchmark the new forecasting approach against a simpler linear regression model as well as a naive forecast. Contrary to most of the related literature, we also evaluate the statistical significance of the superiority of one approach over another by conducting Diebold–Mariano hypothesis tests. Our major results can be summarized as follows. Firstly, in contrast to real-world electricity price forecasts, we find the naive approach to perform very poorly when deployed model-endogenously (mean absolute percentage error 0.40–0.53). Secondly, although the linear regression performs reasonably well (mean absolute percentage error 0.17–0.32), it is outperformed by the neural network approach (mean absolute percentage error 0.17–0.21). Thirdly, the use of an additional classifier for outlier handling substantially improves the forecasting accuracy, particularly for the linear regression approach. Finally, the choice of the model-endogenous forecasting method has a clear impact on simulated electricity prices. This latter finding is particularly crucial since these prices are a major results of electricity market models.

Suggested Citation

  • Fraunholz, Christoph & Kraft, Emil & Keles, Dogan & Fichtner, Wolf, 2021. "Advanced price forecasting in agent-based electricity market simulation," Applied Energy, Elsevier, vol. 290(C).
  • Handle: RePEc:eee:appene:v:290:y:2021:i:c:s0306261921002142
    DOI: 10.1016/j.apenergy.2021.116688
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921002142
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.116688?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andreas Schröder & Friedrich Kunz & Jan Meiss & Roman Mendelevitch & Christian von Hirschhausen, 2013. "Current and Prospective Costs of Electricity Generation until 2050," Data Documentation 68, DIW Berlin, German Institute for Economic Research.
    2. Singh, Nitin & Mohanty, Soumya Ranjan & Dev Shukla, Rishabh, 2017. "Short term electricity price forecast based on environmentally adapted generalized neuron," Energy, Elsevier, vol. 125(C), pages 127-139.
    3. Eric Guerci & Mohammad Ali Rastegar & Silvano Cincotti, 2010. "Agent-based modeling and simulation of competitive wholesale electricity markets," Post-Print halshs-00871063, HAL.
    4. Fraunholz, Christoph & Hladik, Dirk & Keles, Dogan & Möst, Dominik & Fichtner, Wolf, 2021. "On the long-term efficiency of market splitting in Germany," Energy Policy, Elsevier, vol. 149(C).
    5. Bento, P.M.R. & Pombo, J.A.N. & Calado, M.R.A. & Mariano, S.J.P.S., 2018. "A bat optimized neural network and wavelet transform approach for short-term price forecasting," Applied Energy, Elsevier, vol. 210(C), pages 88-97.
    6. Keles, Dogan & Bublitz, Andreas & Zimmermann, Florian & Genoese, Massimo & Fichtner, Wolf, 2016. "Analysis of design options for the electricity market: The German case," Applied Energy, Elsevier, vol. 183(C), pages 884-901.
    7. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    8. Just, Sebastian & Weber, Christoph, 2008. "Pricing of reserves: Valuing system reserve capacity against spot prices in electricity markets," Energy Economics, Elsevier, vol. 30(6), pages 3198-3221, November.
    9. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    10. Marc Deissenroth & Martin Klein & Kristina Nienhaus & Matthias Reeg, 2017. "Assessing the Plurality of Actors and Policy Interactions: Agent-Based Modelling of Renewable Energy Market Integration," Complexity, Hindawi, vol. 2017, pages 1-24, December.
    11. Keles, Dogan & Genoese, Massimo & Möst, Dominik & Fichtner, Wolf, 2012. "Comparison of extended mean-reversion and time series models for electricity spot price simulation considering negative prices," Energy Economics, Elsevier, vol. 34(4), pages 1012-1032.
    12. Saeed Moshiri & Faezeh Foroutan, 2006. "Forecasting Nonlinear Crude Oil Futures Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 81-96.
    13. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    14. Conejo, Antonio J. & Contreras, Javier & Espinola, Rosa & Plazas, Miguel A., 2005. "Forecasting electricity prices for a day-ahead pool-based electric energy market," International Journal of Forecasting, Elsevier, vol. 21(3), pages 435-462.
    15. Florian Leuthold & Hannes Weigt & Christian Hirschhausen, 2012. "A Large-Scale Spatial Optimization Model of the European Electricity Market," Networks and Spatial Economics, Springer, vol. 12(1), pages 75-107, March.
    16. Lean Yu & Yang Zhao & Ling Tang, 2017. "Ensemble Forecasting for Complex Time Series Using Sparse Representation and Neural Networks," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(2), pages 122-138, March.
    17. Keles, Dogan & Scelle, Jonathan & Paraschiv, Florentina & Fichtner, Wolf, 2016. "Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks," Applied Energy, Elsevier, vol. 162(C), pages 218-230.
    18. Emil Kraft & Dogan Keles & Wolf Fichtner, 2020. "Modeling of frequency containment reserve prices with econometrics and artificial intelligence," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(8), pages 1179-1197, December.
    19. Ding, Yishan, 2018. "A novel decompose-ensemble methodology with AIC-ANN approach for crude oil forecasting," Energy, Elsevier, vol. 154(C), pages 328-336.
    20. Wang, Deyun & Luo, Hongyuan & Grunder, Olivier & Lin, Yanbing & Guo, Haixiang, 2017. "Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm," Applied Energy, Elsevier, vol. 190(C), pages 390-407.
    21. Ringler, Philipp & Keles, Dogan & Fichtner, Wolf, 2017. "How to benefit from a common European electricity market design," Energy Policy, Elsevier, vol. 101(C), pages 629-643.
    22. Dudek, Grzegorz, 2016. "Multilayer perceptron for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1057-1060.
    23. Ilkay Oksuz & Umut Ugurlu, 2019. "Neural Network Based Model Comparison for Intraday Electricity Price Forecasting," Energies, MDPI, vol. 12(23), pages 1-14, November.
    24. Michael Bucksteeg, Stephan Spiecker, and Christoph Weber, 2019. "Impact of Coordinated Capacity Mechanisms on the European Power Market," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2).
    25. Zhao, Yang & Li, Jianping & Yu, Lean, 2017. "A deep learning ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 9-16.
    26. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    27. Guoqiang Sun & Tong Chen & Zhinong Wei & Yonghui Sun & Haixiang Zang & Sheng Chen, 2016. "A Carbon Price Forecasting Model Based on Variational Mode Decomposition and Spiking Neural Networks," Energies, MDPI, vol. 9(1), pages 1-16, January.
    28. Fraunholz, Christoph & Keles, Dogan & Fichtner, Wolf, 2021. "On the role of electricity storage in capacity remuneration mechanisms," Energy Policy, Elsevier, vol. 149(C).
    29. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    30. Ghoddusi, Hamed & Creamer, Germán G. & Rafizadeh, Nima, 2019. "Machine learning in energy economics and finance: A review," Energy Economics, Elsevier, vol. 81(C), pages 709-727.
    31. Weidlich, Anke & Veit, Daniel, 2008. "A critical survey of agent-based wholesale electricity market models," Energy Economics, Elsevier, vol. 30(4), pages 1728-1759, July.
    32. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    33. Peng, Lu & Liu, Shan & Liu, Rui & Wang, Lin, 2018. "Effective long short-term memory with differential evolution algorithm for electricity price prediction," Energy, Elsevier, vol. 162(C), pages 1301-1314.
    34. Jammazi, Rania & Aloui, Chaker, 2012. "Crude oil price forecasting: Experimental evidence from wavelet decomposition and neural network modeling," Energy Economics, Elsevier, vol. 34(3), pages 828-841.
    35. Bublitz, Andreas & Keles, Dogan & Zimmermann, Florian & Fraunholz, Christoph & Fichtner, Wolf, 2019. "A survey on electricity market design: Insights from theory and real-world implementations of capacity remuneration mechanisms," Energy Economics, Elsevier, vol. 80(C), pages 1059-1078.
    36. Ringler, Philipp & Keles, Dogan & Fichtner, Wolf, 2016. "Agent-based modelling and simulation of smart electricity grids and markets – A literature review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 57(C), pages 205-215.
    37. Huang, Lili & Wang, Jun, 2018. "Global crude oil price prediction and synchronization based accuracy evaluation using random wavelet neural network," Energy, Elsevier, vol. 151(C), pages 875-888.
    38. Esmaeili Aliabadi, Danial & Kaya, Murat & Sahin, Guvenc, 2017. "Competition, risk and learning in electricity markets: An agent-based simulation study," Applied Energy, Elsevier, vol. 195(C), pages 1000-1011.
    39. Christian Giovanelli & Seppo Sierla & Ryutaro Ichise & Valeriy Vyatkin, 2018. "Exploiting Artificial Neural Networks for the Prediction of Ancillary Energy Market Prices," Energies, MDPI, vol. 11(7), pages 1-22, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paweł Pijarski & Adrian Belowski, 2024. "Application of Methods Based on Artificial Intelligence and Optimisation in Power Engineering—Introduction to the Special Issue," Energies, MDPI, vol. 17(2), pages 1-42, January.
    2. Erik Heilmann & Janosch Henze & Heike Wetzel, 2021. "Machine learning in energy forecasts with an application to high frequency electricity consumption data," MAGKS Papers on Economics 202135, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    3. Beltrán, Sergio & Castro, Alain & Irizar, Ion & Naveran, Gorka & Yeregui, Imanol, 2022. "Framework for collaborative intelligence in forecasting day-ahead electricity price," Applied Energy, Elsevier, vol. 306(PA).
    4. Heilmann, Erik, 2023. "The impact of transparency policies on local flexibility markets in electric distribution networks," Utilities Policy, Elsevier, vol. 83(C).
    5. Fabian Scheller & Frauke Wiese & Jann Michael Weinand & Dominik Franjo Dominkovi'c & Russell McKenna, 2021. "An expert survey to assess the current status and future challenges of energy system analysis," Papers 2106.15518, arXiv.org.
    6. Erik Heilmann, 2021. "The impact of transparency policies on local flexibility markets in electrical distribution networks: A case study with artificial neural network forecasts," MAGKS Papers on Economics 202141, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    7. Shao, Zhen & Yang, Yudie & Zheng, Qingru & Zhou, Kaile & Liu, Chen & Yang, Shanlin, 2022. "A pattern classification methodology for interval forecasts of short-term electricity prices based on hybrid deep neural networks: A comparative analysis," Applied Energy, Elsevier, vol. 327(C).
    8. Tanut Treetanthiploet & Yufei Zhang & Lukasz Szpruch & Isaac Bowers-Barnard & Henrietta Ridley & James Hickey & Chris Pearce, 2023. "Insurance pricing on price comparison websites via reinforcement learning," Papers 2308.06935, arXiv.org.
    9. Giacomo Talluri & Gabriele Maria Lozito & Francesco Grasso & Carlos Iturrino Garcia & Antonio Luchetta, 2021. "Optimal Battery Energy Storage System Scheduling within Renewable Energy Communities," Energies, MDPI, vol. 14(24), pages 1-23, December.
    10. Fett, Daniel & Fraunholz, Christoph & Keles, Dogan, 2021. "Diffusion and system impact of residential battery storage under different regulatory settings," Energy Policy, Elsevier, vol. 158(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liyang Tang, 2020. "Application of Nonlinear Autoregressive with Exogenous Input (NARX) neural network in macroeconomic forecasting, national goal setting and global competitiveness assessment," Papers 2005.08735, arXiv.org.
    2. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    3. Emil Kraft & Dogan Keles & Wolf Fichtner, 2020. "Modeling of frequency containment reserve prices with econometrics and artificial intelligence," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(8), pages 1179-1197, December.
    4. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    5. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    6. Díaz, Guzmán & Coto, José & Gómez-Aleixandre, Javier, 2019. "Prediction and explanation of the formation of the Spanish day-ahead electricity price through machine learning regression," Applied Energy, Elsevier, vol. 239(C), pages 610-625.
    7. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    8. Fraunholz, Christoph & Miskiw, Kim K. & Kraft, Emil & Fichtner, Wolf & Weber, Christoph, 2021. "On the role of risk aversion and market design in capacity expansion planning," Working Paper Series in Production and Energy 62, Karlsruhe Institute of Technology (KIT), Institute for Industrial Production (IIP).
    9. Qiao, Weibiao & Yang, Zhe, 2020. "Forecast the electricity price of U.S. using a wavelet transform-based hybrid model," Energy, Elsevier, vol. 193(C).
    10. Richter, Lucas & Lehna, Malte & Marchand, Sophie & Scholz, Christoph & Dreher, Alexander & Klaiber, Stefan & Lenk, Steve, 2022. "Artificial Intelligence for Electricity Supply Chain automation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 163(C).
    11. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    12. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    13. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    14. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    15. Ethem Çanakoğlu & Esra Adıyeke, 2020. "Comparison of Electricity Spot Price Modelling and Risk Management Applications," Energies, MDPI, vol. 13(18), pages 1-22, September.
    16. Umut Ugurlu & Oktay Tas & Aycan Kaya & Ilkay Oksuz, 2018. "The Financial Effect of the Electricity Price Forecasts’ Inaccuracy on a Hydro-Based Generation Company," Energies, MDPI, vol. 11(8), pages 1-19, August.
    17. Manickavasagam, Jeevananthan & Visalakshmi, S. & Apergis, Nicholas, 2020. "A novel hybrid approach to forecast crude oil futures using intraday data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    18. Li, Wei & Becker, Denis Mike, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Energy, Elsevier, vol. 237(C).
    19. Will, Christian & Zimmermann, Florian & Ensslen, Axel & Fraunholz, Christoph & Jochem, Patrick & Keles, Dogan, 2023. "Can electric vehicle charging be carbon neutral? Uniting smart charging and renewables," Working Paper Series in Production and Energy 69, Karlsruhe Institute of Technology (KIT), Institute for Industrial Production (IIP).
    20. Li, Jinchao & Zhu, Shaowen & Wu, Qianqian, 2019. "Monthly crude oil spot price forecasting using variational mode decomposition," Energy Economics, Elsevier, vol. 83(C), pages 240-253.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:290:y:2021:i:c:s0306261921002142. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.