IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v14y2021i19p6274-d648634.html
   My bibliography  Save this article

Forecasting for Battery Storage: Choosing the Error Metric

Author

Listed:
  • Colin Singleton

    (Counting Lab Ltd., Reading RG6 6BU, UK)

  • Peter Grindrod

    (Mathematical Institute, University of Oxford, Oxford OX2 6GG, UK)

Abstract

We describe our approach to the Western Power Distribution (WPD) Presumed Open Data (POD) 6 MWh battery storage capacity forecasting competition, in which we finished second. The competition entails two distinct forecasting aims to maximise the daily evening peak reduction and using as much solar photovoltaic energy as possible. For the latter, we combine a Bayesian (MCMC) linear regression model with an average generation distribution. For the former, we introduce a new error metric that allows even a simple weighted average combined with a simple linear regression model to score very well using the competition performance metric.

Suggested Citation

  • Colin Singleton & Peter Grindrod, 2021. "Forecasting for Battery Storage: Choosing the Error Metric," Energies, MDPI, vol. 14(19), pages 1-11, October.
    • Handle: RePEc:gam:jeners:v:14:y:2021:i:19:p:6274-:d:648634
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/14/19/6274/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/14/19/6274/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    2. Eugenio Borghini & Cinzia Giannetti & James Flynn & Grazia Todeschini, 2021. "Data-Driven Energy Storage Scheduling to Minimise Peak Demand on Distribution Systems with PV Generation," Energies, MDPI, vol. 14(12), pages 1-22, June.
    3. Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(8), pages 1352-1362, August.
    4. Makridakis, Spyros, 1993. "Accuracy measures: theoretical and practical concerns," International Journal of Forecasting, Elsevier, vol. 9(4), pages 527-529, December.
    5. W. R. Gilks & P. Wild, 1992. "Adaptive Rejection Sampling for Gibbs Sampling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 41(2), pages 337-348, June.
    6. Haben, Stephen & Ward, Jonathan & Vukadinovic Greetham, Danica & Singleton, Colin & Grindrod, Peter, 2014. "A new error measure for forecasts of household-level, high resolution electrical energy consumption," International Journal of Forecasting, Elsevier, vol. 30(2), pages 246-256.
    7. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    8. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    9. Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(3), pages 524-524, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    2. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    3. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    4. Dominik Martin & Philipp Spitzer & Niklas Kuhl, 2020. "A New Metric for Lumpy and Intermittent Demand Forecasts: Stock-keeping-oriented Prediction Error Costs," Papers 2004.10537, arXiv.org.
    5. Che-Yu Hung & Chien-Chih Wang & Shi-Woei Lin & Bernard C. Jiang, 2022. "An Empirical Comparison of the Sales Forecasting Performance for Plastic Tray Manufacturing Using Missing Data," Sustainability, MDPI, vol. 14(4), pages 1-21, February.
    6. Larissa Koupriouchina & Jean-Pierre van der Rest & Zvi Schwartz, 2023. "Judgmental Adjustments of Algorithmic Hotel Occupancy Forecasts: Does User Override Frequency Impact Accuracy at Different Time Horizons?," Tourism Economics, , vol. 29(8), pages 2143-2164, December.
    7. Philippe St-Aubin & Bruno Agard, 2022. "Precision and Reliability of Forecasts Performance Metrics," Forecasting, MDPI, vol. 4(4), pages 1-22, October.
    8. Blaskowitz, Oliver & Herwartz, Helmut, 2011. "On economic evaluation of directional forecasts," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1058-1065, October.
    9. Vasile Brătian & Ana-Maria Acu & Camelia Oprean-Stan & Emil Dinga & Gabriela-Mariana Ionescu, 2021. "Efficient or Fractal Market Hypothesis? A Stock Indexes Modelling Using Geometric Brownian Motion and Geometric Fractional Brownian Motion," Mathematics, MDPI, vol. 9(22), pages 1-20, November.
    10. Rahman A. Prasojo & Karunika Diwyacitta & Suwarno & Harry Gumilang, 2017. "Transformer Paper Expected Life Estimation Using ANFIS Based on Oil Characteristics and Dissolved Gases (Case Study: Indonesian Transformers)," Energies, MDPI, vol. 10(8), pages 1-18, August.
    11. Stetco, Adrian & Dinmohammadi, Fateme & Zhao, Xingyu & Robu, Valentin & Flynn, David & Barnes, Mike & Keane, John & Nenadic, Goran, 2019. "Machine learning methods for wind turbine condition monitoring: A review," Renewable Energy, Elsevier, vol. 133(C), pages 620-635.
    12. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    13. Man Sing Wong & Tingneng Wang & Hung Chak Ho & Coco Y. T. Kwok & Keru Lu & Sawaid Abbas, 2018. "Towards a Smart City: Development and Application of an Improved Integrated Environmental Monitoring System," Sustainability, MDPI, vol. 10(3), pages 1-16, February.
    14. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Forecasting Principles from Experience with Forecasting Competitions," Forecasting, MDPI, vol. 3(1), pages 1-28, February.
    15. Spiliotis, Evangelos & Nikolopoulos, Konstantinos & Assimakopoulos, Vassilios, 2019. "Tales from tails: On the empirical distributions of forecasting errors and their implication to risk," International Journal of Forecasting, Elsevier, vol. 35(2), pages 687-698.
    16. Warwick Smith & Anca M. Hanea & Mark A. Burgman, 2022. "Can Groups Improve Expert Economic and Financial Forecasts?," Forecasting, MDPI, vol. 4(3), pages 1-18, August.
    17. Theocharides, Spyros & Makrides, George & Livera, Andreas & Theristis, Marios & Kaimakis, Paris & Georghiou, George E., 2020. "Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing," Applied Energy, Elsevier, vol. 268(C).
    18. Huang, Tao & Fildes, Robert & Soopramanien, Didier, 2014. "The value of competitive information in forecasting FMCG retail product sales and the variable selection problem," European Journal of Operational Research, Elsevier, vol. 237(2), pages 738-748.
    19. Yelland, Phillip M., 2010. "Bayesian forecasting of parts demand," International Journal of Forecasting, Elsevier, vol. 26(2), pages 374-396, April.
    20. Mohamed Khalil Benzekri & Hatice Şehime Özütler, 2021. "On the Predictability of Bitcoin Price Movements: A Short-term Price Prediction with ARIMA," Journal of Economic Policy Researches, Istanbul University, Faculty of Economics, vol. 8(2), pages 293-309, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:14:y:2021:i:19:p:6274-:d:648634. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.