Accuracy indicators for evaluating retrospective performance of energy system models
Author
Abstract
Suggested Citation
DOI: 10.1016/j.apenergy.2022.119906
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Hillard G. Huntington, 1994.
"Oil Price Forecasting in the 1980s: What Went Wrong?,"
The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 1-22.
- Hillard G. Huntington, 1994. "Oil Price Forecasting in the 1980s: What Went Wrong?," The Energy Journal, , vol. 15(2), pages 1-22, April.
- Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
- Groissböck, Markus & Pickl, Matthias J., 2016. "An analysis of the power market in Saudi Arabia: Retrospective cost and environmental optimization," Applied Energy, Elsevier, vol. 165(C), pages 548-558.
- Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(8), pages 1352-1362, August.
- Labandeira, Xavier & Labeaga, José M. & López-Otero, Xiral, 2017.
"A meta-analysis on the price elasticity of energy demand,"
Energy Policy, Elsevier, vol. 102(C), pages 549-568.
- Xavier Labandeira & José M.aría Labeaga & Xiral López-Otero, 2015. "A meta-analysis on the price elasticity of energy demand," Working Papers 04-2015, Economics for Energy.
- Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard, 2009.
"Understanding errors in EIA projections of energy demand,"
Resource and Energy Economics, Elsevier, vol. 31(3), pages 198-209, August.
- Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard D., 2008. "Understanding Errors in EIA Projections of Energy Demand," RFF Working Paper Series dp-08-54, Resources for the Future.
- Evan D. Sherwin & Max Henrion & Inês M. L. Azevedo, 2018. "Estimation of the year-on-year volatility and the unpredictability of the United States energy system," Nature Energy, Nature, vol. 3(4), pages 341-346, April.
- Abosedra, Salah & Baghestani, Hamid, 2004. "On the predictive accuracy of crude oil futures prices," Energy Policy, Elsevier, vol. 32(12), pages 1389-1393, August.
- Gilbert, Alexander Q. & Sovacool, Benjamin K., 2016. "Looking the wrong way: Bias, renewable electricity, and energy modelling in the United States," Energy, Elsevier, vol. 94(C), pages 533-541.
- Linderoth, Hans, 2002. "Forecast errors in IEA-countries' energy consumption," Energy Policy, Elsevier, vol. 30(1), pages 53-61, January.
- DeCarolis, Joseph F. & Hunter, Kevin & Sreepathi, Sarat, 2012. "The case for repeatable analysis with energy economy optimization models," Energy Economics, Elsevier, vol. 34(6), pages 1845-1853.
- Trutnevyte, Evelina & McDowall, Will & Tomei, Julia & Keppo, Ilkka, 2016. "Energy scenario choices: Insights from a retrospective review of UK energy futures," Renewable and Sustainable Energy Reviews, Elsevier, vol. 55(C), pages 326-337.
- Glotin, David & Bourgeois, Cyril & Giraudet, Louis-Gaëtan & Quirion, Philippe, 2019.
"Prediction is difficult, even when it's about the past: A hindcast experiment using Res-IRF, an integrated energy-economy model,"
Energy Economics, Elsevier, vol. 84(S1).
- David Glotin & Cyril Bourgeois & Louis-Gaëtan Giraudet & Philippe Quirion, 2019. "Prediction is difficult, even when it's about the past: a hindcast experiment using Res-IRF, an integrated energy-economy model," Working Papers 2019.03, FAERE - French Association of Environmental and Resource Economists.
- McConnell, Dylan & Hearps, Patrick & Eales, Dominic & Sandiford, Mike & Dunn, Rebecca & Wright, Matthew & Bateman, Lachlan, 2013. "Retrospective modeling of the merit-order effect on wholesale electricity prices from distributed photovoltaic generation in the Australian National Electricity Market," Energy Policy, Elsevier, vol. 58(C), pages 17-27.
- Bentzen, J. & Linderoth, H., 2001.
"Has the accuracy of energy demand projections in the OECD countries improved since the 1970s?,"
Papers
01-5, Aarhus School of Business - Department of Economics.
- Bentzen, Jan & Linderoth, Hans, 2001. "Has the accuracy of energy demand projections in the OECD countries improved since the 1970s?," Working Papers 01-5, University of Aarhus, Aarhus School of Business, Department of Economics.
- Manzoor, Davood & Aryanpur, Vahid, 2017. "Power sector development in Iran: A retrospective optimization approach," Energy, Elsevier, vol. 140(P1), pages 330-339.
- Hua Liao & Jia-Wei Cai & Dong-Wei Yang & Yi-Ming Wei, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA¡¯s projection," CEEP-BIT Working Papers 92, Center for Energy and Environmental Policy Research (CEEP), Beijing Institute of Technology.
- Priesmann, Jan & Nolting, Lars & Praktiknjo, Aaron, 2019. "Are complex energy system models more accurate? An intra-model comparison of power system optimization models," Applied Energy, Elsevier, vol. 255(C).
- Fujimori, Shinichiro & Dai, Hancheng & Masui, Toshihiko & Matsuoka, Yuzuru, 2016. "Global energy model hindcasting," Energy, Elsevier, vol. 114(C), pages 293-301.
- Steinbuks, Jevgenijs, 2019. "Assessing the accuracy of electricity production forecasts in developing countries," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1175-1185.
- Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.
- Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
- Huntington, Hillard G., 2021.
"Model evaluation for policy insights: Reflections on the forum process,"
Energy Policy, Elsevier, vol. 156(C).
- Huntington, Hillard G., 2021. "Model Evaluation for Policy Insights: Reflections on the Forum Process," MPRA Paper 108691, University Library of Munich, Germany.
- Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2021. "Point and interval forecasting of electricity supply via pruned ensembles," Energy, Elsevier, vol. 232(C).
- Richard Loulou, 2008. "ETSAP-TIAM: the TIMES integrated assessment model. part II: mathematical formulation," Computational Management Science, Springer, vol. 5(1), pages 41-66, February.
- al Irsyad, Muhammad Indra & Halog, Anthony & Nepal, Rabindra, 2019.
"Renewable energy projections for climate change mitigation: An analysis of uncertainty and errors,"
Renewable Energy, Elsevier, vol. 130(C), pages 536-546.
- M. Indra al Irsyada & Anthony Halog & Rabindra Nepal, 2017. "Renewable energy projections for climate change mitigation: An analysis of uncertainty and errors," CAMA Working Papers 2017-74, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- He, Yongxiu & Jiao, Jie & Chen, Qian & Ge, Sifan & Chang, Yan & Xu, Yang, 2017. "Urban long term electricity demand forecast method based on system dynamics of the new economic normal: The case of Tianjin," Energy, Elsevier, vol. 133(C), pages 9-22.
- Siddons, Craig & Allan, Grant & McIntyre, Stuart, 2015. "How accurate are forecasts of costs of energy? A methodological contribution," Energy Policy, Elsevier, vol. 87(C), pages 224-228.
- Vaclav Smil, 2008. "Long-range energy forecasts are no more than fairy tales," Nature, Nature, vol. 453(7192), pages 154-154, May.
- Qudrat-Ullah, Hassan, 2017. "How to enhance the future use of energy policy simulation models through ex post validation," Energy, Elsevier, vol. 120(C), pages 58-66.
- Winebrake, James J. & Sakva, Denys, 2006. "An evaluation of errors in US energy forecasts: 1982-2003," Energy Policy, Elsevier, vol. 34(18), pages 3475-3483, December.
- Bashmakov, Igor, 2007. "Three laws of energy transitions," Energy Policy, Elsevier, vol. 35(7), pages 3583-3594, July.
- Jan-Philipp Sasse & Evelina Trutnevyte, 2020. "Regional impacts of electricity system transition in Central Europe until 2035," Nature Communications, Nature, vol. 11(1), pages 1-14, December.
- Hyndman, Rob J. & Koehler, Anne B., 2006.
"Another look at measures of forecast accuracy,"
International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
- Rob J. Hyndman & Anne B. Koehler, 2005. "Another Look at Measures of Forecast Accuracy," Monash Econometrics and Business Statistics Working Papers 13/05, Monash University, Department of Econometrics and Business Statistics.
- Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
- Katherine Calvin & Marshall Wise & Page Kyle & Leon Clarke & Jae Edmonds, 2017. "A Hindcast Experiment Using The Gcam 3.0 Agriculture And Land-Use Module," Climate Change Economics (CCE), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 1-21, February.
- Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(3), pages 524-524, March.
- van Ruijven, Bas & de Vries, Bert & van Vuuren, Detlef P. & van der Sluijs, Jeroen P., 2010. "A global model for residential energy use: Uncertainty in calibration to regional data," Energy, Elsevier, vol. 35(1), pages 269-282.
- Richard Loulou & Maryse Labriet, 2008. "ETSAP-TIAM: the TIMES integrated assessment model Part I: Model structure," Computational Management Science, Springer, vol. 5(1), pages 7-40, February.
- Trutnevyte, Evelina, 2016. "Does cost optimization approximate the real-world energy transition?," Energy, Elsevier, vol. 106(C), pages 182-193.
- Goodwin, Paul & Lawton, Richard, 1999. "On the asymmetry of the symmetric MAPE," International Journal of Forecasting, Elsevier, vol. 15(4), pages 405-408, October.
- Felix Creutzig & Peter Agoston & Jan Christoph Goldschmidt & Gunnar Luderer & Gregory Nemet & Robert C. Pietzcker, 2017. "The underestimated potential of solar energy to mitigate climate change," Nature Energy, Nature, vol. 2(9), pages 1-9, September.
- Jing Meng & Rupert Way & Elena Verdolini & Laura Diaz Anadon, 2021. "Comparing expert elicitation and model-based probabilistic technology cost forecasts for the energy transition," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 118(27), pages 1917165118-, July.
- Berntsen, Philip B. & Trutnevyte, Evelina, 2017. "Ensuring diversity of national energy scenarios: Bottom-up energy system model with Modeling to Generate Alternatives," Energy, Elsevier, vol. 126(C), pages 886-898.
- Makridakis, Spyros, 1993. "Accuracy measures: theoretical and practical concerns," International Journal of Forecasting, Elsevier, vol. 9(4), pages 527-529, December.
- Li, Francis G.N. & Trutnevyte, Evelina, 2017. "Investment appraisal of cost-optimal and near-optimal pathways for the UK electricity sector transition to 2050," Applied Energy, Elsevier, vol. 189(C), pages 89-109.
- DeCarolis, Joseph & Daly, Hannah & Dodds, Paul & Keppo, Ilkka & Li, Francis & McDowall, Will & Pye, Steve & Strachan, Neil & Trutnevyte, Evelina & Usher, Will & Winning, Matthew & Yeh, Sonia & Zeyring, 2017. "Formalizing best practice for energy system optimization modelling," Applied Energy, Elsevier, vol. 194(C), pages 184-198.
- O'Neill, Brian C. & Desai, Mausami, 2005. "Accuracy of past projections of US energy consumption," Energy Policy, Elsevier, vol. 33(8), pages 979-993, May.
- Müller, Jonas & Trutnevyte, Evelina, 2020. "Spatial projections of solar PV installations at subnational level: Accuracy testing of regression models," Applied Energy, Elsevier, vol. 265(C).
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Fan, Xiaoyu & Ji, Wei & Li, Junxian & Gao, Zhaozhao & Chen, Liubiao & Wang, Junjie, 2024. "Advancing liquid air energy storage with moving packed bed: Development and analysis from components to system level," Applied Energy, Elsevier, vol. 355(C).
- Sasse, Jan-Philipp & Trutnevyte, Evelina, 2023. "Cost-effective options and regional interdependencies of reaching a low-carbon European electricity system in 2035," Energy, Elsevier, vol. 282(C).
- Andrea Costantino, 2023. "Development, Validation, and Application of Building Energy Simulation Models for Livestock Houses: A Systematic Review," Agriculture, MDPI, vol. 13(12), pages 1-28, December.
- Tomasz Ząbkowski & Krzysztof Gajowniczek & Grzegorz Matejko & Jacek Brożyna & Grzegorz Mentel & Małgorzata Charytanowicz & Jolanta Jarnicka & Anna Olwert & Weronika Radziszewska & Jörg Verstraete, 2023. "Cluster-Based Approach to Estimate Demand in the Polish Power System Using Commercial Customers’ Data," Energies, MDPI, vol. 16(24), pages 1-21, December.
- Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2023. "Hindcasting to inform the development of bottom-up electricity system models: The cases of endogenous demand and technology learning," Applied Energy, Elsevier, vol. 340(C).
- Gorman, Nicholas & MacGill, Iain & Bruce, Anna, 2024. "Re-dispatch simplification analysis: Confirmation holism and assessing the impact of simplifications on energy system model performance," Applied Energy, Elsevier, vol. 365(C).
- Wen, Xin & Heinisch, Verena & Müller, Jonas & Sasse, Jan-Philipp & Trutnevyte, Evelina, 2023. "Comparison of statistical and optimization models for projecting future PV installations at a sub-national scale," Energy, Elsevier, vol. 285(C).
- Jan-Philipp Sasse & Evelina Trutnevyte, 2023. "A low-carbon electricity sector in Europe risks sustaining regional inequalities in benefits and vulnerabilities," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2023. "Hindcasting to inform the development of bottom-up electricity system models: The cases of endogenous demand and technology learning," Applied Energy, Elsevier, vol. 340(C).
- Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.
- Wen, Xin & Heinisch, Verena & Müller, Jonas & Sasse, Jan-Philipp & Trutnevyte, Evelina, 2023. "Comparison of statistical and optimization models for projecting future PV installations at a sub-national scale," Energy, Elsevier, vol. 285(C).
- Berntsen, Philip B. & Trutnevyte, Evelina, 2017. "Ensuring diversity of national energy scenarios: Bottom-up energy system model with Modeling to Generate Alternatives," Energy, Elsevier, vol. 126(C), pages 886-898.
- Trutnevyte, Evelina, 2016. "Does cost optimization approximate the real-world energy transition?," Energy, Elsevier, vol. 106(C), pages 182-193.
- DeCarolis, Joseph & Daly, Hannah & Dodds, Paul & Keppo, Ilkka & Li, Francis & McDowall, Will & Pye, Steve & Strachan, Neil & Trutnevyte, Evelina & Usher, Will & Winning, Matthew & Yeh, Sonia & Zeyring, 2017. "Formalizing best practice for energy system optimization modelling," Applied Energy, Elsevier, vol. 194(C), pages 184-198.
- Moret, Stefano & Codina Gironès, Víctor & Bierlaire, Michel & Maréchal, François, 2017. "Characterization of input uncertainties in strategic energy planning models," Applied Energy, Elsevier, vol. 202(C), pages 597-617.
- Xexakis, Georgios & Hansmann, Ralph & Volken, Sandra P. & Trutnevyte, Evelina, 2020. "Models on the wrong track: Model-based electricity supply scenarios in Switzerland are not aligned with the perspectives of energy experts and the public," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
- Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
- Colin Singleton & Peter Grindrod, 2021. "Forecasting for Battery Storage: Choosing the Error Metric," Energies, MDPI, vol. 14(19), pages 1-11, October.
- Charlie Wilson & Céline Guivarch & Elmar Kriegler & Bas Ruijven & Detlef P. Vuuren & Volker Krey & Valeria Jana Schwanitz & Erica L. Thompson, 2021.
"Evaluating process-based integrated assessment models of climate change mitigation,"
Climatic Change, Springer, vol. 166(1), pages 1-22, May.
- Charlie Wilson & Céline Guivarch & Elmar Kriegler & Bas van Ruijven & Detlef van Vuuren & Volker Krey & Valeria Jana Schwanitz & Erica Thompson, 2021. "Evaluating process-based integrated assessment models of climate change mitigation," Post-Print hal-03216630, HAL.
- al Irsyad, Muhammad Indra & Halog, Anthony & Nepal, Rabindra, 2019.
"Renewable energy projections for climate change mitigation: An analysis of uncertainty and errors,"
Renewable Energy, Elsevier, vol. 130(C), pages 536-546.
- M. Indra al Irsyada & Anthony Halog & Rabindra Nepal, 2017. "Renewable energy projections for climate change mitigation: An analysis of uncertainty and errors," CAMA Working Papers 2017-74, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Wang, Fangzhi & Liao, Hua, 2022. "Unexpected economic growth and oil price shocks," Energy Economics, Elsevier, vol. 116(C).
- Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
- Price, James & Keppo, Ilkka, 2017. "Modelling to generate alternatives: A technique to explore uncertainty in energy-environment-economy models," Applied Energy, Elsevier, vol. 195(C), pages 356-369.
- Che-Yu Hung & Chien-Chih Wang & Shi-Woei Lin & Bernard C. Jiang, 2022. "An Empirical Comparison of the Sales Forecasting Performance for Plastic Tray Manufacturing Using Missing Data," Sustainability, MDPI, vol. 14(4), pages 1-21, February.
- Larissa Koupriouchina & Jean-Pierre van der Rest & Zvi Schwartz, 2023. "Judgmental Adjustments of Algorithmic Hotel Occupancy Forecasts: Does User Override Frequency Impact Accuracy at Different Time Horizons?," Tourism Economics, , vol. 29(8), pages 2143-2164, December.
- Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
- Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Forecasting Principles from Experience with Forecasting Competitions," Forecasting, MDPI, vol. 3(1), pages 1-28, February.
- Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
More about this item
Keywords
Energy system models; Energy projections; Energy scenarios; Accuracy indicators; Optimization; Model evaluation;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:325:y:2022:i:c:s0306261922011667. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.