IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v159y2022ics1364032122001022.html
   My bibliography  Save this article

Model-related outcome differences in power system models with sector coupling—Quantification and drivers

Author

Listed:
  • Gils, Hans Christian
  • Gardian, Hedda
  • Kittel, Martin
  • Schill, Wolf-Peter
  • Murmann, Alexander
  • Launer, Jann
  • Gaumnitz, Felix
  • van Ouwerkerk, Jonas
  • Mikurda, Jennifer
  • Torralba-Díaz, Laura

Abstract

This paper presents the results of a multi-model comparison to determine outcome deviations resulting from differences in power system models. We apply eight temporally and spatially resolved models to 16 stylized test cases. These test cases differ in their renewable energy supply share, technology scope, and optimization scope. We focus on technologies for balancing the variability of power generation, such as controllable power plants, energy storage, power transmission, and flexibility related to sector coupling. We use harmonized input data in all models to separate model-related from data-related outcome deviations. We find that our approach allows for isolating and quantifying model-related outcome deviations and robust effects concerning system operation and investment decisions. Furthermore, we can attribute these deviations to the identified model differences. Our results show that trends in the use of individual flexibility options are robust across most models. Moreover, our analysis reveals that differences in the general modeling approach and the modeling of specific technologies lead to comparatively small deviations. In contrast, a heterogeneous model scope can cause substantially larger deviations. Due to a large number of models and scenarios, our analysis can provide important information on which investment and operation decisions are robust to the model choice, and which modeling approaches have an exceptionally high impact on results. Our findings may guide both modelers and decision-makers in properly evaluating the results of similarly designed power system models.

Suggested Citation

  • Gils, Hans Christian & Gardian, Hedda & Kittel, Martin & Schill, Wolf-Peter & Murmann, Alexander & Launer, Jann & Gaumnitz, Felix & van Ouwerkerk, Jonas & Mikurda, Jennifer & Torralba-Díaz, Laura, 2022. "Model-related outcome differences in power system models with sector coupling—Quantification and drivers," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
  • Handle: RePEc:eee:rensus:v:159:y:2022:i:c:s1364032122001022
    DOI: 10.1016/j.rser.2022.112177
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032122001022
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.rser.2022.112177?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bistline, John E.T. & Brown, Maxwell & Siddiqui, Sauleh A. & Vaillancourt, Kathleen, 2020. "Electric sector impacts of renewable policy coordination: A multi-model study of the North American energy system," Energy Policy, Elsevier, vol. 145(C).
    2. Ruhnau, O. & Bucksteeg, M. & Ritter, D. & Schmitz, R. & Böttger, D. & Koch, M. & Pöstges, A. & Wiedmann, M. & Hirth, L., 2022. "Why electricity market models yield different results: Carbon pricing in a model-comparison experiment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    3. Richardson, David B., 2013. "Electric vehicles and the electric grid: A review of modeling approaches, Impacts, and renewable energy integration," Renewable and Sustainable Energy Reviews, Elsevier, vol. 19(C), pages 247-254.
    4. Giarola, Sara & Molar-Cruz, Anahi & Vaillancourt, Kathleen & Bahn, Olivier & Sarmiento, Luis & Hawkes, Adam & Brown, Maxwell, 2021. "The role of energy storage in the uptake of renewable energy: A model comparison approach," Energy Policy, Elsevier, vol. 151(C).
    5. Gils, Hans Christian & Simon, Sonja, 2017. "Carbon neutral archipelago – 100% renewable energy supply for the Canary Islands," Applied Energy, Elsevier, vol. 188(C), pages 342-355.
    6. Gils, Hans Christian & Pregger, Thomas & Flachsbarth, Franziska & Jentsch, Mareike & Dierstein, Constantin, 2019. "Comparison of spatially and temporally resolved energy system models with a focus on Germany's future power supply," Applied Energy, Elsevier, vol. 255(C).
    7. Gacitua, L. & Gallegos, P. & Henriquez-Auba, R. & Lorca, Á. & Negrete-Pincetic, M. & Olivares, D. & Valenzuela, A. & Wenzel, G., 2018. "A comprehensive review on expansion planning: Models and tools for energy policy analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 98(C), pages 346-360.
    8. Fattahi, A. & Sijm, J. & Faaij, A., 2020. "A systemic approach to analyze integrated energy system modeling tools: A review of national models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    9. Pietzcker, Robert C. & Ueckerdt, Falko & Carrara, Samuel & de Boer, Harmen Sytze & Després, Jacques & Fujimori, Shinichiro & Johnson, Nils & Kitous, Alban & Scholz, Yvonne & Sullivan, Patrick & Ludere, 2017. "System integration of wind and solar power in integrated assessment models: A cross-model evaluation of new approaches," Energy Economics, Elsevier, vol. 64(C), pages 583-599.
    10. Klemm, Christian & Vennemann, Peter, 2021. "Modeling and optimization of multi-energy systems in mixed-use districts: A review of existing methods and approaches," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    11. Gaete-Morales, Carlos & Kittel, Martin & Roth, Alexander & Schill, Wolf-Peter, 2021. "DIETERpy: A Python framework for the Dispatch and Investment Evaluation Tool with Endogenous Renewables," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 15.
    12. Joseph Aldy & William Pizer & Massimo Tavoni & Lara Aleluia Reis & Keigo Akimoto & Geoffrey Blanford & Carlo Carraro & Leon E. Clarke & James Edmonds & Gokul C. Iyer & Haewon C. McJeon & Richard Riche, 2016. "Economic tools to promote transparency and comparability in the Paris Agreement," Nature Climate Change, Nature, vol. 6(11), pages 1000-1004, November.
    13. Prina, Matteo Giacomo & Manzolini, Giampaolo & Moser, David & Nastasi, Benedetto & Sparber, Wolfram, 2020. "Classification and challenges of bottom-up energy system models - A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 129(C).
    14. Savvidis, Georgios & Siala, Kais & Weissbart, Christoph & Schmidt, Lukas & Borggrefe, Frieder & Kumar, Subhash & Pittel, Karen & Madlener, Reinhard & Hufendiek, Kai, 2019. "The gap between energy policy challenges and model capabilities," Energy Policy, Elsevier, vol. 125(C), pages 503-520.
    15. Bosetti, Valentina & Marangoni, Giacomo & Borgonovo, Emanuele & Diaz Anadon, Laura & Barron, Robert & McJeon, Haewon C. & Politis, Savvas & Friley, Paul, 2015. "Sensitivity to energy technology costs: A multi-model comparison analysis," Energy Policy, Elsevier, vol. 80(C), pages 244-263.
    16. Siala, Kais & Mier, Mathias & Schmidt, Lukas & Torralba-Díaz, Laura & Sheykhha, Siamak & Savvidis, Georgios, 2022. "Which model features matter? An experimental approach to evaluate power market modeling choices," Energy, Elsevier, vol. 245(C).
    17. Mai, Trieu & Bistline, John & Sun, Yinong & Cole, Wesley & Marcy, Cara & Namovicz, Chris & Young, David, 2018. "The role of input assumptions and model structures in projections of variable renewable energy: A multi-model perspective of the U.S. electricity system," Energy Economics, Elsevier, vol. 76(C), pages 313-324.
    18. Hanley, Emma S. & Deane, JP & Gallachóir, BP Ó, 2018. "The role of hydrogen in low carbon energy futures–A review of existing perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 82(P3), pages 3027-3045.
    19. Krey, Volker & Guo, Fei & Kolp, Peter & Zhou, Wenji & Schaeffer, Roberto & Awasthy, Aayushi & Bertram, Christoph & de Boer, Harmen-Sytze & Fragkos, Panagiotis & Fujimori, Shinichiro & He, Chenmin & Iy, 2019. "Looking under the hood: A comparison of techno-economic assumptions across national and global integrated assessment models," Energy, Elsevier, vol. 172(C), pages 1254-1267.
    20. Gils, Hans Christian & Gardian, Hedda & Kittel, Martin & Schill, Wolf-Peter & Zerrahn, Alexander & Murmann, Alexander & Launer, Jann & Fehler, Alexander & Gaumnitz, Felix & van Ouwerkerk, Jonas & Bußa, 2022. "Modeling flexibility in energy systems — comparison of power sector models based on simplified test cases," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    21. Blanco, Herib & Faaij, André, 2018. "A review at the role of storage in energy systems with a focus on Power to Gas and long-term storage," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1049-1086.
    22. Gils, Hans Christian & Scholz, Yvonne & Pregger, Thomas & Luca de Tena, Diego & Heide, Dominik, 2017. "Integrated modelling of variable renewable energy-based power supply in Europe," Energy, Elsevier, vol. 123(C), pages 173-188.
    23. Zerrahn, Alexander & Schill, Wolf-Peter, 2017. "Long-run power storage requirements for high shares of renewables: review and a new model," Renewable and Sustainable Energy Reviews, Elsevier, vol. 79(C), pages 1518-1534.
    24. Wilkerson, Jordan T. & Leibowicz, Benjamin D. & Turner, Delavane D. & Weyant, John P., 2015. "Comparison of integrated assessment models: Carbon price impacts on U.S. energy," Energy Policy, Elsevier, vol. 76(C), pages 18-31.
    25. Bloess, Andreas & Schill, Wolf-Peter & Zerrahn, Alexander, 2018. "Power-to-heat for renewable energy integration: A review of technologies, modeling approaches, and flexibility potentials," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 212, pages 1611-1626.
    26. Misconel, S. & Leisen, R. & Mikurda, J. & Zimmermann, F. & Fraunholz, C. & Fichtner, W. & Möst, D. & Weber, C., 2022. "Systematic comparison of high-resolution electricity system modeling approaches focusing on investment, dispatch and generation adequacy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    27. Lopion, Peter & Markewitz, Peter & Robinius, Martin & Stolten, Detlef, 2018. "A review of current challenges and trends in energy systems modeling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 156-166.
    28. Laura Torralba-Díaz & Christoph Schimeczek & Matthias Reeg & Georgios Savvidis & Marc Deissenroth-Uhrig & Felix Guthoff & Benjamin Fleischer & Kai Hufendiek, 2020. "Identification of the Efficiency Gap by Coupling a Fundamental Electricity Market Model and an Agent-Based Simulation Model," Energies, MDPI, vol. 13(15), pages 1-19, July.
    29. Huntington, Hillard G. & Bhargava, Abha & Daniels, David & Weyant, John P. & Avraam, Charalampos & Bistline, John & Edmonds, James A. & Giarola, Sara & Hawkes, Adam & Hansen, Matthew & Johnston, Peter, 2020. "Key findings from the core North American scenarios in the EMF34 intermodel comparison," Energy Policy, Elsevier, vol. 144(C).
    30. Gils, Hans Christian & Gardian, Hedda & Schmugge, Jens, 2021. "Interaction of hydrogen infrastructures with other sector coupling options towards a zero-emission energy system in Germany," Renewable Energy, Elsevier, vol. 180(C), pages 140-156.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Prina, Matteo Giacomo & Nastasi, Benedetto & Groppi, Daniele & Misconel, Steffi & Garcia, Davide Astiaso & Sparber, Wolfram, 2022. "Comparison methods of energy system frameworks, models and scenario results," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    2. Heinisch, Verena & Dujardin, Jérôme & Gabrielli, Paolo & Jain, Pranjal & Lehning, Michael & Sansavini, Giovanni & Sasse, Jan-Philipp & Schaffner, Christian & Schwarz, Marius & Trutnevyte, Evelina, 2023. "Inter-comparison of spatial models for high shares of renewable electricity in Switzerland," Applied Energy, Elsevier, vol. 350(C).
    3. F, Feijoo & A, Pfeifer & L, Herc & D, Groppi & N, Duić, 2022. "A long-term capacity investment and operational energy planning model with power-to-X and flexibility technologies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    4. Kondziella, Hendrik & Specht, Karl & Lerch, Philipp & Scheller, Fabian & Bruckner, Thomas, 2023. "The techno-economic potential of large-scale hydrogen storage in Germany for a climate-neutral energy system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    5. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2023. "Hindcasting to inform the development of bottom-up electricity system models: The cases of endogenous demand and technology learning," Applied Energy, Elsevier, vol. 340(C).
    6. Gorman, Nicholas & MacGill, Iain & Bruce, Anna, 2024. "Re-dispatch simplification analysis: Confirmation holism and assessing the impact of simplifications on energy system model performance," Applied Energy, Elsevier, vol. 365(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gils, Hans Christian & Gardian, Hedda & Kittel, Martin & Schill, Wolf-Peter & Zerrahn, Alexander & Murmann, Alexander & Launer, Jann & Fehler, Alexander & Gaumnitz, Felix & van Ouwerkerk, Jonas & Bußa, 2022. "Modeling flexibility in energy systems — comparison of power sector models based on simplified test cases," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    2. van Ouwerkerk, Jonas & Gils, Hans Christian & Gardian, Hedda & Kittel, Martin & Schill, Wolf-Peter & Zerrahn, Alexander & Murmann, Alexander & Launer, Jann & Torralba-Díaz, Laura & Bußar, Christian, 2022. "Impacts of power sector model features on optimal capacity expansion: A comparative study," Renewable and Sustainable Energy Reviews, Elsevier, vol. 157(C).
    3. Prina, Matteo Giacomo & Nastasi, Benedetto & Groppi, Daniele & Misconel, Steffi & Garcia, Davide Astiaso & Sparber, Wolfram, 2022. "Comparison methods of energy system frameworks, models and scenario results," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    4. Østergaard, P.A. & Lund, H. & Thellufsen, J.Z. & Sorknæs, P. & Mathiesen, B.V., 2022. "Review and validation of EnergyPLAN," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    5. Haugen, Mari & Blaisdell-Pijuan, Paris L. & Botterud, Audun & Levin, Todd & Zhou, Zhi & Belsnes, Michael & Korpås, Magnus & Somani, Abhishek, 2024. "Power market models for the clean energy transition: State of the art and future research needs," Applied Energy, Elsevier, vol. 357(C).
    6. Blanco, Herib & Leaver, Jonathan & Dodds, Paul E. & Dickinson, Robert & García-Gusano, Diego & Iribarren, Diego & Lind, Arne & Wang, Changlong & Danebergs, Janis & Baumann, Martin, 2022. "A taxonomy of models for investigating hydrogen energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    7. Fodstad, Marte & Crespo del Granado, Pedro & Hellemo, Lars & Knudsen, Brage Rugstad & Pisciella, Paolo & Silvast, Antti & Bordin, Chiara & Schmidt, Sarah & Straus, Julian, 2022. "Next frontiers in energy system modelling: A review on challenges and the state of the art," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    8. Chang, Miguel & Thellufsen, Jakob Zink & Zakeri, Behnam & Pickering, Bryn & Pfenninger, Stefan & Lund, Henrik & Østergaard, Poul Alberg, 2021. "Trends in tools and approaches for modelling the energy transition," Applied Energy, Elsevier, vol. 290(C).
    9. Martínez-Gordón, R. & Morales-España, G. & Sijm, J. & Faaij, A.P.C., 2021. "A review of the role of spatial resolution in energy systems modelling: Lessons learned and applicability to the North Sea region," Renewable and Sustainable Energy Reviews, Elsevier, vol. 141(C).
    10. Thimet, P.J. & Mavromatidis, G., 2022. "Review of model-based electricity system transition scenarios: An analysis for Switzerland, Germany, France, and Italy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    11. Chang, Miguel & Lund, Henrik & Thellufsen, Jakob Zinck & Østergaard, Poul Alberg, 2023. "Perspectives on purpose-driven coupling of energy system models," Energy, Elsevier, vol. 265(C).
    12. Zerrahn, Alexander & Schill, Wolf-Peter & Kemfert, Claudia, 2018. "On the economics of electrical storage for variable renewable energy sources," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 108, pages 259-279.
    13. Javier L'opez Prol & Wolf-Peter Schill, 2020. "The Economics of Variable Renewables and Electricity Storage," Papers 2012.15371, arXiv.org.
    14. Rhodes, Ekaterina & Hoyle, Aaron & McPherson, Madeleine & Craig, Kira, 2022. "Understanding climate policy projections: A scoping review of energy-economy models in Canada," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    15. Johannes Schaffert & Hans Christian Gils & Max Fette & Hedda Gardian & Christine Brandstätt & Thomas Pregger & Nils Brücken & Eren Tali & Marc Fiebrandt & Rolf Albus & Frank Burmeister, 2022. "Integrating System and Operator Perspectives for the Evaluation of Power-to-Gas Plants in the Future German Energy System," Energies, MDPI, vol. 15(3), pages 1-22, February.
    16. Mier, Mathias & Azarova, Valeriya, 2024. "Investment cost specifications revisited," Energy Policy, Elsevier, vol. 188(C).
    17. Niina Helistö & Juha Kiviluoma & Hannele Holttinen & Jose Daniel Lara & Bri‐Mathias Hodge, 2019. "Including operational aspects in the planning of power systems with large amounts of variable generation: A review of modeling approaches," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 8(5), September.
    18. van Ouwerkerk, Jonas & Hainsch, Karlo & Candas, Soner & Muschner, Christoph & Buchholz, Stefanie & Günther, Stephan & Huyskens, Hendrik & Berendes, Sarah & Löffler, Konstantin & Bußar, Christian & Tar, 2022. "Comparing open source power system models - A case study focusing on fundamental modeling parameters for the German energy transition," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    19. Bucksteeg, Michael & Wiedmann, Michael & Pöstges, Arne & Haller, Markus & Böttger, Diana & Ruhnau, Oliver & Schmitz, Richard, 2022. "The transformation of integrated electricity and heat systems—Assessing mid-term policies using a model comparison approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    20. Heinisch, Verena & Dujardin, Jérôme & Gabrielli, Paolo & Jain, Pranjal & Lehning, Michael & Sansavini, Giovanni & Sasse, Jan-Philipp & Schaffner, Christian & Schwarz, Marius & Trutnevyte, Evelina, 2023. "Inter-comparison of spatial models for high shares of renewable electricity in Switzerland," Applied Energy, Elsevier, vol. 350(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:159:y:2022:i:c:s1364032122001022. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.