IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v239y2019icp991-1002.html

Prospects for energy economy modelling with big data: Hype, eliminating blind spots, or revolutionising the state of the art?

Author

Listed:
  • Li, Francis G.N.
  • Bataille, Chris
  • Pye, Steve
  • O'Sullivan, Aidan

Abstract

Energy economy models are central to decision making on energy and climate issues in the 21st century, such as informing the design of deep decarbonisation strategies under the Paris Agreement. Designing policies that are aimed at achieving such radical transitions in the energy system will require ever more in-depth modelling of end-use demand, efficiency and fuel switching, as well as an increasing need for regional, sectoral, and agent disaggregation to capture technological, jurisdictional and policy detail. Building and using these models entails complex trade-offs between the level of detail, the size of the system boundary, and the available computing resources. The availability of data to characterise key energy system sectors and interactions is also a key driver of model structure and parameterisation, and there are many blind spots and design compromises that are caused by data scarcity. We may soon, however, live in a world of data abundance, potentially enabling previously impossible levels of resolution and coverage in energy economy models. But while big data concepts and platforms have already begun to be used in a number of selected energy research applications, their potential to improve or even completely revolutionise energy economy modelling has been almost completely overlooked in the existing literature. In this paper, we explore the challenges and possibilities of this emerging frontier. We identify critical gaps and opportunities for the field, as well as developing foundational concepts for guiding the future application of big data to energy economy modelling, with reference to the existing literature on decision making under uncertainty, scenario analysis and the philosophy of science.

Suggested Citation

  • Li, Francis G.N. & Bataille, Chris & Pye, Steve & O'Sullivan, Aidan, 2019. "Prospects for energy economy modelling with big data: Hype, eliminating blind spots, or revolutionising the state of the art?," Applied Energy, Elsevier, vol. 239(C), pages 991-1002.
    • Handle: RePEc:eee:appene:v:239:y:2019:i:c:p:991-1002
    DOI: 10.1016/j.apenergy.2019.02.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261919302922
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2019.02.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Scarpa, Riccardo & Willis, Ken, 2010. "Willingness-to-pay for renewable energy: Primary and discretionary choice of British households' for micro-generation technologies," Energy Economics, Elsevier, vol. 32(1), pages 129-136, January.
    2. van Alphen, Klaas & van Voorst tot Voorst, Quirine & Hekkert, Marko P. & Smits, Ruud E.H.M., 2007. "Societal acceptance of carbon capture and storage technologies," Energy Policy, Elsevier, vol. 35(8), pages 4368-4380, August.
    3. Di Salvo, André L.A. & Agostinho, Feni & Almeida, Cecília M.V.B. & Giannetti, Biagio F., 2017. "Can cloud computing be labeled as “green”? Insights under an environmental accounting perspective," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 514-526.
    4. repec:aen:journl:2006se_jaccard-a05 is not listed on IDEAS
    5. Olivier Sassi & Renaud Crassous & Jean-Charles Hourcade & Vincent Gitz & Henri Waisman & Celine Guivarch, 2010. "IMACLIM-R: a modelling framework to simulate sustainable development pathways," International Journal of Global Environmental Issues, Inderscience Enterprises Ltd, vol. 10(1/2), pages 5-24.
    6. Michelsen, Carl Christian & Madlener, Reinhard, 2012. "Homeowners' preferences for adopting innovative residential heating systems: A discrete choice analysis for Germany," Energy Economics, Elsevier, vol. 34(5), pages 1271-1283.
    7. Li, Pei-Hao & Pye, Steve, 2018. "Assessing the benefits of demand-side flexibility in residential and transport sectors from an integrated energy systems perspective," Applied Energy, Elsevier, vol. 228(C), pages 965-979.
    8. Christophe McGlade & Paul Ekins, 2015. "The geographical distribution of fossil fuels unused when limiting global warming to 2 °C," Nature, Nature, vol. 517(7533), pages 187-190, January.
    9. Sándor Szabó & Magda Moner-Girona & Ioannis Kougias & Rob Bailis & Katalin Bódis, 2016. "Identification of advantageous electricity generation options in sub-Saharan Africa integrating existing resources," Nature Energy, Nature, vol. 1(10), pages 1-8, October.
    10. Sivarajah, Uthayasankar & Kamal, Muhammad Mustafa & Irani, Zahir & Weerakkody, Vishanth, 2017. "Critical analysis of Big Data challenges and analytical methods," Journal of Business Research, Elsevier, vol. 70(C), pages 263-286.
    11. Sandrine Mathy & Patrick Criqui & Katharina Knoop & Manfred Fischedick & Sascha Samadi, 2016. "Uncertainty management and the dynamic adjustment of deep decarbonization pathways," Climate Policy, Taylor & Francis Journals, vol. 16(sup1), pages 47-62, June.
    12. Schuelke-Leech, Beth-Anne & Barry, Betsy & Muratori, Matteo & Yurkovich, B.J., 2015. "Big Data issues and opportunities for electric utilities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 937-947.
    13. Jean Charles Hourcade & Mark Jaccard & Chris Bataille & Frédéric Ghersi, 2006. "Hybrid Modeling: New Answers to Old Challenges," Post-Print halshs-00471234, HAL.
    14. Brand, Christian & Cluzel, Celine & Anable, Jillian, 2017. "Modeling the uptake of plug-in vehicles in a heterogeneous car market using a consumer segmentation approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 97(C), pages 121-136.
    15. Deane, J.P. & Chiodi, Alessandro & Gargiulo, Maurizio & Ó Gallachóir, Brian P., 2012. "Soft-linking of a power systems model to an energy systems model," Energy, Elsevier, vol. 42(1), pages 303-312.
    16. Zhou, Kaile & Yang, Shanlin, 2016. "Understanding household energy consumption behavior: The contribution of energy big data analytics," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 810-819.
    17. Axsen, Jonn & Mountain, Dean C. & Jaccard, Mark, 2009. "Combining stated and revealed choice research to simulate the neighbor effect: The case of hybrid-electric vehicles," Resource and Energy Economics, Elsevier, vol. 31(3), pages 221-238, August.
    18. Rausch, Sebastian & Metcalf, Gilbert E. & Reilly, John M., 2011. "Distributional impacts of carbon pricing: A general equilibrium approach with micro-data for households," Energy Economics, Elsevier, vol. 33(S1), pages 20-33.
    19. Erevelles, Sunil & Fukawa, Nobuyuki & Swayne, Linda, 2016. "Big Data consumer analytics and the transformation of marketing," Journal of Business Research, Elsevier, vol. 69(2), pages 897-904.
    20. Fosso Wamba, Samuel & Akter, Shahriar & Edwards, Andrew & Chopin, Geoffrey & Gnanzou, Denis, 2015. "How ‘big data’ can make big impact: Findings from a systematic review and a longitudinal case study," International Journal of Production Economics, Elsevier, vol. 165(C), pages 234-246.
    21. Chris Bataille & Henri Waisman & Michel Colombier & Laura Segafredo & Jim Williams & Frank Jotzo, 2016. "The need for national deep decarbonization pathways for effective climate policy," Climate Policy, Taylor & Francis Journals, vol. 16(sup1), pages 7-26, June.
    22. repec:aen:journl:ej39-3-blanfor is not listed on IDEAS
    23. Fais, Birgit & Sabio, Nagore & Strachan, Neil, 2016. "The critical role of the industrial sector in reaching long-term emission reduction, energy efficiency and renewable targets," Applied Energy, Elsevier, vol. 162(C), pages 699-712.
    24. repec:aen:journl:2005v26-01-a04 is not listed on IDEAS
    25. Francesco Fuso Nerini & Julia Tomei & Long Seng To & Iwona Bisaga & Priti Parikh & Mairi Black & Aiduan Borrion & Catalina Spataru & Vanesa Castán Broto & Gabrial Anandarajah & Ben Milligan & Yacob Mu, 2018. "Mapping synergies and trade-offs between energy and the Sustainable Development Goals," Nature Energy, Nature, vol. 3(1), pages 10-15, January.
    26. Steve Pye & Chris Bataille, 2016. "Improving deep decarbonization modelling capacity for developed and developing country contexts," Climate Policy, Taylor & Francis Journals, vol. 16(sup1), pages 27-46, June.
    27. Henri Waisman & Céline Guivarch & Fabio Grazi & Jean Hourcade, 2012. "The I maclim-R model: infrastructures, technical inertia and the costs of low carbon futures under imperfect foresight," Climatic Change, Springer, vol. 114(1), pages 101-120, September.
    28. Bohringer, Christoph & Rutherford, Thomas F., 2008. "Combining bottom-up and top-down," Energy Economics, Elsevier, vol. 30(2), pages 574-596, March.
    29. Dai, Hancheng & Mischke, Peggy & Xie, Xuxuan & Xie, Yang & Masui, Toshihiko, 2016. "Closing the gap? Top-down versus bottom-up projections of China’s regional energy use and CO2 emissions," Applied Energy, Elsevier, vol. 162(C), pages 1355-1373.
    30. Lori Bennear & Robert Stavins, 2007. "Second-best theory and the use of multiple policy instruments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 111-129, May.
    31. Kavousian, Amir & Rajagopal, Ram & Fischer, Martin, 2013. "Determinants of residential electricity consumption: Using smart meter data to examine the effect of climate, building characteristics, appliance stock, and occupants' behavior," Energy, Elsevier, vol. 55(C), pages 184-194.
    32. Vandyck, Toon & Van Regemorter, Denise, 2014. "Distributional and regional economic impact of energy taxes in Belgium," Energy Policy, Elsevier, vol. 72(C), pages 190-203.
    33. Steve Pye & Francis G. N. Li & James Price & Birgit Fais, 2017. "Erratum: Achieving net-zero emissions through the reframing of UK national targets in the post-Paris Agreement era," Nature Energy, Nature, vol. 2(6), pages 1-1, June.
    34. Jean-Charles Hourcade & Mark Jaccard & Chris Bataille & Frédéric Ghersi, 2006. "Hybrid Modeling: New Answers to Old Challenges Introduction to the Special Issue of The Energy Journal," The Energy Journal, , vol. 27(2_suppl), pages 1-11, June.
    35. Steve Pye & Francis G. N. Li & James Price & Birgit Fais, 2017. "Achieving net-zero emissions through the reframing of UK national targets in the post-Paris Agreement era," Nature Energy, Nature, vol. 2(3), pages 1-7, March.
    36. David J. Hand & Heikki Mannila & Padhraic Smyth, 2001. "Principles of Data Mining," MIT Press Books, The MIT Press, edition 1, volume 1, number 026208290x, December.
    37. Doll, Christopher N.H. & Pachauri, Shonali, 2010. "Estimating rural populations without access to electricity in developing countries through night-time light satellite imagery," Energy Policy, Elsevier, vol. 38(10), pages 5661-5670, October.
    38. repec:aen:journl:2006se_jaccard-a01 is not listed on IDEAS
    39. Lott, Melissa C. & Pye, Steve & Dodds, Paul E., 2017. "Quantifying the co-impacts of energy sector decarbonisation on outdoor air pollution in the United Kingdom," Energy Policy, Elsevier, vol. 101(C), pages 42-51.
    40. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    41. Elmar Kriegler & Keywan Riah & Nils Petermann & Valentina Bosetti & Pantelis Capros & Detlef van Vuuren & Patrick Criqui & Christian Egenhofer & Panagiotis Fragkos & Nils Johnson & Leonidas Paroussos , 2014. "Assessing Pathways toward Ambitious Climate Targets at the Global and European levels: A Synthesis of Results from the AMPERE Project," Working Papers hal-01866610, HAL.
    42. repec:aen:journl:2003v24-01-a03 is not listed on IDEAS
    43. Mathew, Paul A. & Dunn, Laurel N. & Sohn, Michael D. & Mercado, Andrea & Custudio, Claudine & Walter, Travis, 2015. "Big-data for building energy performance: Lessons from assembling a very large national database of building energy use," Applied Energy, Elsevier, vol. 140(C), pages 85-93.
    44. Green, Jemma & Newman, Peter, 2017. "Citizen utilities: The emerging power paradigm," Energy Policy, Elsevier, vol. 105(C), pages 283-293.
    45. Sue Wing, Ian, 2008. "The synthesis of bottom-up and top-down approaches to climate policy modeling: Electric power technology detail in a social accounting framework," Energy Economics, Elsevier, vol. 30(2), pages 547-573, March.
    46. Andy Stirling, 2010. "Keep it complex," Nature, Nature, vol. 468(7327), pages 1029-1031, December.
    47. Arias, Mariz B. & Bae, Sungwoo, 2016. "Electric vehicle charging demand forecasting model based on big data technologies," Applied Energy, Elsevier, vol. 183(C), pages 327-339.
    48. Roberts, Simon, 2008. "Demographics, energy and our homes," Energy Policy, Elsevier, vol. 36(12), pages 4630-4632, December.
    49. Hausman,Daniel M., 1992. "The Inexact and Separate Science of Economics," Cambridge Books, Cambridge University Press, number 9780521415019, December.
    50. Zhou, Kaile & Fu, Chao & Yang, Shanlin, 2016. "Big data driven smart energy management: From big data to big insights," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 215-225.
    51. Daly, Hannah E. & Ramea, Kalai & Chiodi, Alessandro & Yeh, Sonia & Gargiulo, Maurizio & Gallachóir, Brian Ó, 2014. "Incorporating travel behaviour and travel time into TIMES energy system models," Applied Energy, Elsevier, vol. 135(C), pages 429-439.
    52. Ma, Jun & Cheng, Jack C.P., 2016. "Estimation of the building energy use intensity in the urban scale by integrating GIS and big data technology," Applied Energy, Elsevier, vol. 183(C), pages 182-192.
    53. Filippo Simini & Marta C. González & Amos Maritan & Albert-László Barabási, 2012. "A universal model for mobility and migration patterns," Nature, Nature, vol. 484(7392), pages 96-100, April.
    54. Hausman,Daniel M., 1992. "The Inexact and Separate Science of Economics," Cambridge Books, Cambridge University Press, number 9780521425230, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bistline, John E.T. & Merrick, James H., 2020. "Parameterizing open-source energy models: Statistical learning to estimate unknown power plant attributes," Applied Energy, Elsevier, vol. 269(C).
    2. Kelk, Rainer & Podofillini, Luca & Dang, Vinh N. & Panos, Evangelos, 2025. "Explorative application of discrete Bayesian networks as surrogate models for energy systems analysis," Applied Energy, Elsevier, vol. 394(C).
    3. Sadeghi, M. & Kalantar, M., 2023. "Fully decentralized multi-agent coordination scheme in smart distribution restoration: Multilevel consensus," Applied Energy, Elsevier, vol. 350(C).
    4. Wang, Zhangyuan & Zhao, Xudong & Han, Zhonghe & Luo, Liang & Xiang, Jinwei & Zheng, Senglin & Liu, Guangming & Yu, Min & Cui, Yu & Shittu, Samson & Hu, Menglong, 2021. "Advanced big-data/machine-learning techniques for optimization and performance enhancement of the heat pipe technology – A review and prospective study," Applied Energy, Elsevier, vol. 294(C).
    5. Meng, Measrainsey & Sanders, Kelly T., 2019. "A data-driven approach to investigate the impact of air temperature on the efficiencies of coal and natural gas generators," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    6. Jilong Li & Sara Shirowzhan & Gloria Pignatta & Samad M. E. Sepasgozar, 2024. "Data-Driven Net-Zero Carbon Monitoring: Applications of Geographic Information Systems, Building Information Modelling, Remote Sensing, and Artificial Intelligence for Sustainable and Resilient Cities," Sustainability, MDPI, vol. 16(15), pages 1-26, July.
    7. Rosenfelder, Markus & Wussow, Moritz & Gust, Gunther & Cremades, Roger & Neumann, Dirk, 2021. "Predicting residential electricity consumption using aerial and street view images," Applied Energy, Elsevier, vol. 301(C).
    8. Hofbauer, Leonhard & McDowall, Will & Pye, Steve, 2022. "Challenges and opportunities for energy system modelling to foster multi-level governance of energy transitions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    9. Zhao, Lu-Tao & Zheng, Zhi-Yi & Wei, Yi-Ming, 2023. "Forecasting oil inventory changes with Google trends: A hybrid wavelet decomposer and ARDL-SVR ensemble model," Energy Economics, Elsevier, vol. 120(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andersen, Kristoffer S. & Termansen, Lars B. & Gargiulo, Maurizio & Ó Gallachóirc, Brian P., 2019. "Bridging the gap using energy services: Demonstrating a novel framework for soft linking top-down and bottom-up models," Energy, Elsevier, vol. 169(C), pages 277-293.
    2. Willenbockel, Dirk, 2017. "Macroeconomic Effects of a Low-Carbon Electricity Transition in Kenya and Ghana: An Exploratory Dynamic General Equilibrium Analysis," MPRA Paper 78070, University Library of Munich, Germany.
    3. Lee, Hwarang & Kang, Sung Won & Koo, Yoonmo, 2020. "A hybrid energy system model to evaluate the impact of climate policy on the manufacturing sector: Adoption of energy-efficient technologies and rebound effects," Energy, Elsevier, vol. 212(C).
    4. Daniel Scamman & Baltazar Solano-Rodríguez & Steve Pye & Lai Fong Chiu & Andrew Z. P. Smith & Tiziano Gallo Cassarino & Mark Barrett & Robert Lowe, 2020. "Heat Decarbonisation Modelling Approaches in the UK: An Energy System Architecture Perspective," Energies, MDPI, vol. 13(8), pages 1-28, April.
    5. Dai, Hancheng & Mischke, Peggy & Xie, Xuxuan & Xie, Yang & Masui, Toshihiko, 2016. "Closing the gap? Top-down versus bottom-up projections of China’s regional energy use and CO2 emissions," Applied Energy, Elsevier, vol. 162(C), pages 1355-1373.
    6. repec:aen:journl:ej35-si1-11 is not listed on IDEAS
    7. Chyong, Chi Kong & Newbery, David, 2022. "A unit commitment and economic dispatch model of the GB electricity market – Formulation and application to hydro pumped storage," Energy Policy, Elsevier, vol. 170(C).
    8. Charlotte Senkpiel & Audrey Dobbins & Christina Kockel & Jan Steinbach & Ulrich Fahl & Farina Wille & Joachim Globisch & Sandra Wassermann & Bert Droste-Franke & Wolfgang Hauser & Claudia Hofer & Lars, 2020. "Integrating Methods and Empirical Findings from Social and Behavioural Sciences into Energy System Models—Motivation and Possible Approaches," Energies, MDPI, vol. 13(18), pages 1-30, September.
    9. Xavier Labandeira & Pedro Linares & Miguel Rodriguez, 2009. "An Integrated Approach to Simulate the Impacts of Carbon Emissions Trading Schemes," The Energy Journal, , vol. 30(2_suppl), pages 217-237, December.
    10. Rausch, Sebastian & Mowers, Matthew, 2014. "Distributional and efficiency impacts of clean and renewable energy standards for electricity," Resource and Energy Economics, Elsevier, vol. 36(2), pages 556-585.
    11. Halkos, George, 2014. "The Economics of Climate Change Policy: Critical review and future policy directions," MPRA Paper 56841, University Library of Munich, Germany.
    12. Brand, C. & Marsden, G. & Anable, J.L. & Dixon, J. & Barrett, J., 2025. "Achieving deep transport energy demand reductions in the United Kingdom," Renewable and Sustainable Energy Reviews, Elsevier, vol. 207(C).
    13. Julien Lefevre, 2018. "Modeling the Socioeconomic Impacts of the Adoption of a Carbon Pricing Instrument – Literature review," Working Papers hal-03128619, HAL.
    14. Lanz, Bruno & Rausch, Sebastian, 2011. "General equilibrium, electricity generation technologies and the cost of carbon abatement: A structural sensitivity analysis," Energy Economics, Elsevier, vol. 33(5), pages 1035-1047, September.
    15. DeCarolis, Joseph & Daly, Hannah & Dodds, Paul & Keppo, Ilkka & Li, Francis & McDowall, Will & Pye, Steve & Strachan, Neil & Trutnevyte, Evelina & Usher, Will & Winning, Matthew & Yeh, Sonia & Zeyring, 2017. "Formalizing best practice for energy system optimization modelling," Applied Energy, Elsevier, vol. 194(C), pages 184-198.
    16. Price, James & Zeyringer, Marianne & Konadu, Dennis & Sobral Mourão, Zenaida & Moore, Andy & Sharp, Ed, 2018. "Low carbon electricity systems for Great Britain in 2050: An energy-land-water perspective," Applied Energy, Elsevier, vol. 228(C), pages 928-941.
    17. Theodoridou, Ifigeneia & Papadopoulos, Agis M. & Hegger, Manfred, 2012. "A feasibility evaluation tool for sustainable cities – A case study for Greece," Energy Policy, Elsevier, vol. 44(C), pages 207-216.
    18. Lyu, Wenjing & Liu, Jin, 2021. "Artificial Intelligence and emerging digital technologies in the energy sector," Applied Energy, Elsevier, vol. 303(C).
    19. Li, Pei-Hao & Keppo, Ilkka & Strachan, Neil, 2018. "Incorporating homeowners' preferences of heating technologies in the UK TIMES model," Energy, Elsevier, vol. 148(C), pages 716-727.
    20. Ajay Gambhir & Isabela Butnar & Pei-Hao Li & Pete Smith & Neil Strachan, 2019. "A Review of Criticisms of Integrated Assessment Models and Proposed Approaches to Address These, through the Lens of BECCS," Energies, MDPI, vol. 12(9), pages 1-21, May.
    21. Ghasemaghaei, Maryam & Calic, Goran, 2019. "Does big data enhance firm innovation competency? The mediating role of data-driven insights," Journal of Business Research, Elsevier, vol. 104(C), pages 69-84.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:239:y:2019:i:c:p:991-1002. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.