IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v257y2020ics030626191931685x.html
   My bibliography  Save this article

Machine vision for natural gas methane emissions detection using an infrared camera

Author

Listed:
  • Wang, Jingfan
  • Tchapmi, Lyne P.
  • Ravikumar, Arvind P.
  • McGuire, Mike
  • Bell, Clay S.
  • Zimmerle, Daniel
  • Savarese, Silvio
  • Brandt, Adam R.

Abstract

In a climate-constrained world, it is crucial to reduce natural gas methane emissions, which can potentially offset the climate benefits of replacing coal with gas. Optical gas imaging (OGI) is a widely-used method to detect methane leaks, but is labor-intensive and cannot provide leak detection results without operators’ judgment. In this paper, we develop a computer vision approach for OGI-based leak detection using convolutional neural networks (CNN) trained on methane leak images to enable automatic detection. First, we collect ∼1 M frames of labeled videos of methane leaks from different leaking equipment, covering a wide range of leak sizes (5.3–2051.6 g CH4/h) and imaging distances (4.6–15.6 m). Second, we examine different background subtraction methods to extract the methane plume in the foreground. Third, we then test three CNN model variants, collectively called GasNet, to detect plumes in videos. We assess the ability of GasNet to perform leak detection by comparing it to a baseline method that uses an optical-flow based change detection algorithm. We explore the sensitivity of results to the CNN structure, with a moderate-complexity variant performing best across distances. The generated detection probability curves show that the detection accuracy (fraction of leak and non-leak images correctly identified by the algorithm) can reach as high as 99%, the overall detection accuracy can exceed 95% across all leak sizes and imaging distances. Binary detection accuracy exceeds 97% for large leaks (∼710 g CH4/h) imaged closely (∼5–7 m). The GasNet-based computer vision approach could be deployed in OGI surveys for automatic vigilance of methane leak detection with high accuracy in the real world.

Suggested Citation

  • Wang, Jingfan & Tchapmi, Lyne P. & Ravikumar, Arvind P. & McGuire, Mike & Bell, Clay S. & Zimmerle, Daniel & Savarese, Silvio & Brandt, Adam R., 2020. "Machine vision for natural gas methane emissions detection using an infrared camera," Applied Energy, Elsevier, vol. 257(C).
  • Handle: RePEc:eee:appene:v:257:y:2020:i:c:s030626191931685x
    DOI: 10.1016/j.apenergy.2019.113998
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626191931685X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2019.113998?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paola Giuliano & Nathan Nunn, 2021. "Understanding Cultural Persistence and Change [Cultural Assimilation During the Age of Mass Migration]," Review of Economic Studies, Oxford University Press, vol. 88(4), pages 1541-1581.
    2. Guo, Yabin & Tan, Zehan & Chen, Huanxin & Li, Guannan & Wang, Jiangyu & Huang, Ronggeng & Liu, Jiangyan & Ahmad, Tanveer, 2018. "Deep learning-based fault diagnosis of variable refrigerant flow air-conditioning system for building energy saving," Applied Energy, Elsevier, vol. 225(C), pages 732-745.
    3. Fan, Cheng & Xiao, Fu & Zhao, Yang, 2017. "A short-term building cooling load prediction method using deep learning algorithms," Applied Energy, Elsevier, vol. 195(C), pages 222-233.
    4. Shikhman, V. & Nesterov, Yu. & Ginsburgh, V., 2018. "Power method tâtonnements for Cobb–Douglas economies," Journal of Mathematical Economics, Elsevier, vol. 75(C), pages 84-92.
    5. Qadrdan, Meysam & Chaudry, Modassar & Jenkins, Nick & Baruah, Pranab & Eyre, Nick, 2015. "Impact of transition to a low carbon power system on the GB gas network," Applied Energy, Elsevier, vol. 151(C), pages 1-12.
    6. Martin D. D. Evans & Richard K. Lyons, 2017. "Understanding Order Flow," World Scientific Book Chapters, in: Studies in Foreign Exchange Economics, chapter 13, pages 507-546, World Scientific Publishing Co. Pte. Ltd..
    7. Touretzky, Cara R. & McGuffin, Dana L. & Ziesmer, Jena C. & Baldea, Michael, 2016. "The effect of distributed electricity generation using natural gas on the electric and natural gas grids," Applied Energy, Elsevier, vol. 177(C), pages 500-514.
    8. Anonymous, 2017. "Debating Methodology in Business History," Business History Review, Cambridge University Press, vol. 91(3), pages 443-455, October.
    9. Chiang, Nai-Yuan & Zavala, Victor M., 2016. "Large-scale optimal control of interconnected natural gas and electrical transmission systems," Applied Energy, Elsevier, vol. 168(C), pages 226-235.
    10. Ma, Xiaolei & Liu, Congcong & Wen, Huimin & Wang, Yunpeng & Wu, Yao-Jan, 2017. "Understanding commuting patterns using transit smart card data," Journal of Transport Geography, Elsevier, vol. 58(C), pages 135-145.
    11. Chaudry, Modassar & Jenkins, Nick & Qadrdan, Meysam & Wu, Jianzhong, 2014. "Combined gas and electricity network expansion planning," Applied Energy, Elsevier, vol. 113(C), pages 1171-1187.
    12. Dollevoet, T.A.B. & van Essen, J.T. & Glorie, K.M., 2017. "Solution methods for the tray optimization problem," Econometric Institute Research Papers EI2017-16, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    13. Eleutério F. S. Prado, 2017. "Moseley on Marx’s Method," International Journal of Political Economy, Taylor & Francis Journals, vol. 46(1), pages 29-34, January.
    14. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    15. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    16. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    17. Magnus Gålfalk & Göran Olofsson & Patrick Crill & David Bastviken, 2016. "Making methane visible," Nature Climate Change, Nature, vol. 6(4), pages 426-430, April.
    18. Tom Wigley, 2011. "Coal to gas: the influence of methane leakage," Climatic Change, Springer, vol. 108(3), pages 601-608, October.
    19. Qiao, Zheng & Guo, Qinglai & Sun, Hongbin & Pan, Zhaoguang & Liu, Yuquan & Xiong, Wen, 2017. "An interval gas flow analysis in natural gas and electricity coupled networks considering the uncertainty of wind power," Applied Energy, Elsevier, vol. 201(C), pages 343-353.
    20. Yu, Ruiguo & Liu, Zhiqiang & Li, Xuewei & Lu, Wenhuan & Ma, Degang & Yu, Mei & Wang, Jianrong & Li, Bin, 2019. "Scene learning: Deep convolutional networks for wind power prediction by embedding turbines into grid space," Applied Energy, Elsevier, vol. 238(C), pages 249-257.
    21. Souza, P.V.S. & Girardi, D. & de Oliveira, P.M.C., 2017. "Drag force in wind tunnels: A new method," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 467(C), pages 120-128.
    22. ., 2017. "Methodological issues," Chapters, in: An Autecological Theory of the Firm and its Environment, chapter 6, Edward Elgar Publishing.
    23. ., 2017. "Overview of the Anker living wage methodology," Chapters, in: Living Wages Around the World, chapter 2, pages 17-30, Edward Elgar Publishing.
    24. Mongibello, Luigi & Bianco, Nicola & Caliano, Martina & Graditi, Giorgio, 2016. "Comparison between two different operation strategies for a heat-driven residential natural gas-fired CHP system: Heat dumping vs. load partialization," Applied Energy, Elsevier, vol. 184(C), pages 55-67.
    25. Zhang, Xiaochun & Myhrvold, Nathan P. & Hausfather, Zeke & Caldeira, Ken, 2016. "Climate benefits of natural gas as a bridge fuel and potential delay of near-zero energy systems," Applied Energy, Elsevier, vol. 167(C), pages 317-322.
    26. Spoladore, Alessandro & Borelli, Davide & Devia, Francesco & Mora, Flavio & Schenone, Corrado, 2016. "Model for forecasting residential heat demand based on natural gas consumption and energy performance indicators," Applied Energy, Elsevier, vol. 182(C), pages 488-499.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shuo Sun & Linwei Ma & Zheng Li, 2021. "Methane Emission Estimation of Oil and Gas Sector: A Review of Measurement Technologies, Data Analysis Methods and Uncertainty Estimation," Sustainability, MDPI, vol. 13(24), pages 1-29, December.
    2. Mark Agerton & Ben Gilbert & Gregory B. Upton Jr., 2021. "The Economics of Natural Gas Venting, Flaring and Leaking in U.S. Shale: An Agenda for Research and Policy," Working Papers 2021-02, Colorado School of Mines, Division of Economics and Business.
    3. Shi, Zhongtuo & Yao, Wei & Zeng, Lingkang & Wen, Jianfeng & Fang, Jiakun & Ai, Xiaomeng & Wen, Jinyu, 2020. "Convolutional neural network-based power system transient stability assessment and instability mode prediction," Applied Energy, Elsevier, vol. 263(C).
    4. Titchener, James & Millington-Smith, Doug & Goldsack, Chris & Harrison, George & Dunning, Alexander & Ai, Xiao & Reed, Murray, 2022. "Single photon Lidar gas imagers for practical and widespread continuous methane monitoring," Applied Energy, Elsevier, vol. 306(PB).
    5. Wang, Jingfan & Ji, Jingwei & Ravikumar, Arvind P. & Savarese, Silvio & Brandt, Adam R., 2022. "VideoGasNet: Deep learning for natural gas methane leak classification using an infrared camera," Energy, Elsevier, vol. 238(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huang, Tian-en & Guo, Qinglai & Sun, Hongbin & Tan, Chin-Woo & Hu, Tianyu, 2019. "A deep spatial-temporal data-driven approach considering microclimates for power system security assessment," Applied Energy, Elsevier, vol. 237(C), pages 36-48.
    2. Hwang, Jun Kwon & Yun, Geun Young & Lee, Sukho & Seo, Hyeongjoon & Santamouris, Mat, 2020. "Using deep learning approaches with variable selection process to predict the energy performance of a heating and cooling system," Renewable Energy, Elsevier, vol. 149(C), pages 1227-1245.
    3. Wang, Jingfan & Ji, Jingwei & Ravikumar, Arvind P. & Savarese, Silvio & Brandt, Adam R., 2022. "VideoGasNet: Deep learning for natural gas methane leak classification using an infrared camera," Energy, Elsevier, vol. 238(PB).
    4. Danxiang Wei & Jianzhou Wang & Kailai Ni & Guangyu Tang, 2019. "Research and Application of a Novel Hybrid Model Based on a Deep Neural Network Combined with Fuzzy Time Series for Energy Forecasting," Energies, MDPI, vol. 12(18), pages 1-38, September.
    5. Suryanarayana, Gowri & Lago, Jesus & Geysen, Davy & Aleksiejuk, Piotr & Johansson, Christian, 2018. "Thermal load forecasting in district heating networks using deep learning and advanced feature selection methods," Energy, Elsevier, vol. 157(C), pages 141-149.
    6. Munir Husein & Il-Yop Chung, 2019. "Day-Ahead Solar Irradiance Forecasting for Microgrids Using a Long Short-Term Memory Recurrent Neural Network: A Deep Learning Approach," Energies, MDPI, vol. 12(10), pages 1-21, May.
    7. Wang, Guotao & Liao, Qi & Li, Zhengbing & Zhang, Haoran & Liang, Yongtu & Wei, Xuemei, 2022. "How does soaring natural gas prices impact renewable energy: A case study in China," Energy, Elsevier, vol. 252(C).
    8. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    9. Liu, Che & Sun, Bo & Zhang, Chenghui & Li, Fan, 2020. "A hybrid prediction model for residential electricity consumption using holt-winters and extreme learning machine," Applied Energy, Elsevier, vol. 275(C).
    10. Farrokhifar, Meisam & Nie, Yinghui & Pozo, David, 2020. "Energy systems planning: A survey on models for integrated power and natural gas networks coordination," Applied Energy, Elsevier, vol. 262(C).
    11. Rongjiang Ma & Shen Yang & Xianlin Wang & Xi-Cheng Wang & Ming Shan & Nanyang Yu & Xudong Yang, 2020. "Systematic Method for the Energy-Saving Potential Calculation of Air-Conditioning Systems via Data Mining. Part I: Methodology," Energies, MDPI, vol. 14(1), pages 1-15, December.
    12. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    13. Zhong, Wei & Huang, Wei & Lin, Xiaojie & Li, Zhongbo & Zhou, Yi, 2020. "Research on data-driven identification and prediction of heat response time of urban centralized heating system," Energy, Elsevier, vol. 212(C).
    14. Tang, Zhenhao & Zhao, Gengnan & Ouyang, Tinghui, 2021. "Two-phase deep learning model for short-term wind direction forecasting," Renewable Energy, Elsevier, vol. 173(C), pages 1005-1016.
    15. Sabarathinam Srinivasan & Suresh Kumarasamy & Zacharias E. Andreadakis & Pedro G. Lind, 2023. "Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey," Energies, MDPI, vol. 16(14), pages 1-56, July.
    16. Qu, Kaiping & Shi, Shouyuan & Yu, Tao & Wang, Wenrui, 2019. "A convex decentralized optimization for environmental-economic power and gas system considering diversified emission control," Applied Energy, Elsevier, vol. 240(C), pages 630-645.
    17. Fan, Cheng & Xiao, Fu & Yan, Chengchu & Liu, Chengliang & Li, Zhengdao & Wang, Jiayuan, 2019. "A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning," Applied Energy, Elsevier, vol. 235(C), pages 1551-1560.
    18. Ravnik, J. & Hriberšek, M., 2019. "A method for natural gas forecasting and preliminary allocation based on unique standard natural gas consumption profiles," Energy, Elsevier, vol. 180(C), pages 149-162.
    19. Qadrdan, Meysam & Cheng, Meng & Wu, Jianzhong & Jenkins, Nick, 2017. "Benefits of demand-side response in combined gas and electricity networks," Applied Energy, Elsevier, vol. 192(C), pages 360-369.
    20. Liu, Liuchen & Zhu, Tong & Pan, Yu & Wang, Hai, 2017. "Multiple energy complementation based on distributed energy systems – Case study of Chongming county, China," Applied Energy, Elsevier, vol. 192(C), pages 329-336.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:257:y:2020:i:c:s030626191931685x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.