IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v32y2016i3p948-956.html
   My bibliography  Save this article

Probabilistic anomaly detection in natural gas time series data

Author

Listed:
  • Akouemo, Hermine N.
  • Povinelli, Richard J.

Abstract

This paper introduces a probabilistic approach to anomaly detection, specifically in natural gas time series data. In the natural gas field, there are various types of anomalies, each of which is induced by a range of causes and sources. The causes of a set of anomalies are examined and categorized, and a Bayesian maximum likelihood classifier learns the temporal structures of known anomalies. Given previously unseen time series data, the system detects anomalies using a linear regression model with weather inputs, after which the anomalies are tested for false positives and classified using a Bayesian classifier. The method can also identify anomalies of an unknown origin. Thus, the likelihood of a data point being anomalous is given for anomalies of both known and unknown origins. This probabilistic anomaly detection method is tested on a reported natural gas consumption data set.

Suggested Citation

  • Akouemo, Hermine N. & Povinelli, Richard J., 2016. "Probabilistic anomaly detection in natural gas time series data," International Journal of Forecasting, Elsevier, vol. 32(3), pages 948-956.
    • Handle: RePEc:eee:intfor:v:32:y:2016:i:3:p:948-956
    DOI: 10.1016/j.ijforecast.2015.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016920701500076X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2015.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tao Hong, 2014. "Energy Forecasting: Past, Present, and Future," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 32, pages 43-48, Winter.
    2. Nedellec, Raphael & Cugliari, Jairo & Goude, Yannig, 2014. "GEFCom2012: Electric load forecasting and backcasting with semi-parametric models," International Journal of Forecasting, Elsevier, vol. 30(2), pages 375-381.
    3. Beccali, M. & Cellura, M. & Lo Brano, V. & Marvuglia, A., 2008. "Short-term prediction of household electricity consumption: Assessing weather sensitivity in a Mediterranean area," Renewable and Sustainable Energy Reviews, Elsevier, vol. 12(8), pages 2040-2065, October.
    4. Changliang Zou & Sheng-Tsaing Tseng & Zhaojun Wang, 2014. "Outlier detection in general profiles using penalized regression method," IISE Transactions, Taylor & Francis Journals, vol. 46(2), pages 106-117.
    5. Lee, Andy H. & Fung, Wing K., 1997. "Confirmation of multiple outliers in generalized linear and nonlinear regressions," Computational Statistics & Data Analysis, Elsevier, vol. 25(1), pages 55-65, July.
    6. Grané, Aurea & Veiga, Helena, 2010. "Wavelet-based detection of outliers in financial time series," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2580-2593, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Silveira, Douglas & Vasconcelos, Silvinha & Resende, Marcelo & Cajueiro, Daniel O., 2022. "Won’t Get Fooled Again: A supervised machine learning approach for screening gasoline cartels," Energy Economics, Elsevier, vol. 105(C).
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Luo, Jian & Hong, Tao & Fang, Shu-Cherng, 2018. "Benchmarking robustness of load forecasting models under data integrity attacks," International Journal of Forecasting, Elsevier, vol. 34(1), pages 89-104.
    4. Sarah E. Heaps & Malcolm Farrow & Kevin J. Wilson, 2020. "Identifying the effect of public holidays on daily demand for gas," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(2), pages 471-492, February.
    5. Yao Zhang & Fan Lin & Ke Wang, 2020. "Robustness of Short-Term Wind Power Forecasting against False Data Injection Attacks," Energies, MDPI, vol. 13(15), pages 1-21, July.
    6. Luo, Jian & Hong, Tao & Gao, Zheming & Fang, Shu-Cherng, 2023. "A robust support vector regression model for electric load forecasting," International Journal of Forecasting, Elsevier, vol. 39(2), pages 1005-1020.
    7. Himeur, Yassine & Ghanem, Khalida & Alsalemi, Abdullah & Bensaali, Faycal & Amira, Abbes, 2021. "Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives," Applied Energy, Elsevier, vol. 287(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luo, Jian & Hong, Tao & Fang, Shu-Cherng, 2018. "Benchmarking robustness of load forecasting models under data integrity attacks," International Journal of Forecasting, Elsevier, vol. 34(1), pages 89-104.
    2. Bidong Liu & Jakub Nowotarski & Tao Hong & Rafal Weron, 2015. "Probabilistic load forecasting via Quantile Regression Averaging on sister forecasts," HSC Research Reports HSC/15/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    3. Wang, Pu & Liu, Bidong & Hong, Tao, 2016. "Electric load forecasting with recency effect: A big data approach," International Journal of Forecasting, Elsevier, vol. 32(3), pages 585-597.
    4. Hong, Tao & Wang, Pu & White, Laura, 2015. "Weather station selection for electric load forecasting," International Journal of Forecasting, Elsevier, vol. 31(2), pages 286-295.
    5. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    6. Xiang, Liming & Tse, Siu-Keung & Lee, Andy H., 2002. "Influence diagnostics for generalized linear mixed models: applications to clustered data," Computational Statistics & Data Analysis, Elsevier, vol. 40(4), pages 759-774, October.
    7. Anna Kipping & Erik Trømborg, 2017. "Modeling Aggregate Hourly Energy Consumption in a Regional Building Stock," Energies, MDPI, vol. 11(1), pages 1-20, December.
    8. Grané, Aurea & Veiga, Helena, 2010. "Outliers in Garch models and the estimation of risk measures," DES - Working Papers. Statistics and Econometrics. WS ws100502, Universidad Carlos III de Madrid. Departamento de Estadística.
    9. van der Meer, D.W. & Shepero, M. & Svensson, A. & Widén, J. & Munkhammar, J., 2018. "Probabilistic forecasting of electricity consumption, photovoltaic power generation and net demand of an individual building using Gaussian Processes," Applied Energy, Elsevier, vol. 213(C), pages 195-207.
    10. Yun Zhao & Andy Lee & Kelvin Yau & Geoffrey McLachlan, 2011. "Assessing the adequacy of Weibull survival models: a simulated envelope approach," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(10), pages 2089-2097.
    11. Azhar Ahmed Mohammed & Zeyar Aung, 2016. "Ensemble Learning Approach for Probabilistic Forecasting of Solar Power Generation," Energies, MDPI, vol. 9(12), pages 1-17, December.
    12. Lin, Yu & Lu, Qin & Tan, Bin & Yu, Yuanyuan, 2022. "Forecasting energy prices using a novel hybrid model with variational mode decomposition," Energy, Elsevier, vol. 246(C).
    13. Carnero, M. Angeles & Peña, Daniel & Ruiz, Esther, 2012. "Estimating GARCH volatility in the presence of outliers," Economics Letters, Elsevier, vol. 114(1), pages 86-90.
    14. Peña, Juan Ignacio & Rodriguez, Rosa, 2018. "Default supply auctions in electricity markets: Challenges and proposals," Energy Policy, Elsevier, vol. 122(C), pages 142-151.
    15. Moral-Carcedo, Julián & Pérez-García, Julián, 2017. "Integrating long-term economic scenarios into peak load forecasting: An application to Spain," Energy, Elsevier, vol. 140(P1), pages 682-695.
    16. Garshasbi, Samira & Kurnitski, Jarek & Mohammadi, Yousef, 2016. "A hybrid Genetic Algorithm and Monte Carlo simulation approach to predict hourly energy consumption and generation by a cluster of Net Zero Energy Buildings," Applied Energy, Elsevier, vol. 179(C), pages 626-637.
    17. Oleg Shirokikh & Grigory Pastukhov & Vladimir Boginski & Sergiy Butenko, 2013. "Computational study of the US stock market evolution: a rank correlation-based network model," Computational Management Science, Springer, vol. 10(2), pages 81-103, June.
    18. Xu, Lei & Wang, Shengwei & Tang, Rui, 2019. "Probabilistic load forecasting for buildings considering weather forecasting uncertainty and uncertain peak load," Applied Energy, Elsevier, vol. 237(C), pages 180-195.
    19. Jiao, Jieying & Tang, Zefan & Zhang, Peng & Yue, Meng & Yan, Jun, 2022. "Cyberattack-resilient load forecasting with adaptive robust regression," International Journal of Forecasting, Elsevier, vol. 38(3), pages 910-919.
    20. Ward, K.R. & Green, R. & Staffell, I., 2019. "Getting prices right in structural electricity market models," Energy Policy, Elsevier, vol. 129(C), pages 1190-1206.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:32:y:2016:i:3:p:948-956. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.