IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v170y2023ics0960077923002473.html
   My bibliography  Save this article

Identifying lightning structures via machine learning

Author

Listed:
  • Wang, Lingxiao
  • Hare, Brian M.
  • Zhou, Kai
  • Stöcker, Horst
  • Scholten, Olaf

Abstract

Lightning is a fascinating yet insufficiently understood phenomenon. Very high frequency (VHF, 30–300 MHz) observations of lightning yield an ever-growing amount of data. In particular, LOFAR (LOw Frequency ARray) can reach meter and nanosecond precision with up to a million radio source locations per second. This lightning data is extremely complex, as a single lightning flash can contain hundreds of lightning channels and a myriad of different phenomena. However, so far this process has been mostly analyzed by-eye, which is very time-consuming. Thus, this increase in complexity of VHF lightning data calls for the application of machine learning algorithms. To identify structures from numerous spatio-temporal points in a high dimensional space, we designed an analysis pipeline combining a t-distributed stochastic neighbor embedding (t-SNE) algorithm and a clustering algorithm. We show that this combination allows for distinguishing correlated structures in an unsupervised approach. This novel method is a powerful tool to search vast multidimensional data sets for unique structures.

Suggested Citation

  • Wang, Lingxiao & Hare, Brian M. & Zhou, Kai & Stöcker, Horst & Scholten, Olaf, 2023. "Identifying lightning structures via machine learning," Chaos, Solitons & Fractals, Elsevier, vol. 170(C).
  • Handle: RePEc:eee:chsofr:v:170:y:2023:i:c:s0960077923002473
    DOI: 10.1016/j.chaos.2023.113346
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077923002473
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2023.113346?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. William Rison & Paul R. Krehbiel & Michael G. Stock & Harald E. Edens & Xuan-Min Shao & Ronald J. Thomas & Mark A. Stanley & Yang Zhang, 2016. "Observations of narrow bipolar events reveal how lightning is initiated in thunderstorms," Nature Communications, Nature, vol. 7(1), pages 1-12, April.
    2. Long-Gang Pang & Kai Zhou & Nan Su & Hannah Petersen & Horst Stöcker & Xin-Nian Wang, 2018. "An equation-of-state-meter of quantum chromodynamics transition from deep learning," Nature Communications, Nature, vol. 9(1), pages 1-6, December.
    3. Lalmuanawma, Samuel & Hussain, Jamal & Chhakchhuak, Lalrinfela, 2020. "Applications of machine learning and artificial intelligence for Covid-19 (SARS-CoV-2) pandemic: A review," Chaos, Solitons & Fractals, Elsevier, vol. 139(C).
    4. Pessa, Arthur A.B. & Zola, Rafael S. & Perc, Matjaž & Ribeiro, Haroldo V., 2022. "Determining liquid crystal properties with ordinal networks and machine learning," Chaos, Solitons & Fractals, Elsevier, vol. 154(C).
    5. B. M. Hare & O. Scholten & J. Dwyer & T. N. G. Trinh & S. Buitink & S. Veen & A. Bonardi & A. Corstanje & H. Falcke & J. R. Hörandel & T. Huege & P. Mitra & K. Mulrey & A. Nelles & J. P. Rachen & L. R, 2019. "Needle-like structures discovered on positively charged lightning branches," Nature, Nature, vol. 568(7752), pages 360-363, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ortiz-Barrios, Miguel & Arias-Fonseca, Sebastián & Ishizaka, Alessio & Barbati, Maria & Avendaño-Collante, Betty & Navarro-Jiménez, Eduardo, 2023. "Artificial intelligence and discrete-event simulation for capacity management of intensive care units during the Covid-19 pandemic: A case study," Journal of Business Research, Elsevier, vol. 160(C).
    2. Xinyu Ma & Zhaoyu Cai & Chijie Zhuang & Xiangdong Liu & Zhecheng Zhang & Kewei Liu & Bo Cao & Jinliang He & Changxi Yang & Chengying Bao & Rong Zeng, 2024. "Integrated microcavity electric field sensors using Pound-Drever-Hall detection," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    3. Marcel Lucas Chee & Marcus Eng Hock Ong & Fahad Javaid Siddiqui & Zhongheng Zhang & Shir Lynn Lim & Andrew Fu Wah Ho & Nan Liu, 2021. "Artificial Intelligence Applications for COVID-19 in Intensive Care and Emergency Settings: A Systematic Review," IJERPH, MDPI, vol. 18(9), pages 1-15, April.
    4. Srinka Basu & Sugata Sen, 2023. "COVID 19 Pandemic, Socio-Economic Behaviour and Infection Characteristics: An Inter-Country Predictive Study Using Deep Learning," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 645-676, February.
    5. Sini V. Pillai & Ranjith S. Kumar, 2021. "The role of data-driven artificial intelligence on COVID-19 disease management in public sphere: a review," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 48(4), pages 375-389, December.
    6. Faizeh Hatami & Shi Chen & Rajib Paul & Jean-Claude Thill, 2022. "Simulating and Forecasting the COVID-19 Spread in a U.S. Metropolitan Region with a Spatial SEIR Model," IJERPH, MDPI, vol. 19(23), pages 1-16, November.
    7. Mohammad Reza Davahli & Krzysztof Fiok & Waldemar Karwowski & Awad M. Aljuaid & Redha Taiar, 2021. "Predicting the Dynamics of the COVID-19 Pandemic in the United States Using Graph Theory-Based Neural Networks," IJERPH, MDPI, vol. 18(7), pages 1-12, April.
    8. Manuel Sánchez-Montañés & Pablo Rodríguez-Belenguer & Antonio J. Serrano-López & Emilio Soria-Olivas & Yasser Alakhdar-Mohmara, 2020. "Machine Learning for Mortality Analysis in Patients with COVID-19," IJERPH, MDPI, vol. 17(22), pages 1-20, November.
    9. Ehab M. Almetwally, 2022. "The Odd Weibull Inverse Topp–Leone Distribution with Applications to COVID-19 Data," Annals of Data Science, Springer, vol. 9(1), pages 121-140, February.
    10. Mario A Quiroz-Juárez & Armando Torres-Gómez & Irma Hoyo-Ulloa & Roberto de J León-Montiel & Alfred B U’Ren, 2021. "Identification of high-risk COVID-19 patients using machine learning," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-21, September.
    11. Szczygielski, Jan Jakub & Charteris, Ailie & Bwanya, Princess Rutendo & Brzeszczyński, Janusz, 2023. "Which COVID-19 information really impacts stock markets?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 84(C).
    12. Anil Babu Payedimarri & Diego Concina & Luigi Portinale & Massimo Canonico & Deborah Seys & Kris Vanhaecht & Massimiliano Panella, 2021. "Prediction Models for Public Health Containment Measures on COVID-19 Using Artificial Intelligence and Machine Learning: A Systematic Review," IJERPH, MDPI, vol. 18(9), pages 1-11, April.
    13. Feifan Liu & Gaopeng Lu & Torsten Neubert & Jiuhou Lei & Oliver Chanrion & Nikolai Østgaard & Dongshuai Li & Alejandro Luque & Francisco J. Gordillo-Vázquez & Victor Reglero & Weitao Lyu & Baoyou Zhu, 2021. "Optical emissions associated with narrow bipolar events from thunderstorm clouds penetrating into the stratosphere," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    14. Yan, Tao & Wong, Pak Kin & Ren, Hao & Wang, Huaqiao & Wang, Jiangtao & Li, Yang, 2020. "Automatic distinction between COVID-19 and common pneumonia using multi-scale convolutional neural network on chest CT scans," Chaos, Solitons & Fractals, Elsevier, vol. 140(C).
    15. Sharov, Konstantin S., 2020. "Creating and applying SIR modified compartmental model for calculation of COVID-19 lockdown efficiency," Chaos, Solitons & Fractals, Elsevier, vol. 141(C).
    16. Yao, Haitang & Liu, Wei & Wu, Chia-Huei & Yuan, Yu-Hsi, 2022. "The imprinting effect of SARS experience on the fear of COVID-19: The role of AI and big data," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    17. Wajdi Aljedaani & Eysha Saad & Furqan Rustam & Isabel de la Torre Díez & Imran Ashraf, 2022. "Role of Artificial Intelligence for Analysis of COVID-19 Vaccination-Related Tweets: Opportunities, Challenges, and Future Trends," Mathematics, MDPI, vol. 10(17), pages 1-33, September.
    18. Shengxin Huang & Weijiang Chen & Zhong Fu & Yufei Fu & Nianwen Xiang & Xinjie Qiu & Weidong Shi & Dengfeng Cheng & Zhiyuan Zhang, 2022. "Separate luminous structures leading positive leader steps," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    19. Shahriari, Zahra & Nazarimehr, Fahimeh & Rajagopal, Karthikeyan & Jafari, Sajad & Perc, Matjaž & Svetec, Milan, 2022. "Cryptocurrency price analysis with ordinal partition networks," Applied Mathematics and Computation, Elsevier, vol. 430(C).
    20. Miraj Ahmed Bhuiyan & Tiziana Crovella & Annarita Paiano & Helena Alves, 2021. "A Review of Research on Tourism Industry, Economic Crisis and Mitigation Process of the Loss: Analysis on Pre, During and Post Pandemic Situation," Sustainability, MDPI, vol. 13(18), pages 1-27, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:170:y:2023:i:c:s0960077923002473. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.