IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v350y2023ics0306261923011212.html
   My bibliography  Save this article

Enhancing PV panel segmentation in remote sensing images with constraint refinement modules

Author

Listed:
  • Tan, Hongjun
  • Guo, Zhiling
  • Zhang, Haoran
  • Chen, Qi
  • Lin, Zhenjia
  • Chen, Yuntian
  • Yan, Jinyue

Abstract

Incorrect predictions or underestimation of a city's solar potential can result from neglecting common features of photovoltaic (PV) panels from remote sensing images. This paper proposes an improved approach to address the challenge of accurately segmenting PV panels from remote sensing images using deep learning methods. The proposed method incorporates common features of PV panels and a constraint refinement module (CRM) to perform the localization of PV panel regions and shape regularization more accurately. Specifically, the method uses a color loss function based on prior knowledge of color to refine the predicted region with correct color information among confusing objectives, and a shape loss function based on multi-layer shape targets calculation to refine the initial segments and constrain the edge information of predicted regions. Different CRMs are embedded into the four refined initial segment modules, respectively, to improve the detection IoU of PV panels by up to 7.44%. The best CRM-integrated model performs the best IoU of 74.66% when segmenting PV panels. The proposed method has important implications for urban PV panel segmentation at the city level and provides a promising solution for remote sensing image-based PV plate segmentation tasks in challenging scenarios.

Suggested Citation

  • Tan, Hongjun & Guo, Zhiling & Zhang, Haoran & Chen, Qi & Lin, Zhenjia & Chen, Yuntian & Yan, Jinyue, 2023. "Enhancing PV panel segmentation in remote sensing images with constraint refinement modules," Applied Energy, Elsevier, vol. 350(C).
    • Handle: RePEc:eee:appene:v:350:y:2023:i:c:s0306261923011212
    DOI: 10.1016/j.apenergy.2023.121757
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923011212
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.121757?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mao, Hongzhi & Chen, Xie & Luo, Yongqiang & Deng, Jie & Tian, Zhiyong & Yu, Jinghua & Xiao, Yimin & Fan, Jianhua, 2023. "Advances and prospects on estimating solar photovoltaic installation capacity and potential based on satellite and aerial images," Renewable and Sustainable Energy Reviews, Elsevier, vol. 179(C).
    2. L. Kruitwagen & K. T. Story & J. Friedrich & L. Byers & S. Skillman & C. Hepburn, 2021. "A global inventory of photovoltaic solar energy generating units," Nature, Nature, vol. 598(7882), pages 604-610, October.
    3. Chapman, Andrew J. & McLellan, Benjamin & Tezuka, Tetsuo, 2016. "Residential solar PV policy: An analysis of impacts, successes and failures in the Australian case," Renewable Energy, Elsevier, vol. 86(C), pages 1265-1279.
    4. Zhong, Qing & Nelson, Jake R. & Tong, Daoqin & Grubesic, Tony H., 2022. "A spatial optimization approach to increase the accuracy of rooftop solar energy assessments," Applied Energy, Elsevier, vol. 316(C).
    5. Malof, Jordan M. & Bradbury, Kyle & Collins, Leslie M. & Newell, Richard G., 2016. "Automatic detection of solar photovoltaic arrays in high resolution aerial imagery," Applied Energy, Elsevier, vol. 183(C), pages 229-240.
    6. Cavieres, Robinson & Barraza, Rodrigo & Estay, Danilo & Bilbao, José & Valdivia-Lefort, Patricio, 2022. "Automatic soiling and partial shading assessment on PV modules through RGB images analysis," Applied Energy, Elsevier, vol. 306(PA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Ruiqing & He, Guojin & Yin, Ranyu & Wang, Guizhou & Zhang, Zhaoming & Long, Tengfei & Peng, Yan, 2024. "Weakly-semi supervised extraction of rooftop photovoltaics from high-resolution images based on segment anything model and class activation map," Applied Energy, Elsevier, vol. 361(C).
    2. Guo, Zhiling & Zhuang, Zhan & Tan, Hongjun & Liu, Zhengguang & Li, Peiran & Lin, Zhengyuan & Shang, Wen-Long & Zhang, Haoran & Yan, Jinyue, 2023. "Accurate and generalizable photovoltaic panel segmentation using deep learning for imbalanced datasets," Renewable Energy, Elsevier, vol. 219(P1).
    3. Tan, Hongjun & Guo, Zhiling & Lin, Zhengyuan & Chen, Yuntian & Huang, Dou & Yuan, Wei & Zhang, Haoran & Yan, Jinyue, 2024. "General generative AI-based image augmentation method for robust rooftop PV segmentation," Applied Energy, Elsevier, vol. 368(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mao, Hongzhi & Chen, Xie & Luo, Yongqiang & Deng, Jie & Tian, Zhiyong & Yu, Jinghua & Xiao, Yimin & Fan, Jianhua, 2023. "Advances and prospects on estimating solar photovoltaic installation capacity and potential based on satellite and aerial images," Renewable and Sustainable Energy Reviews, Elsevier, vol. 179(C).
    2. Chen, Qi & Li, Xinyuan & Zhang, Zhengjia & Zhou, Chao & Guo, Zhiling & Liu, Zhengguang & Zhang, Haoran, 2023. "Remote sensing of photovoltaic scenarios: Techniques, applications and future directions," Applied Energy, Elsevier, vol. 333(C).
    3. Hu, Wei & Bradbury, Kyle & Malof, Jordan M. & Li, Boning & Huang, Bohao & Streltsov, Artem & Sydny Fujita, K. & Hoen, Ben, 2022. "What you get is not always what you see—pitfalls in solar array assessment using overhead imagery," Applied Energy, Elsevier, vol. 327(C).
    4. Lan, Haifeng & Gou, Zhonghua & Yang, Linchuan, 2020. "House price premium associated with residential solar photovoltaics and the effect from feed-in tariffs: A case study of Southport in Queensland, Australia," Renewable Energy, Elsevier, vol. 161(C), pages 907-916.
    5. Zhixin Zhang & Min Chen & Teng Zhong & Rui Zhu & Zhen Qian & Fan Zhang & Yue Yang & Kai Zhang & Paolo Santi & Kaicun Wang & Yingxia Pu & Lixin Tian & Guonian Lü & Jinyue Yan, 2023. "Carbon mitigation potential afforded by rooftop photovoltaic in China," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    6. Jiang, Hou & Zhang, Xiaotong & Yao, Ling & Lu, Ning & Qin, Jun & Liu, Tang & Zhou, Chenghu, 2023. "High-resolution analysis of rooftop photovoltaic potential based on hourly generation simulations and load profiles," Applied Energy, Elsevier, vol. 348(C).
    7. Stefan Arens & Sunke Schlüters & Benedikt Hanke & Karsten von Maydell & Carsten Agert, 2020. "Sustainable Residential Energy Supply: A Literature Review-Based Morphological Analysis," Energies, MDPI, vol. 13(2), pages 1-28, January.
    8. Müller, Jonas & Trutnevyte, Evelina, 2020. "Spatial projections of solar PV installations at subnational level: Accuracy testing of regression models," Applied Energy, Elsevier, vol. 265(C).
    9. Best, Rohan & Burke, Paul J. & Nishitateno, Shuhei, 2019. "Evaluating the effectiveness of Australia's Small-scale Renewable Energy Scheme for rooftop solar," Energy Economics, Elsevier, vol. 84(C).
    10. Jiang, Hou & Lu, Ning & Yao, Ling & Qin, Jun & Liu, Tang, 2023. "Impact of climate changes on the stability of solar energy: Evidence from observations and reanalysis," Renewable Energy, Elsevier, vol. 208(C), pages 726-736.
    11. Lan, Haifeng & Gou, Zhonghua & Lu, Yi, 2021. "Machine learning approach to understand regional disparity of residential solar adoption in Australia," Renewable and Sustainable Energy Reviews, Elsevier, vol. 136(C).
    12. Cheng Yang & Fuhao Sun & Yujie Zou & Zhipeng Lv & Liang Xue & Chao Jiang & Shuangyu Liu & Bochao Zhao & Haoyang Cui, 2024. "A Survey of Photovoltaic Panel Overlay and Fault Detection Methods," Energies, MDPI, vol. 17(4), pages 1-37, February.
    13. Fan, Siyuan & Wang, Xiao & Wang, Zun & Sun, Bo & Zhang, Zhenhai & Cao, Shengxian & Zhao, Bo & Wang, Yu, 2022. "A novel image enhancement algorithm to determine the dust level on photovoltaic (PV) panels," Renewable Energy, Elsevier, vol. 201(P1), pages 172-180.
    14. Shahryar Jafarinejad & Rebecca R. Hernandez & Sajjad Bigham & Bryan S. Beckingham, 2023. "The Intertwined Renewable Energy–Water–Environment (REWE) Nexus Challenges and Opportunities: A Case Study of California," Sustainability, MDPI, vol. 15(13), pages 1-16, July.
    15. Paul Simshauser & Tim Nelson & Joel Gilmore, 2022. "The sunshine state: implications from mass rooftop solar PV take-up rates in Queensland," Working Papers EPRG2219, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    16. Hui Zhang & Xiaoxi Huang & Zhengwei Wang & Shiyu Jin & Benlin Xiao & Yanyan Huang & Wei Zhong & Aofei Meng, 2024. "An Estimation of the Available Spatial Intensity of Solar Energy in Urban Blocks in Wuhan, China," Energies, MDPI, vol. 17(5), pages 1-26, February.
    17. Konstantinos Ioannou & Dimitrios Myronidis, 2021. "Automatic Detection of Photovoltaic Farms Using Satellite Imagery and Convolutional Neural Networks," Sustainability, MDPI, vol. 13(9), pages 1-15, May.
    18. Zech, Matthias & von Bremen, Lueder, 2024. "End-to-end learning of representative PV capacity factors from aggregated PV feed-ins," Applied Energy, Elsevier, vol. 361(C).
    19. Li, Jiyan & Long, Yong & Jing, Yanju & Zhang, Jiaqing & Du, Silu & Jiao, Rui & Sun, Hanxue & Zhu, Zhaoqi & Liang, Weidong & Li, An, 2024. "Superhydrophobic multi-shell hollow microsphere confined phase change materials for solar photothermal conversion and energy storage," Applied Energy, Elsevier, vol. 365(C).
    20. Borislav Stankov & Angel Terziev & Momchil Vassilev & Martin Ivanov, 2024. "Influence of Wind and Rainfall on the Performance of a Photovoltaic Module in a Dusty Environment," Energies, MDPI, vol. 17(14), pages 1-29, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:350:y:2023:i:c:s0306261923011212. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.