IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v260y2026ics096014812600042x.html

Synthesizing images with aligned masks using text-to-image based generative AI for robust PV segmentation

Author

Listed:
  • Tan, Hongjun
  • Guo, Zhiling
  • Li, Jiaze
  • Chen, Yuntian
  • Chen, Qi
  • Liu, Junwei
  • Zhang, Haoran
  • Yan, Jinyue

Abstract

The robust detection of photovoltaic (PV) panels across multiple regions and backgrounds has traditionally relied on aligned remote-sensing imagery with manually labelled annotations, particularly in supervised learning. However, it faces challenges in collecting training datasets, including large volumes, accessibility concerns, and inconsistent quality. To efficiently produce paired PV images and masks, this study introduces SynthPV, a Text-to-Image based Generative AI (GenAI) approach that incorporates diverse backgrounds. By training on less than 1 % of real-world data, it can simultaneously generate highly aligned PV masks. The experimental results from three distinct scenarios using the Heilbronn, Jiaxing, and BDAPPV datasets demonstrate that synthetic image-mask pairs could significantly enhance PV segmentation performance. Notably, Intersection over Union (IoU) values increase by an average of 13.09 % and by 20.55 % for the Jiaxing dataset in particular. Cross-validation using synthetic data from Heilbronn with real datasets from Jiaxing and BDAPPV shows a further IoU improvement compared to solely real data. These findings underscore the effectiveness and robustness of the proposed GenAI method, offering a feature-adaptive and integrated approach to visual data augmentation that significantly enhances PV segmentation accuracy, thereby enabling more efficient and scalable applications in solar energy system analysis and deployment.

Suggested Citation

  • Tan, Hongjun & Guo, Zhiling & Li, Jiaze & Chen, Yuntian & Chen, Qi & Liu, Junwei & Zhang, Haoran & Yan, Jinyue, 2026. "Synthesizing images with aligned masks using text-to-image based generative AI for robust PV segmentation," Renewable Energy, Elsevier, vol. 260(C).
  • Handle: RePEc:eee:renene:v:260:y:2026:i:c:s096014812600042x
    DOI: 10.1016/j.renene.2026.125217
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S096014812600042X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2026.125217?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wen, Haoran & Du, Yang & Chen, Xiaoyang & Lim, Eng Gee & Wen, Huiqing & Yan, Ke, 2023. "A regional solar forecasting approach using generative adversarial networks with solar irradiance maps," Renewable Energy, Elsevier, vol. 216(C).
    2. Yang, Jinhao & Wu, Jinghua & Lu, Junjie & Peng, Xiangang & Yuan, Haoliang & Lai, Loi Lei, 2024. "A novel method for assessment rooftop PV potential based on remote sensing images," Renewable Energy, Elsevier, vol. 237(PC).
    3. Chen, Qi & Li, Xinyuan & Zhang, Zhengjia & Zhou, Chao & Guo, Zhiling & Liu, Zhengguang & Zhang, Haoran, 2023. "Remote sensing of photovoltaic scenarios: Techniques, applications and future directions," Applied Energy, Elsevier, vol. 333(C).
    4. Tian, Shuai & Yang, Guoqiang & Du, Sihong & Zhuang, Dian & Zhu, Ke & Zhou, Xin & Jin, Xing & Ye, Yu & Li, Peixian & Shi, Xing, 2024. "An innovative method for evaluating the urban roof photovoltaic potential based on open-source satellite images," Renewable Energy, Elsevier, vol. 224(C).
    5. Guo, Zhiling & Lu, Jiayue & Chen, Qi & Liu, Zhengguang & Song, Chenchen & Tan, Hongjun & Zhang, Haoran & Yan, Jinyue, 2024. "TransPV: Refining photovoltaic panel detection accuracy through a vision transformer-based deep learning model," Applied Energy, Elsevier, vol. 355(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tan, Hongjun & Guo, Zhiling & Lin, Zhengyuan & Chen, Yuntian & Huang, Dou & Yuan, Wei & Zhang, Haoran & Yan, Jinyue, 2024. "General generative AI-based image augmentation method for robust rooftop PV segmentation," Applied Energy, Elsevier, vol. 368(C).
    2. Yao, Xuedong & Zhang, Shihong & Liang, Zeyu & Li, Jianhua & Liu, Chang, 2026. "PVSAM: Adapting geometric prompts to segment anything model for photovoltaic detection in remote sensing imagery," Applied Energy, Elsevier, vol. 404(C).
    3. Yang, Junyi & Zhao, Lihua & Xu, Chengliang & Sun, Yongjun & Ren, Haoshan & Nie, Zichuan, 2025. "A deep-learning multi-source information fusion method for high-precision PV identification: Integration of U2-net image segmentation and multi-spectral screening," Applied Energy, Elsevier, vol. 401(PA).
    4. Feng, Xiaofan & Zhang, Zhengjia & Chen, Qi & Guo, Zhiling & Zhang, Haoran & Wang, Mengmeng & Gao, Wei & Liu, Xiuguo, 2025. "Integrating remote sensing, GIS, and multi-criteria decision making for assessing PV potential in mountainous regions," Renewable Energy, Elsevier, vol. 241(C).
    5. Mao, Hongzhi & Liu, Weili & Li, Chongzheng & Tian, Zhiyong & Zarrella, Angelo & Ma, Ling & Chen, Xinyu & Luo, Yongqiang & Fan, Jianhua, 2025. "An accurate quantification study on the rooftop PV potential based UAV field photography in dense urban environments," Applied Energy, Elsevier, vol. 399(C).
    6. Lodhi, Muhammad Kamran & Tan, Yumin & Wang, Xiaolu & Masum, Syed Muhammad & Nouman, Khan Muhammad & Ullah, Nasim, 2024. "Harnessing rooftop solar photovoltaic potential in Islamabad, Pakistan: A remote sensing and deep learning approach," Energy, Elsevier, vol. 304(C).
    7. Wang, Siyuan & Shao, Zhenfeng & Hou, Dongyang & Cai, Bowen, 2025. "PV Segmenter: A frequency-guided edge-aware network for distributed photovoltaic segmentation in remote sensing imagery," Applied Energy, Elsevier, vol. 393(C).
    8. Pu, Yifan & Zhu, Rui & Wang, Shu & You, Linlin & Zhong, Teng & Xu, Yanqing & Qin, Zheng, 2025. "City-scale roadside electric vehicle parking and charging capacity: A deep learning augmented street-view-image data mining and analytic framework," Applied Energy, Elsevier, vol. 389(C).
    9. Fernando Venâncio Mucomole & Carlos Augusto Santos Silva & Lourenço Lázaro Magaia, 2025. "Parametric Forecast of Solar Energy over Time by Applying Machine Learning Techniques: Systematic Review," Energies, MDPI, vol. 18(6), pages 1-51, March.
    10. Ruan, Guoping & Chen, Xiaoyang & Li, Yiheng & Lim, Eng Gee & Fang, Lurui & Jiang, Lin & Du, Yang & Wang, Fei, 2026. "SkyNet: A Deep Learning Architecture for Intra-hour Multimodal Solar Forecasting with Ground-based Sky Images," Renewable Energy, Elsevier, vol. 256(PF).
    11. Pei, Jingyin & Dong, Yunxuan & Guo, Pinghui & Wu, Thomas & Hu, Jianming, 2024. "A Hybrid Dual Stream ProbSparse Self-Attention Network for spatial–temporal photovoltaic power forecasting," Energy, Elsevier, vol. 305(C).
    12. Guo, Zhiling & Zhuang, Zhan & Tan, Hongjun & Liu, Zhengguang & Li, Peiran & Lin, Zhengyuan & Shang, Wen-Long & Zhang, Haoran & Yan, Jinyue, 2023. "Accurate and generalizable photovoltaic panel segmentation using deep learning for imbalanced datasets," Renewable Energy, Elsevier, vol. 219(P1).
    13. Xiao, Sheng & Ren, He & Zhao, Yanling & He, Tingting & Huang, Chunlin & Chen, Qixiang & Zhang, Lifan & An, Yifan & Li, Fashuai & Chen, Yuwei, 2025. "Land reuse for carbon mitigation: Decarbonization potential of solar photovoltaics in China's open-pit mining areas," Land Use Policy, Elsevier, vol. 158(C).
    14. Li, Guanglei & Wang, Guohao & Luo, Tengqi & Hu, Yuxiao & Wu, Shouyuan & Gong, Guanghui & Song, Chenchen & Guo, Zhiling & Liu, Zhengguang, 2024. "SolarSAM: Building-scale photovoltaic potential assessment based on Segment Anything Model (SAM) and remote sensing for emerging city," Renewable Energy, Elsevier, vol. 237(PA).
    15. Jiang, Luguang & Liu, Ye & Yang, Liwen, 2026. "Rapid expansion of photovoltaic land in China's coastal regions: A doubling from 2020 to 2023," Land Use Policy, Elsevier, vol. 160(C).
    16. Peng, Wanshan & He, Tao & Ma, Yichuan & Zheng, Yueming, 2026. "A physics-informed machine learning method for short-term solar radiation forecast with satellite-derived cloud optical depth," Applied Energy, Elsevier, vol. 406(C).
    17. Hou, Xinyuan & Papachristopoulou, Kyriakoula & Saint-Drenan, Yves-Marie & Kosmopoulos, Panagiotis G. & Psiloglou, Basil E. & Kazadzis, Stelios, 2025. "Effects of clouds, aerosols and shadows on solar energy potential on urban rooftops using earth observation data and digital surface models," Applied Energy, Elsevier, vol. 397(C).
    18. Wang, Zhijin & Wu, Senzhen & Huang, Yaohui & Liu, Ruyu & Liu, Xiufeng, 2026. "A comprehensive review of deep learning for solar nowcasting: Enhancing accuracy, reliability, and interpretability," Applied Energy, Elsevier, vol. 407(C).
    19. Xie, Yang & Zheng, Jianyong & Mei, Fei & Taylor, Gareth & Gao, Ang, 2025. "An efficient approach for regional photovoltaic power forecasting optimization based on texture features from satellite images and transfer learning," Applied Energy, Elsevier, vol. 385(C).
    20. Yang, Jinhao & Wu, Jinghua & Lu, Junjie & Peng, Xiangang & Yuan, Haoliang & Lai, Loi Lei, 2024. "A novel method for assessment rooftop PV potential based on remote sensing images," Renewable Energy, Elsevier, vol. 237(PC).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:260:y:2026:i:c:s096014812600042x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.