IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v381y2025ics0306261924023912.html
   My bibliography  Save this article

Unsupervised disaggregation of aggregated net load considering behind-the-meter PV based on virtual PV sample construction

Author

Listed:
  • Qu, Ziyu
  • Ge, Xinxin
  • Lu, Jinling
  • Wang, Fei

Abstract

Most of the distributed photovoltaics (PV) are installed behind the meter (BTM), single-meter deployments permit distribution system operators to monitor only the net load and exclude the BTM PV generation, so the growing prevalence of BTM PV installations negatively affects distribution system planning and the local balance of supply and demand. However, existing methods for net load disaggregation mainly rely on the installation of expensive monitoring devices and high-resolution sensors, and face challenges such as privacy concerns, data diversity, and communication barriers. In this paper, an unsupervised method for aggregated net load disaggregation is proposed that achieves accurate separation of BTM PV outputs and actual loads using only net load data and exogenous variables. First, a data-driven method is developed to construct the actual load sample matrix of customers. Then, a virtual PV sample construction method based on the self-feedback decoupling algorithm (SFDA) is proposed to tackle the invisibility of BTM PV resources. The method performs self-feedback learning and constructs the virtual PV samples by minimizing the long-term decomposition residuals, and generates the virtual PV sample matrix. Finally, the model learning results are employed to achieve net load disaggregation through the contextually supervised source separation (CSSS) algorithm. The study utilized real open-source data whereby analyses reveal the method greatly enhances the decoupling accuracy of unsupervised algorithms. Furthermore, it eliminates a series of problems associated with traditional supervised algorithms and expands the scope of unsupervised decoupling methods.

Suggested Citation

  • Qu, Ziyu & Ge, Xinxin & Lu, Jinling & Wang, Fei, 2025. "Unsupervised disaggregation of aggregated net load considering behind-the-meter PV based on virtual PV sample construction," Applied Energy, Elsevier, vol. 381(C).
  • Handle: RePEc:eee:appene:v:381:y:2025:i:c:s0306261924023912
    DOI: 10.1016/j.apenergy.2024.125007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924023912
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.125007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Kangping & Wang, Fei & Mi, Zengqiang & Fotuhi-Firuzabad, Mahmoud & Duić, Neven & Wang, Tieqiang, 2019. "Capacity and output power estimation approach of individual behind-the-meter distributed photovoltaic system for demand response baseline estimation," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    2. Zeng, Lijun & Guo, Lingyi & Jiang, Liwen, 2024. "A bi-level multi-objective optimization model for inter-provincial carbon emissions transfer tax on electricity production," Applied Energy, Elsevier, vol. 356(C).
    3. Razavi, Seyed-Ehsan & Rahimi, Ehsan & Javadi, Mohammad Sadegh & Nezhad, Ali Esmaeel & Lotfi, Mohamed & Shafie-khah, Miadreza & Catalão, João P.S., 2019. "Impact of distributed generation on protection and voltage regulation of distribution systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 105(C), pages 157-167.
    4. Fei Wang & Kangping Li & Xinkang Wang & Lihui Jiang & Jianguo Ren & Zengqiang Mi & Miadreza Shafie-khah & João P. S. Catalão, 2018. "A Distributed PV System Capacity Estimation Approach Based on Support Vector Machine with Customer Net Load Curve Features," Energies, MDPI, vol. 11(7), pages 1-19, July.
    5. Erdener, Burcin Cakir & Feng, Cong & Doubleday, Kate & Florita, Anthony & Hodge, Bri-Mathias, 2022. "A review of behind-the-meter solar forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    6. Gao, Ang & Zheng, Jianyong & Mei, Fei & Liu, Yu, 2024. "Toward intelligent demand-side energy management via substation-level flexible load disaggregation," Applied Energy, Elsevier, vol. 367(C).
    7. Herc, Luka & Pfeifer, Antun & Duić, Neven & Wang, Fei, 2022. "Economic viability of flexibility options for smart energy systems with high penetration of renewable energy," Energy, Elsevier, vol. 252(C).
    8. Stainsby, Wendell & Zimmerle, Daniel & Duggan, Gerald P., 2020. "A method to estimate residential PV generation from net-metered load data and system install date," Applied Energy, Elsevier, vol. 267(C).
    9. Liu, Chao Charles & Chen, Hongkun & Shi, Jing & Chen, Lei, 2022. "Self-supervised learning method for consumer-level behind-the-meter PV estimation," Applied Energy, Elsevier, vol. 326(C).
    10. Chen, Yongbao & Xu, Peng & Chu, Yiyi & Li, Weilin & Wu, Yuntao & Ni, Lizhou & Bao, Yi & Wang, Kun, 2017. "Short-term electrical load forecasting using the Support Vector Regression (SVR) model to calculate the demand response baseline for office buildings," Applied Energy, Elsevier, vol. 195(C), pages 659-670.
    11. Wang, Fei & Lu, Xiaoxing & Mei, Shengwei & Su, Ying & Zhen, Zhao & Zou, Zubing & Zhang, Xuemin & Yin, Rui & Duić, Neven & Shafie-khah, Miadreza & Catalão, João P.S., 2022. "A satellite image data based ultra-short-term solar PV power forecasting method considering cloud information from neighboring plant," Energy, Elsevier, vol. 238(PC).
    12. Qu, Yinpeng & Xu, Jian & Sun, Yuanzhang & Liu, Dan, 2021. "A temporal distributed hybrid deep learning model for day-ahead distributed PV power forecasting," Applied Energy, Elsevier, vol. 304(C).
    13. Heleen L. Soest & Michel G. J. Elzen & Detlef P. Vuuren, 2021. "Net-zero emission targets for major emitting countries consistent with the Paris Agreement," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    14. Pan, Keda & Chen, Zhaohua & Lai, Chun Sing & Xie, Changhong & Wang, Dongxiao & Li, Xuecong & Zhao, Zhuoli & Tong, Ning & Lai, Loi Lei, 2022. "An unsupervised data-driven approach for behind-the-meter photovoltaic power generation disaggregation," Applied Energy, Elsevier, vol. 309(C).
    15. Cantú, Victor H. & Ponsich, Antonin & Azzaro-Pantel, Catherine & Carrera, Eduardo, 2023. "Capturing spatial, time-wise and technological detail in hydrogen supply chains: A bi-level multi-objective optimization approach," Applied Energy, Elsevier, vol. 344(C).
    16. Visser, Lennard & AlSkaif, Tarek & van Sark, Wilfried, 2022. "Operational day-ahead solar power forecasting for aggregated PV systems with a varying spatial distribution," Renewable Energy, Elsevier, vol. 183(C), pages 267-282.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yuqing & Fu, Wenjie & Wang, Junlong & Zhen, Zhao & Wang, Fei, 2024. "Ultra-short-term distributed PV power forecasting for virtual power plant considering data-scarce scenarios," Applied Energy, Elsevier, vol. 373(C).
    2. Liu, Chao Charles & Chen, Hongkun & Shi, Jing & Chen, Lei, 2022. "Self-supervised learning method for consumer-level behind-the-meter PV estimation," Applied Energy, Elsevier, vol. 326(C).
    3. Sabadus, Andreea & Blaga, Robert & Hategan, Sergiu-Mihai & Calinoiu, Delia & Paulescu, Eugenia & Mares, Oana & Boata, Remus & Stefu, Nicoleta & Paulescu, Marius & Badescu, Viorel, 2024. "A cross-sectional survey of deterministic PV power forecasting: Progress and limitations in current approaches," Renewable Energy, Elsevier, vol. 226(C).
    4. Keda Pan & Changhong Xie & Chun Sing Lai & Dongxiao Wang & Loi Lei Lai, 2020. "Photovoltaic Output Power Estimation and Baseline Prediction Approach for a Residential Distribution Network with Behind-the-Meter Systems," Forecasting, MDPI, vol. 2(4), pages 1-18, November.
    5. Yuan-Kang Wu & Yi-Hui Lai & Cheng-Liang Huang & Nguyen Thi Bich Phuong & Wen-Shan Tan, 2022. "Artificial Intelligence Applications in Estimating Invisible Solar Power Generation," Energies, MDPI, vol. 15(4), pages 1-18, February.
    6. Erdener, Burcin Cakir & Feng, Cong & Doubleday, Kate & Florita, Anthony & Hodge, Bri-Mathias, 2022. "A review of behind-the-meter solar forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    7. Pei, Jingyin & Dong, Yunxuan & Guo, Pinghui & Wu, Thomas & Hu, Jianming, 2024. "A Hybrid Dual Stream ProbSparse Self-Attention Network for spatial–temporal photovoltaic power forecasting," Energy, Elsevier, vol. 305(C).
    8. Lai, Wenzhe & Zhen, Zhao & Wang, Fei & Fu, Wenjie & Wang, Junlong & Zhang, Xudong & Ren, Hui, 2024. "Sub-region division based short-term regional distributed PV power forecasting method considering spatio-temporal correlations," Energy, Elsevier, vol. 288(C).
    9. Markovics, Dávid & Mayer, Martin János, 2022. "Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    10. Yin, Linfei & Cao, Xinghui & Liu, Dongduan, 2023. "Weighted fully-connected regression networks for one-day-ahead hourly photovoltaic power forecasting," Applied Energy, Elsevier, vol. 332(C).
    11. Wang, Zhenyi & Zhang, Hongcai, 2024. "Customer baseline load estimation for virtual power plants in demand response: An attention mechanism-based generative adversarial networks approach," Applied Energy, Elsevier, vol. 357(C).
    12. Taeyoung Kim & Jinho Kim, 2021. "A Regional Day-Ahead Rooftop Photovoltaic Generation Forecasting Model Considering Unauthorized Photovoltaic Installation," Energies, MDPI, vol. 14(14), pages 1-22, July.
    13. Gandhi, Oktoviano & Zhang, Wenjie & Kumar, Dhivya Sampath & Rodríguez-Gallegos, Carlos D. & Yagli, Gokhan Mert & Yang, Dazhi & Reindl, Thomas & Srinivasan, Dipti, 2024. "The value of solar forecasts and the cost of their errors: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    14. Huang, Congzhi & Yang, Mengyuan, 2023. "Memory long and short term time series network for ultra-short-term photovoltaic power forecasting," Energy, Elsevier, vol. 279(C).
    15. Li, Kangping & Wang, Fei & Mi, Zengqiang & Fotuhi-Firuzabad, Mahmoud & Duić, Neven & Wang, Tieqiang, 2019. "Capacity and output power estimation approach of individual behind-the-meter distributed photovoltaic system for demand response baseline estimation," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    16. Ziras, Charalampos & Heinrich, Carsten & Bindner, Henrik W., 2021. "Why baselines are not suited for local flexibility markets," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    17. Pan, Keda & Chen, Zhaohua & Lai, Chun Sing & Xie, Changhong & Wang, Dongxiao & Li, Xuecong & Zhao, Zhuoli & Tong, Ning & Lai, Loi Lei, 2022. "An unsupervised data-driven approach for behind-the-meter photovoltaic power generation disaggregation," Applied Energy, Elsevier, vol. 309(C).
    18. Meng, Yan & Fan, Shuai & Shen, Yu & Xiao, Jucheng & He, Guangyu & Li, Zuyi, 2023. "Transmission and distribution network-constrained large-scale demand response based on locational customer directrix load for accommodating renewable energy," Applied Energy, Elsevier, vol. 350(C).
    19. Feng, Zhong-kai & Huang, Qing-qing & Niu, Wen-jing & Yang, Tao & Wang, Jia-yang & Wen, Shi-ping, 2022. "Multi-step-ahead solar output time series prediction with gate recurrent unit neural network using data decomposition and cooperation search algorithm," Energy, Elsevier, vol. 261(PA).
    20. Wang, Bingzheng & Lu, Xiaofei & Zhang, Cancan & Wang, Hongsheng, 2022. "Cascade and hybrid processes for co-generating solar-based fuels and electricity via combining spectral splitting technology and membrane reactor," Renewable Energy, Elsevier, vol. 196(C), pages 782-799.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:381:y:2025:i:c:s0306261924023912. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.