IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v238y2022ipbs0360544221019769.html
   My bibliography  Save this article

Household profile identification for behavioral demand response: A semi-supervised learning approach using smart meter data

Author

Listed:
  • Wang, Fei
  • Lu, Xiaoxing
  • Chang, Xiqiang
  • Cao, Xin
  • Yan, Siqing
  • Li, Kangping
  • Duić, Neven
  • Shafie-khah, Miadreza
  • Catalão, João P.S.

Abstract

Accurate household profiles (e.g., house type, number of occupants) identification is the key to the successful implementation of behavioral demand response. Currently, supervised learning methods are widely adopted to identify household profiles using smart meter data. Such methods could achieve promising performance in the case of sufficient labeled data but show low accuracy if labeled data is insufficient or even unavailable. However, the acquisition of accurately labeled data (usually obtained by survey) is very difficult, costly, and time-consuming in practice due to various reasons such as privacy concerns. To this end, a semi-supervised learning approach is proposed in this paper to address the above issues. Firstly, 78 preliminary features reflecting the household profiles information are extracted from both time and frequency domain. Secondly, feature selection methods are introduced to select more relevant ones as the input of the identification model from the preliminary features. Thirdly, a transductive support vector machine method is adopted to learn the mapping relation between the input features and the output household profile identification results. Case study on an Irish dataset indicates that the proposed approach outperforms supervised learning methods when only limited labeled data is available. Furthermore, the impacts of different feature selection methods (i.e., Filter, Wrapper and Embedding methods) are also investigated, among which the wrapper method performs best, and the identification accuracy improves with the increase of data resolution.

Suggested Citation

  • Wang, Fei & Lu, Xiaoxing & Chang, Xiqiang & Cao, Xin & Yan, Siqing & Li, Kangping & Duić, Neven & Shafie-khah, Miadreza & Catalão, João P.S., 2022. "Household profile identification for behavioral demand response: A semi-supervised learning approach using smart meter data," Energy, Elsevier, vol. 238(PB).
  • Handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221019769
    DOI: 10.1016/j.energy.2021.121728
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221019769
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2021.121728?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Kangping & Wang, Fei & Mi, Zengqiang & Fotuhi-Firuzabad, Mahmoud & Duić, Neven & Wang, Tieqiang, 2019. "Capacity and output power estimation approach of individual behind-the-meter distributed photovoltaic system for demand response baseline estimation," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    2. Newsham, Guy R. & Bowker, Brent G., 2010. "The effect of utility time-varying pricing and load control strategies on residential summer peak electricity use: A review," Energy Policy, Elsevier, vol. 38(7), pages 3289-3296, July.
    3. Viegas, Joaquim L. & Vieira, Susana M. & Melício, R. & Mendes, V.M.F. & Sousa, João M.C., 2016. "Classification of new electricity customers based on surveys and smart metering data," Energy, Elsevier, vol. 107(C), pages 804-817.
    4. Wang, Fei & Ge, Xinxin & Yang, Peng & Li, Kangping & Mi, Zengqiang & Siano, Pierluigi & Duić, Neven, 2020. "Day-ahead optimal bidding and scheduling strategies for DER aggregator considering responsive uncertainty under real-time pricing," Energy, Elsevier, vol. 213(C).
    5. Hlalele, Thabo G. & Zhang, Jiangfeng & Naidoo, Raj M. & Bansal, Ramesh C., 2021. "Multi-objective economic dispatch with residential demand response programme under renewable obligation," Energy, Elsevier, vol. 218(C).
    6. Lu, Qing & Lü, Shuaikang & Leng, Yajun & Zhang, Zhixin, 2020. "Optimal household energy management based on smart residential energy hub considering uncertain behaviors," Energy, Elsevier, vol. 195(C).
    7. Finck, Christian & Li, Rongling & Zeiler, Wim, 2019. "Economic model predictive control for demand flexibility of a residential building," Energy, Elsevier, vol. 176(C), pages 365-379.
    8. Yu, Biying & Tian, Yaming & Zhang, Junyi, 2015. "A dynamic active energy demand management system for evaluating the effect of policy scheme on household energy consumption behavior," Energy, Elsevier, vol. 91(C), pages 491-506.
    9. Wang, Zhikun & Crawley, Jenny & Li, Francis G.N. & Lowe, Robert, 2020. "Sizing of district heating systems based on smart meter data: Quantifying the aggregated domestic energy demand and demand diversity in the UK," Energy, Elsevier, vol. 193(C).
    10. Lu, Xiaoxing & Li, Kangping & Xu, Hanchen & Wang, Fei & Zhou, Zhenyu & Zhang, Yagang, 2020. "Fundamentals and business model for resource aggregator of demand response in electricity markets," Energy, Elsevier, vol. 204(C).
    11. Huang, Shoujun & Abedinia, Oveis, 2021. "Investigation in economic analysis of microgrids based on renewable energy uncertainty and demand response in the electricity market," Energy, Elsevier, vol. 225(C).
    12. Kavousian, Amir & Rajagopal, Ram & Fischer, Martin, 2013. "Determinants of residential electricity consumption: Using smart meter data to examine the effect of climate, building characteristics, appliance stock, and occupants' behavior," Energy, Elsevier, vol. 55(C), pages 184-194.
    13. Satre-Meloy, Aven, 2019. "Investigating structural and occupant drivers of annual residential electricity consumption using regularization in regression models," Energy, Elsevier, vol. 174(C), pages 148-168.
    14. Andruszkiewicz, Jerzy & Lorenc, Józef & Weychan, Agnieszka, 2020. "Seasonal variability of price elasticity of demand of households using zonal tariffs and its impact on hourly load of the power system," Energy, Elsevier, vol. 196(C).
    15. Melillo, Andreas & Durrer, Roman & Worlitschek, Jörg & Schütz, Philipp, 2020. "First results of remote building characterisation based on smart meter measurement data," Energy, Elsevier, vol. 200(C).
    16. Beckel, Christian & Sadamori, Leyna & Staake, Thorsten & Santini, Silvia, 2014. "Revealing household characteristics from smart meter data," Energy, Elsevier, vol. 78(C), pages 397-410.
    17. Waseem, Muhammad & Lin, Zhenzhi & Liu, Shengyuan & Zhang, Zhi & Aziz, Tarique & Khan, Danish, 2021. "Fuzzy compromised solution-based novel home appliances scheduling and demand response with optimal dispatch of distributed energy resources," Applied Energy, Elsevier, vol. 290(C).
    18. Kumar, Pankaj & Banerjee, Rangan & Mishra, Trupti, 2020. "A framework for analyzing trade-offs in cost and emissions in power sector," Energy, Elsevier, vol. 195(C).
    19. Oveis Abedinia & Mehdi Bagheri, 2021. "Power Distribution Optimization Based on Demand Respond with Improved Multi-Objective Algorithm in Power System Planning," Energies, MDPI, vol. 14(10), pages 1-18, May.
    20. Khalili, Tohid & Jafari, Amirreza & Abapour, Mehdi & Mohammadi-Ivatloo, Behnam, 2019. "Optimal battery technology selection and incentive-based demand response program utilization for reliability improvement of an insular microgrid," Energy, Elsevier, vol. 169(C), pages 92-104.
    21. Y, Kiguchi & Y, Heo & M, Weeks & R, Choudhary, 2019. "Predicting intra-day load profiles under time-of-use tariffs using smart meter data," Energy, Elsevier, vol. 173(C), pages 959-970.
    22. Wang, Fei & Xu, Hanchen & Xu, Ti & Li, Kangping & Shafie-khah, Miadreza & Catalão, João. P.S., 2017. "The values of market-based demand response on improving power system reliability under extreme circumstances," Applied Energy, Elsevier, vol. 193(C), pages 220-231.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jiang, Qian & Mu, Yunfei & Jia, Hongjie & Cao, Yan & Wang, Zibo & Wei, Wei & Hou, Kai & Yu, Xiaodan, 2022. "A Stackelberg Game-based planning approach for integrated community energy system considering multiple participants," Energy, Elsevier, vol. 258(C).
    2. Ahammed, Md. Tanvir & Khan, Imran, 2022. "Ensuring power quality and demand-side management through IoT-based smart meters in a developing country," Energy, Elsevier, vol. 250(C).
    3. Ozarisoy, B. & Altan, H., 2022. "Significance of occupancy patterns and habitual household adaptive behaviour on home-energy performance of post-war social-housing estate in the South-eastern Mediterranean climate: Energy policy desi," Energy, Elsevier, vol. 244(PB).
    4. Liu, Yixing & Liu, Bo & Guo, Xiaoyu & Xu, Yiqiao & Ding, Zhengtao, 2023. "Household profile identification for retailers based on personalized federated learning," Energy, Elsevier, vol. 275(C).
    5. Daiva Stanelyte & Neringa Radziukyniene & Virginijus Radziukynas, 2022. "Overview of Demand-Response Services: A Review," Energies, MDPI, vol. 15(5), pages 1-31, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahir, Rajesh K. & Chakraborty, Basab, 2021. "A meta-analytic approach for determining the success factors for energy conservation," Energy, Elsevier, vol. 230(C).
    2. Tao, Peng & Xu, Fei & Dong, Zengbo & Zhang, Chao & Peng, Xuefeng & Zhao, Junpeng & Li, Kangping & Wang, Fei, 2022. "Graph convolutional network-based aggregated demand response baseline load estimation," Energy, Elsevier, vol. 251(C).
    3. Guo, Peiyang & Lam, Jacqueline C.K. & Li, Victor O.K., 2019. "Drivers of domestic electricity users’ price responsiveness: A novel machine learning approach," Applied Energy, Elsevier, vol. 235(C), pages 900-913.
    4. Lesley Thomson & David Jenkins, 2023. "The Use of Real Energy Consumption Data in Characterising Residential Energy Demand with an Inventory of UK Datasets," Energies, MDPI, vol. 16(16), pages 1-29, August.
    5. Satre-Meloy, Aven & Diakonova, Marina & Grünewald, Philipp, 2020. "Cluster analysis and prediction of residential peak demand profiles using occupant activity data," Applied Energy, Elsevier, vol. 260(C).
    6. Jacqueline Nicole Adams & Zsófia Deme Bélafi & Miklós Horváth & János Balázs Kocsis & Tamás Csoknyai, 2021. "How Smart Meter Data Analysis Can Support Understanding the Impact of Occupant Behavior on Building Energy Performance: A Comprehensive Review," Energies, MDPI, vol. 14(9), pages 1-23, April.
    7. Chen, J.J. & Qi, B.X. & Rong, Z.K. & Peng, K. & Zhao, Y.L. & Zhang, X.H., 2021. "Multi-energy coordinated microgrid scheduling with integrated demand response for flexibility improvement," Energy, Elsevier, vol. 217(C).
    8. Roberts, Mike B. & Haghdadi, Navid & Bruce, Anna & MacGill, Iain, 2019. "Characterisation of Australian apartment electricity demand and its implications for low-carbon cities," Energy, Elsevier, vol. 180(C), pages 242-257.
    9. Tang, Wenjun & Wang, Hao & Lee, Xian-Long & Yang, Hong-Tzer, 2022. "Machine learning approach to uncovering residential energy consumption patterns based on socioeconomic and smart meter data," Energy, Elsevier, vol. 240(C).
    10. Xu, Xiaojing & Chen, Chien-fei & Zhu, Xiaojuan & Hu, Qinran, 2018. "Promoting acceptance of direct load control programs in the United States: Financial incentive versus control option," Energy, Elsevier, vol. 147(C), pages 1278-1287.
    11. Yang, Ting & Zhao, Liyuan & Li, Wei & Zomaya, Albert Y., 2021. "Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learning," Energy, Elsevier, vol. 235(C).
    12. Fateh Nassim Melzi & Allou Same & Mohamed Haykel Zayani & Latifa Oukhellou, 2017. "A Dedicated Mixture Model for Clustering Smart Meter Data: Identification and Analysis of Electricity Consumption Behaviors," Energies, MDPI, vol. 10(10), pages 1-21, September.
    13. Kiguchi, Y. & Weeks, M. & Arakawa, R., 2021. "Predicting winners and losers under time-of-use tariffs using smart meter data," Energy, Elsevier, vol. 236(C).
    14. Lau, Jat-Syu & Jiang, Yihuo & Li, Ziyuan & Qian, Qian, 2023. "Stochastic trading of storage systems in short term electricity markets considering intraday demand response market," Energy, Elsevier, vol. 280(C).
    15. Zhang, Tairan & Sobhani, Behrouz, 2023. "Optimal economic programming of an energy hub in the power system while taking into account the uncertainty of renewable resources, risk-taking and electric vehicles using a developed routing method," Energy, Elsevier, vol. 271(C).
    16. Liu, Jia & Zeng, Peter Pingliang & Xing, Hao & Li, Yalou & Wu, Qiuwei, 2020. "Hierarchical duality-based planning of transmission networks coordinating active distribution network operation," Energy, Elsevier, vol. 213(C).
    17. Huang, Sen & Ye, Yunyang & Wu, Di & Zuo, Wangda, 2021. "An assessment of power flexibility from commercial building cooling systems in the United States," Energy, Elsevier, vol. 221(C).
    18. Annala, Salla & Ruggiero, Salvatore & Kangas, Hanna-Liisa & Honkapuro, Samuli & Ohrling, Tiina, 2022. "Impact of home market on business development and internationalization of demand response firms," Energy, Elsevier, vol. 242(C).
    19. Chen, Xiao & Zanocco, Chad & Flora, June & Rajagopal, Ram, 2022. "Constructing dynamic residential energy lifestyles using Latent Dirichlet Allocation," Applied Energy, Elsevier, vol. 318(C).
    20. Jieyi Kang & David Reiner, 2021. "Machine Learning on residential electricity consumption: Which households are more responsive to weather?," Working Papers EPRG2113, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221019769. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.