IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i20p7557-d941265.html
   My bibliography  Save this article

Data Preparation and Visualization of Electricity Consumption for Load Profiling

Author

Listed:
  • Oscar G. Duarte

    (Facultad de Ingeniería, Universidad Nacional de Colombia, Bogotá 111321, Colombia
    These authors contributed equally to this work.)

  • Javier A. Rosero

    (Facultad de Ingeniería, Universidad Nacional de Colombia, Bogotá 111321, Colombia
    These authors contributed equally to this work.)

  • María del Carmen Pegalajar

    (Escuela Técnica Superior de Ingenierías Informática y de Telecomunicaciones, Universidad de Granada, 18014 Granada, Spain
    These authors contributed equally to this work.)

Abstract

The construction of daily electricity consumption profiles is a common practice for user characterization and segmentation tasks. As in any data analysis project, to obtain these load profiles, a stage of data preparation is necessary. This article explores to what extent does the selection of the data preparation technique impacts load profiling. The techniques discussed are used in the following tasks: standardization, construction of data, dimensionality reduction and data enrichment. The analysis reveals a great incidence of the data preparation on the result. The need to make the data preparation process explicit in each report is identified. In particular, it is highlighted that the most usual default standardization process, column standardization, is not adequate in the preparation of energy consumption profiles.

Suggested Citation

  • Oscar G. Duarte & Javier A. Rosero & María del Carmen Pegalajar, 2022. "Data Preparation and Visualization of Electricity Consumption for Load Profiling," Energies, MDPI, vol. 15(20), pages 1-30, October.
    • Handle: RePEc:gam:jeners:v:15:y:2022:i:20:p:7557-:d:941265
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/20/7557/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/15/20/7557/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jong-Il Park & Chang-Hyun Park, 2022. "Harmonic Contribution Assessment Based on the Random Sample Consensus and Recursive Least Square Methods," Energies, MDPI, vol. 15(17), pages 1-18, September.
    2. Jun-Hao Chen & Kuang-Hsiung Tan & Yih-Der Lee, 2022. "Intelligent Controlled DSTATCOM for Power Quality Enhancement," Energies, MDPI, vol. 15(11), pages 1-19, May.
    3. Ioannidis, Filippos & Kosmidou, Kyriaki & Savva, Christos & Theodossiou, Panayiotis, 2021. "Electricity pricing using a periodic GARCH model with conditional skewness and kurtosis components," Energy Economics, Elsevier, vol. 95(C).
    4. Yi-Hung Liao & Yen-Lun Lin, 2022. "An Improved Down-Scale Evaluation System for Capacitors Utilized in High-Power Three-Phase Inverters under Balanced and Unbalanced Load Conditions," Energies, MDPI, vol. 15(19), pages 1-14, September.
    5. Guodong Liu & Maximiliano F. Ferrari & Thomas B. Ollis & Kevin Tomsovic, 2022. "An MILP-Based Distributed Energy Management for Coordination of Networked Microgrids," Energies, MDPI, vol. 15(19), pages 1-20, September.
    6. Yankun Xia & Wenzhang Tang, 2022. "Study on Harmonic Impedance Estimation Based on Gaussian Mixture Regression Using Railway Power Supply Loads," Energies, MDPI, vol. 15(19), pages 1-18, September.
    7. Mohammad Mujahid Irfan & Sushama Malaji & Chandrashekhar Patsa & Shriram S. Rangarajan & S. M. Suhail Hussain, 2022. "Control of DSTATCOM Using ANN-BP Algorithm for the Grid Connected Wind Energy System," Energies, MDPI, vol. 15(19), pages 1-14, September.
    8. Edgardo Cayon & Julio Sarmiento, 2022. "The Impact of Coskewness and Cokurtosis as Augmentation Factors in Modeling Colombian Electricity Price Returns," Energies, MDPI, vol. 15(19), pages 1-8, September.
    9. Arash Moradzadeh & Omid Sadeghian & Kazem Pourhossein & Behnam Mohammadi-Ivatloo & Amjad Anvari-Moghaddam, 2020. "Improving Residential Load Disaggregation for Sustainable Development of Energy via Principal Component Analysis," Sustainability, MDPI, vol. 12(8), pages 1-14, April.
    10. Arman Goudarzi & Farzad Ghayoor & Muhammad Waseem & Shah Fahad & Issa Traore, 2022. "A Survey on IoT-Enabled Smart Grids: Emerging, Applications, Challenges, and Outlook," Energies, MDPI, vol. 15(19), pages 1-32, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniela Pereira Macedo & António Cardoso Marques & Olivier Damette, 2023. "Challenges in Assessing the Behaviour of Nodal Electricity Prices in Insular Electricity Markets: The Case of New Zealand," Economies, MDPI, vol. 11(6), pages 1-19, June.
    2. Muhammad Waseem & Muhammad Adnan Khan & Arman Goudarzi & Shah Fahad & Intisar Ali Sajjad & Pierluigi Siano, 2023. "Incorporation of Blockchain Technology for Different Smart Grid Applications: Architecture, Prospects, and Challenges," Energies, MDPI, vol. 16(2), pages 1-29, January.
    3. İsmail Hakkı Çavdar & Vahit Feryad, 2021. "Efficient Design of Energy Disaggregation Model with BERT-NILM Trained by AdaX Optimization Method for Smart Grid," Energies, MDPI, vol. 14(15), pages 1-21, July.
    4. Ines Ortega-Fernandez & Francesco Liberati, 2023. "A Review of Denial of Service Attack and Mitigation in the Smart Grid Using Reinforcement Learning," Energies, MDPI, vol. 16(2), pages 1-15, January.
    5. Tomas Macak & Jan Hron & Jaromir Stusek, 2020. "A Causal Model of the Sustainable Use of Resources: A Case Study on a Woodworking Process," Sustainability, MDPI, vol. 12(21), pages 1-22, October.
    6. Elnaz Azizi & Mohammad T. H. Beheshti & Sadegh Bolouki, 2021. "Event Matching Classification Method for Non-Intrusive Load Monitoring," Sustainability, MDPI, vol. 13(2), pages 1-20, January.
    7. Umme Mumtahina & Sanath Alahakoon & Peter Wolfs, 2023. "A Literature Review on the Optimal Placement of Static Synchronous Compensator (STATCOM) in Distribution Networks," Energies, MDPI, vol. 16(17), pages 1-38, August.
    8. Macedo, Daniela Pereira & Marques, António Cardoso & Damette, Olivier, 2022. "The role of electricity flows and renewable electricity production in the behaviour of electricity prices in Spain," Economic Analysis and Policy, Elsevier, vol. 76(C), pages 885-900.
    9. Sheeraz Kirmani & Abdul Mazid & Irfan Ahmad Khan & Manaullah Abid, 2022. "A Survey on IoT-Enabled Smart Grids: Technologies, Architectures, Applications, and Challenges," Sustainability, MDPI, vol. 15(1), pages 1-26, December.
    10. Arash Moradzadeh & Sahar Zakeri & Maryam Shoaran & Behnam Mohammadi-Ivatloo & Fazel Mohammadi, 2020. "Short-Term Load Forecasting of Microgrid via Hybrid Support Vector Regression and Long Short-Term Memory Algorithms," Sustainability, MDPI, vol. 12(17), pages 1-17, August.
    11. Arash Moradzadeh & Sahar Zakeri & Waleed A. Oraibi & Behnam Mohammadi-Ivatloo & Zulkurnain Abdul-Malek & Reza Ghorbani, 2022. "Non-Intrusive Load Monitoring of Residential Loads via Laplacian Eigenmaps and Hybrid Deep Learning Procedures," Sustainability, MDPI, vol. 14(22), pages 1-16, November.
    12. Filippos Ioannidis & Kyriaki Kosmidou & Kostas Andriosopoulos & Antigoni Everkiadi, 2021. "Assessment of the Target Model Implementation in the Wholesale Electricity Market of Greece," Energies, MDPI, vol. 14(19), pages 1-22, October.
    13. Edgardo Cayon & Julio Sarmiento, 2022. "The Impact of Coskewness and Cokurtosis as Augmentation Factors in Modeling Colombian Electricity Price Returns," Energies, MDPI, vol. 15(19), pages 1-8, September.
    14. Apergis, Nicholas & Pan, Wei-Fong & Reade, James & Wang, Shixuan, 2023. "Modelling Australian electricity prices using indicator saturation," Energy Economics, Elsevier, vol. 120(C).
    15. Angelos Patsidis & Adam Dyśko & Campbell Booth & Anastasios Oulis Rousis & Polyxeni Kalliga & Dimitrios Tzelepis, 2023. "Digital Architecture for Monitoring and Operational Analytics of Multi-Vector Microgrids Utilizing Cloud Computing, Advanced Virtualization Techniques, and Data Analytics Methods," Energies, MDPI, vol. 16(16), pages 1-19, August.
    16. Wadim Strielkowski & Andrey Vlasov & Kirill Selivanov & Konstantin Muraviev & Vadim Shakhnov, 2023. "Prospects and Challenges of the Machine Learning and Data-Driven Methods for the Predictive Analysis of Power Systems: A Review," Energies, MDPI, vol. 16(10), pages 1-31, May.
    17. Nametala, Ciniro Aparecido Leite & Faria, Wandry Rodrigues & Lage, Guilherme Guimarães & Pereira, Benvindo Rodrigues, 2023. "Analysis of hourly price granularity implementation in the Brazilian deregulated electricity contracting environment," Utilities Policy, Elsevier, vol. 81(C).
    18. Rassi, Samin & Kanamura, Takashi, 2023. "Electricity price spike formation and LNG prices effect under gross bidding scheme in JEPX," Energy Policy, Elsevier, vol. 177(C).
    19. Omid Sadeghian & Arash Moradzadeh & Behnam Mohammadi-Ivatloo & Mehdi Abapour & Fausto Pedro Garcia Marquez, 2020. "Generation Units Maintenance in Combined Heat and Power Integrated Systems Using the Mixed Integer Quadratic Programming Approach," Energies, MDPI, vol. 13(11), pages 1-25, June.
    20. Sikorska-Pastuszka, Magdalena & Papież, Monika, 2023. "Dynamic volatility connectedness in the European electricity market," Energy Economics, Elsevier, vol. 127(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:20:p:7557-:d:941265. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.