IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i24p7933-d1295144.html
   My bibliography  Save this article

Denoising Masked Autoencoder-Based Missing Imputation within Constrained Environments for Electric Load Data

Author

Listed:
  • Jaeik Jeong

    (Energy ICT Research Section, Electronics and Telecommunications Research Institute, Daejeon 34129, Republic of Korea)

  • Tai-Yeon Ku

    (Energy ICT Research Section, Electronics and Telecommunications Research Institute, Daejeon 34129, Republic of Korea)

  • Wan-Ki Park

    (Energy ICT Research Section, Electronics and Telecommunications Research Institute, Daejeon 34129, Republic of Korea)

Abstract

With recent advancements in data technologies, particularly machine learning, research focusing on the enhancement of energy efficiency in residential, commercial, and industrial settings through the collection of load data, such as heat, electricity, and gas, has gained significant attention. Nevertheless, issues arising from hardware- or network-related problems can result in missing data, necessitating the development of management techniques to mitigate these challenges. Traditional methods for missing imputation face difficulties when operating in constrained environments characterized by short data collection periods and frequent consecutive missing. In this paper, we introduce the denoising masked autoencoder (DMAE) model as a solution to improve the handling of missing data, even in such restrictive settings. The proposed DMAE model capitalizes on the advantages of the denoising autoencoder (DAE), enabling effective learning of the missing imputation process, even with relatively small datasets, and the masked autoencoder (MAE), allowing for learning in environments with a high missing ratio. By integrating these strengths, the DMAE model achieves an enhanced performance in terms of missing imputation. The simulation results demonstrate that the proposed DMAE model outperforms the DAE or MAE significantly in a constrained environment where the duration of the training data is short, less than a year, and missing values occur frequently with durations ranging from 3 h to 12 h.

Suggested Citation

  • Jaeik Jeong & Tai-Yeon Ku & Wan-Ki Park, 2023. "Denoising Masked Autoencoder-Based Missing Imputation within Constrained Environments for Electric Load Data," Energies, MDPI, vol. 16(24), pages 1-18, December.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:24:p:7933-:d:1295144
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/24/7933/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/24/7933/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jeong, Dongyeon & Park, Chiwoo & Ko, Young Myoung, 2021. "Missing data imputation using mixture factor analysis for building electric load data," Applied Energy, Elsevier, vol. 304(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liguori, Antonio & Markovic, Romana & Ferrando, Martina & Frisch, Jérôme & Causone, Francesco & van Treeck, Christoph, 2023. "Augmenting energy time-series for data-efficient imputation of missing values," Applied Energy, Elsevier, vol. 334(C).
    2. Liu, Liqi & Liu, Yanli, 2022. "Load image inpainting: An improved U-Net based load missing data recovery method," Applied Energy, Elsevier, vol. 327(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:24:p:7933-:d:1295144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.