IDEAS home Printed from https://ideas.repec.org/a/alk/jcsts0/v5y2023i4id8868.html

AI-Driven Data Optimization: Automating Cleaning, Feature Engineering, and Augmentation for Superior Machine Learning Performance in Digital Health Care System

Author

Listed:
  • MD RUSSEL HOSSAIN

    (Washington University of Science and Technology, Master of Science in Information Technology, USA)

  • ESRAT ZAHAN SNIGDHA

    (Washington University of Science and Technology, Master of Science in Information Technology, USA)

  • SHOHONI MAHABUB

    (Washington University of Science and Technology, Master of Science in Information Technology, USA)

Abstract

The primary step of machine learning (ML) requires data preparation since it influences model accuracy along with its operational performance. Standard data preparation tasks that include data cleansing and feature engineering and augmentation require considerable manual labor from experts in addition to their domain expertise plus they are susceptible to human errors. Modern and sophisticated data science needs automated solutions because rising complexity and data volume demand better and easier ML systems. Five key areas of data management including cleaning and engineering are enhanced through automated artificial intelligence technologies for optimizing data preparation operations. AI models equipped with improved imputation techniques together with unsupervised anomaly detection algorithms clean data to address noisy data and missing values with greater efficiency than traditional approaches. Using machine learning techniques for feature engineering allows computers to automatically select and produce important features which reduces the requirement for expert personnel as well as human intervention. AI-powered techniques such as AutoML function to establish optimal features when human design of features is eliminated. GANs and VAEs alongside other generative models enable realistic synthetic data generation for data augmentation purposes which results in better generalization and alleviates data scarcity challenges. The investigation demonstrates through laboratory work alongside real-world case studies how these automated artificial intelligence systems boost both accuracy levels along with system durability and operational speed across multiple ranges of data. Together these results show how automation changes data preparation while giving scalable solutions for modern ML applications which can minimize the need for human intervention in data processing. This study shows that artificial intelligence creates essential approaches for building efficient and effective ML processes which boost model performance while speeding up deployment time.

Suggested Citation

  • Md Russel Hossain & Esrat Zahan Snigdha & Shohoni Mahabub, 2023. "AI-Driven Data Optimization: Automating Cleaning, Feature Engineering, and Augmentation for Superior Machine Learning Performance in Digital Health Care System," Journal of Computer Science and Technology Studies, Al-Kindi Center for Research and Development, vol. 5(4), pages 218-228, October.
  • Handle: RePEc:alk:jcsts0:v:5:y:2023:i:4:id:8868
    DOI: 10.32996/jcsts.2023.5.4.23
    as

    Download full text from publisher

    File URL: https://al-kindipublisher.com/index.php/jcsts/article/view/8868
    File Function: Abstract page
    Download Restriction: no

    File URL: https://al-kindipublisher.com/index.php/jcsts/article/download/8868/7574
    File Function: Full text
    Download Restriction: no

    File URL: https://libkey.io/10.32996/jcsts.2023.5.4.23?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:alk:jcsts0:v:5:y:2023:i:4:id:8868. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Al-Kindi Center for Research and Development (email available below). General contact details of provider: https://al-kindipublisher.com/index.php/jcsts .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.