IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v13y2021i8p193-d602327.html
   My bibliography  Save this article

Education 4.0: Teaching the Basics of KNN, LDA and Simple Perceptron Algorithms for Binary Classification Problems

Author

Listed:
  • Diego Lopez-Bernal

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

  • David Balderas

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

  • Pedro Ponce

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

  • Arturo Molina

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

Abstract

One of the main focuses of Education 4.0 is to provide students with knowledge on disruptive technologies, such as Machine Learning (ML), as well as the skills to implement this knowledge to solve real-life problems. Therefore, both students and professors require teaching and learning tools that facilitate the introduction to such topics. Consequently, this study looks forward to contributing to the development of those tools by introducing the basic theory behind three machine learning classifying algorithms: K-Nearest-Neighbor (KNN), Linear Discriminant Analysis (LDA), and Simple Perceptron; as well as discussing the diverse advantages and disadvantages of each method. Moreover, it is proposed to analyze how these methods work on different conditions through their implementation over a test bench. Thus, in addition to the description of each algorithm, we discuss their application to solving three different binary classification problems using three different datasets, as well as comparing their performances in these specific case studies. The findings of this study can be used by teachers to provide students the basic knowledge of KNN, LDA, and perceptron algorithms, and, at the same time, it can be used as a guide to learn how to apply them to solve real-life problems that are not limited to the presented datasets.

Suggested Citation

  • Diego Lopez-Bernal & David Balderas & Pedro Ponce & Arturo Molina, 2021. "Education 4.0: Teaching the Basics of KNN, LDA and Simple Perceptron Algorithms for Binary Classification Problems," Future Internet, MDPI, vol. 13(8), pages 1-14, July.
    • Handle: RePEc:gam:jftint:v:13:y:2021:i:8:p:193-:d:602327
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/13/8/193/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1999-5903/13/8/193/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Voyant, Cyril & Notton, Gilles & Kalogirou, Soteris & Nivet, Marie-Laure & Paoli, Christophe & Motte, Fabrice & Fouilloy, Alexis, 2017. "Machine learning methods for solar radiation forecasting: A review," Renewable Energy, Elsevier, vol. 105(C), pages 569-582.
    2. Niraj Thapa & Zhipeng Liu & Dukka B. KC & Balakrishna Gokaraju & Kaushik Roy, 2020. "Comparison of Machine Learning and Deep Learning Models for Network Intrusion Detection Systems," Future Internet, MDPI, vol. 12(10), pages 1-16, September.
    3. Giulia Bressan & Giulia Cisotto & Gernot R. Müller-Putz & Selina Christin Wriessnegger, 2021. "Deep Learning-Based Classification of Fine Hand Movements from Low Frequency EEG," Future Internet, MDPI, vol. 13(5), pages 1-14, April.
    4. Rajagopal, 2015. "Market Trend Analysis," Palgrave Macmillan Books, in: The Butterfly Effect in Competitive Markets, chapter 4, pages 95-118, Palgrave Macmillan.
    5. Eric Hitimana & Gaurav Bajpai & Richard Musabe & Louis Sibomana & Jayavel Kayalvizhi, 2021. "Implementation of IoT Framework with Data Analysis Using Deep Learning Methods for Occupancy Prediction in a Building," Future Internet, MDPI, vol. 13(3), pages 1-19, March.
    6. Guillermo Rodríguez-Abitia & Graciela Bribiesca-Correa, 2021. "Assessing Digital Transformation in Universities," Future Internet, MDPI, vol. 13(2), pages 1-16, February.
    7. Heinermann, Justin & Kramer, Oliver, 2016. "Machine learning ensembles for wind power prediction," Renewable Energy, Elsevier, vol. 89(C), pages 671-679.
    8. Ping Zhang & Rongqin Wang & Nianfeng Shi, 2020. "IgA Nephropathy Prediction in Children with Machine Learning Algorithms," Future Internet, MDPI, vol. 12(12), pages 1-11, December.
    9. J. B. Heaton & N. G. Polson & J. H. Witte, 2017. "Deep learning for finance: deep portfolios," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 33(1), pages 3-12, January.
    10. Zeng, Yu-Rong & Zeng, Yi & Choi, Beomjin & Wang, Lin, 2017. "Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network," Energy, Elsevier, vol. 127(C), pages 381-396.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohammad Mahdi Forootan & Iman Larki & Rahim Zahedi & Abolfazl Ahmadi, 2022. "Machine Learning and Deep Learning in Energy Systems: A Review," Sustainability, MDPI, vol. 14(8), pages 1-49, April.
    2. Sabarathinam Srinivasan & Suresh Kumarasamy & Zacharias E. Andreadakis & Pedro G. Lind, 2023. "Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey," Energies, MDPI, vol. 16(14), pages 1-56, July.
    3. Nam, KiJeon & Hwangbo, Soonho & Yoo, ChangKyoo, 2020. "A deep learning-based forecasting model for renewable energy scenarios to guide sustainable energy policy: A case study of Korea," Renewable and Sustainable Energy Reviews, Elsevier, vol. 122(C).
    4. Dania Ortiz & Vera Migueis & Vitor Leal & Janelle Knox-Hayes & Jungwoo Chun, 2022. "Analysis of Renewable Energy Policies through Decision Trees," Sustainability, MDPI, vol. 14(13), pages 1-31, June.
    5. Rushdi, Mostafa A. & Yoshida, Shigeo & Watanabe, Koichi & Ohya, Yuji, 2021. "Machine learning approaches for thermal updraft prediction in wind solar tower systems," Renewable Energy, Elsevier, vol. 177(C), pages 1001-1013.
    6. Agga, Ali & Abbou, Ahmed & Labbadi, Moussa & El Houm, Yassine, 2021. "Short-term self consumption PV plant power production forecasts based on hybrid CNN-LSTM, ConvLSTM models," Renewable Energy, Elsevier, vol. 177(C), pages 101-112.
    7. Mousavi, Navid & Kothapalli, Ganesh & Habibi, Daryoush & Das, Choton K. & Baniasadi, Ali, 2020. "A novel photovoltaic-pumped hydro storage microgrid applicable to rural areas," Applied Energy, Elsevier, vol. 262(C).
    8. Eleni Kosta, 2022. "Algorithmic state surveillance: Challenging the notion of agency in human rights," Regulation & Governance, John Wiley & Sons, vol. 16(1), pages 212-224, January.
    9. Erik Heilmann & Janosch Henze & Heike Wetzel, 2021. "Machine learning in energy forecasts with an application to high frequency electricity consumption data," MAGKS Papers on Economics 202135, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    10. Ke Yan & Xudong Wang & Yang Du & Ning Jin & Haichao Huang & Hangxia Zhou, 2018. "Multi-Step Short-Term Power Consumption Forecasting with a Hybrid Deep Learning Strategy," Energies, MDPI, vol. 11(11), pages 1-15, November.
    11. Amir Mosavi & Pedram Ghamisi & Yaser Faghan & Puhong Duan, 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," Papers 2004.01509, arXiv.org.
    12. Ping-Huan Kuo & Chiou-Jye Huang, 2018. "A Green Energy Application in Energy Management Systems by an Artificial Intelligence-Based Solar Radiation Forecasting Model," Energies, MDPI, vol. 11(4), pages 1-15, April.
    13. Packey, Daniel J. & Kingsnorth, Dudley, 2016. "The impact of unregulated ionic clay rare earth mining in China," Resources Policy, Elsevier, vol. 48(C), pages 112-116.
    14. Paik, Chunhyun & Chung, Yongjoo & Kim, Young Jin, 2021. "ELCC-based capacity credit estimation accounting for uncertainties in capacity factors and its application to solar power in Korea," Renewable Energy, Elsevier, vol. 164(C), pages 833-841.
    15. Da Liu & Kun Sun & Han Huang & Pingzhou Tang, 2018. "Monthly Load Forecasting Based on Economic Data by Decomposition Integration Theory," Sustainability, MDPI, vol. 10(9), pages 1-22, September.
    16. Beáta Novotná & Ľuboš Jurík & Ján Čimo & Jozef Palkovič & Branislav Chvíla & Vladimír Kišš, 2022. "Machine Learning for Pan Evaporation Modeling in Different Agroclimatic Zones of the Slovak Republic (Macro-Regions)," Sustainability, MDPI, vol. 14(6), pages 1-22, March.
    17. Mostafa A. Rushdi & Ahmad A. Rushdi & Tarek N. Dief & Amr M. Halawa & Shigeo Yoshida & Roland Schmehl, 2020. "Power Prediction of Airborne Wind Energy Systems Using Multivariate Machine Learning," Energies, MDPI, vol. 13(9), pages 1-23, May.
    18. AlSkaif, Tarek & Dev, Soumyabrata & Visser, Lennard & Hossari, Murhaf & van Sark, Wilfried, 2020. "A systematic analysis of meteorological variables for PV output power estimation," Renewable Energy, Elsevier, vol. 153(C), pages 12-22.
    19. Moews, Ben & Ibikunle, Gbenga, 2020. "Predictive intraday correlations in stable and volatile market environments: Evidence from deep learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 547(C).
    20. Stefania Corsaro & Valentina De Simone & Zelda Marino & Salvatore Scognamiglio, 2022. "l 1 -Regularization in Portfolio Selection with Machine Learning," Mathematics, MDPI, vol. 10(4), pages 1-15, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:13:y:2021:i:8:p:193-:d:602327. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.