IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i20p13446-d946101.html
   My bibliography  Save this article

Interpretable Success Prediction in Higher Education Institutions Using Pedagogical Surveys

Author

Listed:
  • Fátima Leal

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal)

  • Bruno Veloso

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    INESC TEC—Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 4200-465 Porto, Portugal)

  • Carla Santos Pereira

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal)

  • Fernando Moreira

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal
    IE et A—Institute of Electronics and Informatics Engineering, University of Aveiro, 3810-193 Aveiro, Portugal)

  • Natércia Durão

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal)

  • Natacha Jesus Silva

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal)

Abstract

The indicators of student success at higher education institutions are continuously analysed to increase the students’ enrolment in multiple scientific areas. Every semester, the students respond to a pedagogical survey that aims to collect the student opinion of curricular units in terms of content and teaching methodologies. Using this information, we intend to anticipate the success in higher-level courses and prevent dropouts. Specifically, this paper contributes with an interpretable student classification method. The proposed solution relies on (i) a pedagogical survey to collect student’s opinions; (ii) a statistical data analysis to validate the reliability of the survey; and (iii) machine learning algorithms to classify the success of a student. In addition, the proposed method includes an explainable mechanism to interpret the classifications and their main factors. This transparent pipeline was designed to have implications in both digital and sustainable education, impacting the three pillars of sustainability, i.e.,economic, social, and environmental, where transparency is a cornerstone. The work was assessed with a dataset from a Portuguese higher-level institution, contemplating multiple courses from different departments. The most promising results were achieved with Random Forest presenting 98% in accuracy and F -measure.

Suggested Citation

  • Fátima Leal & Bruno Veloso & Carla Santos Pereira & Fernando Moreira & Natércia Durão & Natacha Jesus Silva, 2022. "Interpretable Success Prediction in Higher Education Institutions Using Pedagogical Surveys," Sustainability, MDPI, vol. 14(20), pages 1-18, October.
  • Handle: RePEc:gam:jsusta:v:14:y:2022:i:20:p:13446-:d:946101
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/20/13446/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/14/20/13446/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. María del Carmen Olmos-Gómez & Mónica Luque Suárez & Concetta Ferrara & Eva María Olmedo-Moreno, 2020. "Quality of Higher Education through the Pursuit of Satisfaction with a Focus on Sustainability," Sustainability, MDPI, vol. 12(6), pages 1-20, March.
    2. Rosa María Brito & Columba Rodríguez & José Luis Aparicio, 2018. "Sustainability in Teaching: An Evaluation of University Teachers and Students," Sustainability, MDPI, vol. 10(2), pages 1-16, February.
    3. Mahdi M. Alamri & Mohammed Amin Almaiah & Waleed Mugahed Al-Rahmi, 2020. "Social Media Applications Affecting Students’ Academic Performance: A Model Developed for Sustainability in Higher Education," Sustainability, MDPI, vol. 12(16), pages 1-14, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ali Mugahed Al-Rahmi & Alina Shamsuddin & Uthman Alturki & Ahmed Aldraiweesh & Farahwahida Mohd Yusof & Waleed Mugahed Al-Rahmi & Abdulmajeed A. Aljeraiwi, 2021. "The Influence of Information System Success and Technology Acceptance Model on Social Media Factors in Education," Sustainability, MDPI, vol. 13(14), pages 1-23, July.
    2. Quetzalcoatl Hernandez-Escobedo & Alida Ramirez-Jimenez & Jesús Manuel Dorador-Gonzalez & Miguel-Angel Perea-Moreno & Alberto-Jesus Perea-Moreno, 2020. "Sustainable Solar Energy in Mexican Universities. Case Study: The National School of Higher Studies Juriquilla (UNAM)," Sustainability, MDPI, vol. 12(8), pages 1-22, April.
    3. Alexander K. Killion & Jessica Ostrow Michel & Jason K. Hawes, 2022. "Toward Identifying Sustainability Leadership Competencies: Insights from Mapping a Graduate Sustainability Education Curriculum," Sustainability, MDPI, vol. 14(10), pages 1-18, May.
    4. María del Carmen Olmos-Gómez & Mónica Luque-Suárez & Diego Becerril-Ruiz & Jesús Manuel Cuevas-Rincón, 2021. "Gender and Socioeconomic Status as Factors of Individual Differences in Pre-University Students’ Decision-Making for Careers, with a Focus on Family Influence and Psychosocial Factors," IJERPH, MDPI, vol. 18(3), pages 1-12, February.
    5. Ling Wang & Gongliang Hu & Tiehua Zhou, 2018. "Semantic Analysis of Learners’ Emotional Tendencies on Online MOOC Education," Sustainability, MDPI, vol. 10(6), pages 1-19, June.
    6. Cristina Dimulescu, 2023. "E-Learning Platform Usage and Acceptance of Technology after the COVID-19 Pandemic: The Case of Transilvania University," Sustainability, MDPI, vol. 15(22), pages 1-26, November.
    7. Uthman Alturki & Ahmed Aldraiweesh, 2021. "Application of Learning Management System (LMS) during the COVID-19 Pandemic: A Sustainable Acceptance Model of the Expansion Technology Approach," Sustainability, MDPI, vol. 13(19), pages 1-16, October.
    8. María del Carmen Olmos-Gómez, 2020. "Sex and Careers of University Students in Educational Practices as Factors of Individual Differences in Learning Environment and Psychological Factors during COVID-19," IJERPH, MDPI, vol. 17(14), pages 1-19, July.
    9. Ambika Zutshi & Andrew Creed & Brian L. Connelly, 2018. "Education for Sustainable Development: Emerging Themes from Adopters of a Declaration," Sustainability, MDPI, vol. 11(1), pages 1-15, December.
    10. Katerina Tzafilkou & Liliana Mâță & Gabriela Livia Curpănaru & Ionuț Viorel Stoica & Lucian Nicolae Voinea & Constantin Șufaru, 2022. "A Comprehensive Instrument to Measure Teachers’ Attitude towards Quality Management in the Context of Online Education," IJERPH, MDPI, vol. 19(3), pages 1-16, January.
    11. Amer Mutrik Sayaf & Mahdi Mohammed Alamri & Mohammed Ayid Alqahtani & Waleed Mugahed Al-Rahmi, 2021. "Information and Communications Technology Used in Higher Education: An Empirical Study on Digital Learning as Sustainability," Sustainability, MDPI, vol. 13(13), pages 1-19, June.
    12. Yifan Liu & Tiantian Bao & Dan Zhao & Huiyun Sang & Benwei Fu, 2022. "Evaluation of Student-Perceived Service Quality in Higher Education for Sustainable Development: A Fuzzy TODIM-ERA Method," Sustainability, MDPI, vol. 14(8), pages 1-21, April.
    13. Romana Aziz & Ala Saleh Alluhaidan, 2022. "Are we good enough? A measurement for Information Technology Service Quality (ITSQ) in higher education institutions in Saudi Arabia," PLOS ONE, Public Library of Science, vol. 17(11), pages 1-14, November.
    14. Hanns de la Fuente-Mella & Ricardo Campos-Espinoza & Nelson Lay-Raby & Omar Lamelés-Corvalán & Mario Pino-Moya & Reynier Ramírez-Molina, 2022. "Multinomial Cross-Sectional Regression Models to Estimate and Predict the Determinants of Academic Performance: The Case of Auditor Accountant of the Pontifical Catholic University of Valparaíso," Sustainability, MDPI, vol. 14(15), pages 1-15, July.
    15. Rishaa Abdulaziz Alnajim & Bahjat Fakieh, 2023. "A Tourist-Based Framework for Developing Digital Marketing for Small and Medium-Sized Enterprises in the Tourism Sector in Saudi Arabia," Data, MDPI, vol. 8(12), pages 1-33, November.
    16. María del Carmen Olmos-Gómez & Mónica Luque-Suárez & Soraya Mohamed-Mohamed & Jesús Manuel Cuevas-Rincón, 2020. "Validation of the Smart City as a Sustainable Development Knowledge Tool: The Challenge of Using Technologies in Education during COVID-19," Sustainability, MDPI, vol. 12(20), pages 1-18, October.
    17. Rosa María Brito & Columba Rodríguez & José Luis Aparicio & Jerome Paolacci & María Laura Sampedro & Juana Beltrán, 2018. "Indicators of Sustainability in Educational Practice: Perception of Teachers and Students of UAGro-Mexico," Sustainability, MDPI, vol. 10(10), pages 1-18, October.
    18. Salman Zulfiqar & Hamad A. Al-reshidi & Moteeb A. Al Moteri & Hafiz Muhammad Basit Feroz & Noraffandy Yahya & Waleed Mugahed Al-Rahmi, 2021. "Understanding and Predicting Students’ Entrepreneurial Intention through Business Simulation Games: A Perspective of COVID-19," Sustainability, MDPI, vol. 13(4), pages 1-27, February.
    19. Amila Omazic & Bernd Markus Zunk, 2021. "Semi-Systematic Literature Review on Sustainability and Sustainable Development in Higher Education Institutions," Sustainability, MDPI, vol. 13(14), pages 1-45, July.
    20. Gabriela-Livia Curpanaru, 2021. "Quality Management and Leadership in Education," Book chapters-LUMEN Proceedings, in: Otilia Clipa (ed.), ATEE 2020 - Winter Conference. Teacher Education for Promoting Well-Being in School. Suceava, 2020, edition 1, volume 16, chapter 11, pages 149-162, Editura Lumen.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:20:p:13446-:d:946101. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.