IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v17y2025i2p559-d1565598.html

The Role of Learning Analytics in Evaluating Course Effectiveness

Author

Listed:
  • Billy T. M. Wong

    (Institute for Research in Open and Innovative Education, Hong Kong Metropolitan University, Homantin, Kowloon, Hong Kong, China)

  • Kam Cheong Li

    (Institute for Research in Open and Innovative Education, Hong Kong Metropolitan University, Homantin, Kowloon, Hong Kong, China)

  • Mengjin Liu

    (Institute for Research in Open and Innovative Education, Hong Kong Metropolitan University, Homantin, Kowloon, Hong Kong, China)

Abstract

This study aims to examine the use of learning analytics in course evaluation within higher education institutions, in order to identify effective methodologies and best practices for leveraging data to improve educational effectiveness. Following the PRISMA guidelines, a systematic literature search was conducted in Scopus, yielding 34 relevant studies published between 2015 and 2024 for analysis. The results reveal six key categories of learning analytics applications: sentiment analysis, questionnaire analysis, engagement analysis, topic classification, predictive modelling, and performance analysis. The data sources for learning analytics applications primarily include questionnaires and learning management systems. While descriptive analysis was found to be the most commonly employed analytical technique, advanced techniques such as machine learning, artificial intelligence, and social network analysis are becoming more prominent. The studies addressed a wide range of elements associated with course evaluation, including course design, content quality, assignments, instructional strategies, workload, feedback mechanisms, and the integration of technology. These findings highlight the importance of adopting holistic approaches to capture the multifaceted nature of student experiences. This study also uncovers major limitations in the existing research, such as small sample sizes, potential biases due to the use of survey-based methods, and challenges in generalising findings across disciplines. These insights underscore the need for further research to enhance the methodologies used in course evaluations. This study contributes to advancing learning analytics practices and emphasises the importance of innovative approaches for evaluating and improving course effectiveness.

Suggested Citation

  • Billy T. M. Wong & Kam Cheong Li & Mengjin Liu, 2025. "The Role of Learning Analytics in Evaluating Course Effectiveness," Sustainability, MDPI, vol. 17(2), pages 1-22, January.
    • Handle: RePEc:gam:jsusta:v:17:y:2025:i:2:p:559-:d:1565598
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/17/2/559/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/17/2/559/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Billy T. M. Wong & Kam Cheong Li & Hon Tung Chan & Simon K. S. Cheung, 2023. "HyFlex Learning Research and Practice: A Longitudinal Analysis," Sustainability, MDPI, vol. 15(12), pages 1-18, June.
    2. Rosemary J. Avery & W. Keith Bryant & Alan Mathios & Hyojin Kang & Duncan Bell, 2006. "Electronic Course Evaluations: Does an Online Delivery System Influence Student Evaluations?," The Journal of Economic Education, Taylor & Francis Journals, vol. 37(1), pages 21-37, January.
    3. Philippe Mongeon & Adèle Paul-Hus, 2016. "The journal coverage of Web of Science and Scopus: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 213-228, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maribel Vega-Arce & Gonzalo Salas & Gastón Núñez-Ulloa & Cristián Pinto-Cortez & Ivelisse Torres Fernandez & Yuh-Shan Ho, 2019. "Research performance and trends in child sexual abuse research: a Science Citation Index Expanded-based analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1505-1525, December.
    2. Serhat Burmaoglu & Ozcan Saritas, 2019. "An evolutionary analysis of the innovation policy domain: Is there a paradigm shift?," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 823-847, March.
    3. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    4. Mohd Rizaimy Shaharudin & Azyyati Anuar & Preecha Wararatchai & Natapat Areerakulkan & Wissawa Aunyawong, 2025. "Drivers and Constraints of Remanufacturing: A Global Bibliometric Review," Information Management and Business Review, AMH International, vol. 17(4), pages 141-163.
    5. Mike Thelwall, 2020. "Mid-career field switches reduce gender disparities in academic publishing," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1365-1383, June.
    6. Nasrabadi, Mohamadreza Azar & Beauregard, Yvan & Ekhlassi, Amir, 2024. "The implication of user-generated content in new product development process: A systematic literature review and future research agenda," Technological Forecasting and Social Change, Elsevier, vol. 206(C).
    7. Mansoureh Beheshti Nejad & Seyed Mahmoud Zanjirchi & Seyed Mojtaba Hosseini Bamakan & Negar Jalilian, 2024. "Blockchain Adoption in Operations Management: A Systematic Literature Review of 14 Years of Research," Annals of Data Science, Springer, vol. 11(4), pages 1361-1389, August.
    8. Pantea Kamrani & Isabelle Dorsch & Wolfgang G. Stock, 2021. "Do researchers know what the h-index is? And how do they estimate its importance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5489-5508, July.
    9. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    10. Théodore Nikiema & Eugène C. Ezin & Sylvain Kpenavoun Chogou, 2023. "Bibliometric Analysis of the State of Research on Agroecology Adoption and Methods Used for Its Assessment," Sustainability, MDPI, vol. 15(21), pages 1-18, November.
    11. Maurer, Moritz, 2025. "Wild Experiments? Restricting Narratives in Research on Alternative Food and Agriculture Networks," OSF Preprints u2tyv, Center for Open Science.
    12. María Fernanda Carnero Quispe & Lucciana Débora Chambilla Mamani & Hugo Tsugunobu Yoshida Yoshizaki & Irineu de Brito Junior, 2025. "Temporary Facility Location Problem in Humanitarian Logistics: A Systematic Literature Review," Logistics, MDPI, vol. 9(1), pages 1-27, March.
    13. Abdulkarim. K. Alhowaish, 2025. "The Blue Economy in the Arabian Gulf: Trends, Gaps, and Pathways for Sustainable Coastal Development," Sustainability, MDPI, vol. 17(19), pages 1-24, October.
    14. Manuel Sánchez-Pérez & Nuria Rueda-López & María Belén Marín-Carrillo & Eduardo Terán-Yépez, 2021. "Theoretical dilemmas, conceptual review and perspectives disclosure of the sharing economy: a qualitative analysis," Review of Managerial Science, Springer, vol. 15(7), pages 1849-1883, October.
    15. Stephen, Dimity & Stahlschmidt, Stephan, 2021. "Performance and structures of the German science system 2021," Studien zum deutschen Innovationssystem 5-2021, Expertenkommission Forschung und Innovation (EFI) - Commission of Experts for Research and Innovation, Berlin.
    16. Simon Zaby, 2019. "Science Mapping of the Global Knowledge Base on Microfinance: Influential Authors and Documents, 1989–2019," Sustainability, MDPI, vol. 11(14), pages 1-21, July.
    17. Ana Batlles-delaFuente & Luis Jesús Belmonte-Ureña & José Antonio Plaza-Úbeda & Emilio Abad-Segura, 2021. "Sustainable Business Model in the Product-Service System: Analysis of Global Research and Associated EU Legislation," IJERPH, MDPI, vol. 18(19), pages 1-33, September.
    18. Katarzyna Piwowar‐Sulej, 2021. "Core functions of Sustainable Human Resource Management. A hybrid literature review with the use of H‐Classics methodology," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(4), pages 671-693, July.
    19. Abderahman Rejeb & Karim Rejeb & Yasanur Kayikci & Andrea Appolloni & Horst Treiblmaier, 2024. "Mapping the knowledge domain of green procurement: a review and bibliometric analysis," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(12), pages 30027-30061, December.
    20. Myriam Dunn Cavelty, 2018. "Cybersecurity Research Meets Science and Technology Studies," Politics and Governance, Cogitatio Press, vol. 6(2), pages 22-30.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:17:y:2025:i:2:p:559-:d:1565598. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.