IDEAS home Printed from https://ideas.repec.org/a/ibn/hesjnl/v15y2025i2p189.html
   My bibliography  Save this article

Meta-Analysis of Artificial Intelligence in Education

Author

Listed:
  • Jincheng Zhang
  • Thada Jantakoon
  • Rukthin Laoha

Abstract

This meta-analysis examined the effectiveness of artificial intelligence (AI) technologies in educational settings through a systematic review of 13 empirical studies conducted across eight countries. We analysed the impact of various AI technologies on educational outcomes using PRISMA guidelines and multiple analytical approaches, including novel applications of Naive Bayes, TF-IDF, and BERT-based algorithms. The overall analysis revealed a significant positive effect size (Hedges' g = 0.86, 95% CI [0.45, 1.27], p < 0.0001), indicating substantial benefits of AI integration in education. Particularly noteworthy were the effects of chatbots and generative AI (effect size = 1.02, 95% CI [0.45, 1.59], p < 0.0001), which demonstrated the most substantial positive impact on student learning outcomes. Online learning and virtual reality applications showed moderate positive effects (effect size = 0.79, 95% CI [-0.04, 1.62], p < 0.07) while learning management systems and AI platforms demonstrated promising but more modest impacts (effect size = 0.62, 95% CI [0.03, 1.21], p < 0.05). Although significant heterogeneity was observed across studies (I² ranging from 54.03% to 93.23%), the consistent positive effects across different educational contexts suggest the robust potential of AI technologies in enhancing educational practices. Implementing a novel weighted hybrid model, combining random and fixed effects approaches, provided additional methodological insights for analysing educational technology effectiveness. These findings provide empirical support for integrating AI technologies in educational settings while highlighting the importance of considering specific contextual factors and implementation strategies for optimal outcomes.

Suggested Citation

  • Jincheng Zhang & Thada Jantakoon & Rukthin Laoha, 2025. "Meta-Analysis of Artificial Intelligence in Education," Higher Education Studies, Canadian Center of Science and Education, vol. 15(2), pages 189-189, May.
    • Handle: RePEc:ibn:hesjnl:v:15:y:2025:i:2:p:189
    as

    Download full text from publisher

    File URL: https://ccsenet.org/journal/index.php/hes/article/download/0/0/51474/55925
    Download Restriction: no
    File URL: https://ccsenet.org/journal/index.php/hes/article/view/0/51474
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xinjie Deng & Zhonggen Yu, 2023. "A Meta-Analysis and Systematic Review of the Effect of Chatbot Technology Use in Sustainable Education," Sustainability, MDPI, vol. 15(4), pages 1-19, February.
    2. Bing Chen & Yunqing Wang & Lianghui Wang, 2022. "The Effects of Virtual Reality-Assisted Language Learning: A Meta-Analysis," Sustainability, MDPI, vol. 14(6), pages 1-18, March.
    3. Farhan Mohammed Alshammary & Waleed Salim Alhalafawy, 2023. "Digital Platforms and the Improvement of Learning Outcomes: Evidence Extracted from Meta-Analysis," Sustainability, MDPI, vol. 15(2), pages 1-21, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jean Chiu & Hsing-Lung Lien, 2025. "Bridging the Gap: Value-Based Strategies in Virtual Reality Integration for Developing SDG 13 and Global Competence," Sustainability, MDPI, vol. 17(12), pages 1-16, June.
    2. Kristaps Lesinskis & Inese Mavlutova & Aivars Spilbergs & Janis Hermanis, 2023. "Digital Transformation in Entrepreneurship Education: The Use of a Digital Tool KABADA and Entrepreneurial Intention of Generation Z," Sustainability, MDPI, vol. 15(13), pages 1-20, June.
    3. Goran Bubaš & Antonela Čižmešija & Andreja Kovačić, 2023. "Development of an Assessment Scale for Measurement of Usability and User Experience Characteristics of Bing Chat Conversational AI," Future Internet, MDPI, vol. 16(1), pages 1-19, December.
    4. Jibon Naher, 2023. "A Survey to Understand the experience of ChatGPT Usage among Engineering University Students in Bangladesh," Technium, Technium Science, vol. 15(1), pages 1-8.
    5. Fahd Kamis Alzahrani & Waleed Salim Alhalafawy, 2023. "Gamification for Learning Sustainability in the Blackboard System: Motivators and Obstacles from Faculty Members’ Perspectives," Sustainability, MDPI, vol. 15(5), pages 1-19, March.
    6. Johan @ Eddy Luaran & Kyra Aqilah Binti Jamal & Jasmine Jain, 2025. "Immersive Learning Environment: Investigating Student Engagement, Retention and Learning Outcomes in Using Virtual Reality (VR) and Augemented Reality (AR) in Teaching and Learning," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(4), pages 3119-3125, April.
    7. Eva Milkova & Mirela Moldoveanu & Tomas Krcil, 2025. "Sustainable Education Through Information and Communication Technology: A Case Study on Enhancing Digital Competence and Academic Performance of Social Science Higher Education Students," Sustainability, MDPI, vol. 17(10), pages 1-20, May.
    8. Ali Hassan Najmi & Waleed Salim Alhalafawy & Marwa Zaki Tawfiq Zaki, 2023. "Developing a Sustainable Environment Based on Augmented Reality to Educate Adolescents about the Dangers of Electronic Gaming Addiction," Sustainability, MDPI, vol. 15(4), pages 1-22, February.
    9. Maria Karyotaki & Athanasios Drigas & Charalabos Skianis, 2024. "Contributions of the 9-Layered Model of Giftedness to the Development of a Conversational Agent for Healthy Ageing and Sustainable Living," Sustainability, MDPI, vol. 16(7), pages 1-18, March.
    10. Fathi M. Abunaser & Mohamed Mostafa Mohamed Hamd & Asma Mubarak Nasser Bani-Oraba & Omer Hamed & Maen Qasem Mohamad Alshiyab & Zubaida Shebani, 2025. "Dynamic Capabilities of University Administration and Their Impact on Student Awareness of Artificial Intelligence Tools," Sustainability, MDPI, vol. 17(15), pages 1-25, August.
    11. Carlos Cacciuttolo & Yaneth Vásquez & Deyvis Cano & Fernando Valenzuela, 2023. "Research Thesis for Undergraduate Engineering Programs in the Digitalization Era: Learning Strategies and Responsible Research Conduct Road to a University Education 4.0 Paradigm," Sustainability, MDPI, vol. 15(14), pages 1-27, July.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:hesjnl:v:15:y:2025:i:2:p:189. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.