IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v17y2025i21p9508-d1779672.html
   My bibliography  Save this article

Custom Generative Artificial Intelligence Tutors in Action: An Experimental Evaluation of Prompt Strategies in STEM Education

Author

Listed:
  • Rok Gabrovšek

    (Faculty of Education, University of Ljubljana, Kardeljeva Ploščad 16, SI-1000 Ljubljana, Slovenia)

  • David Rihtaršič

    (Faculty of Education, University of Ljubljana, Kardeljeva Ploščad 16, SI-1000 Ljubljana, Slovenia)

Abstract

The integration of generative artificial intelligence, particularly large language models, into education presents opportunities for both personalised learning and pedagogical challenges. This study focuses on electrical engineering laboratory education. We developed a configurable prototype of a generative artificial intelligence powered tutoring tool, implemented it in an undergraduate electrical engineering laboratory course, and analysed 208 student–tutoring tool interactions using a mixed-methods approach that combined research team evaluation with learner feedback. The findings show that student prompts were predominantly procedural or factual, with limited conceptual or metacognitive engagement. Structured prompt styles produced clearer and more coherent responses and were rated the highest by students, while approaches aimed at fostering reasoning and reflection were valued mainly by the research team for their pedagogical depth. This contrast highlights a consistent preference–pedagogy gap, indicating the need to embed stronger instructional guidance into artificial intelligence tutoring. To bridge this gap, a promising direction is the development of pedagogically enriched AI tutors that integrate features such as adaptive prompting, hybrid strategy blending, and retrieval-augmented feedback to balance clarity, engagement, and depth. The results provide practical and conceptual value relevant to educators, developers, and researchers interested in artificial intelligence tutors that are both engaging and pedagogically sound. For educators, the study clarifies how students interact with tutors, helping align artificial intelligence use with instructional goals. For developers, it highlights the importance of designing systems that combine usability with educational value. For researchers, the findings identify directions for further study on how design choices in artificial intelligence tutoring affect learning processes and pedagogical alignment across STEM contexts. On a broader level, the study contributes to a more transparent, equitable, and sustainable integration of generative AI in education.

Suggested Citation

  • Rok Gabrovšek & David Rihtaršič, 2025. "Custom Generative Artificial Intelligence Tutors in Action: An Experimental Evaluation of Prompt Strategies in STEM Education," Sustainability, MDPI, vol. 17(21), pages 1-20, October.
  • Handle: RePEc:gam:jsusta:v:17:y:2025:i:21:p:9508-:d:1779672
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/17/21/9508/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/17/21/9508/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Janik Ole Wecks & Johannes Voshaar & Benedikt Jost Plate & Jochen Zimmermann, 2024. "Generative AI Usage and Exam Performance," Papers 2404.19699, arXiv.org, revised Nov 2024.
    2. Brina Kurent & Stanislav Avsec, 2024. "Synergizing Systems Thinking and Technology-Enhanced Learning for Sustainable Education Using the Flow Theory Framework," Sustainability, MDPI, vol. 16(21), pages 1-42, October.
    3. Prema Nedungadi & Kai-Yu Tang & Raghu Raman, 2024. "The Transformative Power of Generative Artificial Intelligence for Achieving the Sustainable Development Goal of Quality Education," Sustainability, MDPI, vol. 16(22), pages 1-27, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahmed Sadek Abdelmagid & Naif Mohammed Jabli & Abdullah Yahya Al-Mohaya & Ahmed Ali Teleb, 2025. "Integrating Interactive Metaverse Environments and Generative Artificial Intelligence to Promote the Green Digital Economy and e-Entrepreneurship in Higher Education," Sustainability, MDPI, vol. 17(12), pages 1-30, June.
    2. Nur ‘Amirah Mhd Noh & Ahmad Amru Mohamad Zaid & Rabeah Md Zin, 2025. "Transforming Teaching and Learning through LIFT: A Structured Dashboard for Education 5.0," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(22), pages 15-20, October.
    3. Jorge Buele & Ángel Ramón Sabando-García & Bosco Javier Sabando-García & Hugo Yánez-Rueda, 2025. "Ethical Use of Generative Artificial Intelligence Among Ecuadorian University Students," Sustainability, MDPI, vol. 17(10), pages 1-16, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:17:y:2025:i:21:p:9508-:d:1779672. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.