IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i15p11606-d1203967.html
   My bibliography  Save this article

Research on Learning Concentration Recognition with Multi-Modal Features in Virtual Reality Environments

Author

Listed:
  • Renhe Hu

    (Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua 321004, China)

  • Zihan Hui

    (Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua 321004, China)

  • Yifan Li

    (Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua 321004, China)

  • Jueqi Guan

    (Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua 321004, China)

Abstract

Learning concentration, as a crucial factor influencing learning outcomes, provides the basis for learners’ self-regulation and teachers’ instructional adjustments and intervention decisions. However, the current research on learning concentration recognition lacks the integration of cognitive, emotional, and behavioral features, and the integration of interaction and vision data for recognition requires further exploration. The way data are collected in a head-mounted display differs from that in a traditional classroom or online learning. Therefore, it is vital to explore a recognition method for learning concentration based on multi-modal features in VR environments. This study proposes a multi-modal feature integration-based learning concentration recognition method in VR environments. It combines interaction and vision data, including measurements of interactive tests, text, clickstream, pupil facial expressions, and eye gaze data, to measure learners’ concentration in VR environments in terms of cognitive, emotional, and behavioral representation. The experimental results demonstrate that the proposed method, which integrates interaction and vision data to comprehensively represent the cognitive, emotional, and behavioral dimensions of learning concentration, outperforms single-dimensional and single-type recognition results in terms of accuracy. Additionally, it was found that learners with higher concentration levels achieve better learning outcomes, and learners’ perceived sense of immersion is an important factor influencing their concentration.

Suggested Citation

  • Renhe Hu & Zihan Hui & Yifan Li & Jueqi Guan, 2023. "Research on Learning Concentration Recognition with Multi-Modal Features in Virtual Reality Environments," Sustainability, MDPI, vol. 15(15), pages 1-16, July.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:15:p:11606-:d:1203967
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/15/11606/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/15/11606/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David L. Olson & Dursun Delen, 2008. "Advanced Data Mining Techniques," Springer Books, Springer, number 978-3-540-76917-0, September.
    2. Alan L. Montgomery & Shibo Li & Kannan Srinivasan & John C. Liechty, 2004. "Modeling Online Browsing and Path Analysis Using Clickstream Data," Marketing Science, INFORMS, vol. 23(4), pages 579-595, November.
    3. Fei Li & Jianfeng Jiang & Qingao Qin & Xiaobo Wang & Guoqiang Zeng & Yi Gu & Wentai Guo, 2023. "Application of Sustainable Development of Teaching in Engineering Education: A Case Study of Undergraduate Course Design of Raman Spectroscopy Based on Virtual Reality (VR) Technology," Sustainability, MDPI, vol. 15(3), pages 1-17, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Babur De los Santos & Sergei Koulayev, 2017. "Optimizing Click-Through in Online Rankings with Endogenous Search Refinement," Marketing Science, INFORMS, vol. 36(4), pages 542-564, July.
    2. Yanwen Wang & Chunhua Wu & Ting Zhu, 2019. "Mobile Hailing Technology and Taxi Driving Behaviors," Marketing Science, INFORMS, vol. 38(5), pages 734-755, September.
    3. Vangelis Marinakis & Themistoklis Koutsellis & Alexandros Nikas & Haris Doukas, 2021. "AI and Data Democratisation for Intelligent Energy Management," Energies, MDPI, vol. 14(14), pages 1-14, July.
    4. Mark Gilchrist & Deana Lehmann Mooers & Glenn Skrubbeltrang & Francine Vachon, 2012. "Knowledge Discovery in Databases for Competitive Advantage," Journal of Management and Strategy, Journal of Management and Strategy, Sciedu Press, vol. 3(2), pages 2-15, April.
    5. Kappe, Eelco & Stadler Blank, Ashley & DeSarbo, Wayne S., 2018. "A random coefficients mixture hidden Markov model for marketing research," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 415-431.
    6. Steven M. Shugan, 2005. "Brand Loyalty Programs: Are They Shams?," Marketing Science, INFORMS, vol. 24(2), pages 185-193.
    7. Kris J. Ferreira & Sunanda Parthasarathy & Shreyas Sekar, 2022. "Learning to Rank an Assortment of Products," Management Science, INFORMS, vol. 68(3), pages 1828-1848, March.
    8. Alessandro Acquisti & Hal R. Varian, 2005. "Conditioning Prices on Purchase History," Marketing Science, INFORMS, vol. 24(3), pages 367-381, May.
    9. J. Burez & D. Van Den Poel, 2005. "CRM at a Pay-TV Company: Using Analytical Models to Reduce Customer Attrition by Targeted Marketing for Subscription Services," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 05/348, Ghent University, Faculty of Economics and Business Administration.
    10. Sha Yang & Yi Zhao & Ravi Dhar, 2010. "Modeling the Underreporting Bias in Panel Survey Data," Marketing Science, INFORMS, vol. 29(3), pages 525-539, 05-06.
    11. Benjamin Reed Shiller, 2020. "Approximating Purchase Propensities And Reservation Prices From Broad Consumer Tracking," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(2), pages 847-870, May.
    12. Bergh, Andreas & Funcke, Alexander & Wernberg, Joakim, 2021. "The Sharing Economy: Definition, Measurement and its Relationship to Capitalism," Working Paper Series 1380, Research Institute of Industrial Economics.
    13. Marina Johnson & Abdullah Albizri & Serhat Simsek, 2022. "Artificial intelligence in healthcare operations to enhance treatment outcomes: a framework to predict lung cancer prognosis," Annals of Operations Research, Springer, vol. 308(1), pages 275-305, January.
    14. Herhausen, Dennis & Kleinlercher, Kristina & Verhoef, Peter C. & Emrich, Oliver & Rudolph, Thomas, 2019. "Loyalty Formation for Different Customer Journey Segments," Journal of Retailing, Elsevier, vol. 95(3), pages 9-29.
    15. Gui Liberali & Alina Ferecatu, 2022. "Morphing for Consumer Dynamics: Bandits Meet Hidden Markov Models," Marketing Science, INFORMS, vol. 41(4), pages 769-794, July.
    16. Ana Alina Tudoran, 2022. "A machine learning approach to identifying decision-making styles for managing customer relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 351-374, March.
    17. Cecere, Grazia & Le Guel, Fabrice & Soulié, Nicolas, 2012. "Perceived Internet privacy concerns on social network in Europe," MPRA Paper 41437, University Library of Munich, Germany.
    18. Mehri, Ali & Darooneh, Amir H. & Shariati, Ashrafalsadat, 2012. "The complex networks approach for authorship attribution of books," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(7), pages 2429-2437.
    19. Jun B. Kim & Paulo Albuquerque & Bart J. Bronnenberg, 2010. "Online Demand Under Limited Consumer Search," Marketing Science, INFORMS, vol. 29(6), pages 1001-1023, 11-12.
    20. Michał Jasiński & Tomasz Sikorski & Zbigniew Leonowicz & Klaudiusz Borkowski & Elżbieta Jasińska, 2020. "The Application of Hierarchical Clustering to Power Quality Measurements in an Electrical Power Network with Distributed Generation," Energies, MDPI, vol. 13(9), pages 1-19, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:15:p:11606-:d:1203967. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.