IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i10p5822-d812497.html
   My bibliography  Save this article

Psychometric Properties for Multidimensional Cognitive Load Scale in an E-Learning Environment

Author

Listed:
  • Younyoung Choi

    (Department of Psychology, Ajou University, Suwon 16499, Korea)

  • Hyunwoo Lee

    (Biohealth Convergence-Open-Sharing System, Dankook University, Cheonan 31116, Korea)

Abstract

(1) Background: A learner’s cognitive load in a learning system should be effectively addressed to provide optimal learning processing because the cognitive load explains individual learning differences. However, little empirical research has been conducted into the validation of a cognitive load measurement tool (cognitive load scale, i.e., CLS) suited to online learning systems within higher education. The purpose of this study was to evaluate the psychometric properties of the CLS in an online learning system within higher education through the framework suggested by the Standards for Educational and Psychological Testing. (2) Methods: Data from 800 learners were collected from a cyber-university in South Korea. The age of students ranged from 20 to 64. The CLS was developed, including three components: extraneous cognitive load, intrinsic cognitive load, and germane cognitive load. Then, psychometric properties of the CLS were evaluated including reliability and validity. Evidence relating to content validity, construct validity, and criterion validity were collected. The response pattern of each item was evaluated on the basis of item response theory (IRT). Cronbach’s α was computed for reliability. (3) Results: The CLS presented high internal consistency. A three-factor model with extraneous cognitive load, intrinsic cognitive load, and germane cognitive load was suggested by exploratory and confirmatory factor analysis. This three-factor model is consistent with the previous research into the cognitive load in an offline learning environment. Higher levels of the extraneous cognitive load and intrinsic cognitive load were related to lower levels of academic achievement in an online learning environment, but the germane cognitive load was not significantly positively associated with midterm exam scores, though it was significantly related to the final exam scores. IRT analysis showed that the item-fit statistics for all items were acceptable. Lastly, the measurement invariance was examined through differential item functioning analysis (DIF), with the results suggesting that the items did not contain measurement variance in terms of gender. (4) Conclusions: This validation study of the CLS in an online learning environment within higher education assesses psychometric properties and suggests that the CLS is valid and reliable with a three-factor model. There is a need for an evaluation tool to take into account the cognitive load among learners in online learning system because the characteristics of learners within higher education were varied. This CLS will help instructional/curriculum designers and educational instructors to provide more effective instructions and identify individual learning differences in an online learning environment within higher education.

Suggested Citation

  • Younyoung Choi & Hyunwoo Lee, 2022. "Psychometric Properties for Multidimensional Cognitive Load Scale in an E-Learning Environment," IJERPH, MDPI, vol. 19(10), pages 1-12, May.
    • Handle: RePEc:gam:jijerp:v:19:y:2022:i:10:p:5822-:d:812497
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/10/5822/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/19/10/5822/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wahab Ali, 2020. "Online and Remote Learning in Higher Education Institutes: A Necessity in light of COVID-19 Pandemic," Higher Education Studies, Canadian Center of Science and Education, vol. 10(3), pages 1-16, September.
    2. Maria-Crina Radu & Carol Schnakovszky & Eugen Herghelegiu & Vlad-Andrei Ciubotariu & Ion Cristea, 2020. "The Impact of the COVID-19 Pandemic on the Quality of Educational Process: A Student Survey," IJERPH, MDPI, vol. 17(21), pages 1-15, October.
    3. Zhixin Zhang & Gang Xu & Jing Gao & Lu Wang & Yonghai Zhu & Zhiyong Li & Wei Zhou, 2020. "Effects of E-Learning Environment Use on Visual Function of Elementary and Middle School Students: A Two-Year Assessment—Experience from China," IJERPH, MDPI, vol. 17(5), pages 1-19, February.
    4. Melissa A. Schilling & Patricia Vidal & Robert E. Ployhart & Alexandre Marangoni, 2003. "Learning by Doing Something Else: Variation, Relatedness, and the Learning Curve," Management Science, INFORMS, vol. 49(1), pages 39-56, January.
    5. Younyoung Choi & Young Il Cho, 2020. "Learning Analytics Using Social Network Analysis and Bayesian Network Analysis in Sustainable Computer-Based Formative Assessment System," Sustainability, MDPI, vol. 12(19), pages 1-13, September.
    6. Juan Chaves & Antonio A. Lorca-Marín & Emilio José Delgado-Algarra, 2020. "Methodology of Specialist Physicians Training: From Traditional to e-Learning," IJERPH, MDPI, vol. 17(20), pages 1-19, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mostafa Aboulnour Salem & Abu Elnasr E. Sobaih, 2022. "ADIDAS: An Examined Approach for Enhancing Cognitive Load and Attitudes towards Synchronous Digital Learning Amid and Post COVID-19 Pandemic," IJERPH, MDPI, vol. 19(24), pages 1-16, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Younyoung Choi & Jigeun Kim, 2021. "Learning Analytics for Diagnosing Cognitive Load in E-Learning Using Bayesian Network Analysis," Sustainability, MDPI, vol. 13(18), pages 1-13, September.
    2. Hiromi Kawasaki & Satoko Yamasaki & Yuko Masuoka & Mika Iwasa & Susumu Fukita & Ryota Matsuyama, 2021. "Remote Teaching Due to COVID-19: An Exploration of Its Effectiveness and Issues," IJERPH, MDPI, vol. 18(5), pages 1-16, March.
    3. Jiajia Li & Shiyu Yang & Changju Chen & Houjian Li, 2022. "The Impacts of COVID-19 on Distance Education with the Application of Traditional and Digital Appliances: Evidence from 60 Developing Countries," IJERPH, MDPI, vol. 19(11), pages 1-19, May.
    4. Fumiya Tanji & Yuki Kodama, 2021. "Prevalence of Psychological Distress and Associated Factors in Nursing Students during the COVID-19 Pandemic: A Cross-Sectional Study," IJERPH, MDPI, vol. 18(19), pages 1-10, October.
    5. Eelke Wiersma, 2007. "Conditions That Shape the Learning Curve: Factors That Increase the Ability and Opportunity to Learn," Management Science, INFORMS, vol. 53(12), pages 1903-1915, December.
    6. Schilling, Melissa A. & Green, Elad, 2011. "Recombinant search and breakthrough idea generation: An analysis of high impact papers in the social sciences," Research Policy, Elsevier, vol. 40(10), pages 1321-1331.
    7. Marta Medina-García & Lina Higueras-Rodríguez & Mª del Mar García-Vita & Luis Doña-Toledo, 2021. "ICT, Disability, and Motivation: Validation of a Measurement Scale and Consequence Model for Inclusive Digital Knowledge," IJERPH, MDPI, vol. 18(13), pages 1-17, June.
    8. Diwas Singh KC & Bradley R. Staats, 2012. "Accumulating a Portfolio of Experience: The Effect of Focal and Related Experience on Surgeon Performance," Manufacturing & Service Operations Management, INFORMS, vol. 14(4), pages 618-633, October.
    9. Tim R. Holcomb & R. Duane Ireland & R. Michael Holmes Jr. & Michael A. Hitt, 2009. "Architecture of Entrepreneurial Learning: Exploring the Link among Heuristics, Knowledge, and Action," Entrepreneurship Theory and Practice, , vol. 33(1), pages 167-192, January.
    10. Luis Miguel Moctezuma Teresa & José Luis Aparicio López & Columba Rodríguez Alviso & Herlinda Gervacio Jiménez & Rosa María Brito Carmona, 2022. "Environmental Competencies for Sustainability: A Training Experience with High School Teachers in a Rural Community," Sustainability, MDPI, vol. 14(9), pages 1-17, April.
    11. Al Lily, Abdulrahman Essa & Ismail, Abdelrahim Fathy & Abunasser, Fathi Mohammed & Alhajhoj Alqahtani, Rafdan Hassan, 2020. "Distance education as a response to pandemics: Coronavirus and Arab culture," Technology in Society, Elsevier, vol. 63(C).
    12. Rozina Afroz & Nurul Islam & Sajedur Rahman & Nusrat Zerin Anny, 2021. "Students’ and teachers’ attitude towards online classes during Covid-19 pandemic: A study on three Bangladeshi government colleges," International Journal of Research in Business and Social Science (2147-4478), Center for the Strategic Studies in Business and Finance, vol. 10(3), pages 462-476, April.
    13. Parker, Owen N. & Mui, Rachel & Bhawe, Nachiket & Semadeni, Matthew, 2022. "Insight or ignorance: How collaborative history in a workgroup fits with project type to shape performance," Journal of Business Research, Elsevier, vol. 152(C), pages 154-167.
    14. Amit Mehra & Rajiv Dewan & Marshall Freimer, 2011. "Firms as Incubators of Open-Source Software," Information Systems Research, INFORMS, vol. 22(1), pages 22-38, March.
    15. Mine Halis & Duygu Yildirim, 2022. "The effect of perceived social support and life orientation on anxiety caused by online education in Covid 19 conditions," International Journal of Research in Business and Social Science (2147-4478), Center for the Strategic Studies in Business and Finance, vol. 11(4), pages 310-322, June.
    16. Fioretti, Guido, 2009. "From men and machines to the organizational learning curve," MPRA Paper 19392, University Library of Munich, Germany.
    17. Sze-Sze Wong, 2004. "Distal and Local Group Learning: Performance Trade-offs and Tensions," Organization Science, INFORMS, vol. 15(6), pages 645-656, December.
    18. Robert S. Huckman & Bradley R. Staats, 2008. "Variation in Experience and Team Familiarity: Addressing the Knowledge Acquisition-Application Problem," Harvard Business School Working Papers 09-035, Harvard Business School.
    19. William Villegas-Ch. & Milton Roman-Cañizares & Santiago Sánchez-Viteri & Joselin García-Ortiz & Walter Gaibor-Naranjo, 2021. "Analysis of the State of Learning in University Students with the Use of a Hadoop Framework," Future Internet, MDPI, vol. 13(6), pages 1-25, May.
    20. Ohei Kenneth N, 2023. "Using ICT Tools and Technological Applications in this Era of the COVID-19 Pandemic to Facilitate Learning," HOLISTICA – Journal of Business and Public Administration, Sciendo, vol. 14(2), pages 116-136, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:10:p:5822-:d:812497. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.