IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v14y2024i2p21582440241249884.html
   My bibliography  Save this article

A Pilot Study for Measuring Complex Problem-Solving in Jordan: Feasibility, Construct Validity, and Behavior Pattern Analyses

Author

Listed:
  • Saleh Ahmad Alrababah
  • Hao Wu
  • Gyöngyvér Molnár

Abstract

In the 21st century, complex problem-solving (CPS) serves as a key indicator of educational achievement. However, the elements of successful CPS have not yet been fully explored. This study investigates the role of strategic exploration and different problem-solving and test-taking behaviors in CPS success, using logfile data to visualize and quantify students’ problem-solving behavior on 10 CPS problems with different characteristics and levels of difficulty. Additionally, in the present study, we go beyond the limits of most studies that focus on students’ problem-solving behavior pattern analyses in European cultures and education systems to examine Arabic students’ CPS behavior. The results show that computer-based assessments of CPS are feasible and valid in Jordanian higher education. The findings also confirm the structural validity of CPS, indicating that the processes of knowledge acquisition (KAC) and knowledge application (KAP) can be distinguished and separated in the problem-solving process. Large differences were identified in students’ test-taking behavior in terms of the efficacy of their exploration strategy. We identified four latent classes based on the students’ exploration strategy behavior. The study thus leads to a better understanding of how students solve problems and behave during the problem-solving process in uncertain situations.

Suggested Citation

  • Saleh Ahmad Alrababah & Hao Wu & Gyöngyvér Molnár, 2024. "A Pilot Study for Measuring Complex Problem-Solving in Jordan: Feasibility, Construct Validity, and Behavior Pattern Analyses," SAGE Open, , vol. 14(2), pages 21582440241, May.
    • Handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241249884
    DOI: 10.1177/21582440241249884
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/21582440241249884
    Download Restriction: no
    File URL: https://libkey.io/10.1177/21582440241249884?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michela Gnaldi & Silvia Bacci & Thiemo Kunze & Samuel Greiff, 2020. "Students’ Complex Problem Solving Profiles," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 469-501, June.
    2. Ester van Laar & Alexander J. A. M. van Deursen & Jan A. G. M. van Dijk & Jos de Haan, 2020. "Determinants of 21st-Century Skills and 21st-Century Digital Skills for Workers: A Systematic Literature Review," SAGE Open, , vol. 10(1), pages 21582440199, January.
    3. Lotz, Christin & Scherer, Ronny & Greiff, Samuel & Sparfeldt, Jörn R., 2017. "Intelligence in action – Effective strategic behaviors while solving complex problems," Intelligence, Elsevier, vol. 64(C), pages 98-112.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefano D’Angelo & Angelo Cavallo & Antonio Ghezzi & Francesco Di Lorenzo, 2024. "Understanding corporate entrepreneurship in the digital age: a review and research agenda," Review of Managerial Science, Springer, vol. 18(12), pages 3719-3774, December.
    2. Paweł Ziemba & Mateusz Piwowarski & Kesra Nermend, 2023. "Remote Work in Post-Pandemic Reality—Multi-Criteria Evaluation of Teleconferencing Software," Sustainability, MDPI, vol. 15(13), pages 1-20, June.
    3. Michela Gnaldi & Silvia Bacci & Thiemo Kunze & Samuel Greiff, 2020. "Students’ Complex Problem Solving Profiles," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 469-501, June.
    4. Yahya Fikri & Mohamed Rhalma, 2024. "Artificial Intelligence (AI) in Early Childhood Education (ECE): Do Effects and Interactions Matter?," Post-Print hal-04701470, HAL.
    5. De Marco, Stefano & Dumont, Guillaume & Helsper, Ellen Johanna, 2025. "The reproduction of structural inequalities in online job search strategies and outcomes," LSE Research Online Documents on Economics 126847, London School of Economics and Political Science, LSE Library.
    6. Adelina Zeqiri, 2024. "Virtual tourism as a substitute for physical tourism during COVID-19 pandemic," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 26(2), pages 125-144, April.
    7. Jana Stofkova & Adela Poliakova & Katarina Repkova Stofkova & Peter Malega & Matej Krejnus & Vladimira Binasova & Naqibullah Daneshjo, 2022. "Digital Skills as a Significant Factor of Human Resources Development," Sustainability, MDPI, vol. 14(20), pages 1-18, October.
    8. Christian Stary, 2023. "Digital Process Twins as Intelligent Design Technology for Engineering Metaverse/XR Applications," Sustainability, MDPI, vol. 15(22), pages 1-23, November.
    9. Rosa M. Serrano & Oscar Casanova, 2022. "Toward a Technological and Methodological Shift in Music Learning in Spain: Students’ Perception of Their Initial Teacher Training," SAGE Open, , vol. 12(1), pages 21582440211, January.
    10. Nicolay, Björn & Krieger, Florian & Kuhn, Jörg-Tobias & Graesser, Arthur C. & Ifenthaler, Dirk & Baker, Ryan & Greiff, Samuel, 2023. "Unsuccessful and successful complex problem solvers – A log file analysis of complex problem solving strategies across multiple tasks," Intelligence, Elsevier, vol. 101(C).
    11. Cigdem Hursen & Derviş Paşa & Hafize Keser, 2023. "High School Students’ Use of Information, Media, and Technology Skills and Multidimensional 21st-Century Skills: An Investigation within the Context of Students, Teachers, and Curricula," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    12. Cátia Rosário & Celeste Varum & Anabela Botelho, 2024. "Comparison of the Profile of Portuguese Companies That Receive Public Support for Innovation: National Support vs. European Support," Sustainability, MDPI, vol. 16(7), pages 1-23, March.
    13. Lotz, Christin & Scherer, Ronny & Greiff, Samuel & Sparfeldt, Jörn R., 2022. "g's little helpers – VOTAT and NOTAT mediate the relation between intelligence and complex problem solving," Intelligence, Elsevier, vol. 95(C).
    14. Vida Lang & Andrej Šorgo, 2024. "Views of Students, Parents, and Teachers on Smartphones and Tablets in the Development of 21st-Century Skills as a Prerequisite for a Sustainable Future," Sustainability, MDPI, vol. 16(7), pages 1-14, April.
    15. Giovanni N. Enero & Joan P. Bacarisas, 2025. "Digital Application Skills and Documentation Skills among Nurses in a Private Hospitals in Ormoc City," International Journal of Research and Scientific Innovation, International Journal of Research and Scientific Innovation (IJRSI), vol. 12(3), pages 1-38, March.
    16. Veronika Bikse & Liva Grinevica & Baiba Rivza & Peteris Rivza, 2022. "Consequences and Challenges of the Fourth Industrial Revolution and the Impact on the Development of Employability Skills," Sustainability, MDPI, vol. 14(12), pages 1-23, June.
    17. Fatima Afzal & Roksana Jahan Tumpa, 2024. "Exploring Leadership Styles to Foster Sustainability in Construction Projects: A Systematic Literature Review," Sustainability, MDPI, vol. 16(3), pages 1-32, January.
    18. Battisti, Enrico & Alfiero, Simona & Leonidou, Erasmia, 2022. "Remote working and digital transformation during the COVID-19 pandemic: Economic–financial impacts and psychological drivers for employees," Journal of Business Research, Elsevier, vol. 150(C), pages 38-50.
    19. Christ, Alexander & Becker, Nicolas & Kröner, Stephan, 2020. "Multiple complex problem-solving scenarios: The incremental validity of ability self-concept beyond reasoning in adults," Intelligence, Elsevier, vol. 78(C).
    20. Coyle, Thomas R. & Greiff, Samuel, 2021. "The future of intelligence: The role of specific abilities," Intelligence, Elsevier, vol. 88(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241249884. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.