IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i13p5400-d1421916.html

Evaluating a National Traditional Chinese Medicine Examination via Cognitive Diagnostic Approaches

Author

Listed:
  • Lingling Xu

    (Institute of Medical Education, Peking University, Beijing 100191, China)

  • Zhehan Jiang

    (Institute of Medical Education, Peking University, Beijing 100191, China)

  • Yuting Han

    (School of Psychology, Beijing Language and Culture University, Beijing 100083, China)

Abstract

The current research utilized diagnostic classification models (DCMs), an advanced psychometric theory, to evaluate the examination’s quality using psychometric methods for a more precise and comprehensive understanding of health professionals’ competence. Data was gathered from 16,310 fourth-year Traditional Chinese Medicine undergraduates who completed the Standardized Competence Test for Traditional Chinese Medicine Undergraduates (SCTTCMU) comprising 300 multiple-choice items. The study examined the fundamental assumptions, model-data fit, and cognitive diagnostic theory models’ item and test properties. The generalized deterministic input, noisy, “and” gate model applied in this research demonstrated a strong alignment with the real response data, meeting all the necessary assumptions. Cognitive diagnostic analysis indicated that all items exhibited satisfactory psychometric characteristics, and the reported scores offered insights into candidates’ proficiency in cognitive skills. It is expected that the advent of modern psychometric technology will contribute to the improvement of refined diagnostic information for health professional candidates. Furthermore, this research holds the potential to significantly enhance sustainability in healthcare practices, knowledge, economics, resource use, and community resilience.

Suggested Citation

  • Lingling Xu & Zhehan Jiang & Yuting Han, 2024. "Evaluating a National Traditional Chinese Medicine Examination via Cognitive Diagnostic Approaches," Sustainability, MDPI, vol. 16(13), pages 1-12, June.
    • Handle: RePEc:gam:jsusta:v:16:y:2024:i:13:p:5400-:d:1421916
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/13/5400/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/16/13/5400/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jimmy de la Torre, 2011. "The Generalized DINA Model Framework," Psychometrika, Springer;The Psychometric Society, vol. 76(2), pages 179-199, April.
    2. Jimmy Torre, 2011. "Erratum to: The Generalized DINA Model Framework," Psychometrika, Springer;The Psychometric Society, vol. 76(3), pages 510-510, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matthew S. Johnson & Sandip Sinharay, 2020. "The Reliability of the Posterior Probability of Skill Attainment in Diagnostic Classification Models," Journal of Educational and Behavioral Statistics, , vol. 45(1), pages 5-31, February.
    2. Chenchen Ma & Jing Ouyang & Gongjun Xu, 2023. "Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 175-207, March.
    3. Ling Ling Wang & Tao Xin & Xiao Jian Sun, 2026. "Using the Bayesian Network’s Structural Learning Algorithm to Estimate the Q-Matrix in Cognitive Diagnosis Models," Journal of Educational and Behavioral Statistics, , vol. 51(2), pages 419-450, April.
    4. Qingrong Tan & Yan Cai & Fen Luo & Dongbo Tu, 2023. "Development of a High-Accuracy and Effective Online Calibration Method in CD-CAT Based on Gini Index," Journal of Educational and Behavioral Statistics, , vol. 48(1), pages 103-141, February.
    5. Xin Xu & Guanhua Fang & Jinxin Guo & Zhiliang Ying & Susu Zhang, 2024. "Diagnostic Classification Models for Testlets: Methods and Theory," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 851-876, September.
    6. Laine Bradshaw & Jonathan Templin, 2014. "Combining Item Response Theory and Diagnostic Classification Models: A Psychometric Model for Scaling Ability and Diagnosing Misconceptions," Psychometrika, Springer;The Psychometric Society, vol. 79(3), pages 403-425, July.
    7. Peida Zhan & Hong Jiao & Dandan Liao & Feiming Li, 2019. "A Longitudinal Higher-Order Diagnostic Classification Model," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 251-281, June.
    8. Peida Zhan* & Kaiwen Man* & Stefanie A. Wind & Jonathan Malone, 2022. "Cognitive Diagnosis Modeling Incorporating Response Times and Fixation Counts: Providing Comprehensive Feedback and Accurate Diagnosis," Journal of Educational and Behavioral Statistics, , vol. 47(6), pages 736-776, December.
    9. Daoxuan Fu & Chunying Qin & Zhaosheng Luo & Yujun Li & Xiaofeng Yu & Ziyu Ye, 2025. "Using Regularized Methods to Validate Q-Matrix in Cognitive Diagnostic Assessment," Journal of Educational and Behavioral Statistics, , vol. 50(1), pages 149-179, February.
    10. Chen-Wei Liu & Björn Andersson & Anders Skrondal, 2020. "A Constrained Metropolis–Hastings Robbins–Monro Algorithm for Q Matrix Estimation in DINA Models," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 322-357, June.
    11. Hans Friedrich Köhn & Chia-Yi Chiu, 2021. "A Unified Theory of the Completeness of Q-Matrices for the DINA Model," Journal of Classification, Springer;The Classification Society, vol. 38(3), pages 500-518, October.
    12. Jimmy de la Torre & Xue-Lan Qiu & Kevin Carl Santos, 2022. "An Empirical Q-Matrix Validation Method for the Polytomous G-DINA Model," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 693-724, June.
    13. Zhemin Zhu & Bing Jia, 2025. "Study on Mathematics Skill of Sixth-Grade Students in Rural China Based on Cognitive Diagnostic Models," SAGE Open, , vol. 15(4), pages 21582440251, December.
    14. Jonathan Templin & Laine Bradshaw, 2014. "Hierarchical Diagnostic Classification Models: A Family of Models for Estimating and Testing Attribute Hierarchies," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 317-339, April.
    15. Youn Seon Lim, 2024. "Nonparametric Cognitive Diagnosis When Attributes Are Polytomous," Journal of Classification, Springer;The Classification Society, vol. 41(1), pages 94-128, March.
    16. Motonori Oka & Kensuke Okada, 2023. "Scalable Bayesian Approach for the Dina Q-Matrix Estimation Combining Stochastic Optimization and Variational Inference," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 302-331, March.
    17. Yuqi Gu, 2023. "Generic Identifiability of the DINA Model and Blessing of Latent Dependence," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 117-131, March.
    18. Qianru Liang & Jimmy de la Torre & Nancy Law, 2023. "Latent Transition Cognitive Diagnosis Model With Covariates: A Three-Step Approach," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 690-718, December.
    19. Chun Wang, 2021. "Using Penalized EM Algorithm to Infer Learning Trajectories in Latent Transition CDM," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 167-189, March.
    20. Lidan Liang & Jing Lu & Jiwei Zhang & Guanghui Cheng, 2024. "Modeling Skipped Items in Cognitive Diagnostic Assessments," SAGE Open, , vol. 14(4), pages 21582440241, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:13:p:5400-:d:1421916. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.