A comparative study of scores on computer-based tests and paper-based tests

The use of computer-based tests (CBTs) has spread rapidly in recent years, as such tests offer real-time scoring and immediate feedback, facilitate the use of individualised testing methods, improve test administration and reduce test expenses. Thus, most previous studies have tended to focus on the technical advantages of CBTs and on implementation issues. However, objections to the use of CBTs have begun to surface, and the primary concern is whether the scores of CBTs and those of paper-based tests (PBTs) are equivalent. The aim of this article is to compare the scores of Korean students on computer-based and paper-based versions of the same test. We focus on the differences between the scores of male and female participants and between scores on tests examining different subject matter. Surprisingly, even though the Korean students who participated in this study had more exposure to advanced information technologies such as computers, the Internet and multimedia than did students in other countries, they did not achieve higher CBT scores than PBT scores. This finding shows that familiarity with information technology and adaptation to CBTs are distinct. We also identified a fundamental reason for low CBT scores.