IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this paper

Comparing the Similarities and Differences of PISA 2003 and TIMSS

Listed author(s):
  • Margaret Wu

    (University of Melbourne)

Registered author(s):

    This paper makes an in-depth comparison of the PISA (OECD) and TIMSS (IEA) mathematics assessments conducted in 2003. First, a comparison of survey methodologies is presented, followed by an examination of the mathematics frameworks in the two studies. The methodologies and the frameworks in the two studies form the basis for providing explanations for the observed differences in PISA and TIMSS results. At the country level, it appears that Western countries perform relatively better in PISA as compared to their performance in TIMSS. In contrast, Asian and Eastern European countries tend to do better in TIMSS than in PISA. This paper goes beyond making mere conjectures about the observed differences in results between PISA and TIMSS. The paper provides supporting evidence through the use of regression analyses to explain the differences. The analyses showed that performance differences at the country level can be attributed to the content balance of the two tests, as well as the sampling definitions – age-based and grade-based – in PISA and TIMSS respectively. Apart from mathematics achievement, the paper also compares results from the two studies on measures of self-confidence in mathematics. Gender differences are also examined in the light of contrasting results from the two studies. Overall, the paper provides a comprehensive comparison between PISA and TIMSS, and, in doing so, it throws some light on the interpretation of results of large-scale surveys more generally. Le présent document établit une comparaison détaillée des évaluations des mathématiques PISA (OCDE) et TIMSS (IEA), toutes deux menées en 2003. Il présente tout d’abord une comparaison des méthodologies d’enquête, puis un examen des cadres d’évaluation des mathématiques. C’est en effet par une analyse des méthodologies et cadres d’évaluation des deux études que l’on peut expliquer les différences constatées dans les résultats du PISA et ceux du TIMSS. Au niveau des pays, il apparaît que les nations occidentales réussissent relativement mieux à l’enquête PISA qu’à l’enquête TIMSS. En revanche, les pays d’Asie et d’Europe de l’Est ont tendance à obtenir de meilleures performances aux évaluations TIMSS qu’aux évaluations PISA. Au-delà de simples conjectures sur les différences observées, le présent document fournit des éléments de preuves en utilisant des analyses de régression qui expliquent les disparités de résultats. Les analyses ont démontré que les variations de performance au niveau national peuvent être imputées à l’équilibre des contenus des deux tests, ainsi qu’aux définitions d’échantillonnage – fondées sur l’âge ou fondées sur la classe – pour PISA et pour TIMSS, respectivement. Outre les performances en mathématiques, le présent document compare les résultats des deux études sur les mesures de la confiance en soi en mathématiques. Les différences entre les sexes sont également examinées à la lumière des résultats contrastés des deux enquêtes. Dans l’ensemble, ce document offre une comparaison complète entre PISA et TIMSS

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL:
    Download Restriction: no

    Paper provided by OECD Publishing in its series OECD Education Working Papers with number 32.

    in new window

    Date of creation: 22 Apr 2010
    Handle: RePEc:oec:eduaab:32-en
    Contact details of provider: Postal:
    2 rue Andre Pascal, 75775 Paris Cedex 16

    Phone: 33-(0)-1-45 24 82 00
    Fax: 33-(0)-1-45 24 85 00
    Web page:

    More information through EDIRC

    No references listed on IDEAS
    You can help add them by filling out this form.

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:oec:eduaab:32-en. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.