Evaluating school and parent reports of the national student achievement testing system (SIMCE) in Chile: Access, comprehension, and use

This evaluation examined school and parent reports of the national student achievement testing system (SIMCE) in Chile regarding three dimensions: access, comprehension, and use. We conducted phone surveys with a representative sample of directors (N=375), teachers (N=1145) and parents (N=625), and we collected more in-depth data through interviews and focus groups in 16 of these schools. The results indicate that access to the reports is not an obstacle to use for school actors, but it is for parents. While summative ratings of the reports in terms of their clarity and utility were generally very positive, the actual recall and interpretation of even basic information (assessed through case scenarios) was incorrect for a majority of teachers and parents, and reported uses of the information were both intended and unintended in nature. We also found some statistically significant differences regarding comprehension and use among subgroups of our sample. Our findings are especially relevant given the expectations attached to the use of the reports for school improvement on the one hand, and parents' behavior as critical consumers of education on the other hand.