Brown, Giorgina, Micklewright, John, Schnepf, Sylke V. and Waldmann, Robert
Cross-National Surveys of Learning Achievement:
How Robust are the Findings? Southampton, UK, Southampton Statistical Sciences Research Institute, 36pp.
(S3RI Applications and Policy Working Papers, A05/05).
International surveys of learning achievement and functional literacy are increasingly common. We consider two aspects of the robustness of their results. First, we compare results from four surveys: TIMSS, PISA, PIRLS and IALS. This contrasts with the standard approach which is to analyse a single survey with no regard as to whether it agrees or not with other sources. Second, we investigate whether results are sensitive to the choice of item response model used by survey organisers to aggregate respondents' answers. In both cases we focus on countries' average scores, the within-country differences in scores, and on the association between the two. There is mixed news to report.
Actions (login required)