Which schools and pupils respond to educational achievement surveys? A focus on the English PISA sample

Abstract

Non-response is a major problem facing research in the social sciences including in education surveys. Hence, research is needed to better understand non-response patterns as well as non-response as a social phenomenon. Findings may contribute to improvements in the future designs of such surveys. Using logistic and multilevel logistic modelling we examine correlates of non-response at the school and pupil level in the important educational achievement survey ‘Programme for International Student Assessment (PISA)’ for England. The analysis exploits unusually rich auxiliary information on all schools and pupils sampled for PISA, whether responding or not, from two large-scale administrative sources on pupils’ socio-economic background and results in national public exams. This information correlates highly with the PISA target variable. Findings show that characteristics associated with non-response differ between the school and pupil levels. Our results also indicate that schools matter in explaining pupil level response, which is often ignored in non-response analysis. Our findings have important implications for future education surveys. For example, if replacement schools are used to improve response, our results suggest that it may be more important to match initial and replacement schools on the socio-economic composition of their pupils than on any of the factors currently used.

More information

Identifiers

Catalogue record

Export record

Altmetrics