The University of Southampton
University of Southampton Institutional Repository

The effect of coding error on time use surveys estimates

The effect of coding error on time use surveys estimates
The effect of coding error on time use surveys estimates
This article presents the results of a coder reliability study conducted as part of the 2000 UK Time Use Survey. Five coders coded the same 40 diaries in which respondents had recorded, in their own words, their activities for every ten minutes over the course of a particular day. Coding was done via a computerised coding system, which enabled coders to view scanned digital images of diaries and access an online coding frame. In addition to an estimate of net aggregate coder reliability, proportion of agreement coefficients are presented for each of the ten main activity codes at the highest level of the coding hierarchy. Reliabilities are also calculated for individual coders. Intra-class correlation coefficients (Rho) are then estimated and these are combined with the reliability estimates to produce a variance inflation factor for each of the ten higher order main activity codes (). Some illustrative examples are provided to demonstrate the true standard errors of survey estimates once this coder error has been accounted for.
coder reliability, diary surveys, variance inflation
0282-423X
467-480
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c

Sturgis, Patrick (2004) The effect of coding error on time use surveys estimates. Journal of Official Statistics, 20 (3), 467-480.

Record type: Article

Abstract

This article presents the results of a coder reliability study conducted as part of the 2000 UK Time Use Survey. Five coders coded the same 40 diaries in which respondents had recorded, in their own words, their activities for every ten minutes over the course of a particular day. Coding was done via a computerised coding system, which enabled coders to view scanned digital images of diaries and access an online coding frame. In addition to an estimate of net aggregate coder reliability, proportion of agreement coefficients are presented for each of the ten main activity codes at the highest level of the coding hierarchy. Reliabilities are also calculated for individual coders. Intra-class correlation coefficients (Rho) are then estimated and these are combined with the reliability estimates to produce a variance inflation factor for each of the ten higher order main activity codes (). Some illustrative examples are provided to demonstrate the true standard errors of survey estimates once this coder error has been accounted for.

Text
codingerror.pdf - Version of Record
Restricted to Registered users only
Download (134kB)
Request a copy

More information

Published date: 24 September 2004
Keywords: coder reliability, diary surveys, variance inflation

Identifiers

Local EPrints ID: 80189
URI: http://eprints.soton.ac.uk/id/eprint/80189
ISSN: 0282-423X
PURE UUID: 90271c8c-561a-4845-a5bb-3cb6b8a99718
ORCID for Patrick Sturgis: ORCID iD orcid.org/0000-0003-1180-3493

Catalogue record

Date deposited: 24 Mar 2010
Last modified: 14 Mar 2024 00:35

Export record

Contributors

Author: Patrick Sturgis ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×