The University of Southampton
University of Southampton Institutional Repository

An investigation of techniques that aim to improve the quality of labels provided by the crowd

Hare, Jonathon, Acosta, Maribel, Weston, Anna, Simperl, E., Samangooei, Sina, Dupplaw, David and Lewis, Paul H. (2013) An investigation of techniques that aim to improve the quality of labels provided by the crowd At MediaEval 2013 / Crowdsourcing for Social Multimedia, Spain.

Record type: Conference or Workshop Item (Paper)


The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we’ve applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.

PDF crowdsourcing.pdf - Version of Record
Download (201kB)
PDF cs-long.pdf - Other
Download (1MB)

More information

Accepted/In Press date: 18 October 2013
Venue - Dates: MediaEval 2013 / Crowdsourcing for Social Multimedia, Spain, 2013-10-18
Organisations: Web & Internet Science


Local EPrints ID: 358834
PURE UUID: d4a80a33-4821-4a29-b5bc-97ed1e9a601a
ORCID for Jonathon Hare: ORCID iD
ORCID for Anna Weston: ORCID iD
ORCID for E. Simperl: ORCID iD

Catalogue record

Date deposited: 11 Oct 2013 16:36
Last modified: 18 Jul 2017 03:26

Export record


Author: Jonathon Hare ORCID iD
Author: Maribel Acosta
Author: Anna Weston ORCID iD
Author: E. Simperl ORCID iD
Author: Sina Samangooei
Author: David Dupplaw
Author: Paul H. Lewis

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.