The University of Southampton
University of Southampton Institutional Repository

An investigation of techniques that aim to improve the quality of labels provided by the crowd

An investigation of techniques that aim to improve the quality of labels provided by the crowd
An investigation of techniques that aim to improve the quality of labels provided by the crowd
The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we’ve applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Acosta, Maribel
1b83a27a-6ff5-4ec8-91a7-3fc6341db36d
Weston, Anna
96f3b126-bee2-45c5-82ff-8316a3c819cb
Simperl, E.
40261ae4-c58c-48e4-b78b-5187b10e4f67
Samangooei, Sina
c380fb26-55d4-4b34-94e7-c92bbb26a40d
Dupplaw, David
c563ca2b-756a-4d3f-bf99-4f60bb2be1ce
Lewis, Paul H.
7aa6c6d9-bc69-4e19-b2ac-a6e20558c020
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Acosta, Maribel
1b83a27a-6ff5-4ec8-91a7-3fc6341db36d
Weston, Anna
96f3b126-bee2-45c5-82ff-8316a3c819cb
Simperl, E.
40261ae4-c58c-48e4-b78b-5187b10e4f67
Samangooei, Sina
c380fb26-55d4-4b34-94e7-c92bbb26a40d
Dupplaw, David
c563ca2b-756a-4d3f-bf99-4f60bb2be1ce
Lewis, Paul H.
7aa6c6d9-bc69-4e19-b2ac-a6e20558c020

Hare, Jonathon, Acosta, Maribel, Weston, Anna, Simperl, E., Samangooei, Sina, Dupplaw, David and Lewis, Paul H. (2013) An investigation of techniques that aim to improve the quality of labels provided by the crowd At MediaEval 2013 / Crowdsourcing for Social Multimedia, Spain.

Record type: Conference or Workshop Item (Paper)

Abstract

The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we’ve applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.

PDF crowdsourcing.pdf - Version of Record
Download (201kB)
PDF cs-long.pdf - Other
Download (1MB)

More information

Accepted/In Press date: 18 October 2013
Venue - Dates: MediaEval 2013 / Crowdsourcing for Social Multimedia, Spain, 2013-10-18
Organisations: Web & Internet Science

Identifiers

Local EPrints ID: 358834
URI: http://eprints.soton.ac.uk/id/eprint/358834
PURE UUID: d4a80a33-4821-4a29-b5bc-97ed1e9a601a
ORCID for Jonathon Hare: ORCID iD orcid.org/0000-0003-2921-4283
ORCID for Anna Weston: ORCID iD orcid.org/0000-0003-1675-0466
ORCID for E. Simperl: ORCID iD orcid.org/0000-0003-1722-947X

Catalogue record

Date deposited: 11 Oct 2013 16:36
Last modified: 18 Jul 2017 03:26

Export record

Contributors

Author: Jonathon Hare ORCID iD
Author: Maribel Acosta
Author: Anna Weston ORCID iD
Author: E. Simperl ORCID iD
Author: Sina Samangooei
Author: David Dupplaw
Author: Paul H. Lewis

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×