An investigation of techniques that aim to improve the quality of labels provided by the crowd
An investigation of techniques that aim to improve the quality of labels provided by the crowd
The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we’ve applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Acosta, Maribel
1b83a27a-6ff5-4ec8-91a7-3fc6341db36d
Weston, Anna
96f3b126-bee2-45c5-82ff-8316a3c819cb
Simperl, E.
40261ae4-c58c-48e4-b78b-5187b10e4f67
Samangooei, Sina
c380fb26-55d4-4b34-94e7-c92bbb26a40d
Dupplaw, David
c563ca2b-756a-4d3f-bf99-4f60bb2be1ce
Lewis, Paul H.
7aa6c6d9-bc69-4e19-b2ac-a6e20558c020
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Acosta, Maribel
1b83a27a-6ff5-4ec8-91a7-3fc6341db36d
Weston, Anna
96f3b126-bee2-45c5-82ff-8316a3c819cb
Simperl, E.
40261ae4-c58c-48e4-b78b-5187b10e4f67
Samangooei, Sina
c380fb26-55d4-4b34-94e7-c92bbb26a40d
Dupplaw, David
c563ca2b-756a-4d3f-bf99-4f60bb2be1ce
Lewis, Paul H.
7aa6c6d9-bc69-4e19-b2ac-a6e20558c020
Hare, Jonathon, Acosta, Maribel, Weston, Anna, Simperl, E., Samangooei, Sina, Dupplaw, David and Lewis, Paul H.
(2013)
An investigation of techniques that aim to improve the quality of labels provided by the crowd.
MediaEval 2013 / Crowdsourcing for Social Multimedia, Barcelona, Spain.
(In Press)
Record type:
Conference or Workshop Item
(Paper)
Abstract
The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we’ve applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.
Text
crowdsourcing.pdf
- Version of Record
More information
Accepted/In Press date: 18 October 2013
Venue - Dates:
MediaEval 2013 / Crowdsourcing for Social Multimedia, Barcelona, Spain, 2013-10-18
Organisations:
Web & Internet Science
Identifiers
Local EPrints ID: 358834
URI: http://eprints.soton.ac.uk/id/eprint/358834
PURE UUID: d4a80a33-4821-4a29-b5bc-97ed1e9a601a
Catalogue record
Date deposited: 11 Oct 2013 16:36
Last modified: 15 Mar 2024 03:25
Export record
Contributors
Author:
Jonathon Hare
Author:
Maribel Acosta
Author:
Anna Weston
Author:
Sina Samangooei
Author:
David Dupplaw
Author:
Paul H. Lewis
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics