The University of Southampton
University of Southampton Institutional Repository

Verification in referral-based crowdsourcing

Naroditskiy, Victor, Rahwan, Iyad, Cebrian, Manuel and Jennings, Nicholas R. (2012) Verification in referral-based crowdsourcing PLoS ONE, 7, (10), e45924. (doi:10.1371/journal.pone.0045924).

Record type: Article


Online social networks offer unprecedented potential for rallying a large number of people to accomplish a given task. Here we focus on information gathering tasks where rare information is sought through "referral-based crowdsourcing": the information request is propagated recursively through invitations among members of a social network. Whereas previous work analyzed incentives for the referral process in a setting with only correct reports, misreporting is known to be both pervasive in crowdsourcing applications, and difficult/costly to filter out. A motivating example for our work is the DARPA Red Balloon Challenge where the level of misreporting was very high. In order to undertake a formal study of verification, we introduce a model where agents can exert costly effort to perform verification and false reports can be penalized. This is the first model of verification and it provides many directions for future research, which we point out. Our main theoretical result is the compensation scheme that minimizes the cost of retrieving the correct answer. Notably, this optimal compensation scheme coincides with the winning strategy of the Red Balloon Challenge.

PDF journal.pone.0045924.pdf - Other
Download (213kB)

More information

Published date: 10 October 2012
Organisations: Agents, Interactions & Complexity


Local EPrints ID: 342826
ISSN: 1932-6203
PURE UUID: 346a4d97-8913-4f4e-851d-e227efe72fb0

Catalogue record

Date deposited: 14 Sep 2012 10:03
Last modified: 18 Jul 2017 05:27

Export record



Author: Victor Naroditskiy
Author: Iyad Rahwan
Author: Manuel Cebrian
Author: Nicholas R. Jennings

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.