Crowdsourcing contest dilemma
Crowdsourcing contest dilemma
Crowdsourcing offers unprecedented potential for solving tasks efficiently by tapping into the skills of large groups of people. A salient feature of crowdsourcing—its openness of entry—makes it vulnerable to malicious behaviour. Such behaviour took place in a number of recent popular crowdsourcing competitions. We provide game-theoretic analysis of a fundamental trade-off between the potential for increased productivity and the possibility of being set back by malicious behaviour. Our results show that in crowdsourcing competitions malicious behaviour is the norm, not the anomaly—a result contrary to the conventional wisdom in the area. Counterintuitively, making the attacks more costly does not deter them but leads to a less desirable outcome. These findings have cautionary implications for the design of crowdsourcing competitions.
1-8
Naroditskiy, Victor
8881263c-ee85-49f2-b658-99c31b490e1d
Jennings, Nicholas R.
ab3d94cc-247c-4545-9d1e-65873d6cdb30
Van Hentenryck, Pascal
0c5ebdc9-2217-4498-bdca-930a0803527d
Cebrian, Manuel
896cbc84-3da7-4571-a525-4eb8f4284662
20 August 2014
Naroditskiy, Victor
8881263c-ee85-49f2-b658-99c31b490e1d
Jennings, Nicholas R.
ab3d94cc-247c-4545-9d1e-65873d6cdb30
Van Hentenryck, Pascal
0c5ebdc9-2217-4498-bdca-930a0803527d
Cebrian, Manuel
896cbc84-3da7-4571-a525-4eb8f4284662
Naroditskiy, Victor, Jennings, Nicholas R., Van Hentenryck, Pascal and Cebrian, Manuel
(2014)
Crowdsourcing contest dilemma.
Journal of the Royal Society Interface, 12 (103), .
(doi:10.1098/rsif.2014.0532).
Abstract
Crowdsourcing offers unprecedented potential for solving tasks efficiently by tapping into the skills of large groups of people. A salient feature of crowdsourcing—its openness of entry—makes it vulnerable to malicious behaviour. Such behaviour took place in a number of recent popular crowdsourcing competitions. We provide game-theoretic analysis of a fundamental trade-off between the potential for increased productivity and the possibility of being set back by malicious behaviour. Our results show that in crowdsourcing competitions malicious behaviour is the norm, not the anomaly—a result contrary to the conventional wisdom in the area. Counterintuitively, making the attacks more costly does not deter them but leads to a less desirable outcome. These findings have cautionary implications for the design of crowdsourcing competitions.
Text
rsif20140532.pdf
- Accepted Manuscript
More information
Accepted/In Press date: 24 July 2014
e-pub ahead of print date: 20 August 2014
Published date: 20 August 2014
Organisations:
Agents, Interactions & Complexity
Identifiers
Local EPrints ID: 367890
URI: http://eprints.soton.ac.uk/id/eprint/367890
ISSN: 1742-5689
PURE UUID: 61846bd6-e4a2-4c6a-9b6a-81150915508e
Catalogue record
Date deposited: 11 Aug 2014 09:03
Last modified: 14 Mar 2024 17:38
Export record
Altmetrics
Contributors
Author:
Victor Naroditskiy
Author:
Nicholas R. Jennings
Author:
Pascal Van Hentenryck
Author:
Manuel Cebrian
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics