Huynh, Trung Dong, Ebden, Mark, Venanzi, Matteo, Ramchurn, Sarvapali, Roberts, Stephen and Moreau, Luc (2013) Interpretation of Crowdsourced Activities Using Provenance Network Analysis. The First AAAI Conference on Human Computation and Crowdsourcing, Palm Springs, United States. 06 - 09 Nov 2013.
Abstract
Understanding the dynamics of a crowdsourcing application and controlling the quality of the data it generates is challenging, partly due to the lack of tools to do so. Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer their quality. It can also reveal the processes that led to a data item and the interactions of contributors with it. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analysing provenance graphs, constructed from provenance records, to learn about such patterns and to use them for assessing some key properties of crowdsourced data, such as their quality, in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.
More information
Identifiers
Catalogue record
Export record
Contributors
University divisions
- Faculties (pre 2018 reorg) > Faculty of Physical Sciences and Engineering (pre 2018 reorg) > Electronics & Computer Science (pre 2018 reorg) > Agents, Interactions & Complexity (pre 2018 reorg)
Current Faculties > Faculty of Engineering and Physical Sciences > School of Electronics and Computer Science > Electronics & Computer Science (pre 2018 reorg) > Agents, Interactions & Complexity (pre 2018 reorg)
School of Electronics and Computer Science > Electronics & Computer Science (pre 2018 reorg) > Agents, Interactions & Complexity (pre 2018 reorg)
Current Faculties > Faculty of Engineering and Physical Sciences > School of Electronics and Computer Science > Agents, Interactions and Complexity > Agents, Interactions & Complexity (pre 2018 reorg)
School of Electronics and Computer Science > Agents, Interactions and Complexity > Agents, Interactions & Complexity (pre 2018 reorg) - Faculties (pre 2018 reorg) > Faculty of Physical Sciences and Engineering (pre 2018 reorg) > Electronics & Computer Science (pre 2018 reorg) > Web & Internet Science (pre 2018 reorg)
Current Faculties > Faculty of Engineering and Physical Sciences > School of Electronics and Computer Science > Electronics & Computer Science (pre 2018 reorg) > Web & Internet Science (pre 2018 reorg)
School of Electronics and Computer Science > Electronics & Computer Science (pre 2018 reorg) > Web & Internet Science (pre 2018 reorg)
Current Faculties > Faculty of Engineering and Physical Sciences > School of Electronics and Computer Science > Web and Internet Science > Web & Internet Science (pre 2018 reorg)
School of Electronics and Computer Science > Web and Internet Science > Web & Internet Science (pre 2018 reorg)
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.