Multidimensional News Quality: A Comparison of Crowdsourcing and Nichesourcing
Multidimensional News Quality: A Comparison of Crowdsourcing and Nichesourcing
In the age of fake news and of filter bubbles, assessing the quality of information is a compelling issue: it is important for users to understand the quality of the information they consume online. We report on our experiment aimed at understanding if workers from the crowd can be a suitable alternative to experts for information quality assessment. Results show that the data collected by crowdsourcing seem reliable. The agreement with the experts is not full, but in a task that is so complex and related to the assessor’s background, this is expected and, to some extent, positive.
Association for Computing Machinery
Maddalena, Eddy
397dbaba-4363-4c11-8e52-4a7ba4df4bae
Ceolin, Davide
51d8eaac-ba0e-4c31-92f3-f42ae2608409
Mizzaro, Stefano
7be30144-afe5-42bb-a861-59a451decc20
22 October 2018
Maddalena, Eddy
397dbaba-4363-4c11-8e52-4a7ba4df4bae
Ceolin, Davide
51d8eaac-ba0e-4c31-92f3-f42ae2608409
Mizzaro, Stefano
7be30144-afe5-42bb-a861-59a451decc20
Maddalena, Eddy, Ceolin, Davide and Mizzaro, Stefano
(2018)
Multidimensional News Quality: A Comparison of Crowdsourcing and Nichesourcing.
In Proceedings of the 6th International Workshop on News Recommendation and Analytics (INRA 2018).
Association for Computing Machinery.
4 pp
.
Record type:
Conference or Workshop Item
(Paper)
Abstract
In the age of fake news and of filter bubbles, assessing the quality of information is a compelling issue: it is important for users to understand the quality of the information they consume online. We report on our experiment aimed at understanding if workers from the crowd can be a suitable alternative to experts for information quality assessment. Results show that the data collected by crowdsourcing seem reliable. The agreement with the experts is not full, but in a task that is so complex and related to the assessor’s background, this is expected and, to some extent, positive.
This record has no associated files available for download.
More information
Published date: 22 October 2018
Identifiers
Local EPrints ID: 427997
URI: http://eprints.soton.ac.uk/id/eprint/427997
PURE UUID: 7586a025-2b71-4b97-9bce-933002f19854
Catalogue record
Date deposited: 06 Feb 2019 17:30
Last modified: 08 Dec 2023 17:37
Export record
Contributors
Author:
Davide Ceolin
Author:
Stefano Mizzaro
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics