CrowdMap: crowdsourcing ontology alignment with microtasks
CrowdMap: crowdsourcing ontology alignment with microtasks
The last decade of research in ontology alignment has brought a variety of computational techniques to discover correspondences between ontologies. While the accuracy of automatic approaches has continuously improved, human contributions remain a key ingredient of the process: this input serves as a valuable source of domain knowledge that is used to train the algorithms and to validate and augment automatically computed alignments. In this paper, we introduce CROWDMAP, a model to acquire such human contributions via microtask crowdsourcing. For a given pair of ontologies, CROWDMAP translates the alignment problem into microtasks that address individual alignment questions, publishes the microtasks on an online labor market, and evaluates the quality of the results obtained from the crowd. We evaluated the current implementation of CROWDMAP in a series of experiments using ontologies and reference alignments from the Ontology Alignment Evaluation Initiative and the crowdsourcing platform CrowdFlower. The experiments clearly demonstrated that the overall approach is feasible, and can improve the accuracy of existing ontology alignment solutions in a fast, scalable, and cost-effective manner.
978-3-642-35175-4
525-541
Sarasua, C.
acb935ee-4bc2-4a92-9c09-0fa737f593e8
Simperl, E.
40261ae4-c58c-48e4-b78b-5187b10e4f67
Noy, N.
2ec5c985-b466-4bc6-a91e-2ea961eb4fe2
15 November 2012
Sarasua, C.
acb935ee-4bc2-4a92-9c09-0fa737f593e8
Simperl, E.
40261ae4-c58c-48e4-b78b-5187b10e4f67
Noy, N.
2ec5c985-b466-4bc6-a91e-2ea961eb4fe2
Sarasua, C., Simperl, E. and Noy, N.
(2012)
CrowdMap: crowdsourcing ontology alignment with microtasks.
11th International Semantic Web Conference (ISWC2012), Boston, United States.
11 - 15 Nov 2012.
.
(doi:10.1007/978-3-642-35176-1_33).
Record type:
Conference or Workshop Item
(Paper)
Abstract
The last decade of research in ontology alignment has brought a variety of computational techniques to discover correspondences between ontologies. While the accuracy of automatic approaches has continuously improved, human contributions remain a key ingredient of the process: this input serves as a valuable source of domain knowledge that is used to train the algorithms and to validate and augment automatically computed alignments. In this paper, we introduce CROWDMAP, a model to acquire such human contributions via microtask crowdsourcing. For a given pair of ontologies, CROWDMAP translates the alignment problem into microtasks that address individual alignment questions, publishes the microtasks on an online labor market, and evaluates the quality of the results obtained from the crowd. We evaluated the current implementation of CROWDMAP in a series of experiments using ontologies and reference alignments from the Ontology Alignment Evaluation Initiative and the crowdsourcing platform CrowdFlower. The experiments clearly demonstrated that the overall approach is feasible, and can improve the accuracy of existing ontology alignment solutions in a fast, scalable, and cost-effective manner.
This record has no associated files available for download.
More information
Published date: 15 November 2012
Venue - Dates:
11th International Semantic Web Conference (ISWC2012), Boston, United States, 2012-11-11 - 2012-11-15
Organisations:
Web & Internet Science
Identifiers
Local EPrints ID: 351611
URI: http://eprints.soton.ac.uk/id/eprint/351611
ISBN: 978-3-642-35175-4
PURE UUID: 7ea7eabc-080d-436b-8741-5834d498a648
Catalogue record
Date deposited: 29 Apr 2013 13:56
Last modified: 14 Mar 2024 13:41
Export record
Altmetrics
Contributors
Author:
C. Sarasua
Author:
N. Noy
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics
