The ActiveCrowdToolkit: An Open-Source Tool for Benchmarking Active Learning Algorithms for Crowdsourcing Research
Venanzi, Matteo, Parson, Oliver, Rogers, Alex and Jennings, Nicholas R. (2015) The ActiveCrowdToolkit: An Open-Source Tool for Benchmarking Active Learning Algorithms for Crowdsourcing Research At The Third AAAI Conference on Human Computation and Crowdsourcing (HCOMP-2015).
- Accepted Manuscript
We present an open-source toolkit that allows the easy comparison of the performance of active learning methods over a series of datasets. The toolkit allows such strategies to be constructed by combining a judgement aggregation model, task selection method and worker selection method. The toolkit also provides a user interface which allows researchers to gain insight into worker performance and task classification at runtime.
|Item Type:||Conference or Workshop Item (Paper)|
|Venue - Dates:||The Third AAAI Conference on Human Computation and Crowdsourcing (HCOMP-2015), 2015-08-18
|Organisations:||Agents, Interactions & Complexity|
|Date Deposited:||18 Aug 2015 11:01|
|Last Modified:||22 Feb 2017 08:18|
HUMAN-AGENT COLLECTIVES: FROM FOUNDATIONS TO APPLICATIONS [ORCHID]
Funded by: EPSRC (EP/I011587/1)
Led by: Nick Jennings
1 January 2011 to 31 December 2015
|Further Information:||Google Scholar|
|RDF:||RDF+N-Triples, RDF+N3, RDF+XML, Browse.|
Actions (login required)