Aggregating Labels in Crowdsourcing Data CERN Openlab Summer Students Lightning Talks Sessions Maria Priisalu › 19/08/2015
Crowdsourcing › Many workers › Easy tasks › Multiple answers › Little or no prior knowledge › Aggregate answers 19/08/2015 Maria Priisalu Note Image from Windows Clipart2
Advantages of Crowdsourcing › Costs less › Faster › Educate the worker 19/08/2014 First Name and Family Name Note: Images from Windows Clipart 3
Research in Crowdsourcing › Hybrid systems › Task scheduling › Learning algorithms › Aggregation 19/08/2015 Maria Priisalu Note: Image from Windows Clipart 4
Our implementation › Dawid-Skene model (EM) 19/08/2015Maria Priisalu5
Future (and current) work › Aggregation of other types of labels › Sociological aggregation › Educating the crowdworker 19/08/2014 Maria Priisalu Note: Image from Windows Clipart 6
The Webfest 19/08/2014Maria Priisalu7