1. Technische Universität München Institute for Data Processing QualityCrowd2 Christian Keimel Institute for Data Processing Technische Universität München

2. Technische Universität München Institute for Data Processing Christian Keimel QualityCrowd2 framework – Token concept QualityCrowd2 Token-Concept 2 July 2012 CrowdSourcing Platform QualityCrowd2 Framework Worker pull task 1 enter token 4 payment 6 work 2 xy319932e3 receive token 3 validate token 5

3. Technische Universität München Institute for Data Processing Christian Keimel Batch overview Different batches for different test campaigns can be defined QualityCrowd2 - Backend 3 10/2012

4. Technische Universität München Institute for Data Processing Christian Keimel Batch definiton Each batch has some overall properites and consists of individual steps, representing questions and test stimuli QualityCrowd2 - Backend 4 10/2012

5. Technische Universität München Institute for Data Processing Christian Keimel Batch script language Batches are defined via a simple script language, QC-Script Documenation is provided online QualityCrowd2 - Backend 5 10/2012

6. Technische Universität München Institute for Data Processing Christian Keimel Batch results & export Overall statistics are shown for a quick overview Results can be exported in CSV and XLSX format QualityCrowd2 - Backend 6 10/2012

7. Technische Universität München Institute for Data Processing Christian Keimel Results for each step For each step, a short individual statistic is shown QualityCrowd2 - Backend 7 10/2012

8. Technische Universität München Institute for Data Processing Christian Keimel Results for each step Also a short browser and system statistic is provided QualityCrowd2 - Backend 8 10/2012

9. Technische Universität München Institute for Data Processing Christian Keimel Conclusion More information and download available at Conclusion 9 10/2012 Thank you for your attention! www.ldv.ei.tum.de/videolab