Franklin Kramer
Background Experiment Results Conclusions Overview
Online labor market still in early stages How do you determine wages? If it takes 30 seconds to complete one HIT properly, then a price of $0.05 per HIT works out to a rate $6/hour. To what extent are workers affected by time it takes to complete a task (extra time spent, accuracy of results?)? Background
“Copy numbers from a random generator.” Page designed differently for each experimental group (0, 3, 6, 9 second delay) Created log with numbers and timestamps generated in background Experimental Design
Results % error Time delay before number generated (in seconds)
Results Time taken to submit HIT (seconds) Workers (sorted by time increasing) Workers (sorted by time increasing) by Time to Submit HIT
Results Time taken to submit HIT (seconds) Workers (sorted by time increasing) Workers by Time to Submit HIT (sorted by time increasing, total waiting times subtracted per group)
Results Time Order Number Order of Number Generated (second, third, fourth) by Amount of Time to Generate Number (waiting times removed)
Mechanical Turk workers tend to give accurate results independently of the amount of time it takes for the task to be done Waiting has varying effects on efficiency not necessarily dependent on waiting time Further research can be done on why delays in the extremes (0 and 9 seconds) made workers less efficient than midrange delays (3 and 6 seconds). Conclusions