Franklin Kramer.   Background  Experiment  Results  Conclusions Overview.

Slides:



Advertisements
Similar presentations
1 Evaluation Rong Jin. 2 Evaluation  Evaluation is key to building effective and efficient search engines usually carried out in controlled experiments.
Advertisements

IGCSE Coursework August 2011 The write up for this experiment should be word processed if possible A hard copy should be submitted by next Monday No excuses.
TI: An Efficient Indexing Mechanism for Real-Time Search on Tweets Chun Chen 1, Feng Li 2, Beng Chin Ooi 2, and Sai Wu 2 1 Zhejiang University, 2 National.
Teacher Directions Overview: Students will use various technology skills to create slides showing the stages of the life cycle of a frog. Extra slides.
Aggregate Demand & Supply Chapter 22. Behavior of Aggregate Demand’s Component Parts.
1 Unsupervised Learning With Non-ignorable Missing Data Machine Learning Group Talk University of Toronto Monday Oct 4, 2004 Ben Marlin Sam Roweis Rich.
THE NATURAL UNEMPLOYMENT RATE Recall: 1) when the economy is at full employment, there is still some amount of unemployment. (recall the definition of.
Productivity and Costs By Rupa Kaur And Cristina Ontiveros.
1 Start at Estimating Cable Labor Howard Budd University of Rochester Rochester Meeting Nov
Do you have a job during the school year? 1.No. 2.Yes, less than 10 hours per week. 3.Yes, between 10 and 20 hours per week. 4.Yes, 20 or more hours per.
LAW OF DIMINISHING RETURNS. What is the Purpose? The Purpose of the Law of Diminishing Returns is to measure how efficient a business is making a product,
Law of Variable Proportions
Chapter 5 - Introduction to Supply Supply is the amount of a product that would be offered for sale at all possible prices in the market. The Law of Supply.
Fluency. Virginia Standards of Learning for Fluency 1.8 The student will read familiar stories, poems, and passages with fluency and expression. First.
. Throughout the late nineteenth century, the inventions of steel, the moving assembly line, and the automobile revolutionized American industry and urban.
© 2015 albert-learning.com Marketing Research Process MARKETING RESEARCH PROCESS.
AP Bell Ringer Sit in your regular number seat On as Sheet of Paper Define: Control Group Treatment Group Variable Independent Variable Dependent Variable.
Supply Chapter 5.
1 Work Sampling Can provide information about men and machines in less time and lower cost. It has three main uses: 1.Activity and delay sampling To measure.
Introduction The large amount of traffic nowadays in Internet comes from social video streams. Internet Service Providers can significantly enhance local.
Author: J R Reid Extended Investigation Introduction Planning an Investigation Writing a Report Data Collection Data Processing Conclusions and Discussions.
Comparing the Effectiveness of Alternative Approaches for Displaying Edit-Error Messages in Web Forms Bill Mockovak Office of Survey Methods Research Bureau.
Chapter 12 Jones, Investments: Analysis and Management
The Cost-Minimizing Input Combinations. 1. Alternative Input Combinations ▫Substitutes and Complements in Factor Markets  Review of Substitutes and Complements.
Scientific Notation. Example 1: 1000 Example 2:
Principles of Economics Ohio Wesleyan University Goran Skosples Supply, Demand, and Government Policies 6. Supply, Demand, and Government Policies.
Research Design. A controlled experiment needs to be carefully designed so that extraneous variables are minimised. This ensures that the independent.
Economics Chapter 5: Supply Economics Chapter 5: Supply Supply is the amount of a product that would be offered for sale at all possible prices in the.
INVESTMENTS: Analysis and Management Second Canadian Edition INVESTMENTS: Analysis and Management Second Canadian Edition W. Sean Cleary Charles P. Jones.
This Tip Sheet focuses on the steps required to review the agency Census & Waiting List, generate reports and submit monthly data to ADAA. Total Pages:
2.10 Entrepreneurship I.  A category of expenditure that a business incurs as a result of performing its normal business operations.  Examples include:
Economic Activity and Productivity. To the economist, a market is a location or situation where buyers and sellers exchange an economic product Markets.
1 Automatic Classification of Bookmarked Web Pages Chris Staff Third Talk February 2007.
Cost Analysis Control costs and expenses Improve cost structure – problems show up Cost structure – relative proportion of each type of cost – fixed, variable,
The Effects of Operating Conditions on Speed and Power of Replica – Based SRAM Circuits Nika Sharifvaghefi Nicholas Kumar EE241 - Spring 2012.
10 Aug 2010 ECE/BENG-493 SENIOR ADVANCED DESIGN PROJECT Meeting #2.
David Ackerman, Associate VP Crystal Butler, Research Associate.
Artificial Neural Networks Approach to Stock Prediction Presented by Justin Jaeck.
11 Online Computing and Predicting Architectural Vulnerability Factor of Microprocessor Structures Songjun Pan Yu Hu Xiaowei Li {pansongjun, huyu,
Self Service Reporting Portal for Business Cizer.Net Reporting 4.0 Lower IT Overhead & Eliminate Delays in the flow of Business Intelligence.
Waste treatment after a radiological accident Miliza Malmelin.
1. STARTING POINT Data is an important part of helping State and Local HDs achieve better health outcomes for their constituencies. Currently there appear.
Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks EMNLP 2008 Rion Snow CS Stanford Brendan O’Connor Dolores.
1 Work Orders. 2 Generating a Work Order There are two methods to generating a Work Order in the WYNNE STSTEM. First method: Option 11 – 12 – 13 * Open.
Understand Project Costs…  How much will the project cost?  Are we on budget?  How much have we spent on materials versus labor?
By Franklin Kramer.   Crowdsourcing web service  Have turkers complete HITs for small amounts of money (most being 1-25 cents)  Can filter workers.
6.2 Factors of Polynomials Here are some graphs of different polynomials. Look at their end behavior and make some conjectures.
TOPIC 3 NOTES. AN INTRODUCTION TO DEMAND Demand depends on two variables: the price of a product and the quantity available at a given point in time.
Lab 0 – Uncertainties of Experimental Data Objectives: Learn how to find the lab instructions Learn how to express uncertainty in standard form Learn how.
LABOR UNIONS. Key Terms 1. Labor Union – organization of workers 2. Strike – workers refuse to work a. money b. benefits 3. lockout – when owners refuse.
GREEN EARTH Global Warming Project for 8th Grade Science Introduction
The Six Secrets to Going from Employee to Business Owner in 12 Months.
Trade-Off & Opportunity Cost
STUDY GUIDE: Page 11 -     Q7 Page 12 -     Q , 15 TEXT BOOK:
Theory Of Production.
SC3 – Business Planning (C)
Chapter 17 Appendix DERIVED DEMAND.
Co-Curricular Hours vs. Homework Hours
Internet Commerce Cisco Systems
Warm-up How do the owners of fast-food restaurants know how much food to produce each day? What would happen to the owner’s profits if they made too.
Conclusion.
Competitive Industry Report and Calculations
Labor Distribution Report
Chapter 10 EFFICIENCY.
Competitive Industry Report and Calculations
(you’ll continue this pattern down the rest of the page)
Title Presenter name DATE Towards a More Sustainable World.
Agenda for Unit 8: Defining Arrays in Game Programs
RANDOM NUMBERS SET # 1:
Presentation transcript:

Franklin Kramer

  Background  Experiment  Results  Conclusions Overview

  Online labor market still in early stages  How do you determine wages?  If it takes 30 seconds to complete one HIT properly, then a price of $0.05 per HIT works out to a rate $6/hour.  To what extent are workers affected by time it takes to complete a task (extra time spent, accuracy of results?)? Background

  “Copy numbers from a random generator.”  Page designed differently for each experimental group (0, 3, 6, 9 second delay)  Created log with numbers and timestamps generated in background Experimental Design

 Results % error Time delay before number generated (in seconds)

 Results Time taken to submit HIT (seconds) Workers (sorted by time increasing) Workers (sorted by time increasing) by Time to Submit HIT

 Results Time taken to submit HIT (seconds) Workers (sorted by time increasing) Workers by Time to Submit HIT (sorted by time increasing, total waiting times subtracted per group)

 Results Time Order Number Order of Number Generated (second, third, fourth) by Amount of Time to Generate Number (waiting times removed)

  Mechanical Turk workers tend to give accurate results independently of the amount of time it takes for the task to be done  Waiting has varying effects on efficiency not necessarily dependent on waiting time  Further research can be done on why delays in the extremes (0 and 9 seconds) made workers less efficient than midrange delays (3 and 6 seconds). Conclusions