Moving the Crowd: Incentives for Ureport Uganda
“I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell
Ushahidi’s Crisis Crowdsourcing SMS for rapid disaster response: Kenyan election violence Haiti earthquake Gulf Oil Spill Next step for SMS-based crowdsourcing: Normal, non-crisis settings ©Ushahidi Ory Okolloh
Outcomes of Interest Ureport: SMS-text system to aggregate citizen feedback Currently: 33,000 Ureporters Weekly polls: e.g., child labor Three questions: 1. Best method to recruit? 2. How to motivate reports? 3. Ureport’s effects on substantive development outcomes?
Randomized Controlled Trial (RCT) Intervention or treatment. Randomly assigned to a relatively large group of subjects. In expectation, randomization balances observable and unobservable confounding factors. Duflo & Hannah (2003) RCT used photos to reduce teacher absenteeism
What motivates the crowd? Intrinsic: The action is its own reward Extrinsic: Additional material rewards Possibilities: Intrinsic and extrinsic motives may have an additive effect. Or, extrinsic rewards may crowd out intrinsic motives.
Selected districts receive no intervention (but do receive polls & automated responses as usual) Justification: Provides comparison or baseline observations for all treatments Control Group
Treatments to Recruit Ureporters
Radio Ads Treatment: 5 ads per day over 5 days Justification: Intrinsic motivations to perform a pro-social activity.
Radio Lottery Treatment: Radio ads (5x 5 days) + promise of entry into lottery to win solar charger Justification: Adds extrinsic incentive to intrinsic motive
Treatments to Motivate Reports
Human Feedback Treatment: Researchers respond to each Ureport: Thanks Follow up Nudge back to topic Justification: Connection with actual human being enhances intrinsic motive.
Response Lottery Treatment: Ureporters who answer every poll are entered in lottery to win solar charger (1 winner per district) Justification: Addition of extrinsic incentive
“Twitter™” Networks Treatment: Through moderated groups, Ureporters communicate on specific topics of interest Justification: Peer-to-peer interaction to heighten intrinsic incentives
Results
Preliminary Results on Recruitment Radio Radio Lottery National Radio
Preliminary Results for at least One Response Condition Respons e Percent Control44% Radio63% Radio Lottery73% Human Feedback58% Response Lottery75% "Twitter"53% Total Subjects9,440 Control Radio Radio Lottery Human Feedback Response Lottery “Twitter”
Preliminary Results for Total Number of Responses ConditionAvg. Control2.9 Radio3.6 Radio Lottery5.4 Human Feedback4.9 Response Lottery6.4 "Twitter"4.5 Total Messages30,058 Control Radio Radio Lottery Human Feedback Response Lottery “Twitter”
Error Corrections? The crowd is pretty motivated already Intrinsic + extrinsic incentives appear additive A lot left to learn about and from crowdsourcing Next step for Ureport: Stock-outs of ACTs Next step for us: Keep thinking we might be mistaken Kenya’s iHub
AidData Enhanced Project View
Enhanced Project View and Crowd-sourcing INSERT IMAGES OF ENHANCED PROJECT VIEW MOCK-UPS HERE
Enhanced Project View and Crowd-sourcing INSERT IMAGES OF ENHANCED PROJECT VIEW MOCK-UPS HERE
Enhanced Project View and Crowd-sourcing INSERT IMAGES OF ENHANCED PROJECT VIEW MOCK-UPS HERE
Enhanced Project View and Crowd-sourcing INSERT IMAGES OF ENHANCED PROJECT VIEW MOCK-UPS HERE