1. Open and Online Experimental Philosophy (X-Phi)
Kathryn Francis (PCLS, Dept. of Philosophy) Nat Hansen (Dept. of Philosophy) Phil Beaman (PCLS)

2. “I know that I will make it to work on time”

3. “hmm…”

4. Reliability and Validity
Our Project
Reliability and Validity
Number of scenarios: 1  6
Number of stakes: 1  5
Stakes as scalar not binary
MED 1
HIGH
LOW
MED 2

6. Replication
Many findings impossible to replicate in further investigations

7. Amazon Mechanical Turk
26k+ papers
100k+

8. Amazon Mechanical Turk

9. Amazon Mechanical Turk
Virtual Private Servers (VPS)
MTurk-based studies compromised by responses from individuals using VPS (faking their location)
Bypass exclusion criteria
Complete multiple times

10. Amazon Mechanical Turk
Virtual Private Servers (VPS)

11. But?

12. How “Open”? 44.8292 10.32am Amtrak WiFi -71.4132 11.32am
GPS Coordinates
Start/Finish
IP Tracker
10.32am
Amtrak WiFi
11.32am
How “open” should our open research practices be if sharing our resources could facilitate the misuse or abuse of participant data?

13. Interdisciplinary approach
has allowed us to incorporate new experimental designs:
Greater statistical power & generalizability
Produce informative experimental tools for future
Pre-registering replication, publishing open-access, online filtering
has allowed us to :
Quality: finer-grained & accurate picture
Transparency: access to procedure, materials, data
Reproducibility & Replicability

14. Nat Hansen (Dept. of Philosophy)
Thank you!
Nat Hansen (Dept. of Philosophy)
Phil Beaman (PCLS)