Open and Online Experimental Philosophy (X-Phi) Kathryn Francis (PCLS, Dept. of Philosophy) Nat Hansen (Dept. of Philosophy) Phil Beaman (PCLS)

“I know that I will make it to work on time”

“hmm…”

Reliability and Validity Our Project Reliability and Validity Number of scenarios: 1  6 Number of stakes: 1  5 Stakes as scalar not binary MED 1 HIGH LOW MED 2

Replication Many findings impossible to replicate in further investigations

Amazon Mechanical Turk 26k+ papers 100k+

Amazon Mechanical Turk

Amazon Mechanical Turk Virtual Private Servers (VPS) MTurk-based studies compromised by responses from individuals using VPS (faking their location) Bypass exclusion criteria Complete multiple times

Amazon Mechanical Turk Virtual Private Servers (VPS)

But?

How “Open”? 44.8292 10.32am Amtrak WiFi -71.4132 11.32am GPS Coordinates Start/Finish IP Tracker 44.8292 10.32am Amtrak WiFi -71.4132 11.32am How “open” should our open research practices be if sharing our resources could facilitate the misuse or abuse of participant data?

Interdisciplinary approach has allowed us to incorporate new experimental designs: Greater statistical power & generalizability Produce informative experimental tools for future Pre-registering replication, publishing open-access, online filtering has allowed us to : Quality: finer-grained & accurate picture Transparency: access to procedure, materials, data Reproducibility & Replicability

Nat Hansen (Dept. of Philosophy) Thank you! Nat Hansen (Dept. of Philosophy) Phil Beaman (PCLS)