A Novel, Countermeasure- proof, P300-Based Protocol for Detection of Concealed Information J.Peter Rosenfeld, Michael Winograd, Elena Labkovsky, Ann Ming.

Slides:



Advertisements
Similar presentations
J. Peter Rosenfeld, John Meixner, Michael Winograd, Elena Labkovsky, Alex Haynes, Northwestern University.
Advertisements

Helen Gaeta, David Friedman, & Gregory Hunt Cognitive Electrophysiology Laboratory New York State Psychiatric Institute Differential Effects of Stimulus.
Results and Discussion Logan Pedersen & Dr. Mei-Ching Lien School of Psychological Science, College of Liberal Arts Introduction A classic finding in Psychology.
Detecting Conflict-Related Changes in the ACC Judy Savitskaya 1, Jack Grinband 1,3, Tor Wager 2, Vincent P. Ferrera 3, Joy Hirsch 1,3 1.Program for Imaging.
Attention-Dependent Hemifield Asymmetries When Judging Numerosity Nestor Matthews & Sarah Theobald Department of Psychology, Denison University, Granville.
Countermeasures to P300- based Guilty Knowledge Tests of Deception J.Peter Rosenfeld, Matt Soskins,Joanna Blackburn, & Ann Mary Robertson Northwestern.
Countermeasures to P300- based Guilty Knowledge Tests of Deception J.Peter Rosenfeld, Matt Soskins,Joanna Blackburn, & Ann Mary Robertson Northwestern.
J. Peter Rosenfeld, John Meixner, Michael Winograd, Elena Labkovsky, Alex Sokolovsky, Xiaoxing Hu,Alex Haynes, Northwestern University.
Electrodermal Measures of Face Recognition Iowa State University of Science and Technology Alison L. MorrisDanielle R. Mitchell Nichole Stubbe Anne M.
Does radical type frequency reliably affect character recognition? Zih-Nian, Cong & Jei-Tun, Wu Department of Psychology, National Taiwan University, Taipei,
Does Prior Knowledge Affect Distraction? The Effects of Aging and Music Expertise on Reading with Distraction Elizabeth R. Graham, 1,2 Gabrielle Osborne,
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Experiment 2: MEG Study Materials and Methods: 11 right-handed subjects with 20:20 vision were run. 3 subjects’ data was discarded because of poor performance.
Visual Hemifields and Perceptual Grouping Sarah Theobald & Nestor Matthews Department of Psychology, Denison University, Granville OH USA The human.
ERPs in Deception, Malingering, and False Memory J. Peter Rosenfeld Psychology Department Northwestern University Evanston Illinois,USA.
Attention Limited amount of mental resources Mental “resources” = general term could refer mental processes, mental representations, or mental structures.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
Experimental Designs Psych 231: Research Methods in Psychology.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
The Experimental Approach September 15, 2009Introduction to Cognitive Science Lecture 3: The Experimental Approach.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Experimental Design Tali Sharot & Christian Kaul With slides taken from presentations by: Tor Wager Christian Ruff.
Recruitment success and variability in marine fish populations: Does age-truncation matter? Sarah Ann Siedlak 1, John Wiedenmann 2 1 University of Miami,
Effects of Warning Validity and Proximity on Responses to Warnings Joachim Meyer, Israel HUMAN FACTORS, Vol. 43, No. 4 (2001)
Hypothesis Testing Section 8.2. Statistical hypothesis testing is a decision- making process for evaluating claims about a population. In hypothesis testing,
Figure 3: H5 Probe and Control Data Bar 1: Percent correct on regular probe trials. Bar 2: Percent correct on probes with blind exp. Bar 3: Percent correct.
Block Types: Pure blocks of singleton search or feature search, plus mixed blocks of singleton search and feature search. Predictions Singleton Search:
Susceptibility Induced Loss of Signal: Comparing PET and fMRI on a Semantic Task Devlin et al. (in press)
IMPRINT models of training: Update on RADAR modeling MURI Annual Meeting September 12, 2008 Carolyn Buck-Gengler Department of Psychology, Institute of.
SIGNAL DETECTION IN FIXED PATTERN CHROMATIC NOISE 1 A. J. Ahumada, Jr., 2 W. K. Krebs 1 NASA Ames Research Center; 2 Naval Postgraduate School, Monterey,
Studying Memory Encoding with fMRI Event-related vs. Blocked Designs Aneta Kielar.
J. Peter Rosenfeld, Elena Labkovsky, Michael Winograd, Alex Haynes Northwestern University Psychology Department, Institute of Neuroscience.
When Uncertainty Matters: The Selection of Rapid Goal-Directed Movements Julia Trommershäuser, Laurence T. Maloney, Michael S. Landy Department of Psychology.
Additional Statistical Investigations A paired t-test was performed to evaluate whether a perceptual learning process occurs between the initial baseline.
Training Phase Results The RT difference between gain and loss was numerically larger for the second half of the trials than the first half, as predicted,
Anti-terror uses of the P300- based,Concealed Information Test; Deception Awareness effects J. Peter Rosenfeld Northwestern University Psychology Department.
Distributed Representative Reading Group. Research Highlights 1Support vector machines can robustly decode semantic information from EEG and MEG 2Multivariate.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
The effects of working memory load on negative priming in an N-back task Ewald Neumann Brain-Inspired Cognitive Systems (BICS) July, 2010.
Experimental Psychology PSY 433
School of Computer Science 1 Information Extraction with HMM Structures Learned by Stochastic Optimization Dayne Freitag and Andrew McCallum Presented.
Categorization and Hypothesis Testing
Memory for Color in Familiar vs. Non-familiar Images Presented by: Megan Guenin.
When the brain is prepared to learn: Enhancing human learning using real- time fMRI Y, J. J. a, Hinds, O. b, Ofen, N. a, Thompson, T. W. b, Whitfield-Gabrieli,
Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,
J. Peter Rosenfeld, John Meixner, Michael Winograd, Elena Labkovsky, Alex Sokolovsky, Xiaoxing Hu,Alex Haynes, Northwestern University.
PET Count  Word Frequency effects (coefficients) were reliably related to activation in both the striate and ITG for older adults only.  For older adults,
J. Peter Rosenfeld, John Meixner, Michael Winograd, Elena Labkovsky, Alex Sokolovsky, Xiaoxing Hu,Alex Haynes, Northwestern University.
GRAPPLING WITH DATA Variability in observations Sources of variability measurement error and reliability Visualizing the sample data Frequency distributions.
Countermeasures to P300- based Guilty Knowledge Tests of Deception J.Peter Rosenfeld, Matt Soskins,Joanna Blackburn, & Ann Mary Robertson Northwestern.
A Comparison of Methods for Estimating the Capacity of Visual Working Memory: Examination of Encoding Limitations Domagoj Švegar & Dražen Domijan
J. Peter Rosenfeld, John Meixner, Michael Winograd, Elena Labkovsky, Alex Haynes, Northwestern University.
Alison Burros, Nathan Herdener, & Mei-Ching Lien
The New Complex Trial Protocol for Deception Detection with P300: Mock Crime Scenario and Enhancements J. Peter Rosenfeld, John Meixner, Michael Winograd,
The New Complex Trial Protocol for Deception Detection with P300: Mock Crime Scenario and Enhancements J. Peter Rosenfeld, John Meixner, Michael Winograd,
Volume 63, Issue 6, Pages (September 2009)
Variance priming. Variance priming. (A) Mean RTs for both levels of prime variance (x axis; high or low) and both levels of target variance (lines; high.
The New Complex Trial Protocol for Deception Detection with P300: Mock Crime Scenario and Enhancements J. Peter Rosenfeld, John Meixner, Michael Winograd,
The New Complex Trial Protocol for Deception Detection with P300: Mock Crime Scenario and Enhancements J. Peter Rosenfeld, John Meixner, Michael Winograd,
The Generality of Parietal Involvement in Visual Attention
Karl R Gegenfurtner, Jochem Rieger  Current Biology 
Intro to fMRI studies BCS204 Week 4.1 2/4/2019.
Medial Prefrontal and Subcortical Mechanisms Underlying the Acquisition of Motor and Cognitive Action Sequences in Humans  Etienne Koechlin, Adrian Danek,
Direct Two-Dimensional Access to the Spatial Location of Covert Attention in Macaque Prefrontal Cortex  Elaine Astrand, Claire Wardak, Pierre Baraduc,
A, Rewarded voluntary switch task, a combined risky decision-making and task-switching paradigm. A, Rewarded voluntary switch task, a combined risky decision-making.
Repetition suppression: Interaction between trials without (prime) versus with (target) context (C) and repeated versus non-repeated context (i.e., repetition.
Experimental procedures.
A Supramodal Number Representation in Human Intraparietal Cortex
Volume 63, Issue 6, Pages (September 2009)
Presentation transcript:

A Novel, Countermeasure- proof, P300-Based Protocol for Detection of Concealed Information J.Peter Rosenfeld, Michael Winograd, Elena Labkovsky, Ann Ming Lui Department of Psychology Institute for Neuroscience Northwestern University

Previous P300 DD protocols used Separate Probe(P),Irrelevant(I) and Target(T) trials. 80% to 95% correct detection rates….but…. *Rosenfeld et al. (2004) and Mertens, Allen et al. (2007):These methods are vulnerable to Counter-measures (CMs) via turning I’s into covert T’s.

Results from Rosenfeld et al. (2004): Farwell-Donchin paradigm (BAD and BCAD are 2 analysis methods.) Diagnoses of Guilty Guilty Group Innocent Group CM Group 9/11(82 %) 1/11(9%) 2/11(18%) Amplitude Difference (BAD) method,p=.1 Cross-Correlation(BC-AD ) Method, p=.1 6/11(54 %) 0/11(0%) 6/11(54 %)

Results (hit rates) from Rosenfeld et al. (2004): Rosenfeld paradigm Week BAD* BC-AD* 1: no CM 12/13(.92) 9/13(.69) 2: CM 6/12(.50) 3/12(.25) 3: no CM 7/12(.58) 3/12(.25) *Note: BCD and BAD are 2 kinds of analytic bootstrap procedures.

In the “Complex Trial Protocol,” P/I and T/NT decisions are separated: Two stimuli per trial, s apart. The first is P or I presented in white font. The second is the same P or I presented either in T color (green) or one of 4 non- T colors (red, yellow, etc.) (The second could also be T and NT numbers, or whatever.)

4 STIMULUS TYPES STIMULUS TYPE NUMBER PROBABILITY Probe Target Probe non-Target Irrelevant Target Irrelevant non-Target All Probes Oddballs One probe and 4 irrelevants P (T/P) =.5… vs… P (T/I) =.11 (Confound?)

DESIGN: as in ’04 paper, Exp. 2: 3 weeks in one group Week 1 Naïve Week 2 CM Week 3 Repeat Week 1 One block with one probe type, but category varied and counterbalanced across subjects/weeks: 1)mother’s first names 2) family surnames 3) home towns Main Study plus near replication. Innocent Control Group for FPs.

Countermeasures in Week 2: Also as in ’04 paper Left finger press to Irrelevant # 1 Left toe wiggle to Irrelevant # 2 Right toe wiggle to Irrelevant # 3 Imagine Prof slaps you for Irrelevant#4 All these are done covertly so that operator cannot detect them.

RTs (all stimuli). Replication like ‘04 study: no overlap.

P & I Individual RTs in CT Protocol (Flat liner at bottom did not beat test.)

Statistical tests within each subject: T/F-tests comparing Week 1 RT or RT Variance versus Week 2 are all p<.01, and <.001 in the one subject who beat the test in Week 2. Thus CM use is detectable.

In ’04 paper (old protocol), probe declines over weeks:

NEW RESULTS: P300s

P300, p-p

Two* possible (P-I) tests: 1)Traditional: Probe versus mean of all Irrelevants, P vs I-All. 2)Probe versus Maximum Irrelevant P vs I-max (“simple hit”) or Probe versus I-max not associated with elevated RT (“RT-screened Hit”). * at.9 or.95 confidence levels.

Main Study. Within-subject correct detections of guilty subjects based on bootstrap comparison of probe P300 against the average of all irrelevant P300s over 3 weeks. WEEK Hit Rate [Hit Rate] Week 1 (no CM): 11/12 (92%) [12/12*( 100%)] Week 2 (CM): 10/11 (91%) [11/12* (92%)] Week 3 (no CM): 11/12 (92%) [12/12* (100%)] Main Study: False positive(FP) group. Confidence=.9 Confidence=.95 Test FPs Hits A’ FPs Hits A’ Iall Imax

Main Study: Simple and RT-qualified diagnoses (at confidence =.9, Probe vs. Imax (or RT-qualified Imax) across 3 weeks (n values in parentheses). CM use also shown. Week 1 (12) Week 2 (11) Week 3 (12) Simple hits Hits/RT qualified CM use

Near Replication: Within-subject correct detections (“Hits”) of guilty subjects based on bootstrap comparison (at 2 confidence levels) of probe(P) P300 against the average of all irrelevant P300s (I-All) over weeks, and against the largest irrelevant P300 (I-Max). CONFIDENCE LEVEL: 0.90 WEEK P vs I-All: Hits, [FPs], A’ P vs I-Max: Hits, [FPs] A’ 1: 12/12 (100%),[8%].91 11/12 ( 92%), [0%].98 2: 12/12 (100%) 11/12 ( 92%) * 3: 9/10 (90%) 7/10 (70%) CONFIDENCE LEVEL: 0.95 WEEK P vs I-All: Hits, [FPs], A’ P vs I-Max: Hits, [FPs], A’ 1: 11/12 (92%),[0%].98 11/12 ( 92%), [0%].98 2: 12/12 (100%) 11/12 ( 92%) * 3: 9/11 (82%) ** 8/11 (73%)**

CTP Mock Crime Study: Preliminary Results. Note Target= (Mike Winograd’s study)

Conclusions (& Why ? ) The complex trial protocol is CM- resistant and accurate in the CIT Context. *The S1 involves no classification or decision, unlike older protocols, whose target classification task is removed, leaving all resources devoted to probe/irrelevant recognition. *CMs force more attention to first stimulus  increased probe (& Irrel) P300s.

NEXT? We need to extend CTP to our hybrid CQT screening protocol (Rosenfeld et al., 1991.) We need to try 3-4 blocks a session, each with different probe category. CTP should be even better with more Irrelevants.

A Novel, Countermeasure- proof, P300-Based Protocol for Detection of Deception (DD).