The importance of context and stimulus sampling in mockwitness tasks: Perceptual similarity may not be enough Stephen J. Ross 1, Roy S. Malpass 2, & Lisa.

Slides:



Advertisements
Similar presentations
How Accurately Can Laypersons Predict Factors That Affect Eyewitness Testimony?
Advertisements

In Today’s Society Education = Testing Scores = Accountability Obviously, Students are held accountable, But also!  Teachers  School districts  States.
Factors affecting EWT Age. Starter activity Think and make notes in pairs about the following two questions: O How do you think “Age” may affect the accuracy.
Module 36: Correlation Pitfalls Effect Size and Correlations Larger sample sizes require a smaller correlation coefficient to reach statistical significance.
Realism in Assessment of Effort Estimation Uncertainty: It Matters How You Ask By Magne Jorgensen IEEE Transactions on Software Engineering Vol. 30, No.
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
Educational Research: Sampling a Population
Effects of sex and gender role identification on male face evaluation Kathryn R. Macapagal, M.Ed. 1,2, Heather A. Rupp, Ph.D. 2, & Julia R. Heiman, Ph.D.
Who are the participants? Creating a Quality Sample 47:269: Research Methods I Dr. Leonard March 22, 2010.
Defining Performance and Choosing a Measurement Approach: Overview
AGEC 608 Lecture 14, p. 1 AGEC 608: Lecture 14 Objective: Provide overview of contingent valuation method (CVM) and review strengths and weaknesses of.
11 Populations and Samples.
Chapter 6 Variables Used in Experimentation ♣ ♣ Types of Variables   The Independent Variable   The Dependent Variable   Demo: Identifying IVs and.
Chapter 5.
Agenda: Block Watch: Random Assignment, Outcomes, and indicators Issues in Impact and Random Assignment: Youth Transition Demonstration –Who is randomized?
Efsa LEARNING PROGRAMME Module 4 - Session 4.5a Non - Probability Sampling Methods.
Chapter 4 Selecting a Sample Gay, Mills, and Airasian
Carolyn Awalt University of Texas at El Paso Paul Resta
Classroom Assessment A Practical Guide for Educators by Craig A
Community Surveys and Preferences for Policing Dr. Paul Norris (University of Edinburgh)
Assessing the Heritage Planning Process: the Views of Citizens Assessing the Heritage Planning Process: the Views of Citizens Dr. Michael MacMillan Department.
Measurement and Data Quality
Identification of Misfit Item Using IRT Models Dr Muhammad Naveed Khalid.
Criminal Procedure for the Criminal Justice Professional 11th Edition
© 2013 Cengage Learning. Outline  Types of Cross-Cultural Research  Method validation studies  Indigenous cultural studies  Cross-cultural comparisons.
1 Item Analysis - Outline 1. Types of test items A. Selected response items B. Constructed response items 2. Parts of test items 3. Guidelines for writing.
Collecting Quantitative Data
Authentic Assessment Lynne E. Houtz, Ph.D. Associate Professor of Education Creighton University.
Welcome to the Data Warehouse HOME HELP COGNITIVE LEVELS Assessments COGNITIVE LEVELS.
Chapter 4 Selecting a Sample Gay and Airasian
Chapter 5 Selecting a Sample Gay, Mills, and Airasian 10th Edition
Quasi Experimental Methods I Nethra Palaniswamy Development Strategy and Governance International Food Policy Research Institute.
Southern Methodist UniversityPSYC Observation Chapter 4.
Systematic Review Module 7: Rating the Quality of Individual Studies Meera Viswanathan, PhD RTI-UNC EPC.
ATTRIBUTEDESCRIPTION Focal Knowledge, Skills, Abilities The primary knowledge / skills / abilities (KSAs) targeted by this design pattern. RationaleHow/why.
Teaching Today: An Introduction to Education 8th edition
Students’ and Faculty’s Perceptions of Assessment at Qassim College of Medicine Abdullah Alghasham - M. Nour-El-Din – Issam Barrimah Acknowledgment: This.
Performance Assessment OSI Workshop June 25 – 27, 2003 Yerevan, Armenia Ara Tekian, PhD, MHPE University of Illinois at Chicago.
No criminal on the run The concept of test of significance FETP India.
Project Director: Brian Ostrom, Ph.D. National Center for State Courts Assessing Consistency & Fairness in Sentencing: A Comparative Study in Three States.
Teaching Research Methods: Resources for HE Social Sciences Practitioners Random Sampling.
Standard Setting Results for the Oklahoma Alternate Assessment Program Dr. Michael Clark Research Scientist Psychometric & Research Services Pearson State.
1 Item Analysis - Outline 1. Types of test items A. Selected response items B. Constructed response items 2. Parts of test items 3. Guidelines for writing.
Statistical Inference An introduction. Big picture Use a random sample to learn something about a larger population.

Bangor Transfer Abroad Programme Marketing Research SAMPLING (Zikmund, Chapter 12)
STATISTICAL DATA GATHERING: Sampling a Population.
Chapter 6 - Standardized Measurement and Assessment
CONCEPT, PROCEDURES, ADVANTAGES & DISADVANTAGES Point Method of Job Evaluation By: Arthur Gonzaga.
Assessment My favorite topic (after grammar, of course)
Exclusionary Rule and Identification Procedures
A DDITIONAL I NFORMATION : P OINTLESS OR N ECESSARY ? Grace Desjardins The Academy of Notre Dame de Namur Grade 9.
 Approximately 75,000 defendants are implicated by eyewitnesses in the U.S. every year, but unfortunately, some eyewitnesses make mistakes.
Statistical Inferences for Variance Objectives: Learn to compare variance of a sample with variance of a population Learn to compare variance of a sample.
There is no question appearance is important when making judgments. A mug shot of a felon wanted for gang affiliation spread virally through social media.
Poster presented at APS 2014 Abstract This study was conducted to determine if explaining criminal behavior influences later identification. Schooler and.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Research in Psychology. Quantitative Methods  Quantitative: experiments and studies gathering data with questionnaires and analyzing results with correlations.
Designing Quality Assessment and Rubrics
Cognitive model of stereotype change: Hewstone & Johnston
Personality Assessment, Measurement, and Research Design
African-American Stimuli
Alison Burros, Nathan Herdener, & Mei-Ching Lien
SAMPLING (Zikmund, Chapter 12.
CHAPTER 21: Comparing Two Means
Identification parades:
Personality Assessment, Measurement, and Research Design
Validity and Reliability II: The Basics
Crucial Traits for Highly Effective Management Development Programmer
Presentation transcript:

The importance of context and stimulus sampling in mockwitness tasks: Perceptual similarity may not be enough Stephen J. Ross 1, Roy S. Malpass 2, & Lisa D. Topp 3 1 Florida International University 2 University of Texas at El Paso 3 Stephen F. Austin State University

Evaluating Lineup Fairness Using mock witnesses Using mock witnesses – An individual who did not witness a crime but is asked to view a lineup and select the suspect Rationale Rationale – If a lineup is constructed appropriately, each person in the lineup should have an equal chance of being selected Determining Fairness Determining Fairness – Biased if proportion of suspect identifications differs from chance expectancy – Lineup can also be considered unfair if the fillers in the lineup are not reasonable alternatives to the suspect

Lineup Fairness What is the MW task concerned with? What is the MW task concerned with? – Focus should be on having MW determine “who is the accused?” (Wells & Bradfield, 1998) – “Suspect stands out” or “Suspect stands out compared to the description of the perp”? Similarity is associated with lineup fairness estimates Similarity is associated with lineup fairness estimates – Perceptual similarity is not just physical similarity Individuals also use inferred connotative information from individuals when forming similarity judgments (Rhodes, 1988; Ross, 2008) Individuals also use inferred connotative information from individuals when forming similarity judgments (Rhodes, 1988; Ross, 2008) MW report “criminality” as a contributor to choice (McQuiston & Malpass, 2002) MW report “criminality” as a contributor to choice (McQuiston & Malpass, 2002)

Three Questions…. Does description presence influence lineup fairness? Does description presence influence lineup fairness? – Do MW use different information depending on presence absence of description? Does filler pool source influence MW evals? Does filler pool source influence MW evals? – Are college student filler pools equivalent to criminal filler pools? Do they vary in similarity & inferred characteristics? Do they vary in similarity & inferred characteristics? How does this variation influence lineup fairness assessments? How does this variation influence lineup fairness assessments? Does context influence lineup fairness? Does context influence lineup fairness? – Do MW use different information depending on the context the photoarray is presented in (i.e., criminal v. volunteer)?

Method - Materials Constructed 13 lineups Constructed 13 lineups – 8 criminal – 5 layperson Varied in similarity Varied in similarity

Very Dissimilar

Dissimilar

Moderately Similar

Very Similar

Very Dissimilar Very Similar

Method – Participants & Procedure 689 undergrads 689 undergrads – 129 trait/similarity raters – 560 mockwitnesses Trait/Similarity ratings Trait/Similarity ratings – Rated each individual on 7 characteristics – Assessed similarity of potential fillers with target individual Mockwitness evaluations Mockwitness evaluations – Assessed lineup fairness (bias & size)

Results – Bias (desc) r = -.81

Results – Size (desc) r =.64

Results – Bias (no desc) r =.21

Results – Size (no desc) r = -.34

What are MW basing decision upon? When told suspected of committing a crime – Description provided: similarity # of MW choices – No description provided: criminality # of MW choices DescNo desc Choice/similarity Choice/criminality.17.51

Do college students differ from criminals? Criminal College Student Similarity Distinctiveness Memorability Attractiveness Baby-facedness Criminality Dangerousness Likeability p = ns p <.05

– College students produces lineups that are more unfair even though similarity is the same Do college students differ from criminals?

– College students produces lineups that are more unfair even though similarity is the same Do college students differ from criminals?

Take-home Message Information used by MW varies as a function of description presence and question asked While college students did not differ from criminals in their perceived similarity to the target, they did differ on key inferred traits – Lineups using college students as fillers were evaluated to be more unfair than lineups using criminal mugshots even though the perceived similarity was the same What is the appropriate question to be asked? Does the suspect stand out in the lineup? OR Taking into account the description provided by the witness, does the suspect stand out?

Current/Future Research Replication Similarity structure across various construction techniques

Thank You!!