Tests and Measurements Intersession 2006

Examiner/Test-Taker Relationship Children: Rapport, IQ tests and age of child Familiarity Adults: Attitudinal studies

Race of Tester Little evidence race of tester affects performance on IQ Why? Testing limits

Language and Training Knowledge of language can influence scores Translation of test Interpreters Training: generally, more is better

Expectancy Effects aka Rosenthal effects Told success vs. failure expected (1 point on 20 scale difference) Seen in some situations (not all) Subtle nonverbal cues? Scoring?

Reinforcing Responses Rewards can affect behaviour Children and IQ: Tangible rewards vs. praise Complicated results Attitudinal studies Nodding Random reinforcing

Computer-Assisted Test Administration Advantages Sensitive information Interpretive reports Can have undetected scoring problems

State of the Test Taker Motivation and anxiety Illness Drugs Hormones

Behavioural Assessment Observer Reactivity Reliability and validity highest when observed Drift Contrast effect Expectancies Rating accuracy Halo effect

Interviews Standardized/structured Unstructured Always have a purpose Mutual interaction that influences Social facilitation Interviewers: set a relaxed and warm environment, but remain in control

Effective Interviewing Attitude Avoid Judgmental or evaluative statements Probing statements Hostile responses False reassurance Flow of interview: Close-ended questions Open-ended questions

Flow Responses Transitional phrase Verbatim playback Paraphrasing and restating Summarizing Clarification Empathy/understanding

Measuring Understanding Active listening = using understanding statements Carkhuff and colleagues 5-point scale Level 1 – no relationship to interviewee’s response Level 2 – superficial awareness of meaning Level 3 – interchangeable with response (paraphrase, verbatim playback, clarification, restatements), Level 4 – go noticeably beyond statement Level 5 – go significantly beyond statement

Types of Interviews Evaluation Confrontation Direct questions Structured clinical interview Spitzer et al. – SCID DISC

Types of Interviews Case History Interview Major life events, education, work, medical, family, relationships More information is often better Using computers? Mental Status Exam Diagnose psychosis, brain damage, etc

Source:

Types of Interviews Employment Interview Best: structured format Hired Rejected First impressions Interviewing Skills Familiarize with research and theory Supervised practice Apply good interviewing principles

Error in Interviewing Interview validity Natural errors in observation and judgment Halo effect General standoutishness Cross-cultural/class differences Consider interview data tentative Interview Reliability Interinterviewer agreement

Reducing Error Interviews: imposing structure Provide interviewers with scripts and standard sets of questions Develop scoring guides for interviewee responses Use multiple interviews