Maggie Selander, Julia Martin, Marie Ware, Caroline Lopez, Lynn.

Slides:



Advertisements
Similar presentations
The Rorschach Test Ink Blot Test MAKE-UP EDITION.
Advertisements

Standardized Scales.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Fundamentals of Psychological Testing PSYC 4500: Introduction to Clinical Psychology Brett Deacon, Ph.D. October 8, 2013.
Part II Sigma Freud & Descriptive Statistics
What is a Good Test Validity: Does test measure what it is supposed to measure? Reliability: Are the results consistent? Objectivity: Can two or more.
Part II Sigma Freud & Descriptive Statistics
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
The Effects of Achievement Priming on Expectations and Performance Kathryn Raso Team 14 PSY 321.
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
Assessment: Reliability, Validity, and Absence of bias
Concept of Measurement
Research Methods in MIS
Chapter 7 Correlational Research Gay, Mills, and Airasian
Assessing Personality
Assessing Personality
Classroom Assessment A Practical Guide for Educators by Craig A
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Personality and Individuality
What is a Hypothesis? RESEARCH METHODS. Scientific Process (G.A.D.D.I) 1.Identify a problem or question 2.Develop a hypothesis 3.Gather Data 4.Analyze.
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
TAYLOR HOWARD The Employment Interview: A Review of Current Studies and Directions for Future Research.
Athleticism, like intelligence, is many things
Projective Personality Tests. Based on PROJECTIVE HYPOTHESIS: Based on PROJECTIVE HYPOTHESIS: when people attempt to understand an ambiguous or vague.
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. The Nature of Research Chapter One.
Projective Assessment of Personality I Pertemuan 3 Matakuliah: Psikologi Diagnostik Tahun: 2010.
Office of Institutional Research, Planning and Assessment January 24, 2011 UNDERSTANDING THE DIAGNOSTIC GUIDE.
Foundations of Educational Measurement
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Analyzing Reliability and Validity in Outcomes Assessment (Part 1) Robert W. Lingard and Deborah K. van Alphen California State University, Northridge.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Principles in language testing What is a good test?
Power Point and Syllabus h3443.html.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
Assessment in Counseling Chapter 1. 2 What is assessment? Needs to be systematic and objective Sample(s) of behavior from which we make inferences Measurement.
EDU 8603 Day 6. What do the following numbers mean?
Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
The KOPPITZ-2 A revision of Dr. Elizabeth Koppitz’
Issues in Validity and Reliability Conducting Educational Research Chapter 4 Presented by: Vanessa Colón.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Selecting a Sample. Sampling Select participants for study Select participants for study Must represent a larger group Must represent a larger group Picked.
Validity and Reliability Neither Valid nor Reliable Reliable but not Valid Valid & Reliable Fairly Valid but not very Reliable Think in terms of ‘the purpose.
Presented By Dr / Said Said Elshama  Distinguish between validity and reliability.  Describe different evidences of validity.  Describe methods of.
Ch 9 Internal and External Validity. Validity  The quality of the instruments used in the research study  Will the reader believe what they are readying.
Testing College Board’s Curriculum Model Testing and Individual Differences Good Activities!
Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.
Personality and Individuality Psychological Testing.
Spring 2015 Kyle Stephenson
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Chapter 6 - Standardized Measurement and Assessment
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
How Psychologists Do Research Chapter 2. How Psychologists Do Research What makes psychological research scientific? Research Methods Descriptive studies.
1 Collecting and Interpreting Quantitative Data Deborah K. van Alphen and Robert W. Lingard California State University, Northridge.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Data Collection Methods NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN.
Coding with R-PAS: Does Prior Training with the Exner Comprehensive System Impact Interrater Reliability Compared to Those Examiners with Only R-PAS Based.
Lecture 5 Validity and Reliability
Assessing Personality
Test Validity.
Reliability & Validity
Standards and Guidelines for Conducting Cognitive Interviews
Analyzing Reliability and Validity in Outcomes Assessment Part 1
Assessing Personality
Analyzing Reliability and Validity in Outcomes Assessment
Collecting and Interpreting Quantitative Data
Chapter 3: How Standardized Test….
Presentation transcript:

Maggie Selander, Julia Martin, Marie Ware, Caroline Lopez, Lynn

 Central Assumption:  Stimuli from the environment are organized by a person’s specific needs, motives, conflicts, & by certain perceptual “sets”  exaggerated when faced with ambiguous stimuli like ink-blots!  Person must draw from their own personal internal images, ideas, and relationships to create a response.  Purpose:  To asses the structure of personality, with particular emphasis on how individuals construct their experience & the meanings assigned to their own perceptual experiences  Provides information on variables such as: motivations, response tendencies, cognitive operations, affectivity, & personal/interpersonal perceptions

 Many inkblot-type tests had existed long before The Rorschach  Da Vinci & Botticelli were interested in determining how a person’s interpretation of ambiguous designs reflected their personality  A popular game in the late 1800’s required players to make creative responses to inkblots  Hermann Rorschach published first 10 cards in 1921  1 st extensive empirically based system to score & interpret responses to a standardized set of cards  Originally intended to use the test to note the characteristic responses of different types of populations ▪ Initial norms were used to help differentiate between clinical and normal populations ▪ Rorschach was only minimally concerned with the symbolic interpretation of contents. ▪ Many of his original concepts & scoring categories still used

Unfortunately Rorschach died shortly after publishing his work, Psychodiagnostic, at age 37 Without the guidance & research of “the founding father” the test’s continued development was taken up by person’s with different backgrounds than Rorschach & each other By 1957, 5 Rorschach systems were in use, the most popular being those developed by Beck & Klopfer ▪ Represented polarized schools of though & were often in conflict.

 S. J. Beck (1937) adhered closely to original format for coding & scoring  Emphasized the perceptual-cognitive process in which respondents structure & organize their perceptions into meaningful responses ▪ Likely to reflect how they respond to their world in general  B. Klopfer (1937) closely aligned to theories of personality developed by Freud & Jung  Emphasized the symbolic content & experiential nature of the respondent’s Rorschach contents  Responses are fantasy products triggered by the inkblots and reflect perceived aspects of their world Piotrowski, Hertz, & Rapaport’s versions represented “middle- ground” between the Klopfer and Beck but were not as popular

 Exner (1969) provided a comparative analysis of the 5 different systems  Concluded “the notion of the Rorschach was more myth than reality” ▪ The 5 systems used the same verbal instructions ▪ Only 2 required identical seating arrangements ▪ Each had developed their own format for scoring resulting in different interpretations ▪ The wide range of approaches resulted in numerous detrimental practices ▪ Lacked consistency in the administration, scoring, and interpretation of contents ▪ Difficulty recruiting subjects, experimenter bias, statistical complexities of data analysis, inadequate control groups, insufficient normative data  Research on & the clinical use of the Rorschach was seriously flawed

 Exner & his colleagues began the collection of a broad normative database and the development of an integrated system of scoring/interpretation  Established clear guidelines for seating, verbal instructions, recording, & inquiry by the examiner regarding the examinee responses  Scoring category based on both empirical validation (min. of.85 level for inter-scorer reliability) & commonality across the 5 different systems  Final product 1 st published in 1974, The Rorschach: A Comprehensive System ▪ 2 nd ed (1986), 3 rd ed (1993), and 4 th ed (2003) ▪ A 2 nd volume relating to current research & interpretation has been released in two editions (Exner, 1978, 1991) ▪ Additionally, two editions on the assessment of children/adolescents have been published

 The most recent publication has included 450 contemporary protocols from persons, 18 to 65+, split evenly between males and females, with a wide range of education & ethnicities  Most research studies from the past 20 years use this system & is the most frequently taught version in graduate schools  Exner’s work to empirically validate the Rorschach with a comprehensive system has increased its acceptance & status

 Exner has been responsible for much of the leadership and advances regarding the Rorschach  His death in 2006 opens up the possibility for significant changes in his system  However, the merits of nearly all aspects of the test continue to be challenged including:  Inter-scorer reliability  Norms  Temporal stability  Accuracy of meta-analysis that have previously found support for the test

 Exner only included scoring categories that had an inter-rater reliability of.85 or higher  Some controversy has resulted concerning these values, other researchers found greater variability  A (2000) study found that nearly half of the categories for the comprehensive system had excellent reliability ratings (>.81)  1/3 had substantial reliability (>.61)  1/4 had less than adequate (<.61)  Sample sizes were small, greater variability would be expected

 The most recent & rigorous study, G. Meyer et all (2002) concluded that overall the Comprehensive System has excellent inter-scorer reliability ranging from.82 to.97  If scorers are appropriately trained  Interpretive agreement among experienced clinicians ranged between.76 to.89  Test-retest reliabilities somewhat variable  Of 41 (out of 125) variables over a 1yr interval found reliability ranging from.26 to.92 (most between.81 &.89) ▪ Exner - low reliabilities were due to the variables being affected by the changeable state (not trait) characteristics of the person ▪ Study supported that some variables or valid indicators for change following psychotherapy ▪ Many of the Rorschach’s variables are untested for reliability