Spring 2015 Kyle Stephenson

Slides:



Advertisements
Similar presentations
What makes us intelligent Or Not so intelligent
Advertisements

Intelligence Chapter 9.
Myers’ EXPLORING PSYCHOLOGY (5th Ed)
What do you see?.
Assessing Personality
Assessing Personality
INTELLIGENCE AND PSYCHOLOGICAL TESTING. KEY CONCEPTS IN PSYCHOLOGICAL TESTING Psychological test: a standardized measure of a sample of a person’s behavior.
Intelligence Meredyth Daneman PSY100. What is Intelligence? abstract reasoning, problem solving, capacity to acquire knowledge memory, mental speed, linguistic.
Intelligence A.P. Psych Information adapted from:
Origins & Modern Intelligence Tests
Personality and Individuality
What is Intelligence? Definition: 3 main characteristics 1) 2) 3)
WHAT IS INTELLIGENCE? Psychologists cannot seem to agree, can we?
INTELLIGENCE HOW IS IT MEASURED AND DEFINED?. DEFINE INTELLIGENCE The ability to learn from experience, solve problems, and use knowledge to adapt to.
Theories of Intelligence
Theories of Intelligence Mr. Koch AP Psychology Forest Lake High School.
Wechsler Adult Intelligence Scales
Intelligence What makes us intelligent Or Not so intelligent.
© 2008 The McGraw-Hill Companies, Inc. Chapter 9: Intelligence.
Chapter 13 Psychological Testing
IQ Testing & Brain Damage. Full Scale IQ Person’s relative standing in comparison w/ age- related peers and global estimate of overall mental abilities.
Cognitive Development and Intelligence. Overview Piaget’s theory of development Intelligence: definitions Cultural issues with intelligence tests Howard.
Unit 11. * intelligence: * aggregate or global capacity * to act purposefully * to think rationally * to deal effectively with the environment * fluid.
Assessment in Counseling Chapter 1. 2 What is assessment? Needs to be systematic and objective Sample(s) of behavior from which we make inferences Measurement.
Intelligence Test Review. Robert Sternberg’s three types of intelligence?
© Hodder Education 2010 Part 6 Individual Differences Chapter 41 Intelligence.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 8 Assessment Intelligence.
Intelligence Defined Intelligence Defined Intelligence Defined Intelligence Defined 1. What intelligence tests measure. 2. Ability or abilities involved.
Session 7 Standardized Assessment. Standardized Tests Assess students’ under uniform conditions: a) Structured directions for administration b) Procedures.
Measurement Validity.
Intelligence.
Intelligence and Mental Abilities You have to do the best with what God gave you.
Intelligence Chapter 7. Intelligence  The global capacity to think rationally, act purposefully, and deal effectively with the environment.  Not necessarily,
Intelligence CHAPTER 16 LESSONS 16.1 Measuring Intelligence
INTELLIGENCE What is it?. Intelligence vs. Achievement  Achievement-knowledge or skills acquired through experience  Involve specific content  Intelligence.
1. 1/ ADJUSTMENT OR ADAPTATION TO THE ENVIRONMENT- AN ADAPTIBILITY TO NEW SITUATIONS- CAPACITY TO DEAL WITH A RANGE OF SITUATIONS 2/ ABILITY TO LEARN-
Individual differences
Testing College Board’s Curriculum Model Testing and Individual Differences Good Activities!
Psychological Testing Unit 3. Reliability: Is the test consistent? Do you get the same result under any circumstance? Test-retest Reliability: Is the.
Personality and Individuality Psychological Testing.
Intelligence and Intelligence Assessment Chapter 9.
Intelligence testing. What is Intelligence? Intelligence is a construct (i.e, concrete observational entities), not a concrete object. Intelligence is.
Testing & Intelligence Principal Types of Tests –Personality –Mental ability Intelligence tests – potential for general mental ability Aptitude – potential.
Assessment in Counseling Chapter 1 Levi Armstrong, Psy.D.
Theories of Intelligence
INTELLIGENCE. Intelligence Intelligence involves the application of cognitive skills and knowledge to: –Learn –Solve problems –Obtain ends valued by the.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Culture and the Individual Intelligence. Psychological Approaches: Intelligence Spearman’s General Intelligence “g” = positively intercorrelated set of.
Intelligence.  Intelligence is the abilities to learn from experience, to think rationally, and to deal effectively with others  Intelligence sets us.
Intelligence. What is Intelligence? ▪ Definition: – The mental abilities to adapt to and shape the environment ▪ Involves reacting to and forming your.
How should intelligence be defined? Describe someone who is intelligent. Describe someone who is unintelligent. What is the difference between the.
Understanding Achievement Psychologists say that intelligence is not the same as achievement. Achievement refers to knowledge and skills gained from experience.
Intelligence What makes us intelligent Or Not so intelligent.
Literacy, Intelligence, and Academic Achievement Zembar and Blume Middle Childhood Development: A Contextual Approach, First Edition ©2009 Pearson Education,
Chapter 9 Intelligence. Objectives 9.1 The Nature of Intelligence Define intelligence from an adaptation perspective. Compare and contrast theories of.
Vocab Unit 11. = a method of assessing an individual's mental aptitudes and comparing them with those of others, using numerical scores.
Unit 11 Vocabulary Individual Differences and Intelligence.
Theories of Intelligence
Assessment in Counseling
Unit 11: Testing and Individual Differences
Intelligence and Intelligence Testing
Myers’ PSYCHOLOGY Intelligence Worth Publishers.
Myers’ PSYCHOLOGY Unit 11 Intelligence Chris Dunn Spalding High School.
EXPLORING PSYCHOLOGY Unit 6 – Part 2 Intelligence Ms. Markham.
Definition Slides.
Myers EXPLORING PSYCHOLOGY (6th Edition in Modules)
Myers’ PSYCHOLOGY (7th Ed)
Unit 11: Testing and Individual Differences
Assessment Chapter 3.
Presentation transcript:

Spring 2015 Kyle Stephenson Clinical Psychology Spring 2015 Kyle Stephenson Remember to bring sample reports

Overview – Day 6 Reliability & validity Intelligence assessment Defining intelligence Assessment methods Notes about IQ Personality assessment “Objective” testing Projective testing Use & abuse of testing Last class we talked about interviews, which are a pretty general tool to get at information that a person can actually report to you. Today, we’re going to focus in on two specific targets of assessment – intelligence and personality – that are A) some of the most common targets of assessment, and B) difficult for people to report for themselves (it sounds pretty silly to ask, “how smart are you on a scale from 0-100?”). As with most lectures in this class, this is not a comprehensive lesson in these areas. During graduate school, students typically spend 1-2 semesters learning about each of these assessment areas, and that’s just to start! However, you can choose to specialize in either of these areas during grad school and beyond, so I want to introduce them to you to see if you’re interested enough to take a more in-depth look at the research in these areas.

Types of Reliability Some concepts that are important in assessment are reliability and validity. Most students are not super excited to learn about these concepts and they do sound pretty dry on the surface. But, they are the primary factors that determine whether you’re able to accurately measure any variable in psychology. So, if you’re interested in actually measuring something interesting like intelligence or anxiety or whatever, you need to know a bit about these concepts. Reliability is typically a measure of consistency – see above.

Types of Validity Validity assumes reliability, but goes beyond it. It’s essentially asking the question of whether you’re measuring what you want to measure. Example – height as a measure of intelligence. This would probably be a reliable measure (consistent over time, a lot of inter-rater reliability, different measurements would probably correlate highly). But, the measurement would be totally invalid because, obviously, height is not a good indicator of intelligence!

Assessment Procedures Reliability and validity are important when measuring any construct in psychology. So, why are we spending additional time on IQ and personality assessment? Primarily because they’re some of the most common things assessed by clinical psychologists. We’re talking 85-93% of practicing psychologists using some scale of IQ or personality at least occasionally. Also, these topics tend to be pretty interesting.

Overview – Day 6 Reliability & validity Intelligence assessment Defining intelligence Assessment methods Notes about IQ Personality assessment “Objective” testing Projective testing Use & abuse of testing

Defining intelligence (or trying to) Three classes of definitions Emphasis on adjustment to environment Adaptability in new situations Capacity to deal with a range of situations Emphasis on the ability to learn How well can you do in school? Emphasis on abstract thinking Ability to use symbols and concepts Verbal and numerical symbols There have been THOUSANDS of papers, books, etc. that have tried to define intelligence. The difficulty with defining this (and most) factors in psychology is that intelligence is a “construct” – a conceptual idea that represents something abstract that we think will be helpful. In other words, there’s no way to “objectively” measure intelligence because intelligence doesn’t actually exist in any physical form. Instead, we use the idea of “intelligence” as a stand-in for a web of related skills and abilities that allow us to talk about and measure things we think are important. Three important outcomes that we think depend on intelligence are mentioned above. As a society, we generally think that a “smart” person should be able to adjust to their environment, learn things, and think abstractly. Certainly, other societies might place more or less emphasis on any on of these abilities and, correspondingly, the way they define intelligence would probably also change. An important take-home point here is that there’s no objectively correct answer as to what intelligence is – we just have to decide what we want intelligence to be. But, we can determine which definitions are most helpful and, once we’ve defined intelligence and selected the things it should be related to, we can objectively judge better or worse measures of it.

Theories of Intelligence This graphic is a good overview of the most common type of theory of intelligence – a hierarchical one. This type of theory holds that people have some overall level of intelligence (g, for general intelligence), but that there are multiple components of intelligence that can vary significantly between people who have the same “overall” intelligence. For example, Jim and Jennifer could both have the same IQ, but Jim might have higher levels of spatial intelligence while Jennifer may have high levels of number intelligence.

Theories of Intelligence Gardner’s multiple intelligences Problem solving skills 8 formal groupings linguistic musical logical-mathematical spatial bodily-kinesthetic naturalistic interpersonal intrapersonal Major criticism: “Intelligences” vs. “talents” But, there are other types of theories. One of the most famous is Gardner’s theory of “multiple intelligences.” This theory basically does away with the concept of overall intelligence, and also expands the range of skills that are included in “intelligence.” In addition to the major criticism of whether we should consider, for example, musical ability as intelligence, this theory also doesn’t do very well at explaining why many different skills sets are highly correlated. For example, linguistic intelligence tends to be correlated with spatial and logical indicators of intelligence, which could potentially be accounted for by an overarching level of “overall intelligence.” You do NOT need to memorize this theory (won’t be tested on it) – I simply include it as an example of a way of defining intelligence that’s not well reflected on modern IQ tests.

Overview – Day 6 Reliability & validity Intelligence assessment Defining intelligence Assessment methods Notes about IQ Personality assessment “Objective” testing Projective testing Use & abuse of testing

Clinical Assessment Wechsler Scales Deviation IQ based Originally designed for adults Performance scale and Verbal scale Each made up of subtests Each subtest gets an IQ score Full Scale IQ But we can’t wait until we have a perfect definition. There are many reasons that we need to assess intelligence now, including assessment of learning disabilities (impairments in one area of ability like reading or math that is far outside what would be expected given a person’s general level of intelligence), diagnosis of mental retardation and other developmental disorders, and identification of particularly skilled individuals (helpful for contexts like the army, schools, etc.). By far the most common way to assess intelligence is one of the Wechsler scales, which include the WAIS, WISC, and WIPSI. All of these scales work in generally the same way. IQ (intelligence quotient) is thought to be normally distributed in the population, meaning that most people fall in the same small range (85-115), with few falling outside that range. Importantly, because we know the exact shape of a normal distribution, we can know based on your score what percentage of the population falls above and below you on any given scale. This method is called “deviation based,” because your score and percentile is based on how much your score deviates from the average performance.

Aptitude vs. Achievement It’s important to note that the Wechsler scales are, for the most part, meant as measures of aptitude. Aptitude is essentially your potential or ability to learn and do things. In contrast, achievement is what you’ve already done with that potential. For grad school, there are measures of each – a general exam that tries to measure aptitude, and a psychology-specific exam that tries to measure the knowledge you’ve accumulated about the field. Content knowledge vs. potential to attain knowledge

Clinical Assessment Wechsler Adult Intelligence Scales (WAIS-IV) Ages 16-90 Scoring system Index scores: Verbal Comprehension, Perceptual Reasoning, Working Memory, Processing Speed Full Scale IQ Score 15 subtests Reversal items Subtests are meant to get at different aspects of intelligence, and to make it possible to identify strengths and weaknesses. Reversal items save time and maintain rapport with test takers.

How does the examination look? Generally verbal questioning Stimulus booklet Block design While almost all the responses are verbal, there has been a concerted effort over the past 20 years to include more non-verbal measures. One big reason for this is that verbal questions and content are more likely to be biased against people from backgrounds different from the people constructing the test (generally well-educated wealthy white people who live in the northeast). For example, asking about supply and demand or even something as concrete as parts of a boat may not do a good job of assessing intelligence for a Latina single mother who has lived in Arizona her whole life (never been on a boat) and didn’t graduate high school. It’s not that she’s not intelligent, she just hasn’t had the life experiences to be equipped to answer those questions. You don’t need to memorize the parts of the WAIS – I include this information just to give you a sense of how the test looks.

WAIS-IV Picture Completion Subtest Block design and picture completion are two examples of attempts to have less culturally-biased measures in the test.

Overview – Day 6 Reliability & validity Intelligence assessment Defining intelligence Assessment methods Notes about IQ Personality assessment “Objective” testing Projective testing Use & abuse of testing The WAIS and other scales generally do a good job of reliably measuring IQ. But, there are a lot of other issues when it comes to intelligence. What about validity – are these measures related to what they should be? Are they useful in predicting behaviors and performance? What do they tell us about the construct of intelligence?

Age and IQ Stability First, we generally expect intelligence to be stable and it looks like IQ scores are generally stable, especially once you become an adult.

IQ We would also expect IQ to be heritable to some degree, but not 100%. This table highlights the importance of both genes and the environment.

Here are some of the environmental factors that are associated with lower IQ scores. There are numerous factors that predict IQ scores. For example, most ethnic minority groups in the US tend to score lower on these tests. Men tend to score slightly higher on spatial ability and women tend to score slightly higher on verbal ability. (see your text for more detail) Does this mean that some of these groups are “smarter” than others? No. There could be numerous reasons for these differences. For one, ethnic minority families on average are exposed to more of the risk factors listed above than caucasian families. Much of the difference in IQ scores can be accounted for by these differences in contextual and cultural factors. Remember, just because two things are correlated (like ethnicity and IQ) doesn’t mean that one causes the other (e.g., minority ethnicity causes lower IQ scores). There can be a third variable (like stress, quality of schooling, etc.) that explains why the original two variables are related. This does NOT mean the test is biased (see below for more discussion about test bias).

IQ predicts Academic achievement (GPA & number of school years completed) Job performance Income (and child’s income) SES Type of occupation Contact with justice system In many ways, the most important question is not whether we are “really” measuring intelligence or what intelligence “really” is, but instead whether our measures are useful. Do they give us information that allows us to make better decisions? The answer is generally yes. You can have a better prediction of someone’s future behavior based on knowing their IQ score. This doesn’t mean that IQ necessarily causes these outcomes, but it does allow us to prepare for them and even intervene. E.g., identify children at risk of struggling academically and provide additional support, select job applicant who will do the best, etc. .4 to .6 between IQ and GPA .3 to .5 – job performance based on supervisor ratings Parent IQ scores predict 1/6 of variance in their children’s income Within-family studies of IQ-SES link. If a person has a higher IQ than family average, he/she is more likely to achieve higher SES and vise versa. -.19 correlation to juvenile offenses (but may be that lower IQ just more likely to get caught)

But… Test motivation / incentives Incentives can increase IQ scores by 9.6 IQ points When taking motivation (assessed by objective observers) into account, predictive ability of IQ scores decreases significantly, especially for non- academic outcomes. But, as with all complicated questions, there are some caveats here. One big one is motivation – how invested are you in doing well on this IQ test? The answer can impact your score (which it shouldn’t – intelligence shouldn’t depend on how motivated you are today), which calls into question how much the association between IQ and other outcomes is a result of differences in motivation to succeed (rather than raw ability or potential to succeed). Comes back to the point that it’s often easier to determine whether a test if “useful” (predicts important outcomes) than to determine whether it’s “valid” (actually measures “intelligence”).

Overview – Day 6 Reliability & validity Intelligence assessment Defining intelligence Assessment methods Notes about IQ Personality assessment “Objective” testing Projective testing Use & abuse of testing

What do we mean by “personality?” Enduring traits (not states/moods) Should be somewhat consistent across time and situations Should predict behaviors Needs to be specific, measurable, and meaningful Not, “he’s a good guy” Rather, “he is X amount of Y trait, which means he is more/less likely to Z”

Objective vs. Projective “Objective” is misleading Really just more objective than projective tests Application, scoring, and interpretation are more objective “Objective” really refers to the fact that different psychologists giving the same test would get the same result. But, most measures of personality rely on the person’s subjective report (e.g., “how often do you try new things?”).

Objective Testing Advantages Economical Large group testing Computer scoring & interpretation Single dimension or trait can be targeted Straightforward Objective & reliable Economical – you can give the client the test and walk away. You can have multiple people (e.g., child and parent) complete tests at the same time. Scoring – can score test very quickly, essentially like a scantron, or even use a computer to administer and score almost instantly. Single dimension – you don’t need to know the person’s entire history and background to understand their responses Objective/reliable – should be minimally biased by clinician, and should give similar results across time and situations

Objective Testing Disadvantages Questions may be uncharacteristic of respondent Underlying reason for behavior not evident Unrepresentative behaviors Distorted or lost information Misinterpretation Uncharacteristic – e.g., if question asks about relationship with siblings and client doesn’t have any siblings – what does their response actually measure? Underlying – e.g., if question asks about frequency of fighting, you don’t know whether it’s because client has to protect themselves from aggressive peers, whether he/she likes boxing, or whether he/she is aggressive and dangerous. Unrepresentative – e.g., asking questions about sleep habits during finals week Biases – people often want to misrepresent themselves, making themselves seem either worse off or better of than they are. E.g., faking good in context of assessment for work, faking bad in context of disability claim.

Objective Testing Empirical criterion keying Minnesota Multiphastic Personality Inventory (MMPI) No assumption based on content of item What matters is that those in the diagnostic group share responses Empirical basis, not always rational One way to help address misrepresentation is using empirical criterion keying. This method is different from how tests are usually constructed: Make large pool of potential items based on some mixture of expert opinion and information directly from population of interest Pilot items and remove confusing ones, ones that overlap with one another too much, etc. Re-test new version and establish structure (e.g., subscales), reliability, and validity Makes additional changes based on results Re-test and publish An important aspect of this typical process is that the initial criterion for inclusion of items is usually face validity – the questions appear to measure what they are in fact measuring. If we want to know how often you feel sad, we ask you how often you feel sad. This is usually fine, but can cause problems when misrepresentation is a concern. Empirical criterion keying is DIFFERENT in that the surface-level content of the items doesn’t matter. If people who say they prefer Washington to Lincoln are consistently more likely to develop schizophrenia, it can be a valid predictor whether or not it makes any sense. Makes it hard to fake bad or fake good, but also can make it more difficult to interpret results.

Objective Testing Here’s a nice summary of different ways of establishing the validity of an item in an objective test.

Simulated MMPI Items MMPI is widely used, especially in research but also fairly commonly in treatment. Again, don’t memorize this, just included b/c I thought you’d be interested.

Objective Testing The NEO is another very commonly used measure and is based on a theory suggesting there are 5 primary aspects of personality.

Overview – Day 6 Reliability & validity Intelligence assessment Defining intelligence Assessment methods Notes about IQ Personality assessment “Objective” testing Projective testing Use & abuse of testing

Projective Testing Characteristics Examinee imposes own structure Unstructured stimulus Indirect methodology Freedom of response Many variables to rate Projective testing was very popular in the 50’s-70’s, less so now. On the upside, it allows you to assess aspects of the person’s experience that he/she may not be comfortable talking about directly or may not even be aware of. You can see the strong link between psychoanalytic theory and these methods of assessment. But, even other clinicians will use them in forensic settings, and with children.

Projective Testing Rorschach inkblots Multiple variation in scoring 10 cards Administration Card is shown, responses offered & noted Evaluation and rating of answers

Rorschach Inkblot Evaluation of responses in complicated, takes a long time, and is often not supported by research. Responses rated on a number of continua including how much of the blot is used, whether movement is implied, whether color is taken into account, etc.

Overview – Day 6 Reliability & validity Intelligence assessment Defining intelligence Assessment methods Notes about IQ Personality assessment “Objective” testing Projective testing Use & abuse of testing

Use & Abuse of Testing Protection Privacy APA standards require training Restrictions in purchasing tests Privacy Right to explanations Relevancy of testing Informed consent Test results can have a large impact on people’s lives so it’s important that trained professionals administer, score, interpret, and report results. It’s also important in many cases that the people taking the tests have not seen them beforehand (if you were able to practice the items on the WAIS beforehand it would cease to be a valid measure of IQ). So, you need credentials to purchase many of the tests and the psychological community all has a stake in keeping the content of some tests from the general public. Test takers also have important rights including explanations as to what the tests measure and how, that the information provided by the test is relevant to their goals, and that they consent to testing. In some cases tests are court ordered, but the more common situation is that tests are administered for research or therapy purposes, in which case participants/clients need to be fully informed.

Use & Abuse of Testing Test Bias Validity issue: if it can be demonstrated that the validity of a test varies significantly across groups, then a case can be made that the test is “biased” Things to remember: Differences in mean scores do not necessarily indicate test bias Tests may be valid (and not biased) for some purposes, but not for others One can “overcome” test bias by using different prediction equations for the different groups We’ve already touched on test bias a bit and it’s an important concept to return to. One of the most common examples is the mean difference in IQ scores between different ethnic groups in the U.S. It’s important to realize that the existence of such a difference doesn’t in and of itself mean the test is biased (remember other factors determine IQ scores besides intelligence like motivation, SES, educational background, etc.). A test is biased if it is NOT AS VALID for different groups. For example, if IQ scores did a good job of predicting college GPA for Caucasian, but not African American students. This type of bias was certainly present in the past, but has in many ways been eliminated or accounted for in more modern versions. For example, the best tests now use entire samples of a single ethnic group (e.g., Native American) and establish reliability and validity within that group, which can result in different scoring methods being used for different people. Again, if one group scores worse on a measure and that score is still equally as valid, it is not test bias. A clear example is that most ethnic minorities tend to do worse on IQ tests, and also tend to have a harder time in school. In this case, the test is doing what it’s supposed to do (predicting future academic performance) and is thus not “biased” as that term is used in psychological science.

Take-Home Psychological assessment is often not measuring physical “things” in the world, but rather theoretical constructs However, we can still objectively test the reliability and validity of assessments and judge them based on their usefulness Intelligence and personality testing are the most common assessments performed by psychologists and each comes with its own set of controversies and complexities