Presentation is loading. Please wait.

Presentation is loading. Please wait.

PSY 614 Instructor: Emily Bullock Yowell, Ph.D.

Similar presentations


Presentation on theme: "PSY 614 Instructor: Emily Bullock Yowell, Ph.D."— Presentation transcript:

1 PSY 614 Instructor: Emily Bullock Yowell, Ph.D.
Ability Testing PSY 614 Instructor: Emily Bullock Yowell, Ph.D. Bring Sattler book to class Sternbert et al (2005)-additional reading #2

2 TEST SECURITY REMINDER
Important with all psychological measures Extremely important with comprehensive measures of intelligence

3 Measuring Ability Assumption: Intelligence exists
How do you define intelligence? Other Measures of Ability

4 Defining Intelligence
6 commonly agreed upon components Knowledge-based thinking Apprehension Adaptive purposeful striving Fluid-analytic reasoning Mental Playfulness Idiosyncratic Learning (Sattler, 2001, Assessment of Children)

5 Defining Intelligence
Ratings of 1,020 experts on the elements of intelligence Abstract thinking or reasoning (99.3%) Problem-solving ability (97.7%) Capacity to acquire knowledge (96.0%) Memory (80.5%) Adaptation to one’s environment (77.2%) Mental speed (71.7%) Linguistic competence (71%) Mathematical competence (67.9%) General knowledge (62.4%) Creativity (59.6%) Sensory acuity (24.4%) Goal-directedness (24%) Achievement motivation (18.9%) (Sattler, 2001, Assessment of Children)

6 Defining Intelligence
Wechsler, David (1939). The measurement of adult intelligence. Baltimore: Williams & Wilkins, p. 229. "The global capacity of a person to act purposefully, to think rationally, and to deal effectively with his/her environment.“ Text’s Definition pg 22 “existence of systematic individual differences in the performance of tasks that involve the manipulation, retrieval, evaluation, or processing of information” (Murphy & Davidshofer, 2005, p.22).

7 Theories of Intelligence
Spearman’s g Thurstone and the 7 group factors of intelligence Fluid and Crystallized Intelligence and CHC theory Gardner’s Theory of Multiple Intelligences

8 The Intelligence Quotient
IQ = (MA/CA) x 100 Problems with the Method New Method

9

10 Characteristics of a Good Test of Intelligence
Broad Sampling of Tasks Avoidance of being an Information Test Indifference of the Indicator Sufficient Sample of Items See text pgs for discussion on each characteristic

11 The Relation among Ability, Intelligence, and Achievement
Ability tests: any measure of what a person can accomplish Intelligence tests: measure broad and general abilities that are acquired over long spans of time Achievement tests: measure specific knowledge or skills that are acquired over a restricted span of time

12 Uses of Ability testing
Job evaluation Entrance into higher education programs Learning disability determination Placement in Special Education services Classroom specific and degree completion evaluations Others?

13 Intelligence, Race, and Genetics
The Bell Curve Intelligence level differences in Asians, Whites, Blacks, Hispanics, and Jews What about Sternberg et al.’s (2005) comments on race and what defines race? How does this information effect the individual that identifies with one of these groups? How does this information effect you personally and your view of individuals in other groups?

14 Individually Administered Tests of Ability
Stanford-Binet Intelligence Scale-V Wechsler Intelligence Scales WAIS-III WISC-IV WPPSI-III Woodcock-Johnson

15 Stanford-Binet Intelligence Scale-V
Comprehensive, norm-referenced individually administered test of intelligence and cognitive abilities Current version released in 2003 Used to assess the intelligence of children and adults ages 2 to 85 years old Based on a hierarchical model of cognitive abilities and yields scores on the following scales:

16 Stanford-Binet Intelligence Scale-V
Full Scale IQ Domain: Verbal IQ Domain: Non-Verbal IQ Fluid Reasoning Knowledge Quantitative Reasoning Visual-Spatial Processing Working Memory Subtest 9 Subtest 1 Subtest 3 Subtest 5 Subtest 7 Subtest 2 Subtest 4 Subtest 6 Subtest 8 Subtest 10

17 Stanford-Binet Intelligence Scale-V
Takes about minutes to administer Mean of 100 and Standard Deviation of 15 Change from all previous versions with a SD of 16 Standardized on 5,013 individuals in 17 age groups

18 SB-V:Psychometric Properties
Reliability of SB-IV Internal consistency-average of .88 Test-Retest reliability-.95 or greater Test taker’s scores tended to raise on 2nd administration Validity Evidence Highly correlated with other well-respected intelligence measures (Bender-Gestalt, Wechsler Scales) Construct-raw scores increase with age, factor analysis support of scales Content-based on broad array of items related to judgment and reasoning Criterion-correlations with teaching ratings and grades

19 SB-V: Limitations Many subtests require adequate hearing, vision, visual-motor and speech abilities Lack of continuity in subtests and range of scores used to attain FSIQ at different ages Scoring difficulties when judgments must be made Few timed tests allow examinees to take as long as wanted to complete items leading to long testing sessions

20 The Wechsler Scales WAIS WISC WPPSI

21 Wechsler Scales The Wechsler Scales and their predecessors--most widely used individual test of intelligence Three foci of the Wechsler Scales are to help assess: psychoeducational disability neuropsychiatric and organic dysfunction giftedness

22 Wechsler Adult Intelligence Scale-IV
Appropriate for ages Range of FSIQ scores from for all ages Mean=100 Standard Deviation=15 Takes about minutes to administer Standardized/normed on 2,200 individuals people per age band stratified by sex, education level, ethnicity, region Latest Edition released in 2008

23 WAIS-III/IV Structure
Full Scale IQ Verbal IQ* Performance IQ* Verbal Comprehension Index Perceptual Reasoning Index Working Memory Index Processing Speed Index - Subtest 9 Subtest 11 Subtest 1 Subtest 3 Subtest 5 Subtest 7 Subtest 2 Subtest 4 Subtest 6 Subtest 8 Subtest 10 *VIQ and PIQ are no longer calculated for the WAIS-IV; were used in previous editions of the WAIS

24 WAIS-IV Structure & Subtests
Verbal Comprehension Scale Core Subtests: Similarities, Vocabulary Information Supplemental Subtests: Comprehension Perceptual Reasoning Scale Core Subtests Block Design, Matrix Reasoning, Visual Puzzles (New) Supplemental Subtests Picture Completion, Figure Weights (New; only)

25 WAIS-IV Structure & Subtests
Working Memory Scale Core Subtests: Digit Span, Arithmetic Supplemental Subtests: Letter-Number Sequencing (16-69 only) Processing Speed Scale Core Subtests: Symbol Search, Coding Supplemental Subtests: Cancellation (New; only)

26

27

28

29 WAIS-IV: Psychometric Properties
Reliability of WAIS-IV Internal Consistency FSIQ-.98 Index Scores-.90 (PSI) to .96 (VCI) Subtests-.81 (SS) to .94 (Vocab.) Test-retest after average of 22 days FSIQ- .95 Interscorer Agreement for average of all subtests; for subtests requiring more judgment in scoring (e.g., vocabulary)

30 WAIS-III: Validity Content Validity
Comprehensive literature and expert reviews were conducted to examine the content of the WAIS-III and to evaluate proposed new items and subtests designed to improve content coverage and relevance Criterion-Related Validity-correlated with the following WAIS-III corresponding subtests, correlations ranging from WISC-IV corresponding subtests, correlations ranging from

31 WAIS-III: Validity Construct Validity
Factor analyses yielded results consistent with the hypothesized four-factor hierarchical model corresponding to the four Index scores that combine to form the g-factor; supported through SEM Acceptable correlations with measures theoretically related to intelligence Data from clinical groups with various mental disorders such as Alzheimer's Disease, Traumatic Brain Injury, and Borderline Intellectual functioning were analyzed. Scores of persons with these types of disorders were, on the average, lower than those in the standardization sample.

32 WAIS-IV: Limitations Limited floor and ceiling; although improved
Possible difficulties in scoring responses from Similarities, Vocabulary, and the Comprehension subtests Poor design of some scoring templates Limited validity info on new version Strength of WAIS-IV Great lengths taken to assess and reduce item bias Improved several subtests and deleted least reliable subtests More in-line with WISC

33 Wechsler Intelligence Scale for Children-IV
WISC-IV is individually administered and was designed to assess the cognitive ability in children Scores include: FSIQ The four index scores seen on WAIS-III No PIQ and VIQ are calculated 15 subtests (10 core, 5 supplemental) Latest Edition released in 2003 WISC-IV integrated 16 process supplementary subtests to increase understanding of child’s processing abilities that may affect their WISC score and increase ability for intervention planning

34 WISC-IV Structure Full Scale IQ Verbal Comprehension Index
Perceptual Organization Index Working Memory Index Processing Speed Index - Subtest 9 Subtest 11 Subtest 1 Subtest 3 Subtest 5 Subtest 7 Subtest 2 Subtest 4 Subtest 6 Subtest 8 Subtest 10

35 Wechsler Intelligence Scale for Children-IV
Appropriate for ages 6 to 16.11 Mean=100 Standard Deviation=15 Takes about minutes to administer Standardized/normed on 2,200 children in 11 age groups Limitations: WISC-IV has practice effects on the Performance Scale and may penalize children that do not highly value speed

36 Wechsler Preschool and Primary Scale of Intelligence-III
WPPSI-III is individually administered instrument for measuring the general intellectual functioning of children Scores include: FSIQ Verbal IQ and Performance IQ Processing Speed Quotient General Language Composite For ages : 5 subtests (4 core, 1 supplemental) For ages : 12 subtests (7 core, 5 supplemental) Latest Edition released in 2002

37 Wechsler Preschool and Primary Scale of Intelligence-III
Appropriate for ages 2.6 to 7.3 Mean=100 Standard Deviation=15 FSIQ scores range from Takes about minutes to administer to 2.6 to 3.11 yr olds and 60 minutes to 4 to 7.3 yr olds Standardized/normed on 1,700 children in 9 age groups Limitations: WPPSI-III may penalize children that do not place a premium on speed

38 Woodcock-Johnson III WJ-III: Designed to provide a co-normed set of tests for measuring general intellectual ability, specific cognitive abilities, scholastic aptitude, oral language, and academic achievement Norm-referenced and individually administered Previously the Woodcock-Johnson Psycho-Educational Battery-Revised 2 parts: Tests of Cognitive Abilities (20 subtests) and Tests of Achievement (22 subtests)

39

40 Woodcock-Johnson III Only scorable with the Compuscore(r) software
Latest Edition released in 2001 Appropriate for ages 2 to 90+ Mean=100 Standard Deviation=15 (for index scores)

41 Woodcock-Johnson III Takes about 20-70 minutes to administer
Typically shorter administration time than for Wechsler or SB Scales Standardized/normed on 8,818 individuals in 3 main age groups Limitations: Small adult standardization sample Strength: Considered by many to be the premier measure of cognitive ability and achievement with a more obvious link to interventions

42 Group Administered Tests of Ability
With a Group Administered Test… The test administrator’s role is reduced Test taker answers written questions not a person Multiple choice items may alter the cognitive process used in answering questions Less information learned about person’s behavior, appearance, problem solving style… -information from pg of text Role reduced-because they just proctor and give standardized directions as compared to the total involvement of an test administrator in individually administered tests Answer a question: There is some advantage to this in that a person may offer cues to correct or incorrect answers Multiple choice: open-ended/ less structured questions in individual administration may lead to more optimal or personally characteristic responses

43 Group Administered Tests of Ability
Intelligence MAB-II Achievement ASVAB GRE ACT SAT

44 Multidimensional Aptitude Battery-II
Initially created to be a group administered equivalent of the WAIS Designed to provide a convenient, objectively scored measure of general cognitive ability 10 subtests with names identical to WAIS subtests Yields Full Scale, Verbal, and Performance Scores Latest Edition released in 1998 Appropriate for ages 16 and over (normed on individuals up to age 74)

45 Multidimensional Aptitude Battery-II
Takes about 100 minutes to administer Standardized/normed on 9 age groups with about 200 people each Requires a 9th grade reading level Limitations: reviewers warn against using it to make important decisions about a person due to the lack of personal interaction with a trained professional; Lowest IQ score is 70 Strengths: less time consuming and easy to score

46 Scholastic Aptitude Test (SAT)
Designed to measure the developed verbal and mathematical reasoning abilities related to successful performance in college Measures verbal and mathematical ability & proficiency in different subject areas Correlation around with performance in college In 1995, new norms adopted that brought the mean back to 500 with a standard deviation of about 110 Utilizes a formula to correct for guessing Criticism: An expensive college entrance decision tool that adds little to information gleaned from HS grades alone Strength: seen as more of an “aptitude” test due to it little reliance on courses taken (unlike ACT)

47 ACT Assessment Program
Two Main Purposes: help students develop postsecondary plans help postsecondary education institutions develop programs suited to the needs and characteristics of their applicants Emphasis in skills taught in school Acceptable reliability ranging from .91 to .79 Little validity evidence linked to ACT scores and performance in college

48 Graduate Record Examinations (GRE)
Designed to assess the Verbal, Quantitative and Analytical reasoning abilities of graduate school applicants Utilizes computerized-adaptive testing technology Scores of test takers receiving different questions are considered comparable due to the statistical analyses inherent in the system Standard score remains the same but percentages may change based on current testing group Criterion-validity estimates around and vary by discipline of graduate student; ETS validity study:

49 Armed Services Vocational Aptitude Battery (ASVAB)
For use in educational and vocational counseling and to stimulate interest in job and training opportunities in the Armed Forces Administered free at participating high school by the Department of Defense 10 subtests and 7 composite scores; no overall score Criticisms: Not seen as useful enough to inform vocational or military choices


Download ppt "PSY 614 Instructor: Emily Bullock Yowell, Ph.D."

Similar presentations


Ads by Google