EPSY 625 LECTURE 3 COGNITIVE ASSESSMENT. AFFECT TASK DEMANDS: STRUCTURING COGNITIVE TESTS TYPES ARTIFICIAL ANALOG ACTUAL TESTS: 1. ACHIEVEMENT 2. INTELLIGENCE.

Slides:



Advertisements
Similar presentations
What makes us intelligent Or Not so intelligent
Advertisements

What makes us smart? Or not so smart?
Aging and Intelligence
Chapter 9 (from p.376): Intelligence
Myers’ EXPLORING PSYCHOLOGY (5th Ed)
1 Chapter 7 Assessment of Intelligence. 2 Defining and Purpose of Intelligence Testing Type of aptitude test that measures a range of intellectual ability.
Intelligence n What is “intelligence”? n Why/how do we measure it? n What do we do with the scores? n Link to Human Intelligence Map Human Intelligence.
Measuring Achievement and Aptitude: Applications for Counseling Session 7.
Chapter 11 Intelligence. Components of Intelligence 1. Understand complex ideas 2. Adapt to the environment 3. Learn from experience 4. Ability to reason.
Session 7 Intelligence and General Ability Testing.
Assessing Intelligence
Intelligence.
Intelligence Meredyth Daneman PSY100. What is Intelligence? abstract reasoning, problem solving, capacity to acquire knowledge memory, mental speed, linguistic.
Intelligence A.P. Psych Information adapted from:
What is Intelligence? Definition: 3 main characteristics 1) 2) 3)
1 Intelligence. 2 What is Intelligence? Intelligence - the ability to learn from experience, solve problems, and use our knowledge to adapt to new situations.
Achievement & Aptitude Tests Achievement tests measure “accomplishment”; learning that results from exposure to a relatively defined learning experience.
Intelligence & Psychological Testing
© 2011 The McGraw-Hill Companies, Inc. Instructor name Class Title, Term/Semester, Year Institution Introductory Psychology Concepts Assessing Intelligence.
Educational Psychology: Theory and Practice Chapter 13 Assessing Student Learning.
INTELLIGENCE ACROSS CULTURES. LECTURE OUTLINE I Background and objectives I Background and objectives II Intelligence and its measurement II Intelligence.
1 Chapter 4: Understanding Student Differences Spring 2007 Kathy-ann Hernandez, Ph. D.
Wechsler Adult Intelligence Scales
Intelligence What makes us intelligent Or Not so intelligent.
Intelligence How is intelligence measured?
Welcome to COU 660: Assessment & Evaluation in Counseling Introductory Material Ethical & Legal Issues.
Assessing Intelligence
Copyright © Allyn & Bacon 2007 Chapter 11 Testing and Individual Differences.
CogAT Cognitive Abilities Test ™ Report to Parents What does CogAT measure? CogAT measures cognitive development of a student in the areas of learned reasoning.
 Intelligence is a concept not a “thing”. We refer to peoples IQ as a trait like Height. That error of reasoning is called reification. Psychologist.
Intelligence n What is “intelligence”? n Why/how do we measure it? n What do we do with the scores?
Chapter 8 Learning Aptitude. Purposes for Assessing Learning Aptitudes Identification of level of intellectual performance Evaluation of adaptive behavior.
Module 23 Intelligence Chapter 7, Pages Essentials of Understanding Psychology- Sixth Edition PSY110 Psychology © Richard Goldman October 31,
Intelligence and Mental Abilities You have to do the best with what God gave you.
I NTELLIGENCE Unit 11. W HAT IS I NTELLIGENCE ?  Intelligence  ability to learn from experience, solve problems, and use knowledge to adapt to new situations.
INTELLIGENCE: IQ & TESTING.
Origins of Intelligence Testing  Intelligence Test  a method of assessing an individual’s mental aptitudes and comparing them to those of others, using.
Creativity Solving problems by combining ideas or behavior in new ways Convergent thinking- a problem is thought to have one solution and all lines of.
Individual differences
Ch Intelligence. What is intelligence? Varies by culture  Western cultures focus on cognitive tasks.
Intelligence What makes us intelligent Or Not so intelligent.
McLoughlin/Lewis, Assessing Students with Special Needs, 7e ISBN: © 2009 Pearson Education Inc. All rights reserved. Chapter 7 Intellectual.
Intelligence. What is intelligence? Varies by culture  Western cultures focus on cognitive tasks.
Assessing Intelligence
Spring 2015 Kyle Stephenson
Chapter 11 Intelligence. Mental quality consisting of the ability to learn from experience, solve problems, and use knowledge to adapt to new situations.
Testing & Intelligence Principal Types of Tests –Personality –Mental ability Intelligence tests – potential for general mental ability Aptitude – potential.
What makes us smart? Or not so smart?
Thursday, October 22 Objective: Compare and contrast learning theories.
INTELLIGENCE. Intelligence Intelligence involves the application of cognitive skills and knowledge to: –Learn –Solve problems –Obtain ends valued by the.
Intelligence does moderately correlate with brain size Remember: experience alters the brain Rats in stimulating environments develop thicker.
Myers PSYCHOLOGY Seventh Edition in Modules Module 31 Assessing Intelligence James A. McCubbin, Ph.D. Clemson University Worth Publishers.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
INTELLIGENCE AND TESTING Unit 11. Intelligence ■Capacity to acquire knowledge, reason effectively, and adapt to one’s surroundings by using inherited.
What makes us intelligent?. The ability to learn from experience, solve problems, and use knowledge to adapt to new situations. Is socially constructed.
Chapter 11 - Intelligence Do I belong in this class? Just Kidding.
Intelligence What makes us intelligent Or Not so intelligent.
Chapter 11 Intelligence “Just Think Mr. Thompson”.
Intelligence (Chapter 11) Lecture Outline : History of intelligence IQ and normal distributions Measurement.
Thinking About Psychology: The Science of Mind and Behavior Charles T. Blair-Broeker Randal M. Ernst.
Literacy, Intelligence, and Academic Achievement Zembar and Blume Middle Childhood Development: A Contextual Approach, First Edition ©2009 Pearson Education,
Test construction and assessment
Unit 11 Vocabulary Individual Differences and Intelligence.
Unit 11: Testing and Individual Differences
Myers’ PSYCHOLOGY Intelligence Worth Publishers.
EXPLORING PSYCHOLOGY Unit 6 – Part 2 Intelligence Ms. Markham.
Intelligence Chapter 11 Vocabulary.
Myers EXPLORING PSYCHOLOGY (6th Edition in Modules)
Unit 11: Testing and Individual Differences
Presentation transcript:

EPSY 625 LECTURE 3 COGNITIVE ASSESSMENT

AFFECT

TASK DEMANDS: STRUCTURING COGNITIVE TESTS TYPES ARTIFICIAL ANALOG ACTUAL TESTS: 1. ACHIEVEMENT 2. INTELLIGENCE

TASK TYPES ARTIFICIAL- intended to assess response to novel conditions not encountered before ANALOG- intended to assess response to conditions not ethically or economically establishable ACTUAL- intended to assess response in “real” setting

I. ACHIEVEMENT TESTS A. Curriculum Guides/ Mandates: TEXAS ESSENTIAL KNOWLEDGE AND SKILLS (TEKS)  TAKS B. Textbook Surveys C. Political/Philosophical Selection (e.g.. Hirsch, “CULTURAL LITERACY) D. Myth/Nostalgic/History “all _______ should know this

ACHIEVEMENT TESTS D. Myth/Nostalgic/History “all _______ should know this” E. Issue: content/pedagogical validity F. Content selection Random/Ordered Importance: how determined? Taxonomies

TAXONOMIES a)Bloom et al. Evaluation Synthesis Analysis Application Comprehension Knowledge

b)Table of specifications Topics Taxonomy KCApAn A699630% B % C466420% 20%30%30%20%100%

SAMPLING OF BEHAVIORS All tests sample a Universe, defined by a combination of all possible tasks, occasions, raters, and measurement methods Domain refers to a content area to which the tasks refer Sampling Variability of Performance Assessments Richard J. Shavelson, Gail P. Baxter, and Xiaohong Gao Journal of Educational Measurement, Fall 1993, Vol. 30, No. 3, pp

COGNITIVE RESEARCH 1. Memory effects - STM/LTM or Level: working-long term 2. Processing effects - spatial - analogical - reasoning - integrative/simultaneous

COGNITIVE RESEARCH 3. hot cognition/affect/ motivation - Paivio’s “dual coding” theory 4. Task structure - VISUAL/SPATIAL - SEMANTIC/VERBAL - PROCEDURAL/ORDER

COGNITIVE RESEARCH 5. Knowledge structure - Declarative (what) - Procedural(how-strategy) - Conditional (when-strategy)

CONTENT SELECTION IMPLICATIONS Situational nature of performance Complexity in development Limitations in generalizability

II. INTELLIGENCE TESTS A. THEORY BASIS: 1. “g” Construct- single factor 2. Limited # (2 or 3 factors) 3. Multiple intelligences 4. Limited scope for assessment (school)

1. “g” FACTOR BINET-TERMAN: children’s mental functioning: STANFORD-BINET IQ British psychology: SPEARMAN: factor analysis RAVEN: Progressive Matrices

2. Limited # of factors WECHSLER and adults: Verbal and non- verbal IQ: WAIS WAIS-R Developmental downward extension: WISC WISC-R WISC-III

2. Limited # of factors KAUFMAN & KAUFMAN: KAB-C: children’s IQ simultaneous & sequential (from Luria’s cognitive theory)

3. MULTIPLE INTELLIGENCES MERCER’S SOMPA (System of Multicultural Pluralistic Assessment) GARDNER’s Multiple Intelligences STERNBERG’s Analogical Reasoning Theory Subtest use of SB, WISC-III, and KAB-C

4. LIMITED SCOPE School intelligence (Publisher developed): Differential Aptitude Tests Scholastic Achievement Tests: SAT, GRE, GMAT COGAT (Cognitive Abilities Test), etc.

B. SAMPLING OF PROCESSES SPECIFIC ABILITIES/PROCESSES: ANALOGICAL REASONING SPATIAL ABILITY MEMORY NONVERBAL: BLOCK DESIGN

TYPES OF RESPONSE I. SUPPLY II. SELECT

I. SUPPLY RESPONSES A. WRITTEN (ESSAY, SHORT ANSWER) B. ORAL C. DRAWING/SKETCHING D. COMPUTATION E. PERFORMANCE

A. WRITTEN- ESSAY Extended response allows greater sampling of knowledge domain Dependent on writing (computer vs. pen) speed, legibility, strategic knowledge Greater time to score- need for rubric, fatigue in scoring Need to constrain topic, task

A. WRITTEN- SHORT ANSWER Restrict topics: Definitions or concepts Quick computations Limit response length Establish protocol for scoring Establish scoring system

B. ORAL RESPONSE Historical precedence (Greek, Roman, European Middle Ages, University system) Performance aspect: knowledge and personal interaction Typically faster response required- “thinking on one’s feet”

C. SKETCHING/DRAWING Less commonly required Often task-specific (e.g.. Knowledge maps) Incorporated into broader assessments or tasks (e.g.. Part of physics or math problem)

D. COMPUTATION Most common to mathematics and science fields Mental or written requirement Use of calculators or computers Verbal component may be important (word problems) Spatial component may be important (imageability)

PERFORMANCE COMPLEX CONSTELLATION OF ACTIVITIES SIMULATION REAL SITUATION ISSUES

PERFORMANCE ISSUES COST TIME TO SET UP TIME TO SCORE- RELIABILITY # OF TASKS SAMPLED AUTHENTICITY VS. VALIDITY

II. SELECTION RESPONSE MULTIPLE CHOICE (INCLUDING T-F) MATCHING

MULTIPLE CHOICE EFFICIENT SAMPLING- Time, cost RELIABILITY- produces reliable measures VALIDITY ISSUE: Does selection represent same knowledge as supply? Limitations overstated by critics current development does not take advantage of information available, new cognitive theory

MULTIPLE CHOICE Livingston, Reynolds & Willson (2005) list for good item writing # options- depends on good alternatives Options generated from incorrect cognitive processes, become clues to knowledge structure (e.g.. BUGGY arithmetic program)

MATCHING VARIANT ON MULTIPLE CHOICE LIMIT # OF MATCHES < 10 REQUIRE SINGLE CONCEPT REQUIRE MORE OPTIONS THAN QUESTIONS