AFFECTIVE ASSESSMENT A Concurrent Session W. James Popham

Slides:



Advertisements
Similar presentations
A Systems Approach To Training
Advertisements

Earth Science in secondary schools in England & Wales Teacher attitudes and levels of teaching.
The Research Consumer Evaluates Measurement Reliability and Validity
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Job Analysis-Based Performance Appraisals
How would you measure the students’ attitudes toward this lecture?
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
Measuring Attitudes, Perceptions, and Preferences
Appraising Performance You have to get ongoing constructive feedback to push you out of your comfort zone. —Kevin Sharer, CEO, Amgen Chapter 17 Copyright.
© 2006 McGraw-Hill Higher Education. All rights reserved. Chapter 19 Affective Behavior.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 5 Making Systematic Observations.
Scaling and Attitude Measurement in Travel and Hospitality Research Research Methodologies CHAPTER 11.
RESEARCH METHODS IN EDUCATIONAL PSYCHOLOGY
Questions to check whether or not the test is well designed: 1. How do you know if a test is effective? 2. Can it be given within appropriate administrative.
Lesson learned from previous exams In general, students often fail to earn points because of incomplete responses or vague responses that can’t be interpreted.
1 SESSION 1 using The New Performance Standards and New VDOE Requirements
Community Sector Governance Capability Framework
EVIDENCE BASED WRITING LEARN HOW TO WRITE A DETAILED RESPONSE TO A CONSTRUCTIVE RESPONSE QUESTION!! 5 th Grade ReadingMs. Nelson EDU 643Instructional.
Attitude Measurement Carlos Torelli Lu Wang. Attitudes Measuring the unobservable in order to predict behavior and to assess people’s responses to persuasion.
Assessment Cadre #3: “Assess How? Designing Assessments to Do What You Want”
Introduction to Survey Research. What kind of data can I collect? Factual Knowledge Factual Knowledge Cognitive Beliefs or Perceptions Cognitive Beliefs.
Assessment Procedures: Observational Techniques, Peer Appraisal, and Self-Report Chapter 13 June 25, 2007.
The Vocabulary of Research. What is Credibility? A researcher’s ability to demonstrate that the study is accurate based on the way the study was conducted.
Cluster Group Meeting Plymouth University Thursday 31 st Jan 2012 WORDLE Update: Viv Bell.
MEASUREMENT OF VARIABLES: OPERATIONAL DEFINITION AND SCALES
ASSESSMENT LITERACY: A BONA FIDE “MAGIC BULLET” FOR EDUCATION W. James Popham University of California, Los Angeles California Educational Research Association.
1 Welcome to Part 2! Adult Learners: Principles, Barriers, and Best Practices Presented by Dr. Mary Jo Self.
The World of Assessment Consider the options! Scores based on developmental levels of academic achievement Age-Equivalent scores.
Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.
Chapter 5 Building Assessment into Instruction Misti Foster
Study of the day Misattribution of arousal (Dutton & Aron, 1974)
English language learners, and the perceived preparedness, self efficacy and knowledge of preservice teachers Aydin Durgunoglu, & Trudie Hughes University.
College of Science and Engineering Learning and Teaching Strategy Planning Meeting Initial Reflections Nick Hulton.
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 13 Assessing Affective Characteristics.
Quantitative SOTL Research Methods Krista Trinder, College of Medicine Brad Wuetherick, GMCTE October 28, 2010.
NEASCNEASC Standards Committees Kick-off Today’s Topic: Overview of the NEASC Game Plan and instructions for today’s work.
Learning Objective Chapter 9 The Concept of Measurement and Attitude Scales Copyright © 2000 South-Western College Publishing Co. CHAPTER nine The Concept.
Approaches to Problem Solving. There are many approaches to problem-solving. What follows in this PowerPoint are several that provide an opportunity for.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Using Measurement Scales to Build Marketing Effectiveness CHAPTER ten.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
1 Chapter 10 Attitude Measurement © 2005 Thomson/South-Western.
Validity Validity is an overall evaluation that supports the intended interpretations, use, in consequences of the obtained scores. (McMillan 17)
Scaling and Index Construction
Measurement Theory in Marketing Research. Measurement What is measurement?  Assignment of numerals to objects to represent quantities of attributes Don’t.
Surveying instructor and learner attitudes toward e-learning Presenter: Jenny Tseng Professor: Ming-Puu Chen Date: April 12, 2008 Liaw, S., Huang, H.,
Surveys.
How would you measure the students’ attitudes toward this lecture?
Chapter 14: Affective Assessment
Enriching Assessment of the Core Albert Oosterhof, Faranak Rohani, & Penny J. Gilmer Florida State University Center for Advancement of Learning and Assessment.
Chapter 6 - Standardized Measurement and Assessment
Justice and Trust Week 5.
Appropriate Testing Administration
Quantitative Data Collection Techniques In contrast to qualitative data quantitative data are numerical. Counted, calculated tallied and rated. Also ratings.
Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.
Michigan Assessment Consortium Common Assessment Development Series Module 16 – Validity.
Affective Assessment Assessment of Dispositions. Affective Learning Targets AttitudesInterests ValuesOpinions PreferencesMotivation Academic Self-ConceptSelf-Esteem.
Chapter Twelve Copyright © 2006 McGraw-Hill/Irwin Attitude Scale Measurements Used In Survey Research.
PREPARATION OF QUESTIONNAIRES PREPARATION OF QUESTIONNAIRES Chapter - 4 Dr. BALAMURUGAN MUTHURAMAN
Assessing Math Looking closer at PARCC Task Types 2.
 TEACH USING THE INQUIRY APPROACH  Common Core Math Practices  Next Generation Science  Hands-On, Minds-On, Real World!
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Chapter 11 Survey Research
Affective Assessment Chapter 10
Steps for development and evaluation of an instrument - Revision
Selected data collection techniques
Aashna A. Dhayagude & David E. Szwedo James Madison University
Designing a Performance Assessment
Measuring Behavior Kirkpatrick’s Level 3
Presentation transcript:

AFFECTIVE ASSESSMENT A Concurrent Session W. James Popham University of California, Los Angeles A Concurrent Session KDE/ISLN/KLA Leadership Networks Joint Summer Conference Lexington, Kentucky June 20, 2011

Affective Assessment: A 21st Century Shortcoming?  

ASSESSING STUDENTS’ AFFECT

We MEASURE what we TREASURE.

The Predictive Nature of Students’ Current Affective Status Students’ Current Behavior Status Students’ Subsequent Behavior Predicts

Potential Attitude Targets: Positive attitudes toward learning Positive attitudes toward self Positive attitudes toward self as a learner Appropriate attitudes toward those who differ from us

Potential Interest Targets: Interest in specific subjects Interest in subject-related activities Interest in public affairs Interest in altruistic endeavors

Potential Value Targets: Honesty Integrity Justice Freedom

ASSESSING AFFECT: A THREE-PART STRATEGY Affective assessment instruments should be self-report inventories, completed by students under conditions of actual and perceived anonymity, from which group-focused inferences about students’ affective status can be accurately drawn.

ANONYMITY-ENHANCEMENT TACTICS Emphasize anonymity in directions. Provide a rationale for the assessment. Restrict responses to untraceable marks. Install an anonymous collection-procedure. Do not hover.

A traditional, unidimensional Likert inventory Two Measurement Tactics for Assessing Students’ Affect via Anonymous, Self-Report Inventories: A traditional, unidimensional Likert inventory A Likert-like, multidimensional inventory

Constructing A Traditional Likert Inventory Select the affective variable to assess. Create a set of favorable and unfavorable statements. Ask others to classify these as positive or negative. Determine number and nature of response options. Construct a preliminary version including directions. Try out the preliminary version. Score the inventories. Delete aberrant statements.

A DIFFERENCE IN DISCRIMINATION-ENGENDERING Day in and day out, school is always the most enjoyable part of my day. (Strongly Agree, Agree, Not Sure, Disagree, Strongly Agree) Although I sometimes find it disagreeable, most of the time, I enjoy school. (Strongly Agree, Agree, Not Sure, Disagree, Strongly Agree)

CONSTRUCTING A MULTIFOCUS INVENTORY Choose the affective variables to measure. Decide on how many items per variable. Generate positive/negative statement for each variable. Determine number and phrasing of response options. Develop directions and a presentation format.

Assessment/Instruction Utility: An Affective Target of Considerable Assessment/Instruction Utility: Students' confidence in their ability to perform important skills

CONSTRUCTING A CONFIDENCE INVENTORY Select suitable skills or bodies of knowledge. Decide on how many items per skill or body of knowledge. Identify and describe tasks (or activities) requiring the use of those skills or bodies of knowledge. Determine number and nature of response options. Develop directions, sample item(s), and presentation formats.

TO DELVE DEEPER INTO THE ASSESSMENT OF AFFECT Read darn near any of Jungle Jim’s books about assessment written during this or the previous century. He is so repetitive! E-Mail Address: wpopham@ucla.edu