The Ecology of Language Assessment Carl Falsgraf, Director CASLS
The Language Education Ecosystem Curriculum Instruction Formative Assessment Formative Assessment Summative Assessment Summative Assessment REFLECTION
Can one assessment do it all?
ASSESSMENT CONTINUUM Teacher administered Customized Curriculum dependent + high validity + supports instruction - low reliability - context dependent Expert administered Standardized Curriculum independent + high reliability + context independent - low validity - divorced from instruction STAMP?
Proficiency PerformanceAchievement OPI Oral quiz Service learning project Weekly quiz Final exam STAMP?
Specifications of Intended Test Use (SITU) (Norris, 2003) Who are the test takers? Who are the test score users? What is the purpose of the test? What information should the test provide? What are the intended consequences of using the test? Norris (2000) STAMP?
ILR Novice-High Novice-Mid Novice-Low Intermediate-High Intermediate-Mid Intermediate-Low Advanced Plus Advanced Superior Benchmark 1 Benchmark 2 Benchmark 3 Benchmark 4 Benchmark 5 Benchmark 6 ACTFL BENCHMARKS Assessment
STAMP 101 By teachers, for teachers By teachers, for teachers Designed to inform, not just measure Designed to inform, not just measure Online: Anywhere, anytime, anybody Online: Anywhere, anytime, anybody Computer adaptive reading/listening Computer adaptive reading/listening Computer assisted speaking/writing Computer assisted speaking/writing
STAMP LISTENING
STAMP READING
NOELLA SPEAKING
Example of a good item
Example of a bad item
Level 3 Level 4
CLASS REPORT
PROGRAM REPORT
SLA Web
National 3rd/4th YR Japanese Data
Proficiency Levels by Years (Spanish - High School students) 1 year of study 2 years of study 3 years of study 4 years of study
NEEDS AUDIT CERTIFICATION PROGRAM EVALUATION PROGRESS CHECK DIAGNOSIS IMPROVE INSTRUCTION MOTIVATE STUDENTS NCLB/STAMP AP/OPI STAMP MIDTERM LINGUAFOLIO ASSESSMENTS
DEVELOPING AN ASSESSMENT PLAN CLARIFY GOALS DEFINE PURPOSES/USES RESEARCH EXISTING TOOLS DEFINE INTERNAL TOOLS INITIATE ASSESSMENT LITERACY PROFESSIONAL DEVELOPMENT
SAMPLE ASSESSMENT PLAN