Classroom-Based Assessment (CBA) What Works and What Doesn’t

Slides:



Advertisements
Similar presentations
An Introduction to Test Construction
Advertisements

Assessment types and activities
Assessment & Evaluation adapted from a presentation by Som Mony
Chapter 1 What is listening?
Alternative Assesment There is no single definition of ‘alternative assessment’ in the relevant literature. For some educators, alternative assessment.
Topic: Assessment and Evaluation
Grade 12 Subject Specific Ministry Training Sessions
Assessment Literacy for Language Teachers by Peggy Garza Partner Language Training Center Europe Associate BILC Secretary for Testing Programs.
Thinking about assessment…
1 DEVELOPING ASSESSMENT TOOLS FOR ESL Liz Davidson & Nadia Casarotto CMM General Studies and Further Education.
Now That My Marking’s Done, Now What??? Brent Galloway Lori Stuber.
Quality in language assessment – guidelines and standards Waldek Martyniuk ECML Graz, Austria.
ASSESSMENT OF STUDENT LEARNING Manal bait Gharim.
Curriculum and Learning Omaha Public Schools
Chapter 2 Observation and Assessment
Assessing Student Learning
Fourth session of the NEPBE II in cycle Dirección de Educación Secundaria February 25th, 2013 Assessment Instruments.
Teaching & Assessment Assessment is a Subset of Teaching.
Assessment Information from multiple sources that describes a student’s level of achievement Used to make educational decisions about students Gives feedback.
Assessment. Workshop Outline Testing and assessment Why assess? Types of tests Types of assessment Some assessment task types Backwash Qualities of a.
Testing and Evaluation
ASSESSMENT LITERACY PROJECT Kansas State Department of Education Introduction and Overview Welcome !
Catholic College at Mandeville Assessment and Evaluation in Inclusive Settings Sessions 3 & /14/2015 Launcelot I. Brown Lisa Philip.
Alternative Assessment Chapter 8 David Goh. Factors Increasing Awareness and Development of Alternative Assessment Educational reform movement Goals 2000,
21 st Century Learning and Instruction Session 2: Balanced Assessment.
Language Assessment. Evaluation: The broadest term; looking at all factors that influence the learning process (syllabus, materials, learner achievements,
ASSESSMENT and EVALUATION (seeing through the jargon and figuring out how to use the tools)
Monitoring and Assessment Presented by: Wedad Al –Blwi Supervised by: Prof. Antar Abdellah.
SECOND LANGUAGE ASSESSMENT Maria del Mar Sáez Ortega Olivia Sánchez Caton Ana Stelea Déborah Vera Perez.
Evaluation and Assessment Evaluation is a broad term which involves the systematic way of gathering reliable and relevant information for the purpose.
PGES Professional Growth and Effectiveness System.
Assessment Design How do you know that they know what you taught them?
Language Assessment.
Chapter 1 Assessment in Elementary and Secondary Classrooms
This project has been funded with support the European Commission
Thinking about assessment…
Assessing Young Learners
Chapter 8: Performance-Based Strategies
M-LANG project  Ref. n NO01-KA Interactive Exchange Workshop on how to use response systems and ICT tools for creating interactive learning.
Phyllis Lynch, PhD Director, Instruction, Assessment and Curriculum
Taking the TEAM Approach: Writing with a Purpose
I love portfolio! Nelly Zafeiriadou MA, EdD ELT School Advisor
English Language Portfolio
Formative and Summative Assessment
ASSESSMENT OF STUDENT LEARNING
Classroom-based assessment to promote equity
Learning About Language Assessment. Albany: Heinle & Heinle
Washback and Alternative Assessment
TESTING AND LANGUAGE TEACHING
Copyright © 2002 The George Lucas Educational Foundation
Human Resources Management: Module 2
What Are Rubrics? Rubrics are components of:
COMPETENCIES & STANDARDS
Student Assessment and Evaluation
PORTFOLIO ASSESSMENT Jay Barrett, GED 621.
Best Practices in STANAG 6001 Testing
Training Teachers to Assess the Productive Skills
14 The Role of Assessment. 14 The Role of Assessment.
What Assessment FOR Learning Can Do for You
Exploring Assessment Options NC Teaching Standard 4
Unit 7: Instructional Communication and Technology
Assessment Literacy: Test Purpose and Use
In The Name Of the Most High
TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1
Alternative Assessment
Assessment Practices in a Balanced Assessment System
Student Assessment and Evaluation
Developing Quality Assessments
Why do we assess?.
EDUC 2130 Quiz #10 W. Huitt.
Presentation transcript:

Classroom-Based Assessment (CBA) What Works and What Doesn’t Peggy Garza BILC Secretary Chair, English Language Programs Dept. Partner Language Training Center Europe George C. Marshall European Center for Security Studies

Definitions of Classroom-Based Assessment “Assessment internal to the classroom and managed by the teacher.” Glen Fulcher “Comprises a repertoire of methods and reflective procedures that teachers and students use for evidence to gauge student learning on an ongoing basis.” Carolyn Turner “ The process of using information about students’ learning in the course of instruction to make decisions to improve learning.” Mary Jo Di Biase

Contrasting Paradigms Large Scale Classroom High stakes Low stakes Contrasting Paradigms Summative Formative Assessment of learning Assessment for learning STANAG 6001 (proficiency) Classroom Based Assessment

Main Principles of CBA Include a variety of methods to build learner profiles to support language learning in the classroom Information from CBA should be used as the basis for interaction between the teacher and the student Teachers need to become aware of assessment methods and procedures

CBA Examples Self assessments Diagnostic tests Peer assessments Vocabulary Portfolios Projects Dictation Spelling Presentations Debates Military briefings Essays Interviews Summaries Achievement tests Quizzes Performance tests

Traditional Assessment Current Practices Standard exams Timed, multiple-choice format Decontextualized test items Scores suffice for feedback Focus on discrete answers Oriented to product Noninteractive performance Fosters extrinsic motivation Continuous long-term assessment Untimed, open-ended responses Contexualized communicative tasks Individualized feedback Open-ended, creative answers Oriented to process Interactive performance Fosters intrinsic motivation

EALTA Guidelines Assessment Purpose(s) and Specification European Association for Language Testing and Assessment (EALTA) members involved in classroom testing and assessment will clarify to themselves and appropriate stakeholders Assessment Purpose(s) and Specification What is the purpose of the assessment? How does the assessment purpose relate to the curriculum? Are there any test specifications? How well is the curriculum covered? How are the assessment purposes and specifications made known and discussed? Assessment Procedures Who designs the assessment procedures? How appropriate are the assessment procedures to the learners? How is information on students´ learning collected? How is information on students´ learning assessed and stored? What efforts are made to ensure that the assessment results are accurate and fair? What efforts are made to promote agreement in marking practices across teachers and schools? What account is taken of students’ views on the assessment procedures? Consequences What use is made of the results? What action(s) will be taken to improve learning? What kind of feedback do students get? What processes are in place for students or their guardians to make complaints or seek re-assessments? What are the consequences of the assessment procedures for classroom practices? What are the consequences of the results of the assessment for learners?

EALTA Guidelines Assessment Purpose(s) and Specification What is the purpose of the assessment? How does the assessment purpose relate to the curriculum? Are there any test specifications? How well is the curriculum covered? How are the assessment purposes and specifications made known and discussed?

EALTA Guidelines B. Assessment Procedures Who designs the assessment procedures? How appropriate are the assessment procedures to the learners? How is information on students´ learning collected? How is information on students´ learning assessed and stored? What efforts are made to ensure that the assessment results are accurate and fair? What efforts are made to promote agreement in marking practices across teachers and schools? What account is taken of students’ views on the assessment procedures?

EALTA Guidelines Consequences What use is made of the results? What action(s) will be taken to improve learning? What kind of feedback do students get? What processes are in place for students or their guardians to make complaints or seek re-assessments? What are the consequences of the assessment procedures for classroom practices? What are the consequences of the results of the assessment for learners?

Washback “Washback is the term that is used when students and teachers do things they would not necessarily otherwise do because of the test.” (Alderson and Wall, 1993) “In large scale assessment, washback often refers to the effects that tests have on instruction in terms of how learners prepare for the test.” (Brown and Abeywickrama, 2010)

Positive and Negative Washback STANAG 6001 proficiency testing Language programs Positive: improvements in classroom instruction to better align it with STANAG 6001 testing Negative: establishing test prep courses, such as those focusing on memorized or rehearsed language

CBA Positive Washback Positively influences what and how teachers teach Positively influences what and how learners learn Gives learners feedback that enhances their language development Is more formative in nature than summative Provides conditions for peak performance by the learner (Brown and Abeywickrama, 2010)

CBA’s Role in Proficiency Building Instructional Goals and Learning Outcomes Content and Instruction Assessment CBA supports proficiency building

Importance of Alignment “When learning and testing are not aligned, bad things happen.”(Dr Clifford, Madrid, May 2015) Possible reactions to lack of alignment Learners, who have mastered the content, fail the test Learners become frustrated and lose motivation Teachers change their instruction to prepare learners for the test, not the learning outcomes

Test method and purpose Test task and proficiency level More on Alignment Test method and purpose Test task and proficiency level

Alignment of Test Method and Test Purpose Methods Description Purposes Advantages Disadvantages 1 Tests or quizzes Provide information on learning outcome Examine achievement of outcomes Ascertain extent to which program adheres to meet goals Provide feedback to teachers, students Evidence of learning is generated as part of classes Results are used Time consuming to create, administer, correct Time taken out of coursework 2 Performance tests Classroom activities using an observation checklist, example: give a briefing Examine student achievement Ascertain performances meet goals Provide feedback to teachers and students Capture data that is difficult to obtain through written texts and other methods Can be difficult to interpret Performances influenced by observer Expensive and time consuming 3 Portfolios Collection of work such as assignments, reflection, self assessment Examine achievement over time Understand progress within program Ascertain extent to which program meets goals Provide feedback to students and teachers Students see growth and reflect on the products in the portfolio Provides a multi- view of student achievement Resources needed: may be costly and time consuming (Adapted from DiBiase, 2014)

Alignment of Test Task & Proficiency Level High Proficiency Essay Debates Extended response Presentations Interviews and reports Panel discussions Low Proficiency Spelling test Multiple choice True/ false LOW Timed paragraph reading Picture-cued Q & A Sentence completion

What About the Learners? Learner expectations They want to be tested on what they learn They want to succeed But should also not be afraid to make mistakes and learn from them Learners appreciate specific feedback But may need teacher guidance and strategies for language development Learners require support and coaching To learn how reflect, become more engaged in the learning process and take greater responsibility for their own learning

Instructional Goals and Learning Outcomes Clifford’s Model of Shrinking Learning Expectations (When only Traditional Tests are Used) Instructional Goals and Learning Outcomes Textbook Teaching Test Learners do not want to waste their time studying what is not going to be “needed”. For learners (and often for teachers), it is the tests used and not a course’s stated learning outcomes that define what is “needed.” (Adapted from Clifford, 2015)

Clifford’s Model of Expanding Learning Expectations Textbook Real-world proficiency Instructional domains (Clifford, 2015)

Per Clifford, teaching for proficiency requires Improved assessment literacy for everyone: teachers, students, and administrators A tolerance for formative assessment that allows learners and programs to find success from their failures

CBA Goes Beyond Traditional Testing Emphasis on continuous assessment Real-world communicative tasks A variety of assessment methods Learner deficiencies become “windows of insight” (Brown and Abeywickrama, 2010)

CBA can be described as the assessment bridge or the place where assessment, teaching and learning interweave in the classroom (Turner, 2012)

What Doesn’t Work Misalignment Testing learners to find out what they don’t know Excessive testing No feedback and untimely feedback Using poorly designed or rapidly constructed tests, rubrics or scoring criteria

What Works Providing feedback for improved learning and classroom instruction Positive washback Alignment of learning outcomes, content and assessment Providing a multi-view assessment of a learner’s competence in different domains of language learning Building responsibility for own learning

Importance of Assessment Literacy “When teachers and program managers do not have assessment literacy, bad things happen.” (Garza, Helsinki, October 2015) Possible reactions They do not understand STANAG 6001 standards and proficiency testing and therefore make bad program design decisions They blame the STANAG 6001 test, believe it is too difficult, or should test specific grammar, vocabulary or military terms

What Is Assessment Literacy? “Knowledge, skills, and understanding of assessment principles and practice” (Taylor, 2009)

Why Is Assessment Literacy Important ? So teachers can provide fair and accurate assessments of their students To improve alignment between classroom instruction and desired final learning outcomes To support increasing accountability for classroom instruction To create coherence across different assessments in a language program and confirm consistency with STANAG 6001 standards

Language Standards & Assessment Seminar For teachers and language program managers Objectives Familiarization with STANAG 6001 Guidelines for aligning instruction to NATO standards Sound assessment principles and practical activities Two week-seminar held twice a year