STANAG 6001 PLUS LEVEL WORKSHOP BUREAU FOR INTERNATIONAL LANGUAGE CO-ORDINATION STANAG 6001 PLUS LEVEL WORKSHOP ROME, 2009.

Slides:



Advertisements
Similar presentations
Performance Assessment
Advertisements

Good Evaluation. Good Evaluation Should … be simple be fair be purposeful be related to the curriculum assess skills & strategies set priorities use multiple.
Performance Assessment Doris R. Brodeur, Ph.D. TEP
Lecture 5: Requirements Engineering
Workshop: Translating graduate attributes into classroom learning A/Prof Simon Barrie Institute for Teaching and Learning Hong Kong Institute of Education.
Core Competencies Student Focus Group, Nov. 20, 2008.
B-ELL Leadership Professional Development Oregon Reading First October 2 nd, 2008 University of Oregon © 2008 by the Oregon Reading First Center Center.
PEER REVIEW OF TEACHING Helen Barefoot Learning and Teaching Institute.
| ERK/ CEFR in Context 23 January 2015, Groningen Estelle Meima Language Centre.
Developing Literacy in English- language Learners: Key Issues and Promising Practices Diane August David Francis Claude Goldenberg Timothy Shanahan.
Assessing and Evaluating Learning
ABC Curriculum Showcase Coventry Public Schools February 10, 2009 An introduction for parents and community members Left click your mouse to advance to.
Assessment Literacy for Language Teachers by Peggy Garza Partner Language Training Center Europe Associate BILC Secretary for Testing Programs.
Looking at Student work to Improve Learning
Planning, Instruction, and Technology Pertemuan 9
ESL Phases & ESL Scale Curriculum Corporation 1994.
Assessment: Creating and Using Rubrics. Workshop Goals Review rubrics and parts of rubrics Use your assignment to create a rubric scale & dimension Peer.
Exploring Strategies for the Secondary Level in Mathematics Patricia Latham and Cathie McQueeney September 28, 2006.
How to Write a Good Conference Proposal Limin Zheng Foreign Service Institute
Chap. 3 Designing Classroom Language Tests
ASAP Introduction to Co- construction Meetings. Introduction to Co-construction Meetings In the setting up of ASAP co- construction meetings we should.
Calculation BIM Curriculum 07. Topics  Calculation with BIM  List Types  Output.
Writing research proposal/synopsis
ICAO Circular 323 Guidelines for Aviation English Training Programmes Philip Shawcross ICAEA ICAO LPRI workshop, ENAC, Rome, 3rd March 2010.
The Interpersonal Mode
Week 5 Lecture 4. Lecture’s objectives  Understand the principles of language assessment.  Use language assessment principles to evaluate existing tests.
Developing a Quality Framework for Community Languages Schools Dr Tim Wyatt Dr Bob Carbines Erebus International Victorian Annual Conference 7 July 2007.
Improving Efficiencies Through Cost- Benefit Analysis of Metadata Creation Joyce Celeste Chapman NCSU Libraries Fellow Metadata and Digital Object roundtable:
Using Content-Based Language Teaching to Teach To and At Higher Proficiency Levels David Pater, Defense Language Institute English Language Center.
Chesapeake College Program Planning & Grant Proposal Writing Workshop Presented by: Pat Bates and Elizabeth Mahler October – November 2009.
Creswell Qualitative Inquiry 2e 11.1 Chapter 11 Turning the Story and Conclusion.
U.S. Government ILR Summits on Listening Sponsored by DLIFLC An Interagency Effort to Expand, Supplement, Define and Revise the ILR Listening Proficiency.
Dirgin, James. January Please seek the author’s permission for distribution or commercial use. ILR Government Skill Level Descriptors for Foreign.
Possible Evaluation Model: Reactions from the Field David T. Conley, Ph.D. Professor, University of Oregon.
D4 Curriculum Design Workshop Liz Bennett and Sue Folley Discover - Dream - Design - Deliver.
1 Your reference A Case for Gender Statistics in National Statistical System Mr. Pali Lehohla Statistics South Africa 26 January 2009.
Chapter 1 Integrating UBD and DI An Essential Partnership.
Criterion-Referenced Testing and Curriculum-Based Assessment EDPI 344.
THREE DIMENSIONS OF A HIGH-QUALITY RUBRIC Created by Shauna Denson “Classroom Assessment for Student Learning”(J. Chappuis)
International Accounting Standards An older set of standards stating how particular types of transactions and other events should be reflected in financial.
TEACHING WITH A FOCUS ON LEARNERS One model of Differentiation: Sousa and Tomlinson (2011) Differentiation and The Brain. Purpose: Understanding Text Complexity.
CAPS: COACHING TEACHERS Facilitator: Dr. Lynne Paradis BELIZE LITERACY PROGRAM June 2011.
Instructional Leadership: Planning Rigorous Curriculum (What is Rigorous Curriculum?)
Benefits of Using TESOL’s Standards to Guide Instructional Design Vann Edge EESL 650.
USING ILR/STANAG LEVEL DESCRIPTORS AND TEXT TYPOLOGY AND PASSAGE RATING IN CLASSROOM TEACHING TOWARDS PROFICIENCY James Dirgin Director Proficiency Standards.
MGT-555 PERFORMANCE AND CAREER MANAGEMENT LECTURE NO
Checklists EDUC 307. What is an Observation Checklist?  The observation checklist is a strategy to monitor specific skills, behaviors, or dispositions.
Coaching protocol practice Each team select a map (unit) to use for the coaching protocol. Join another person / team not from your grade or department.
Evaluation and Assessment Evaluation is a broad term which involves the systematic way of gathering reliable and relevant information for the purpose.
Designing Quality Assessment and Rubrics
AN INTRODUCTION TO SPOKEN LANGUAGE LG4 Section A.
Course Work 2: Critical Reflection GERALDINE DORAN B
1 Rubrics: A powerful assessment tool for you, your students & your programs Dannelle D. Stevens, Ph.D. Professor Emerita, Portland State University Syracuse.
Setting Objectives and Providing Feedback
D4L – Active Learning Curriculum Design Workshop
Students as Self Assessors Teachers as Focused Coaches
Assessment in Language Teaching: part 1 Lecture # 23
ICAO Circular 323 Guidelines for Aviation English Training Programmes
English Language Portfolio
David Keller, Ph.D. Curriculum & Assessment Specialist
Students as Self Assessors Teachers as Focused Coaches
Schema Theory (Paper – 1.1.4:Unit – 5)
Learning About Language Assessment. Albany: Heinle & Heinle
Elizabeth Hoerath Manager FSL Policy and Implementation Unit
TEXTBOOK QUALITY STANDARDS
UNIVERSITY OF THE ARMED FORCES - ESPE
Per STANAG 6001 Ed. 4 Skill Level Descriptions
Branka Petek, Slovenia Gesche Susanna Sutter, Germany
Learning Objective: To write descriptively. 24 February 2019
K–8 Session 1: Exploring the Critical Areas
Presentation transcript:

STANAG 6001 PLUS LEVEL WORKSHOP BUREAU FOR INTERNATIONAL LANGUAGE CO-ORDINATION STANAG 6001 PLUS LEVEL WORKSHOP ROME, 2009

Participants: Marc Issele – Belgium Maria Watton - Italy Donald Fischer - USA Hollie West- ACTFL/USA Branka Petek - Slovenia Maryjo DiBiase - Italy Geshe Sutter - Germany David Moore - USA Jaroslaw Grabowski - Poland Elvira Swender - ACTFL/USA Jana Vasily-Begovic James Dirgin - USA

INTRODUCTION PURPOSE: Creating awareness and common understanding of plus level descriptions of STANAG 6001

DEFINITION... ….SUBSTANTIALLY EXCEEDS BASE LEVEL BUT UNABLE TO SUSTAIN AT THE NEXT LEVEL….STANAG 6001

Questions and Issues surrounding “plus level” performance…

Few Principles to remember... F The Threshold Principle F The Range Principle F The “Mastery” Principle F The Relative Contributions Principle

Where does the plus level performance appear in the range?...more than halfway!

How much does a plus level have to exceed the threshold base level? Substantially...

- How does a plus level user perform at the next level?...does not fully or consistently meet all of the criteria for the next level!

OK...Maybe not “meet all”... But does a plus level user have to meet any of the criteria at the next level?

All of the time? -All of the time? -Most of the time? -Some of the time? - None of the time? “Mostly” usually means more than “some” and less than “all”…

A person performing with a certain degree (mostly?) of “core” accuracy requirements for that level is usually considered to have the “mastery” at that level, meeting the sustainment requirements for the level… %100 accuracy expectation at a level, including for plus level performance, is too high. User operating at %100 accuracy is most likely at the next level--or more... Accuracy & Sustainment

What are we really looking for in plus levels? Certain factors may have “relatively” more significant and important contributions at different levels… These features are more prevalent at plus levels, through the presence salient core features of the next level. Ex.: Organization and abstract linguistic formulations are hallmark of L3, therefore must be observed at L2+ as well...

PLUS LEVELS 1) Can be very useful and efficient to “better understand” the base levels surrounding a plus level. For instance: Level 2 and Level 3 become more clearly defined when one understands, uses and applies 2+ definitions and constructs.

2) facilitate better understanding of the core principles of the STANAG system, leading to better understanding of... the range of performances the degree of deficiency critical factor(s) that are not sustained 3) help diagnosing user deficiencies in the critical linguistic elements and factors - washback to the classroom and curriculum PLUS LEVELS

4) allow finer granulation - more precision help program managers save time and resources in placement, advancement, and more realistic expectations. Ex.: A program manager may be willing to send L2+ user to a L3 program versus a threshold L2, who will clearly not benefit from the program or fail the task clearly and miserably (-$$$). Without plus rating, both will appear as “L2” users without distinction.

5) It is essential to understand, appreciate, and focus on the differences among: plus level testing plus level rating plus level performance

6) Language proficiency appears in a continuum... Plus levels are the zones where transition and overlapping between base levels are not only most apparent, but also the most volatile, unstable, and confusing.

7) There is still a long way to go before we can fully explore and standardize plus level concepts and approaches to testing, teaching, and working with plus levels.

Plus……..

THANK YOU!