Basing writing tests for young learners to the CEFR Cecilie Carlsen & Eli Moe, University of Bergen, Norway Second Annual Conference of EALTA, Voss, Norway.

Slides:

Advertisements

Similar presentations

Using the P Scales launch conferences 2009 Richard Byers University of Cambridge Faculty of Education.

Advertisements

Description of quality assurance in the Latvian vocational education Gunta Kinta Academic Information Centre NCP-VET-CO project fourth meeting.

All Children and young people have an entitlement to a curriculum which they experience as a coherent whole, with smooth and well-paced progression through.

Reliability and Validity

Process skills used by South African and Norwegian students to perform cognitive tasks on magnetism, acids and bases Oyvind Mikalsen and Meshach Ogunniyi.

© Stichting CITO Instituut voor Toetsontwikkeling 1 Mapping the Dutch Foreign Language State Examinations onto the Common European Framework of Reference.

Spiros Papageorgiou University of Michigan

1 The Swiss ‘IEF’ Project - Assessment Instruments Supporting the ELP by Peter Lenz University of Fribourg/CH Voss/N, 3/06/05.

Understanding Grade Level and School Growth Reports Office of Assessment and Accountability.

Bloomington Public Schools K-12 Pathways Based in part on NWEA (2012) study of RIT scales and ACT College Readiness Benchmarks, TIES equating with MCA.

Improving Scottish Local Government Benchmarking In Scotland Public Services Reform Inquiry: Strand 2 – Benchmarking & Performance Measurement Scottish.

1 Academic Performance of English Language Learners on Grades 3-8 ELA Tests (2007 to 2009) David Abrams Assistant Commissioner Office of Standards, Assessment.

Curriculum Alignment. OCTOBER SKY After watching the movie clip from October Sky (1999), discuss with an elbow partner: “What allowed the children to.

Every School A Good School: The Way Forward for SEN and Inclusion Presentation to Annual Conference for Principals of Special Schools Dorothy Angus 22.

I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=

I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=

The National Healthy Schools Programme is a long term initiative that aims to help young people and their schools to be healthy, making a difference to.

THE NEW SEND FRAMEWORK Brian Lamb OBE. From this…..? Welcome to Special Educational Needs and Disability Maze School Action School Action Plus Statements.

Assessing Current Institutional Practices: The ALFI Toolkit PLA with a Purpose Symposium Columbus, Ohio April 29, 2014.

Synthesis of Ideas from MERGA Conference 2007 Participants in VP Development Session on National Curriculum Gaye Williams VP (Development) thanks all MERGA.

Raili Hildén University of Helsinki Relating the Finnish School Scale to the CEFR.

Fremdsprachenkompetenz – Der Schlüssel zur Tür nach Europa Kloster Banz 26. Oktober 2006 Language Testing and Teacher Training — A Swedish Example Gudrun.

From modules to qualifications – reshaping the languages curriculum at the Open University Dr Uwe Baumann and Dr Elodie Vialleton Reshaping Languages in.

24 June 2011 Raising standards, improving lives Moving to outstanding post-16 provision Tom Winskill HMI Principal Officer, Framework Development Ofsted.

The Learning Behaviors Scale

The Bucks County Montessori Charter School PSSA Results, Local District Comparisons, and Year to Year Progressions.

Inferences about School Quality using opportunity to learn data: The effect of ignoring classrooms. Felipe Martinez CRESST/UCLA CCSSO Large Scale Assessment.

CA Teacher Performance Assessments Orientation

RIVERVIEW HIGH SCHOOL

Validation of the Assessment and Comparability to the PISA Framework Hao Ren and Joanna Tomkowicz McGraw-Hill Education CTB.

Preparatory training project within the Education Authority, City of Göteborg, Sweden Whoami? The Education Authority The Swedish Educational System Problem.

3/25/2011 Rubric Development. Overview  A Little About You  Overview A Quick Note about Validity Introduction of Rubrics How to Create a Rubric Using.

Eurocall Conference Coleraine, 5-8 September 2007 ICT as a tool to support learner autonomy more opportunities for oral skills training outside classroom.

The future of education inspection in England 10 February 2015 Andrew Cook Regional Director, East of England.

National tests in Norway – a contested standard in education? Elisabeth Hovdhaugen, Department of Education, University of Oslo/NIFU Idunn Seland, NIFU,

The Common European Framework and the European Language Portfolio (ELP): involving learners and their judgements in the assessment process The ELP team.

CCSSO Criteria for High-Quality Assessments Technical Issues and Practical Application of Assessment Quality Criteria.

The Common European Framework and the European Language Portfolio (ELP): involving learners and their judgements in the assessment process The ELP team.

Average National Arabic Scale Scores for Grades 1, 2 and 3 by School Type Grade Level Scale Score Grade Level Scale.

DECEMBER 2010 EUROPEAN MODULES ON MIGRANT INTEGRATION OUTCOMES & REFLECTIONS FROM THE FIRST MODULE ON LANGUAGE AND INTRODUCTORY COURSES.

Teacher Authority WEEK 1 – Welcome webinar preparation + Free word associations Learn about course syllabus and learning environment Course basics Provide.

Standard development in asessment for learning: Strategies and challenges Lars Sigfred Evensen, NTNU Ragnar Thygesen, UiA Gustaf U. Skar, HiST.

MEAP / MME New Cut Scores Gill Elementary February 2012.

This project has been funded with support from the European Commission. This publication reflects the views only of the author, and the Commission cannot.

Equal Education in Practice!. 2 Kunnskapsdepartementet Aims for this introduction: Background information on immigrant children in Norway, integration.

ELI MOE, UNIVERSITY OF BERGEN, NORWAY ECML project: Language descriptors for migrant and minority learners’ success in compulsory education.

Relating examinations to the CEFR – the Council of Europe Manual and supplementary materials Waldek Martyniuk ECML, Graz, Austria.

The need for competencies about innovation and entrepreneurship in higher education Conference on Entrepreneurship in Higher Education Oslo and Akershus.

Professional Development of Basic Skills Teachers in Norway, Margrethe Marstrøm Svensrud Professional Development of Basic Skills Teachers in Norway Bergen,

EXAMPLE 2 Plot points in a coordinate plane

Achievement Attainment and Progress What evidence will you need?

Georgia Milestones End of Grade (EOG) Assessment Grades 3, 4, and 5

Integrating HOTS in Literature Instruction Overview of Literature Program ( Adapted from Online course) After reading this presentation, teachers will.

KS2 SATs Presentation to parents 20 th April 2016.

Gary W. Phillips Vice President & Institute Fellow American Institutes for Research Next Generation Achievement Standard Setting Symposium CCSSO NCSA New.

Specific Literacy Difficulty Service March 2012 Children & Young People’s Services.

SATs 2016 Meeting. What are the SATs SATs stands for: Statutory Assessment Tasks and Tests The tests are taken Nationally at the end of KS2 The children.

RelEx Introduction to the Standardization Phase Relating language examinations to the Common European Framework of Reference for Languages Gilles Breton.

1 Perspectives on the Achievements of Irish 15-Year-Olds in the OECD PISA Assessment

1 Main achievement outcomes continued.... Performance on mathematics and reading (minor domains) in PISA 2006, including performance by gender Performance.

Improve Outcomes in Literacy

ECML and Lithuanian Educational Institutions: Experence of Cooperation

Smarter Balanced Assessment Results

Assistant Commissioner Office of Standards, Assessment and Reporting

CEFLING Project Overview

Reliability and Validity

Reliability and Validity

EALTA MILSIG: Standardising the assessment of writing across nations

The Third EALTA Conference Krakow, 19–21 May 2006

Presentation transcript:

Basing writing tests for young learners to the CEFR Cecilie Carlsen & Eli Moe, University of Bergen, Norway Second Annual Conference of EALTA, Voss, Norway 2nd –5th June 2005

Background National tests in English, writing and reading, for Norwegian school children (4th, 7th, 10th and 11th grades) Employer: The Norwegian Ministry of Education and Research Test developers: University of Bergen Framework: CEFR Aim: Reporting and pedagogical

Focus of presentation years old pupils’ writing (7th grade) Adjusting the CEFR-scales to young learners Pilot study: Validation of our benchmarks/ levels Questions for discussion

WHY adjust? define relevant domains/ themes define relevant tasks, functions, can dos and text-types * ** the test should function within a pedagogical setting

HOW to adjust? develop adapted candos for young learners develop analytic rating scale for teachers/raters select benchmarks use in-between levels (A1/A2, A2/B1, B1/B2)

Pilotstudy: Validation of benchmarks Benchmarks: 22 Raters: 5 Raters’ profile Raters’ task

Results (I) All raters & all scores

Results (II) Aggregated rating vs Bergen (1)

Results (III) Aggregated rating vs Bergen (2)

Results (IV) Distribution of scores across levels

Agreement? %Cum % Same assessment 40.9 (9) Minor diff. (within level) 22.7 (5) 63.6 Major diff. (different level) 27.3 (6) ** 90.9 One whole level difference 9.1 (2) 100.0

Pilotstudy: Main findings 40% (63%) of the assessments made by the external group were the same as the Bergen group The Bergen estimates are consistently higher than those of the external raters The Bergen group uses more levels than most of the external raters. Short texts is a source of disagreement. Very strong pupils is a source of disagreement (B1 or B2?). There is a considerable variation among the external raters.

Questions for discussion Do our adaptations of the CEFR-descriptors simplify the levels? Is it possible to adjust the CEFR-scales to young learners without changing the levels?? Is it possible to place a 12 year old L2-learner at a level above B1? How to proceed?