Language Tests for Social Cohesion and Citizenship Issues of Quality Assurance An Outline for Policy Makers and Test Developers Henk Kuijper ALTE Authoring.

Slides:

Advertisements

Similar presentations

Quality Control in Evaluation and Assessment

Advertisements

School Based Assessment and Reporting Unit Curriculum Directorate

Lecturette 2: Educational Mandates & Universally Designed Large Scale Assessments.

TASSAB – The Tasmanian Secondary Assessment Board au/www/tassab/htm.

Summative Assessment Kansas State Department of Education ASSESSMENT LITERACY PROJECT1.

Improving the Coherency and Focus of School Statistics Products Pete Whitehouse Head of Analytical Services Unit - Learning.

Ülle Türk Estonian National Defence College Managing the test construction process STANAG 6001 Testing Conference SHAPE, Mons, Belgium September 2013.

General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.

Language requirements for adult migrants Results of a survey Some observations and reflections Linguistic integration of adult migrants Council of Europe.

ASSESSMENT LITERACY PROJECT4 Student Growth Measures - SLOs.

Minnesota Manual of Accommodations for Students with Disabilities Training Guide

Evaluating tests and examinations What questions to ask to make sure your assessment is the best that can be produced within your context. Dianne Wall.

VALIDITY AND TEST VALIDATION Prepared by Olga Simonova, Inna Chmykh, Svetlana Borisova, Olga Kuznetsova Based on materials by Anthony Green 1.

New Hampshire Enhanced Assessment Initiative: Technical Documentation for Alternate Assessments Standard Setting Inclusive Assessment Seminar Marianne.

Assessment Foreign Language Pedagogy EA 125. What is assessment for?  What do we want to assess?  How do teachers benefit from assessment?  How do.

Large Scale Assessment Conference June 22, 2004 Sue Rigney U.S. Department of Education Assessments Shall Provide for… Participation of all students Reasonable.

Challenge Question: Why is being organized on the first day of school important? Self-Test Questions: 1.How do I get my classroom ready? 2.How do I prepare.

Minnesota Manual of Accommodations for Students with Disabilities Training Guide

Language requirements for adult migrants Results of a survey Observations and challenges Linguistic integration of adult migrants Council of Europe 24/

Linguistics and Language Teaching Lecture 9. Approaches to Language Teaching In order to improve the efficiency of language teaching, many approaches.

2007 Annual Conference Competence and Conduct William D. Hogan Applied Measurement Professionals, Inc.

Assessment in Language Teaching: part 2 Today’s # 24.

Questions to check whether or not the test is well designed: 1. How do you know if a test is effective? 2. Can it be given within appropriate administrative.

11/08/ Individualisation-Standardisation 11/08/

Interpersonal and Civic competence This project has been funded with support from the European Commission. This [publication] communication reflects the.

ACADEMIC PERFORMANCE AUDIT

Challenges in Developing and Delivering a Valid Test Michael King and Mabel Li NAFLE, July 2013.

New York State Education Department Understanding The Process: Science Assessments and the New York State Learning Standards.

Key Issues for Educational Assessment in Europe Eduardo Cascallar and Christina Wikström, AEA-Europe Council Members Kiev, Ukraine – July 2007.

Quality in language assessment – guidelines and standards Waldek Martyniuk ECML Graz, Austria.

GUIDELINES ON CRITERIA AND STANDARDS FOR PROGRAM ACCREDITATION (AREA 1, 2, 3 AND 8)

1 An Introduction to Language Testing Fundamentals of Language Testing Fundamentals of Language Testing Dr Abbas Mousavi American Public University.

Principles in language testing What is a good test?

Language Testing Regimes in Europe Gabrielle Hogan-Brun University of Bristol, UK Metropolis Policy-Research Seminar, Ottawa, 22 Oct

MODULE 3 – Topic 305 Toolkit for Learners who are Culturally and Linguistically Diverse Module 3: Assessing and Monitoring Student Progress Culturally.

USEFULNESS IN ASSESSMENT Prepared by Vera Novikova and Tatyana Shkuratova.

ACADEMIC PERFORMANCE AUDIT ON AREA 1, 2 AND 3 Prepared By: Nor Aizar Abu Bakar Quality Academic Assurance Department.

Programme Objectives Analyze the main components of a competency-based qualification system (e.g., Singapore Workforce Skills) Analyze the process and.

European Financial Inclusion Network EFIN Brussels, 5 November 2009.

Author(s)Donald D. Hammill & Stephen C. Larsen,(1996) defined Written Language as : “The term written language refers to the comprehension and expression.

1 Comprehensive Accountability Systems: A Framework for Evaluation Kerry Englert, Ph.D. Paper Presented at the Canadian Evaluation Society June 2, 2003.

Assessment Reform and Assessment for Learning Francis Cheung Date:15 February 2008 (Friday) Time:2:00pm Venue:Taikoo Primary School.

1 Latest EU developments in the field of Adult education 19 Mars 2010 Marta Ferreira.

Evaluation and Assessment Mike Fleming. Assessment can be source of disagreement and tension implications for a Framework of reference for Languages of.

Fitz-Albert R. Russell, PhD JP Establishing Standards for Students’ Assessment.

DEVELOPING THE WORK PLAN

1 Migrants in the EU: education and training issues Maria Pia Sorvillo European Commission, Directorate General Education and Culture UNECE-Eurostat Work.

Dr. Salwa El-Magoli Chairperson of the National Quality Assurance and Accreditation Committee. Former Dean of the Faculty of Agricultural, Cairo university.

LISA A. KELLER UNIVERSITY OF MASSACHUSETTS AMHERST Statistical Issues in Growth Modeling.

Literacy Assessments Literacy Workgroup Marcia Atwood Michelle Boutwell Sue Locke-Scott Rae Lynn McCarthy.

Presentation to the Nevada Council to Establish Academic Standards Proposed Math I and Math II End of Course Cut Scores December 22, 2015 Carson City,

Evaluation and Assessment Evaluation is a broad term which involves the systematic way of gathering reliable and relevant information for the purpose.

Test evaluation (group of 4; oral presentation, mins) *Purpose: Apply the principles learned in your reading and class lectures to evaluate an existing.

Lesson Thirteen Standardized Test. Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized Test.

Chapter 11 Effective Grading in Physical Education 11 Effective Grading in Physical Education C H A P T E R.

Linguistic integration of adult migrants

Principles of Language Assessment

ECML and Lithuanian Educational Institutions: Experence of Cooperation

If ISTEP is out, what should be next?

Quality control & assurance.

Policy Implications of Engineered Cut Scores

Introduction to CPD Quality Assurance

Quality Assurance of Assessment Arrangements

Quality Assurance of Assessment Arrangements

Matthew McCullagh Linking the Principles of Assessment to the QA Criteria.

Understanding and Using Standardized Tests

Meeting the emerging needs for statistics on migrants:

VCE Religion and Society School-based Assessment 2019

Why do we assess?.

Presentation transcript:

Language Tests for Social Cohesion and Citizenship Issues of Quality Assurance An Outline for Policy Makers and Test Developers Henk Kuijper ALTE Authoring Group

Political and Social Issues What use will be made of the test results? What will be the impact for the migrant? What will be the consequences of a test on society? Is it more appropriate to use another form of assessment, rather than a test? Could it be appropriate to use several methods of assessment at the same time?

Use of the Tests Results FacilitatingSanctioning Use of the testlanguage proficiency based on individual needs fixed language level proficiency Impact for migrantimproving language proficiency to function in society civil rights consequences financial consequences possible exclusion Consequences for society inclusion of immigrants using human resources possible exclusion of groups limitation of using human resources Test formatcan be more flexiblehas to be similar for all migrants (equality)

Issues of Validity and Reliability Validity: what is to be assessed and do tests reflect this aims Reliability: are the tests reliable to measure these aims precisely To ensure fairness for candidates

Validity Issues : what is to be assessed Determining test purpose and real work demands on test takers Determining linguistic demands Determining the appropriate level of difficulty Producing test specifications

Reliability Issues Test format Item writing Pretesting Test administration Marking and grading Data analysis Monitoring bias Candidates with special requirements

Main Issues Policymakers and test developers and are responsible for The use of language tests and their purposes The content, validity and reliability of language tests Achieving high test standards Being aware of and coping with conflicting purposes of the tests Questioning if even highest quality tests can compensate for the conflicting purposes tests are used for (impact for individuals and society) At all times test fairness should be considered of prime importance