Test Construction: The Elements

Slides:



Advertisements
Similar presentations
Alternate Choice Test Items
Advertisements

Assessment & Evaluation adapted from a presentation by Som Mony
L2 program design Content, structure, evaluation.
Constructing Exam Questions Dan Thompson & Brandy Close OSU-CHS Educational Development-Clinical Education.
M ATCHING I TEMS Presenter Pema Khandu B.Ed.II(S)Sci ‘B’
AMEP Assessment Task Bank Professional Development Kit Listening Developed by Marian Hargreaves for NEAS 2013 © NEAS Ltd
Some Practical Steps to Test Construction
How to Build Learning Progressions: Formative Assessment’s Basic Blueprints Presentation 3 Siobhán Leahy Dylan Wiliam.
Item Analysis What makes a question good??? Answer options?
1 Sources:  SusanTurner - Napier University  C. Robson, Real World Research, Blackwell, 1993  Steve Collesano: Director, Corporate Research and Development.
Classroom Assessment FOUN 3100 Fall Assessment is an integral part of teaching.
Testing Vocabulary Miss.Mona AL-Kahtani. The purpose of testing vocabulary: to measure the comprehension and the production of words used in speaking.
RELIABILITY BY DESIGN Prepared by Marina Gvozdeva, Elena Onoprienko, Yulia Polshina, Nadezhda Shablikova.
Language Assessment 4 Listening Comprehension Testing Language Assessment Lecture 4 Listening Comprehension Testing Instructor Tung-hsien He, Ph.D. 何東憲老師.
William James Combine various skills Show how well person can function in the language.
Chap. 3 Designing Classroom Language Tests
Bank of Performance Assessment Tasks in English
Test Construction: The Elements
Oscar Vergara Chihlee Institute of Technology July 28, 2014.
Testing Vocabulary Miss.Mona AL-Kahtani. The purpose of testing vocabulary: to measure the comprehension and the production of words used in speaking.
Building Effective Assessments. Agenda  Brief overview of Assess2Know content development  Assessment building pre-planning  Cognitive factors  Building.
Designing and evaluating good multiple choice items Jack B. Monpas-Huber, Ph.D. Director of Assessment & Student Information.
Tips for Top Tests FOSL fall September 10, 2007 Adapted from “Tools for Teaching” by Barbara Gross Davis.
What is Assessment? Assessment is a measure of what students are learning. Its purpose is to improve student learning. It can be thought of as a.
Asking the Right Questions Assessing Language Skills 2008 Presentation to ATESL Central Local Sheri Rhodes, Mount Royal College.
CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CHAPTER 8 AMY L. BLACKWELL JUNE 19, 2007.
Session 2 Traditional Assessments Session 2 Traditional Assessments.
EDU 385 Classroom Assessment Session 6 Preparing and Using Achievement Tests.
Lectures ASSESSING LANGUAGE SKILLS Receptive Skills Productive Skills Criteria for selecting language sub skills Different Test Types & Test Requirements.
1 Item Analysis - Outline 1. Types of test items A. Selected response items B. Constructed response items 2. Parts of test items 3. Guidelines for writing.
 Are more likely to use appropriate strategies when taking tests; and are more "test-wise" than their peers.  Have positive self-esteem  Have greater.
Critical Reading: Sentence Completion Step 3: Strategies.
Assessment Specifications Gronlund, Chapter 4 Gronlund, Chapter 5.
Background in Tests and Test Preparation Đ ặ ng Hi ệ p Giang SED-MOET.
Writing Multiple Choice Questions. Types Norm-referenced –Students are ranked according to the ability being measured by the test with the average passing.
Assessment and Testing
PSAE Reading WorkKeys Reading for Information Assessment.
Introduction to Item Analysis Objectives: To begin to understand how to identify items that should be improved or eliminated.
Language Testing How to make multiple choice test.
Do not on any account attempt to write on both sides of the paper at once. W.C.Sellar English Author, 20th Century.
EVALUATION SUFFECIENCY Types of Tests Items ( part I)
Monitoring and Assessment Presented by: Wedad Al –Blwi Supervised by: Prof. Antar Abdellah.
Objective Examination: Multiple Choice Questions Dr. Madhulika Mistry.
 Good for:  Knowledge level content  Evaluating student understanding of popular misconceptions  Concepts with two logical responses.
Writing Selection Items
Questionnaires. I. Constructing a questionnaire 1. Tick items in lists or boxes 2. In addition other types are often used: a straight choice between two.
Chapter Two Vocabulary Tests Group 李嘉茵 黃怡靜
C H A P T E R 3 Rubrics Chapter 3 Rubrics.
Writing Selection Items Multiple Choice
Writing Reading Items Module 2 Activity 4.
Writing Reading Items Module 2 Activity 4.
EDU 385 Session 8 Writing Selection items
Classroom test and Assessment
We have defined what the student should be able to do.
NYS English Regents Preparing for the 2011 Exam.
Mapping it Out! Practical Tools to Use Assessment Well
TESTING VOCABULARY.
Greg Miller Iowa State University
Constructing Exam Questions
Vocabulary and good language learners
TOPIC 4 STAGES OF TEST CONSTRUCTION
Guide to the Short Answer Question
Testing Receptive Skills
Assessment for Learning
Assignment Design Workshop
Preparing for the GED Essay
Why do we assess?.
FInal Exam SpecIfıcatıons
“QA” = quality assurance
Constructing a Test We now know what makes a good question:
Presentation transcript:

Test Construction: The Elements Đặng Hiệp Giang SED-MOET

Writing vocabulary test items Where can we select the words? How can we choose the question types? What is the implied skill or purpose in selecting the item?

Multiple-choice completion (1) Select the words to be tested. (2) Get the right kind of sentence to put each word in (this sentence creating the context is called the stem). (3) Choose several wrong words to put the right word with (these wrong words are called distractors). Three distractors plus the right word are enough for a written item. (4) Finally, prepare clear and simple instructions.

Advantages of Multiple-Choice Completion 1. It helps students see the full meaning of words by providing natural contexts. Also, it is a good influence on instruction: It discourages word-list memorization. 2. Scoring is easy and consistent. 3. It is a sensitive measure of achievement. Limitations of Multiple-Choice Completion 1. It is rather difficult to prepare good sentence contexts that clearly show the meaning of the word being tested. 2. It is easy for students to cheat by copying what others have circled.

Word formation Advantages 1. It reflects teaching approaches. 2. It is generally faster and easier to construct than are items with distractors. Limitations 1. Fewer words can be tested this way than with multiple choice. 2. There is some difficulty in avoiding ambiguous contexts.

Tasks Work in groups of 2 to 3 to complete the tasks, page 21. Refer to the material if needed. In the same group, prepare 2 items, one multiple choice and one word completion and show to the other groups.