Module 7 1. What do we know about selected- response items? Well constructed selected- response items can target: factual knowledge comprehension analysis.

Slides:



Advertisements
Similar presentations
An Introduction to Computer- assisted Assessment Joanna Bull and Ian Hesketh CAA Centre Teaching and Learning Directorate.
Advertisements

Alternate Choice Test Items
FACULTY DEVELOPMENT PROFESSIONAL SERIES OFFICE OF MEDICAL EDUCATION TULANE UNIVERSITY SCHOOL OF MEDICINE Using Statistics to Evaluate Multiple Choice.
TYPES OF TESTS …MULTIPLE CHOICE, ESSAY, AND TRUE FALSE
1. 2 Dr. Shama Mashhood Dr. Shama Mashhood Medical Educationist Medical Educationist & Coordinator Coordinator Question Review Committee Question Review.
Designing the Test and Test Questions Jason Peake.
2008 Pearson Education, publishing as Longman Publishers Chapter 12: Test Taking Bridging the Gap, 9/e Brenda Smith.
Constructing Exam Questions Dan Thompson & Brandy Close OSU-CHS Educational Development-Clinical Education.
Social Science Faculty Meeting January 2010 Mastering the Art of Test Writing Roundtable Discussion.
Item Analysis What makes a question good??? Answer options?
Yun-Pi Yuan1 Lesson Ten Multiple-Choice Format. Yun-Pi Yuan2 Contents Advantages and disadvantages Terminology Guidelines for making items The stem The.
Classroom Assessment FOUN 3100 Fall Assessment is an integral part of teaching.
Selected Response Measuring knowledge and some reasoning.
CHAPTER 5: CONSTRUCTING OPEN- AND CLOSED-ENDED QUESTIONS Damon Burton University of Idaho University of Idaho.
TEXAS TECH UNIVERSITY HEALTH SCIENCES CENTER SCHOOL OF PHARMACY KRYSTAL K. HAASE, PHARM.D., FCCP, BCPS ASSOCIATE PROFESSOR BEYOND MULTIPLE CHOICE QUESTIONS.
Tuning Up your Common Assessments Michigan School Testing Conference February 21, 2012 Dr. Ed Roeber Kim Young Dr. Ellen Vorenkamp.
Module 6 Test Construction &Evaluation. Lesson’s focus Stages in Test Construction Tasks in Test Test Evaluation.
Narrowing the Gulf Annual Conference 2010 March 2010 Mastering the Art of Writing Objective Test Items.
STRATEGIES TO EVALUATE COMPETENCE Christina B. DeBiase, EdD WVU School of Dentistry.
Written Exam Assessing knows and knows how Departemen Obstetri dan Ginekologi FKUI-RSCM.
Ginny Price CETL TEST DEVELOPMENT. WRITING MULTIPLE CHOICE ITEMS Write only a few items at a time Immediately after preparing class lesson or after class.
Oscar Vergara Chihlee Institute of Technology July 28, 2014.
Designing and evaluating good multiple choice items Jack B. Monpas-Huber, Ph.D. Director of Assessment & Student Information.
COMMON FORMATIVE ASSESSMENTS DAY 2. ALL OF THESE ASSESSMENT TYPES CAN BE USED IN FORMATIVE ASSESSMENTS. Selected Response Item Performance Response Item.
Welcome Interim Assessment Team Agenda 8:00 – 15: Sign In 8:15 – 30: Introduction 8:30 – 9:00: SRs and CRs 9:00 – 9:30: Shared Insight and Performance.
Assessment Literacy Kansas State Department of Education ASSESSMENT LITERACY PROJECT1 Selected-response Tests.
Completion, Short-Answer, and True-False Items
Assessment Literacy Series 1 -Module 6- Quality Assurance & Form Reviews.
CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CHAPTER 8 AMY L. BLACKWELL JUNE 19, 2007.
Choose Your Own Adventure. Introduction Use this as a guide when working on a Smarter Balanced question.
Assessment Literacy Series 1 -Module 3- Item Specifications.
Session 2 Traditional Assessments Session 2 Traditional Assessments.
English Language Arts Item Review Considerations Training Module.
1 Writing Test Blueprints and Test Items “Software for Creating and Delivering Assessments With Powerful Reports”
Assessment Item Writing Workshop Ken Robbins FDN-5560 Classroom Assessment Click HERE to return to the Documentation HERE.
2009 Professional Development Day October 2009 Mastering the Art of Test Writing.
8 Strategies for the Multiple Choice Portion of the AP Literature and Composition Exam.
Biology Partnership Assessment Pedagogy Session Saturday, September 29, 2012 Dr. Susan Butler.
Writing Multiple Choice Questions. Types Norm-referenced –Students are ranked according to the ability being measured by the test with the average passing.
Assessment and Testing
March 11, 2013 Chicago, IL American Board of Preventive Medicine American Board of Preventive Medicine Clinical Informatics Examination Committee Measurement.
Claim 1 Smarter Balanced Sample Items Grade 4 - Target I Solve problems involving measurement and conversion of measurements from a larger unit to a smaller.
Multiple Choice Items EDUC 307. Multiple Choice Items  Definition: This format consists of a stem that poses a question or sets a problem and a set of.
Test Question Writing Instructor Development ANSF Nurse Training Program.
Language Testing How to make multiple choice test.
Do not on any account attempt to write on both sides of the paper at once. W.C.Sellar English Author, 20th Century.
EVALUATION SUFFECIENCY Types of Tests Items ( part I)
University of Baltimore Test Development Solutions (TDS) Thomas Fiske, M.S. - Test Development Team Lead Charles Glover, M.S. - Test Developer; Diann M.
Multiple-Choice Item Design February, 2014 Dr. Mike Atkinson, Teaching Support Centre, Assessment Series.
Reviewing, Revising and Writing Effective Social Studies Multiple-Choice Items 1 Writing and scoring test questions based on Ohio’s Academic Content Standards.
©2013, The McGraw-Hill Companies, Inc. All Rights Reserved Chapter 6 Construction of Knowledge Tests.
NOTE: To change the image on this slide, select the picture and delete it. Then click the Pictures icon in the placeholder to insert your own image. SELECTED.
Assessment and the Institutional Environment Context Institutiona l Mission vision and values Intended learning and Educational Experiences Impact Educational.
Writing Better MCQs. Why Multiple Choice Questions? Most commonly used format in the College Most commonly used format on licensing examinations This.
Objective Examination: Multiple Choice Questions Dr. Madhulika Mistry.
 Good for:  Knowledge level content  Evaluating student understanding of popular misconceptions  Concepts with two logical responses.
Reviewing, Revising and Writing Mathematics Multiple- Choice Items 1 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing,
Assessment in Education ~ What teachers need to know.
Copyright © Springer Publishing Company, LLC. All Rights Reserved. DEVELOPING AND USING TESTS – Chapter 11 –
Writing Selection Items
How to Take Tests! 4 Learn all about: 4 True/False 4 Matching 4 Multiple Choice 4 Fill in the Blank.
Georgetown University
Curriculum and Assessment Design Training plans: Whole school ASSESSMENT 2 Meaningful assessment overview.
Writing Selection Items Multiple Choice
Constructing Exam Questions
Multiple Choice Item (MCI) Quick Reference Guide
Developing Tests and Test Questions/Items
Multiple Choice Questions
Multiple-Choice and Matching Exercises
Multiple Choice Item (MCI) Quick Reference Guide
Presentation transcript:

Module 7 1

What do we know about selected- response items? Well constructed selected- response items can target: factual knowledge comprehension analysis synthesis evaluation 2

Parts of a Selected-Response Item Stem 3 What is the perimeter of a rectangular vegetable garden with dimensions 6 feet by 8 feet? A 48 ft B* 28 ft C 24 ft D 14 ft Distractors (Incorrect Options) Correct answer (Key)

4

General Guidelines 1. Align Items to a Standard 2. Standards-Stem Alignment 3. Target Appropriate Depth of Knowledge 4. Use clear; concise language 5. Use correct grammar 5

General Guidelines 6. Use appropriate reading level 7. Don’t Assume Prior Knowledge 8. Avoid generalizations 9. Avoid Tricky Items 10. Avoid the use of the word “You” 6

General Guidelines 11. Avoid using synonyms 12. Don’t include superfluous information 13. Avoid unnecessary complexity 14. Remember—Formatting Matters 7

8

Two types of Selected-Response Stem  Open-ended and  Closed  Avoid Open-Ended Stems* When possible, a direct question is preferable to an open-ended stem, as it is generally easier to read. *A good ear and professional judgment are called for: 9

Examples: Open-ended stem Closed question stem 10 One of the factors of x 2 – 5x – 36 is ___ A x + 3 B x - 4 C x + 6 D* x - 9 Which of the following is a factor of x 2 – 5x – 36 ? A x + 3 B x - 4 C x + 6 D* x - 9

Guidelines for Writing Stems 1. Stuff the Stem 2. Avoid Redundancy 3. Avoid the use of Negatives 4. Avoid Clues in the Stem 11

Stems with a graphic/stimulus The stem and leaf plot gives the ages of the people who answered survey questions after buying a pair of roller blades on an Internet auction. Lead Stem Leaf Key: 3 2 means 32 What is the median age of the people who answered the survey questions? Question

13

Parts of a Selected-Response Item Stem What is the perimeter of a rectangular vegetable garden with dimensions 6 feet by 8 feet? A 48 ft B* 28 ft C 24 ft D 14 ft Distractors (Incorrect Options) Correct answer (Key) 14

Number of Response Options 3 rd grade = 3 Options 1 correct answer 2 distractors 4 th grade and above = 4* Options 1 correct answer 3 distractors * Except if there are fewer plausible answers.

Example: Number of Options Which best describes when squares are rhombuses? a. always b. sometimes c. never

Example: Number of Options Animal cells have a definite shape. a. True b. False

Guidelines for Writing Response Options 1. Use direct, clear terminology 2. Use Plausible Distractors/Foils 3. Use Equal Length and Detail 4. Make all Distractors Equally Attractive 5. Organize the Options 18

Guidelines for Writing Response Options 6. Have only one correct answer 7. Do not use overlapping answers 8. Vary Placement of Option Choices 9. Good Items are Fair Items 10. Avoid using “All of the Above” and “None of the Above” 19

“Discrimination” In testing, “discrimination” is a good thing. Good items correctly discriminate (distinguish) between those who know and those who don’t by making it difficult for those who don’t know to guess the correct answer.