Multiple Choice Item (MCI) Quick Reference Guide

Slides:



Advertisements
Similar presentations
Writing constructed response items
Advertisements

Alternate Choice Test Items
Test Taking Strategies
1. 2 Dr. Shama Mashhood Dr. Shama Mashhood Medical Educationist Medical Educationist & Coordinator Coordinator Question Review Committee Question Review.
Designing the Test and Test Questions Jason Peake.
Selected Response Tests
Standards for Question Writing Mary Grantner, MA Senior Manager, Physician Assessment.
Constructing Exam Questions Dan Thompson & Brandy Close OSU-CHS Educational Development-Clinical Education.
Assessment “We assess students not merely to evaluate them, but to improve the entire process of teaching and learning.” - Douglas B. Reeves, Making Standards.
Social Science Faculty Meeting January 2010 Mastering the Art of Test Writing Roundtable Discussion.
Objective Examination Dr. Niraj Pandit MD Department of Community Medicine SBKS MIRC.
Guidelines for preparing Multiple Choice Questions (MCQ’s)
Module 6 Test Construction &Evaluation. Lesson’s focus Stages in Test Construction Tasks in Test Test Evaluation.
Narrowing the Gulf Annual Conference 2010 March 2010 Mastering the Art of Writing Objective Test Items.
Ginny Price CETL TEST DEVELOPMENT. WRITING MULTIPLE CHOICE ITEMS Write only a few items at a time Immediately after preparing class lesson or after class.
Oscar Vergara Chihlee Institute of Technology July 28, 2014.
Designing and evaluating good multiple choice items Jack B. Monpas-Huber, Ph.D. Director of Assessment & Student Information.
CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CHAPTER 8 AMY L. BLACKWELL JUNE 19, 2007.
Multiple Choice Question Design Karen Brooks & Barbara Tischler Hastie.
Session 2 Traditional Assessments Session 2 Traditional Assessments.
Test Taking Strategies. Prepare to avoid errors: Analyze your past results and errors Arrive early and prepared for tests Be familiar with exam question.
ASSESSING STUDENT ACHIEVEMENT Using Multiple Measures Prepared by Dean Gilbert, Science Consultant Los Angeles County Office of Education.
2009 Professional Development Day October 2009 Mastering the Art of Test Writing.
 Are more likely to use appropriate strategies when taking tests; and are more "test-wise" than their peers.  Have positive self-esteem  Have greater.
Assessment and Testing
Guidelines to Test Preparation Guidelines to Test Preparation.
March 11, 2013 Chicago, IL American Board of Preventive Medicine American Board of Preventive Medicine Clinical Informatics Examination Committee Measurement.
Materials produced under Phare 2006 financial support Phare TVET RO 2006/ EUROPEAN UNION Project financed under Phare MoERI/ NCDTVET-PIU.
Test Question Writing Instructor Development ANSF Nurse Training Program.
Language Testing How to make multiple choice test.
Do not on any account attempt to write on both sides of the paper at once. W.C.Sellar English Author, 20th Century.
Using Multiple Measures ASSESSING STUDENT ACHIEVEMENT.
EVALUATION SUFFECIENCY Types of Tests Items ( part I)
University of Baltimore Test Development Solutions (TDS) Thomas Fiske, M.S. - Test Development Team Lead Charles Glover, M.S. - Test Developer; Diann M.
Multiple-Choice Item Design February, 2014 Dr. Mike Atkinson, Teaching Support Centre, Assessment Series.
Reviewing, Revising and Writing Effective Social Studies Multiple-Choice Items 1 Writing and scoring test questions based on Ohio’s Academic Content Standards.
NOTE: To change the image on this slide, select the picture and delete it. Then click the Pictures icon in the placeholder to insert your own image. SELECTED.
Objective Examination: Multiple Choice Questions Dr. Madhulika Mistry.
 Good for:  Knowledge level content  Evaluating student understanding of popular misconceptions  Concepts with two logical responses.
Reviewing, Revising and Writing Mathematics Multiple- Choice Items 1 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing,
Copyright © Springer Publishing Company, LLC. All Rights Reserved. DEVELOPING AND USING TESTS – Chapter 11 –
Writing Selection Items
Multiple Choice Questions (MCQ) A brief introduction.
Muhammad Riaz Anjum Nasir Mahmood Irum Bajwa Muhammad Riaz Anjum Nasir Mahmood Irum Bajwa.
Georgetown University
Writing Selection Items Multiple Choice
Test-Taking Strategies
EDU 385 Session 8 Writing Selection items
Test-taking Tips.
ENGLISH TEST 45 Minutes – 75 Questions
Why Test? Comparative Diagnostic To standards (criteria based)
Business and Management Research
Greg Miller Iowa State University
Constructing Exam Questions
Test-Taking Strategies
Classification of Tests Chapter # 2
به نام خدا.
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 8 Objective Test Items.
Critically Evaluating an Assessment Task
Business and Management Research
Multiple Choice Questions
Multiple-Choice and Matching Exercises
Test-Taking Strategies
Multiple Choice Item (MCI) Quick Reference Guide
Narrowing the Gulf Annual Conference 2010
TECHNICAL REPORTS WRITING
Assessment David Taylor.
The Key to Writing Policies and Procedures Updated: February 2012
“QA” = quality assurance
Constructing a Test We now know what makes a good question:
Presentation transcript:

Multiple Choice Item (MCI) Quick Reference Guide NURS 5328 Tracy Nash, Holly Northcutt, Robin Roberts, Cheryl Sheffield, & Elizabeth Tilley General Writing Guidelines Guidelines for Writing Good Alternatives/Options Considerations for Writing Critical Thinking MCIs • Make all answers grammatically similar • Each answer should have the same number of parts. • All alternative/options should sample the same domain (i.e., assessment finding, diagnostics, or other). • If repeating words in each alternative/option, move those words to the stem. • If the stem is a sentence or a question, end it with the appropriate terminal punctuation. • Ranges in values should not overlap each other. • Make sure each choice is numbered or lettered. • Avoid using “none of the above” or “all of the above.” • If asked to choose the “best” answer there must be scientific evidence to support it. • Keep succinct: shorter than 1 line; shorter than stem • Number of options -Four options reduce the chance of guessing, but use three options if you can’t come up with a fourth plausible option. ○ Plus side of three options - reduces reading time, covers a wider range of content, and increases validity of the test. • Place those with a value in numerical, chronological, or sequential order (ascending or descending). • Positive statements- avoid negativity; avoid double negatives = impossible confusion. • Retain information in the stem and avoid overlapping. • Homogeneous appearance- Alternatives/options should be equally attractive, meaning parallel in length, grammatical structure, content, and complexity. If use opposite options consider: ○ Rule of Two Sets - two sets of opposites attract the uninformed student to all four options). Use medical terminology and technical language consistently. Sequential Reasoning • This is the key to writing questions that require critical thinking • Requires two logical steps: remember then analyze (students must apply their knowledge) • Lower levels of cognition require only memorization Writing Original Critical Thinking Items • Must apply sequential reasoning • Identify the competency and course objective Novel Problems • If students are presented with a higher level problem, yet they are familiar with the problem the question is still a recall item • Do not convert a situation used in class into a test question • The more unique the question, the more critical-thinking is involved   Follow these general rules when writing test items: • Every item should measure something important. • Every item should have a correct answer. • Use simple, clear, concise, grammatically correct language; eliminate unnecessary information • Avoid jargon, slang, and unnecessary abbreviations. • Use positive wording. • Items should not contain irrelevant cues or correct answers. • Ensure each item can stand alone. • Peer critique of test item: Ask colleague critique your questions (Do they agree on the correct answer?) • Prepare more test items than the blue print calls demands. Parts of a Multiple Choice Item (MCI) MCI Format Consists of 2 Parts: 1. The Stem (identifies the problem or question) 2. The Options (presents the response alternative) Also contains a key and distractors. Every test item should represent BOTH course content and a learning outcome. Framing Questions in the Nursing Process Guidelines for Writing Effective Question Stems • Complete – Student should understand what stem is asking before reading the options. • Keep clear and to the point! Use several short sentences if one long sentence is too confusing. Students should be able to read and answer the item in less than one minute. • Do not use the stem to teach. • Eliminate key words that may cue the answer. • Avoid negative wording - If you use a negative word make sure it so it REALLY stands out. • Avoid ending the stem in a incomplete sentence. • If it must be an incomplete sentence; provide alternative answers that would make a complete sentence. • Stay focused – each item should serve one purpose. • Present tense- avoid a passive voice. • Avoid bias and homonyms. • If use the completion format, do not leave a blank at the beginning or middle of a stem. Designing Distractors Plausibility → All distractors must be plausible without being too tricky Misconceptions → Keep log of common misconceptions students express in the clinical setting to create effective distractors Sound bites → Use a distractor that is word for word what is said in class, but is not the answer Seek help → Students must discriminate among appropriately other nurse action items and recognize the need to call the MD Quote the RN/ → Quotes need to represent real life patient situations