Part 3 of a Good Test Question Writing Workshop

Objectives At the end of this presentation the faculty member will be able to: Understand and apply test question analysis data provided from LXR software Evaluate questions using data from LXR Develop a plan to ‘recycle’ questions using the LXR database

Ways a computer can help test question writing Grammatical Spelling Analysis With software Spot checks Database creation LXR test Others exist

Ways a computer can help kill question writing Dependency Corruption Lack of understanding

Let’s look at an LXR test report

Now let us look at the question

Active learning time!!!!! From the item statistics report sheet provided to you, pick two questions that you feel would warrant ‘closer’ review.

Discussion of problem questions After looking at the stats, let us look at the questions to identify if the issues from the statistics reports are ‘real.’

Summary Stats are nice My method But not always clear Combine the stats with the question for best results Especially if you have multiple adminstrations My method Review stats first Identify potential issues Then look at the question with a biased eye

Test stats over a time period for question Chap 11 11

Summary of database of questions Great for tracking progression of exam questions Keeps track of administrations Allows for creation of exams that May be easy May be hard

Questions?