1. به نام خدا

2. How to Construct well-designed MCQ’s ?

3. Types of MCQ’s: 1-True/false questions(TFQ)
2-multiple-choice questions (MCQ) OR
ONE-BEST-ANSWER QUESTIONS

4. PURPOSE OF TESTING

5. WHAT SHOULD BE TESTED?

6. GENERALIZABLE) AND ACCURATE (VALID).
ISSUE OF SAMPLING
THE NATURE OF SAMPLING DETERMINES THE EXTENT TO WHICH THE ESTIMATE OF TRUE ABILITY IS REPRODUCIBLE(RELIABLE,
GENERALIZABLE) AND ACCURATE (VALID).

7. IF THE SAMPLE IS NOT THE REPRESENTATIVE OF THE BROADER DOMAIN OF INTEREST,EXAM RESULTS WILL BE BIASED AND WILL NOT PROVIDE A GOOD BASIS FOR ACHIEVEMENT IN THE DOMAIN OF INTEREST.

8. COMPONENTS:
1-STEM
2- LEAD-IN
3-OPTIONS:
CORRECT ANSWER
DISTARCTOR

9. TECHNICAL ITEM FLAWS:
A- GENERAL B-
1- TESTWISENESS
2-IRRELEVANT DIFFICULTY

10. GENERALGUDELINE FOR ITEM CONSTRUCTION
1- Make sure the item can be answered without looking at the options(cover-the-options rule).The entire question is included in the stem.
2-Include as much of the item as possible in the stem:the stems should be long and the options short.
3- Avoid “tricky “ and overly complex items.

12. GENERALGUDELINE FOR ITEM CONSTRUCTION
4-Avoid superfluous information.
5-Write options that are grammatically consistent and logically compatible with the stem:list them in logical or alphabetical order .Write distractors that are plausible and the same relative length as the answer.

13. GENERALGUDELINE FOR ITEM CONSTRUCTION
6-Avoid using absolutes such as always,never ,and all in the options:also avoid using vague terms such as usually and frequently.
7-Avoid negatively phrased terms (e.g. those with except or not in the lead-in).
If you must use a negative stem,use only short (preferebly single word )options.

15. GENERALGUDELINE FOR ITEM CONSTRUCTION
And most important of all:
Focus on important concepts ,don’t waste time testing trivila facts.

16. STILL TWO MORE POINTS!

17. What is a good Item shape?

19. POORLY SHAPED ITEM

20. THE RELATIVE CORRECTNESS OF OPTIONS ,THE OPTIONS MUST DIFFER
IN ORDER TO
RANK –ORDER
THE RELATIVE CORRECTNESS OF OPTIONS ,THE OPTIONS MUST DIFFER
ON A
SINGLE DIMENSION .

25. Issues relaet to testwiseness:
What is test-wiseness?
Millman, Bishop and Ebel (1965) defined
test-wiseness
as “a subject’s capacity to utilize the characteristics and formats of
the test and/or the test taking situation to receive a high score”.

26. the skills and/or knowledge
Testwiseness
is independent of
the skills and/or knowledge
that the test is supposedly measuring, therefore differential test-wiseness
within a group of students is a
source of invalidity in test scores.

27. Issues relaTED to testwiseness:
1- Grammatical cues
2- Logical cues
3- Absolute terms
4- Long correct answer
5- Word repeats
6-Convergence strategy

28. Issues relaTED to testwiseness:
1-GRAMMATICAL CUES:

29. 2-LOGICAL CUES:

30. 3-ABSOLUTE TERMS:

31. 4-LONG CORRECT ANSWER:

32. 5-WORD REPEATS(STEM & CORRECT ANSWER):

33. 6-CONVERGENCE STRATEGY:
WHICH ARE CORRECT:
1-PENCIL AND PEN
2-PENCIL AND HIGHLIGHTER
3-PEN AND MARKER
4-PENCIL AND CRAYON

34. knowledge-based answers
One of our main aims is
to reduce
the number of
lucky guesses
and
to increase
knowledge-based answers

35. ISSUES RELATED TO IRRELEVANT DIFFICULTY:

36. 1-OPTIONS ARE LONG,COMPLICATED OR DOUBLE
THIS CAN SHIFT WHAT IS MEASURED BY AN ITEM FROM CONTENT KNOWLEDGE TO READING SPEED.

37. 2-NUMERIC DATA ARE NOT STATED CONSISTENTLY:

38. 3-FRQUENCY TERMS IN THE OPTIONS ARE VAGUE(e.g.RARELY,USUALLY):

39. GUIDELINES FOR BASIC SCIENCE ITEM WRITING:
BASIC RULES

40. 1- Each item should focus on an important concept.
2-Each item should assess application of knowledge.
3-The stem of the question must pose a clear question.
4-All distarctors should be homogenous.
5-Avoid technical flaws that provide special benefit to testwise eaminees.

41. Basic Science Recall Item Stem:
What area is supplied with blood by the posterior inferior cerebellar artery?

42. Basic Science Application of Knowledge Item Stem:
A 62-year-old man develops left-sided limb ataxia.Horner’s syndrome ,nystagmus,and loss of appreciation of facial pain and temperature sensations .
What artery is most likely to be included?

43. GUIDELINES
FOR
CLINICAL SCIENCE
ITEM CONTENT

44. 1-Test application of knowledge using clinical vignettes to pose medical decisions in patient care situations.
2- Focus items on common or potentially catastrophic problems:avoid “zebras” and esoterica.

45. 3-Pose clinical decision -making tasks that would be expected of a successful examinee.
4- Avoid clinical situations that would be handled by a (sub)specialist.

46. The structure of a clinical vignette

47. An example of a flawed clinical item!

48. THIS IS A
WAITING ROOM ITEM!

50. Another example of a flawed clinical item!
Which of the following findings is most likely to be seen in postsurgical patients with pulmonary embolism?
A clinically backward item!!

51. Patients rarely tell their physician what disease they have and then ask the physician what their signs and symptoms are!

55. THE
END RESULT
SHOULD BE A
VALID
AND
RELIABLE
TEST.

56. 2-
BOTH VALID AND RELAIBLE 1-
NEITHER VALID ,NOR RELAIBLE 2-
NOT VALID ,BUT RELAIBLE

57. با تشکر