1. Assessment and Evaluation

2. Assessment and Evaluation
Measuring quality of performance
Measuring performance
Judgment
Non judgmental
Level of achievement
Helpful to produce improvement
 is perhaps the most complex
Is more limited process with more specific
. It could be part of the evaluation

3. Assessment versus evaluation
The process of assessment is to gather, summarize, interpret, and use data to decide a direction for action.
The process of evaluation is to gather, summarize, interpret, and use data to determine the extent to which an action was successful. (to judge the worth of…)

4. The primary differences between the two terms are those of
- Timing
- purpose

5. Informal Classroom assessment

6. Instructors rely on answers to questions
listen to student comments
Monitor body language and facial expressions

7. Classroom Assessment Techniques (CATs)
Its typically, ungraded activities conducted in the classroom setting.
The Background Knowledge :
- Its a short, simple questionnaire given to students at the start of a course, or before the introduction of a new unit, lesson or topic. It is designed to uncover students’ pre-conceptions.

8. Classroom Assessment Techniques (CATs)
 Minute Paper:  
-Tests how students are gaining knowledge, or not.
- The instructor ends class by asking students to write a brief response to the following questions: “What was the most important thing you learned during this class?” and “What important question remains unanswered

9. Classroom Assessment Techniques (CATs)
The Muddiest Point :
- Its to help assess where students are having difficulties.
- The technique consists of asking students to jot down a quick response to one question: “What was the muddiest point in [the lecture, discussion, homework assignment, film, etc.]

10. Why Should I Use CATs?
1. It can be used to improve the teaching and learning that occurs in a class.
2. Provide just-in-time feedback about the teaching-learning process
3. Provide information about student learning with less work than traditional assignments (tests, papers, etc.)
Help students become better monitors of their own learning
Provide concrete evidence that the instructor cares about learning

11. Question format Open ended questions vs. closed questions
- Advantages :(encourage the applicant to do most of the talking).
What did you do on you holidays?
 How do you keep focused on your work?

12. Question format
Closed questions – refer to all formats in which the answers are provided in the form of options.
do…, did…, can…, is…,are
Where do you live?
What time is it?

13. MCQ

14. MCQ Multiple choice items consist of a stem and a set of options.
with the correct answer called the key
and the incorrect answers called distracters or foil
The stem can include Such as  case study, a graph, a table, or a detailed description

15. MCQ
Best answer
Correct answer

16. MCQ
Best answer:
- format refers to a list of options that can all be correct in the sense that each has an advantage, but one of them is the best.
Correct answer:
- format refers to one and only one right answer

17. RULES
Stem directions should clearly indicate exactly what is being asked :
1. World War II was
A. The result of the failure of the League of Nations.  B. Horrible.  C. Fought in Europe, Asia, and Africa.  D. Fought during the period of
2. In which of these time periods was World War II fought?
A   B   C   D  

18. Rules Keep options independent; options should not be overlapping:
1. During what age period is thumb-sucking likely to produce the greatest psychological trauma?
A. Infancy  B. Preschool period  C. school period D. During toddler   E. After adolescence
2.During what age period is thumb-sucking likely to produce the greatest psychological trauma?
A. From birth to 2 years old  B. From 2 years to 5 years old  C. From 5 years to 12 years old  D. From 12 years to 20 years old  E. 20 years of age or older

19. MCQ RULES
Write the options so they are homogeneous in content:
Which of the following is the primary reason people moved to California in 1849?
A. Climate
B. Religion
C. Gold was discovered in central California
D. Farming

20. Rules
Avoid giving clues through the use of faulty grammatical construction.
1. Who was Albert Einstein?
A. An anthropologist.  B. An Astronomer.  C. A chemist.  D. A mathematician
1. Albert Eisenstein was a:
A. Anthropologist.  B. Astronomer.  C. Chemist.  D. Mathematician .

21. RULES Complete statement The capital of California is in----------?
In which of the following cities is the capital of California? a. b. c.

22. Rules
 A question stem is preferable because it allows the student to focus on answering the question rather than holding the partial sentence. The cognitive load is increased when the stem is constructed with an initial or interior blank, so this construction should be avoided

23. Rules
The greater the similarity among alternatives, the greater the difficulty:
Who was the President of the U.S. during the War of 1812?
A. Grover Cleveland  B. Abraham Lincoln  C. James Madison  D. Harry Truman  E. George Washington

24. Example 1.The primary prevention means ? a. Early detection
b. Health promotion
c. Self care
d. Health protection
1. The early discovering of the disease ,called
a. Primary prevention
b. Secondary prevention
c. Tertiary prevention
d. Disease protection

25. MCQ Emphasize Higher-Level Thinking
- The key to preparing memory-plus application questions ,that requires the student to first recall the facts and then apply or transfer the application of those facts into a situation.

26. Ability to Interpret Cause-and-Effect
- Why does headache occur with hypertension: A. B. C. D.

27. RULES Why is adequate lighting necessary in a balanced aquarium?
Ability to Justify Methods and Procedures :
Why is adequate lighting necessary in a balanced aquarium?
a. Fish need light to see their food.
b. Fish take in oxygen in the dark.
c. Plants expel carbon dioxide in the dark.
d. Plants grow too rapidly in the dark.

28. The alternatives should be presented in a logical order
 (e.g., alphabetical or numerical) to avoid a bias toward certain positions
Diabetics
Encephalitis
Fleabites
Gastritis

29. Avoid complex multiple choice items
In which some or all of the alternatives consist of different combinations of options.
Community health
Public helath
Environmental health
A and B
B and C

30. MCQ RULES • Correct answers are usually the second and third option
Balance the Placement of the Correct Answer
• Correct answers are usually the second and third option
More than five options does not help discriminate performance .
Avoid specific determinates, such as never and always.

31. RULES Which of the following is not an IRAQI poet?
Which of the following is an IRAQI poet?

32. Avoid negative, or using negative words such as “except” or “not
Avoid negative, or using negative words such as “except” or “not.”  If you can’t avoid a negative, then bold, capitalize, or underline the negative word:

33. RULES Avoid, the phrase all of the above, none of the above IN OPTION
- Students may be able to find answer without knowing the correct answer

34. • Use simple, precise and clear wording
Be Grammatically Correct
• Use simple, precise and clear wording
Don't Use difficult terminology
for example : Awkward

35. MCQ Advantages: Easy to grade Reliable
Its measuring different level of cognitive
Disadvantages :
Its not measuring problem solving, higher order reasoning

36. True and faluse
Its test the factual knowledge ( cognitive ability ,recall )
avoid absolute words ( Always , only ) its restrict possibilities
Ask to correct the false
Its provide 50% of guessing

37. True and false
Avoid semi-quantitative terminology. Words such as “often”. “seldom”, etc, are difficult to define.
E.g. : In a certain percentage of patients with an acute pancreatitis the disease is often self-limiting

38. True and false Limitations: Difficult to write questions.
False statements provide no evidence that the student knows the correct answer.
Scores are more influenced by guessing than with any other question type.
Cannot discriminate between students of varying ability as well as other questions.
Requires that the answer to the question is absolutely true or false.

39. Matching to identify relationship between a set of similar items
Its not only two table
we can put the questions and put choices to show which are more match with the questions

40. Essay Its open ended questions
Its depend on evaluation, reasoning ,situation, new concept
The question must not talk in lectures
E.g.: make SWAT analysis for medical regulations

41. Essay
 Essay examinations are commonly given in subjects as diverse as history, art, business, engineering, psychology, and biology

42. Essay
Strengths
- Allows students to interpret and integrate their knowledge of course content.
-Easier and less time consuming to create than other question types.
- Allows students to express individuality and creativity in their answers.
- Reduces guessing.
- Requires students to organize their own answers an to express them in their own words.
Can efficiently measure higher order cognitive objectives  

43. Short answer Measure high level of cognitive It must be few words
must identify the length of answer ( its not like comprehensive )
Ex: What structure in the blood carries oxygen to the cells of the human body

44. Short answers
More time consuming to score than multiple-choice or true-false questions.
Blank spaces should usually occur at the end of the statement rather than the beginning or within.
Avoid verbal clues and specific determiners (e.g., the, an, a).

45. Oral exam
It must provide immediate feedback

46. OSCE O : Objective. Every student gets the same patient S :Structured.
Several skills are tested at one time.
Each skill is tested in a separate station.
The examiner have a checklist for doing the marking.

47. OSCE
C : clinical.
Testing the skills of students:
E : Examination.

48. OSCE Its depend on sheet ,and now they use it with technology
No. of stations: 12-18
The time per station should be uniform as possible. It ranges from 5-20 minutes
Its depend on sheet ,and now they use it with technology

49. OSCE There are instruction to read it before enter the station
If examiner forget something ,they added to incomplete
Its depend on checklist and grade on it
There are timer for each station
Every 2-3 station there are break

50. OSCE
Marks candidates get marks for each step on the mark scheme that they perform correctly
The examiner is usually asked to rate the candidate as pass/borderline/fail or.
This is then used to determine the individual pass mark for the station

51. Marks Many centers allocate each station an individual pass mark.
The sum of the pass marks of all the stations determines the overall pass mark for the OSCE.
Many centers also impose a minimum number of stations required to pass.

52. DISADVANTAGES Expensive
Takes long time to construct a case and a scoring checklist.
Technical limitations
OSCE stations can never be truly standardized and objective in the same way as a written exam

53. References CFT (center for Teaching Guides), Vanderbilt University.
Nurse Educator (s):Marilyn H Oermann PhD RN FAAN ,2008 .