1. Designing & Conducting Formative Evaluation
Instructional Design : Unit ,6
Evaluation Phase

2. Objectives:
Describe the purposes of the various stages of formative evaluation.
Describe the instruments used in formative evaluation
Collect data according to a formative evaluation plan for a given set of instructional strategy.

3. Formative Evaluation - Why?
To determine Weakness(es) in the Instruction

4. Why are there Weaknesses?
Teachers/Trainers are not good predictors of the effectiveness of instructional content (Rosen, 1986, Rothkipf, 1963)
Instructional Theory is not a perfect science
Few courses are evaluated with learners
Designer can’t see the forest for the trees

5. Formative Evaluation Has Six Stages
Design Review
Expert Review
One-To-One
Small Group
Field Trials
Ongoing Evaluation

6. Design Reviews (Ask these 4 questions)
Does the instructional goal match the problem identified in the needs assessment?
Does the learner & environmental analysis match the audience?
Does the task analysis include all the prerequisite skills?
Are the test items reliable and valid, and do they match the objectives?

7. Expert Review (Ask these 5 questions)
Is the content accurate & up-to-date?
Does it present a consistent perspective?
Are examples, practice exercises, & feedback realistic & accurate?
Is the pedagogy consistent with current instructional theory?
Is the instruction appropriate to the audience?

8. One-On-One Review
to identify gross problems in the instruction, such as typographical errors, unclear sentences, poor or missing directions, etc.
Is the message clear?
What is the impact on:
learner attitudes
achievement of objectives & goals
Feasibility of instruction and training

9. Small Group Review
Look for the effects caused by the changes made in the one-to-one review
Identify any remaining learning problems

10. Field Trials (Review) Look for effects in changes made in small group
Can the instruction be used in the context in which it was intended

11. Ongoing Evaluation Viewed through the Lens of:
Project Size
Life span of content
Audiences change
One-To-One
Small Group Tryouts
Field Trials

12. Learner Evaluation “Testing”
Do learners understand the instruction?
Do they know what to do during the practice & the tests?
Can they interpret graphics in the text?
Can they read all the material?
How much time does it take?

13. Session summary Formative Evaluation is critical
Complete as many stages as practical
Don’t depend on SME’s opinion
Document your evaluation