1. © E. G. Kowch iDevelopment 675 Instructional Development (EDER675) Evaluating Instruction

2. © E. G. Kowch iDevelopment 675 Agenda for tonight Review of Instructional Strategies Instructional Materials New: Evaluation of Instruction Program Evaluation Case: Sam Gonzales (Jeremy)

3. © E. G. Kowch iDevelopment 675 Instructional Strategies http://www.ucalgary.ca/%7Eekowch/675/mar24/instructionalstrategy.htm

4. © E. G. Kowch iDevelopment 675 Instructional Materials http://www.ucalgary.ca/%7Eekowch/675/mar24/materials.htm

5. © E. G. Kowch iDevelopment 675 Evaluating Instruction http://www.ucalgary.ca/%7Eekowch/673/mar20/formsum.html

6. © E. G. Kowch iDevelopment 675 Evaluating Instruction Formative Product Evaluation The process of appraising instructional materials during preparation. To judge descriptive info (instruction components) and how much learning results from the instructional materials - valuing those results/ Formative Process Evaluation The appraisal of instructional methods, that is, how well planned learning experiences are delivered or facilitated.

7. © E. G. Kowch iDevelopment 675 Evaluating Instruction: Developing a Formative Evaluation Plan Format of the plan 1. Statement of purpose 2. Description of data collection plans 3. Description of procedures for analyzing data that are appropriate for them 4. Outline the constraints imposed by the situation 5. Decision rules that will guide revisions of the data 6. A desciption of the expected results consistent with the data collection techniques chosen & specific analysis plans 7. Time estimates for implementation of the evaluation plan 8. Plans for communicating results to appropriate decision makers. 9. Roles and responsibilities of a team 10. Team leadership

8. © E. G. Kowch iDevelopment 675 Developing a Formative Evaluation Plan Step 1: Determining purpose, objectives, audience and subjects 1. How much will targeted trainees enjoy the instructional materials, content or methods? 2. How much will the participants learn? 3. How much impact will the learning experience have on the participants’ job performance? 4. How much impact will the planned learning experience have on the organization?

9. © E. G. Kowch iDevelopment 675 Developing a Formative Evaluation Plan Step 2: Assessing Information Needs (of the targeted audiences.. What do we need from these people?) 1. Instructional Designers: want to know how to revise instructional materials 2. Key decision makers 3. Immediate supervisors or learners on board? 4. Union reps on board?

10. © E. G. Kowch iDevelopment 675 Developing a Formative Evaluation Plan 1. Step 3 Protocol 1. Freq. Of audience contact in evaluation 2. Permissions in order 3. Which permissions needed? 4. What formal/informal steps assure 1. Decision makers experience is ok 2. Labels 3. Timing 4. Participation 5. Method of evaluation

11. © E. G. Kowch iDevelopment 675 Developing a Formative Evaluation Plan Step 5. Setting Program issues How much testing Positive outcomes Negative outcomes Cost estimates Accuracy of prerequisites ok?

12. © E. G. Kowch iDevelopment 675 Developing a Formative Evaluation Plan Evaluation design (for client and team) 1. Define key terms 2. Clarify purpose and objectives 3. Provide logical series of activities 4. Identify populations to be studied 5. Summarize standards by which instruct. Matls will be judged

13. © E. G. Kowch iDevelopment 675 Adieu for this week, EDER 675 Readings for The Next Two Weeks: Effective Communication: Chapter 16 - 19 Rothwell & Kazanas. Case: Project Management: Haley Lawrence p. 129 by Diane Erlich Eugene G. Kowch Assistant Professor of Educational Technology This person is reading….. ;-)