Evaluation of Instructional Technologies, Programs Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Assessment versus Evaluation We assess student performance We evaluate instruction product implementation Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Copyright © 2003 by Pearson Education, Inc. All rights reserved. Two Questions Is this working? How can I make this better? Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Formative versus Summative Formative evaluation: conducted during instruction/implementation Summative evaluation: conducted after instruction/implementation Copyright © 2003 by Pearson Education, Inc. All rights reserved.

AEIOU Model of Evaluation Accountability Effectiveness Impact Organizational Context Unanticipated Outcomes Fortune & Keith (1992), Sweeney (1995), Sorensen (1996) Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Tools/Resources of the Evaluator Documents Surveys Interviews Focus groups Observations Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Two Types of Evaluation Informal/internal evaluation Formal/external evaluation Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Evaluation Versus Research Evaluation = “research lite”? Differences in: impetus to conduct who frames the questions audience for results Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Copyright © 2003 by Pearson Education, Inc. All rights reserved. The Next Step Evaluation should lead to revision. First revision largest. Copyright © 2003 by Pearson Education, Inc. All rights reserved.

Copyright © 2003 by Pearson Education, Inc. All rights reserved.