Meta-evaluation

Review What are these checkpoints? How to put your result together? What are lessons-learned during the exercise? S519

Meta-evaluation It is evaluation of an evaluation (Scriven, 1991) to determin the quality and/or value of an evaluation S519

Five criteria Validity Utility Conduct Credibility Costs S519

Validity To what extent, the conclusions of the evaluation are justified Check carefully the facts they use and values they assign Question everything Constraints (budget, time, etc.) Using KEC checkpoints Using standards (www.wmich.edu/evalctr/jc/) S519

Validity Covers all relevant sources of value Comprehensively covers process, outcome and cost Include no irrelevant or illicit criteria Data used to directly address the criteria Include analyses that are appropriate for the data Clearly states how data are interpreted Is clear about where evaluative conclusions come from Include valid recommendation S519

Utility Are the findings Relevant to the questions or decisions being faced by the audience Timely Clearly communicated Cost effective S519

Conduct Legal Ethical Professional standards Cultrual appropriateness Unobtrusiveness Minimal disruptive to the evaluand S519

Credibility Familiar with the context Independence, impartiality, and/or lack of conflict of interest Expertise in evaluation and in the evaluation subject field S519

Cost How reasonable the costs of an evaluation S519

Meta-evaluation rating table S519