1. Types of Effectiveness Evaluations
Effectiveness Evaluation Presentation - Nov. 2002

2. The Variable Space/Time Continuum
Effectiveness Evaluation Presentation - Nov. 2002

3. Response to Brian’s Draft Agenda – August/02
survey-type projects to evaluate short-term results
research projects that test assumptions (process studies; long-term studies, etc.)
adaptive management projects where evaluation is integral and ongoing
Effectiveness Evaluation Presentation - Nov. 2002

4. “Effectiveness Monitoring …in a reliable, adaptive management framework” (Curran /Maynard)
Implementation monitoring (compliance monitoring)
Effectiveness monitoring (do activities achieve desired goal)
Validation monitoring (are predictive assumptions and models correct?)
Effectiveness Evaluation Presentation - Nov. 2002

5. Effectiveness Monitoring (What’s Happening)
Uncontrolled
Retrospective
Compare to standards/results
Snapshot
Potential for assessing change if monitoring plots established
Effectiveness Evaluation Presentation - Nov. 2002

6. Validation Monitoring (Why/Why not?)
Controlled
Test assumptions underlying policy
Potential for assessing long-term relationships, processes, change, cumulative effects
Examples: LTSP; Carnation Creek
Effectiveness Evaluation Presentation - Nov. 2002

7. For Best Effect, Use Together
Effectiveness monitoring answers the question: Is it working?
Validation monitoring answers the question: Why/why not?
Effectiveness Evaluation Presentation - Nov. 2002

8. Adaptive Management “Adaptive management is a systematic process
for continually improving management
policies and practices by learning from the
outcomes of operational programs.
Effectiveness Evaluation Presentation - Nov. 2002

9. Adaptive Management cont.
Its most effective form–"active" adaptive
management–employs management programs
that are designed to experimentally compare
selected policies or practices, by evaluating
alternative hypotheses about the system being
managed.”
Effectiveness Evaluation Presentation - Nov. 2002

10. Adaptive Management Cycle
Effectiveness Evaluation Presentation - Nov. 2002

11. Adaptive Management Controlled
Potential for evaluating short- and long-term relationships, cumulative effects
Conducted in an operational environment
Built-in “extension” or application
Effectiveness Evaluation Presentation - Nov. 2002

12. Summary
Effectiveness evaluation framework should characterize what’s happening, and why
Need to understand relationships at different scales
To do this requires both observation (effectiveness monitoring) and informed analysis (validation monitoring)
Effectiveness Evaluation Presentation - Nov. 2002

13. Summary
Adaptive Management seems well-suited to evaluating policy, standards and alternatives.
Effectiveness Evaluation Presentation - Nov. 2002

14. Questions ?
Effectiveness Evaluation Presentation - Nov. 2002