The Value of What We Do Dan Phalen US EPA Region 10.

Slides:



Advertisements
Similar presentations
Leveraging inter-sectoral action to address the social determinants of health: view from the health system Lucy Gilson University of Cape Town; London.
Advertisements

Toward a Vision for a National System of Natural and Environmental Resource Indicators.
Local Public Health System Assessment
1 EU Strategy for the Baltic Sea Region Evaluation: Setting Outcome Indicators and Targets Seminar: 15 March 2011, La Hulpe Veronica Gaffey Acting Director.
1 DG Regio Evaluation Network Meeting Albert Borschette, Brussels, 14 October 2010 Ex post evaluation of Interreg III - Presentation of Final Results Pasi.
EMS Checklist (ISO model)
Maines Sustainability Solutions Initiative (SSI) Focuses on research of the coupled dynamics of social- ecological systems (SES) and the translation of.
Assessing student learning from Public Engagement David Owen National Co-ordinating Centre for Public Engagement Funded by the UK Funding Councils, Research.
Risk and RACI: Defining Clear Roles
Donald T. Simeon Caribbean Health Research Council
Management Plan: An Overview
Arts in Basic Curriculum 20-Year Anniversary Evaluation the Improve Group.
Experiments in Measuring Sustainability - The Environmental Sustainability Index and its Critics Marc Levy CIESIN
Job Evaluation Old, Bold or a Story Untold Marcus Downing Hay Group.
Logic Models and Evaluation Glen W. White 1 Jamie Simpson 2 1 University of Kansas, Research and Training Center on Independent Living 2 Kansas Department.
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.
Evaluation and Human Resources Focus: discuss how evaluation of schools is conducted and where the emphasis should be placed in these evaluations. Thesis:
Evaluation. Practical Evaluation Michael Quinn Patton.
Bond.org.uk The Bond Effectiveness Programme: developing a sector wide framework for assessing and demonstrating effectiveness July 2011.
Continuous Quality Improvement (CQI)
Molly Chamberlin, Ph.D. Indiana Youth Institute
Problem Definition Exercise. U.S. Fish & Wildlife Service General Summary Responses from ½ of those surveyed (n=14/31) Broad and narrow in scope Narrow.
Domus Leadership Training TOPIC - Planning June 2015.
The SEEAW in the context of Integrated Water Resource Management and the MDGs Roberto Lenton Chair, Technical Committee Global Water Partnership.
Slide no 1 The Department of Labour’s...Outcomes Framework….
CONCEPT PAPER RESULT BASED PLANNING. RESULT-ORIENTED PLANNING Overall Objective/ Goal Specific Objective/ Purposes Expected Result/ Output Activities.
1 Module 4: Designing Performance Indicators for Environmental Compliance and Enforcement Programs.
How many balls can you juggle at one time?. Identify 7 balls extension middle managers juggle every day in leading the extension program Identify strategies.
1 Public Health Accreditation & Quality Improvement AmeriCorps VISTA Orientation September 15, 2014.
THE NATURE AND PURPOSE OF STRATEGIC PLANNING
WRITING EFFECTIVE GRANT PROPOSALS With an Eye toward Performance and Evaluation Issues.
1 Introduction to Evaluating the Minnesota Demonstration Program Paint Product Stewardship Initiative September 19, 2007 Seattle, WA Matt Keene, Evaluation.
BISCAYNE BAY REGIONAL RESTORATION COORDINATION TEAM Development of Overarching Objectives: Dreams and Realities March 12, 2004.
Outcome Based Evaluation for Digital Library Projects and Services
FLLLEX – Final Evaluation
Research Quality Assessment following the RAE David Sweeney Director, Research, Innovation, Skills.
CONNECTICUT HEALTH FOUNDATION: Update on Evaluation Planning for the Strategic Plan.
Logic Models and Theory of Change Models: Defining and Telling Apart
A cumulative effects approach: developing a decision support for understanding a water and food nexus in the North Henry Penn Water & Environmental Research.
Julie R. Morales Butler Institute for Families University of Denver.
M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009.
Goals and Indicators. Sustainable Measures Goals, Principles, Criteria, and Indicators  Goal – a description of future condition community members wish.
Tony Karbo, Ph.D. AHSI/UPEACE Africa Program.  Action or inaction taken by interested entities such as NGOs, Think Tanks, government departments, ministries,
1 Designing Effective Programs: –Introduction to Program Design Steps –Organizational Strategic Planning –Approaches and Models –Evaluation, scheduling,
Government Management Accountability & Performance Program Natural Resources Cabinet Presentation October 6 th, 2010 A Healthy Puget Sound By 2020.
The P Process Strategic Design
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Kathy Corbiere Service Delivery and Performance Commission
 2007 Johns Hopkins Bloomberg School of Public Health Section B Logic Models: The Pathway Model.
MEKONG RIVER COMMISSION PROGRAMMES FOR SUSTAINABLE DEVELOPMENT.
Connect2Complete Theory of Change Development for Colleges and State Offices November 10, 2011 OMG Center for Collaborative Learning.
Session 2: Developing a Comprehensive M&E Work Plan.
Evaluation What is evaluation?
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Gathering a credible evidence base
M&E Basics Miguel Aragon Lopez, MD, MPH
A Guide to SDG Interactions: from Science to Implementation
Strategic Planning for Learning Organizations
Logic Models Dr. Lenay Dunn, Assistant Director, CST.
Ross O. Love Oklahoma Cooperative Extension Service
Developing & Refining a Theory of Action
Using Internet-based Tools to Promote Community Health and Development
Claire NAUWELAERS, independent policy expert
Logic Models and Theory of Change Models: Defining and Telling Apart
Helene Skikos DG Education and Culture
Investing in Source Water Protection
Changing the Game The Logic Model
RECOMMENDATIONS TO THE CONTRACTING PARTIES TO THE BARCELONA CONVENTION
Data for PRS Monitoring: Institutional and Technical Challenges
Presentation transcript:

The Value of What We Do Dan Phalen US EPA Region 10

It has become increasingly important for organizations to describe the value of what they do in order to maintain funding. But more important, each of us wants to know that the work we do is making a contribution to the greater good.

The value of our work needs to be seen in the context of big picture goals derived from high level indicators, but evaluated at a scale appropriate to the project or work using performance measures.

High-Level Indicators

are critical in identifying broad environmental concerns that need focused attention… High-level indicators

but, high level indicators are too far removed from on-the-ground work to be measurably influenced by individual projects. are subject to many variables outside of anyone’s sole control. Therefore: The responsibility for improvement or slippage can’t be attributed to a single entity.

Performance Measures Benchmarks Targets Outcomes Outputs Baselines

Performance Measures are designed to document personal and institutional accountability on the ground. measure the impact or effectiveness of our efforts (measures) in the context of overarching long term goals as identified by indicators.

High Level Indicators and Performance Measures must be: Quantifiable Measurable at a reasonable cost Relevant

Enter, the Logic Model

Actions Policy & Planning Research & Organization Logic Model

A Non-Profit Restoration Project A University Research Grant A Regulatory Agency

Policy & Planning Research & Organization A Logic Model can help focus & coordinate the efforts Non-Profit Restoration Project University Research Grant Regulatory Agency Actions

Logic Models Communicate the performance story Build a common understanding among diverse stakeholders and staff Find “gaps” in the logic of a program and work to resolve them Link otherwise disparate efforts in a common mission

Continued: Logic models come in many forms and shapes. A very simple version may do the trick, or you can really get into the details. Keep it simple if you are going to share it with others.

Courtney and Bailey, were 9 and 11 years old, when they developed this logic model after their mother, Dorian, told them what she had done at work that day. Dorian was on the staff of the Idaho Asthma Coalition Asthma Coalition and had attended a presentation on logic modeling.

We need to conduct this research so that Scientists and the public understand why the fish are dying so that Decision makers can institute protective land use policies so that Residents can modify detrimental behaviors so that Conditions in the stream improve so that Salmon mortality is reduced in urban streams so that Beneficial uses are achieved. A Logic Train

The WorkThe OutcomesCommon Goals INPUTSACTIONSOUTPUTSSHORT TERM MEDIUM TERM LONG TERM STRATEGIC OBJECTIVES  In order to accomplish our goals will need the following resources.  In order to accomplish our goals, we will have to perform the following activities.  Completing these activities will result in the following evidence of progress.  We expect the following outcomes.  We expect the following outcomes after two to three years.  We expect the following impacts within the next three to seven years.  The work done under this grant supports the following Strategic or Long Term Objective(s). The Basic Framework for a Logic Model

Getting to Results What are the desired outcomes? What are the appropriate spatial and temporal scales that “control” these outcomes? How do we measure progress (accomplishments) toward these outcomes?

Some types of results: Increased knowledge Modified behavior Increased capacity/expertise Efficiencies Which lead to: Preservation of environmental resources Improved conditions Improved human health Well functioning ecosystems

The Bottom Line We need to know that our work is making a contribution and we need to be able to explain and quantify that contribution in ways that make sense to others.