IHS Special Diabetes Program Competitive Grants Part 1: Introduction to Idea Mapping Cardiovascular Disease Prevention Planning Cynthia C. Phillips, Ph.D. Lisa Wyatt Knowlton, Ed.D. Evaluation Training ̶ January 2005

Part 1: Overview  Why  Idea Mapping Basics  Idea Map Examples  “Hands-on” Idea Mapping Exercise

Idea Mapping Basics

 Is your team doing the right work?  Can your team make better decisions?  Is your team making a difference?

 Is your team doing the right work? Idea Mapping  Can your team make better decisions? Refining Idea Maps  Is your team making a difference? Evaluation Design

Evaluation Strengths  Describes activities & accomplishments  Documents progress toward results  Improves practice (funder and grantee)  Informs public policy  Others?

Evaluation is Best When…  Program results/outcomes are well defined and described (specific)  Meaningful process and outcome information can be collected (measurable)  The intended users of the evaluation results have agreed on how they will use the information (action-oriented)  Program activities are ones that are known to work with the targeted-type participants (realistic)  How long it will likely take to “see” results is specified (timed)

Evaluation Challenges  Takes too long  Too much information  Not very flexible  Not very useful  Hard to connect knowing with doing  Others?

Idea Maps  Are one way to illustrate how and why your program “works”  Connects activities to results  Improves programs (SMART)  Makes evaluation more focused and meaningful  Guides learning from experience

Basic Idea Map The Beginnings The Planned Work The Intended Results Assumptions Resources Programs/Events Processes Products Short-term Outcomes Long-term Outcomes Impacts If…then... BELIEVEDOGET

Basic Idea Map-IHS The Beginnings The Planned Work The Intended Results Assumptions Resources Programs/Events Processes/Products Short-term Outcomes Long-term Outcomes & Impact If…then... BELIEVEDOGET Research Experience/Capacity Federal $$ Intensive Intervention Less Intensive Intervention Uniform Core Site Specific

One Way to Look at it… Definitions—LMDG page 2

Another Way…

Resources  Includes the human, financial, organizational and community resources a program has available to direct toward doing the work.

Activities  Includes the processes, tools, events, technology and actions that are an intentional part of the program.

Outputs  Includes the direct products of program activities—description and number of participants, services and outreach.

Outcomes  The specific changes in program participants/communities—attitudes, knowledge, skill and behavior.

Impact  Fundamental intended change in individuals, organizations and/or systems that are likely to result from program activities.

Family Vacation Example

Idea Mapping Process Supports Programming

Idea Map Types  Theory of Change  “Big picture”  Assumptions  Less detail, more graphic  Program  Shows more detailed plan of action  More text-based  Evaluation Design  Shows areas of inquiry and methods

Complete Idea Map Example

Theory of Change Idea Map Example: Family Harmony

Program Idea Map Example: Family Harmony

Evaluation Design IM--Questions Example: Family Vacation

Evaluation Design Example: Family Vacation

Idea Map Exercise

Sample Idea Maps  Theory of Change Idea Map for the IHS Special Diabetes Program Competitive Grants  Fictional Idea Map for CVD Project  Fictional Idea Map for Single CVD Strategy

Example IHS Theory of Change IM

Fictional CVD Project IM CVD Risk Reduction Program Idea Map * optional, for demonstration only Outcomes Inputs/Resources Strategy/Activities* Outputs Short Term Long Term Impact Individual Activities Community Activities Case Mgrs/ Counselors Communi- cation Resources Clinical Services Social Marketing Skills Prior Health Ed Experience Diabetes Burden Tip Sheets CVD CVD Seminar Exercise Plan CVD PSAs Lifestyle Coaching Case Mgmt Nutrition Education XX% have tips XX Patients in Lifestyle Coaching for XX weeks XX Patients in Nutrition Ed for XX weeks XXXX Contacts Established Better Health Status - Improved Awareness re CVD -Increased Physical Activity -Reduced Blood Pressure -New Attitudes -New Skills Participant Prospects XX Patients in Exercise for XX weeks XX Patients in Case Mgmt for XX weeks Recruit & Select People w Diabetes Reduced CVD Incidence Knowledge re Effective Health Programming

Fictional CVD Project Single Strategy IM Session 1. Are you at risk? Session 2. Act in Time for Heart Attack Session 3. Be More Physically Active Individual Lifestyle Coaching Support and Monitoring Case Mgrs/ Coaches Prior Health Ed Experience Diabetes Burden session attended & understanding occurs session attended & understanding occurs session attended & understanding Better Health Status Positive Changes in Awareness, Knowledge, Skills, Behavior Participant Prospects Recruit, Select, Engage People w Diabetes Reduced CVD Incidence Knowledge re Reduced CVD Incidence CVD Coaching Idea Map * optional, for demonstration only Outcomes Inputs/Resources Activities* Outputs Short Term Long Term Impact

Idea Mapping Template

Exercise Instructions  Use the template to develop an idea map for your project’s approach to the recruitment strategy  e.g., reflect on the list of “priorities” you generated yesterday