A New Look at Logic Modeling and ADRC Evaluation - The Georgia Experience Glenn M. Landers Amanda Phillips Martinez

Georgia Health Policy Center Established in 1995 Andrew Young School of Policy Studies, Georgia State University Long relationship with Georgia Department of Human Resources

Background Began evaluation activities in March 2007 –Process evaluation of 3 expansion sites Focus on Advisory Boards –Assessing potential for outcome evaluation Evaluation of data integrity –Logic modeling with expansion sites –Evaluation of ADRC training workshops

Why Logic Models? Desire for measurable outcomes But also: –Program clarity –Role clarity –Program continuity (succession planning) –Program/role transformation

Logic Models 101 A logic model is a systematic and visual way to present the impact you expect to have. The most basic logic model is a picture of how you believe your program (or governing body) will work.

Introduction to Logic Models Activities are the processes, tools, events, technology, and actions that are part of the program’s implementation. Activities are used to bring about the intended changes or results. Activities specify tasks: –Expand a database to include DD and MH resources –Hold quarterly provider meetings to share information among DD and Aging providers and case managers

Introduction to Logic Models YOUR INTENDED RESULTS include all of the program’s desired results: Outputs Outcomes Impacts/Goals

Introduction to Logic Models Outputs are the direct products of activities. This tells you if you completed the activities you proposed to do: –Number of meetings held and variety of representation at the meetings –Number of trainings held and level of participation –Number of brochures published and disseminated

Introduction to Logic Models Outcomes are the specific changes in behavior, knowledge, skills, status and level of functioning. They tell you if the activities you did had the effect you hoped they would: –AAA case managers demonstrate increased knowledge in support services and resources available to people with developmental disabilities

Introduction to Logic Models The Impact/Goal is the fundamental intended or unintended change occurring in organizations, communities, or systems as a result of your activities. Example: –A consumer-centered “no wrong door” approach to accessing the long term care support system

Simple Logic Model Logic Model ActivitiesOutputsOutcomesMeasurementImpacts/Goals

Our Process Review all background materials Draft the logic model Compare for alignment with national outcomes: –Informed choice –Consumer focus –Enhanced access –Efficiency –Effectiveness –Visibility

Our Process Compare for alignment with state requirements: –Process – job descriptions, etc. –Training, quality improvement –Information, referral, & assistance –Advocacy, consumer education –Evaluation

Our Process Review draft logic model with ADRC partners (face-to-face) Revise

Outcomes from the Process Program clarity Program buy-in Role clarity Enhanced communication Identification of measurable outcomes

Logic Models Phase II Working with original pilot sites: –Augusta: Program modeling –Atlanta: Advisory board modeling

Advisory Board Logic Models Advisory Boards are a Georgia requirement Meet quarterly Some have become stagnant - adrift Using logic models to focus the Advisory Board’s purpose or reason for being

Advisory Board Logic Models Advisory Board impact: Enhanced or improved ADRC operation – positions Board as a problem solving body Creates member buy-in and reason for attending

Advisory Board Logic Models Activities –Educating each other –Advocacy –Development of MOUs –ADRC “Grand Rounds” Outcomes –Cross learning among partners –Enhanced visibility and resources –Clearly defined roles –ADRC problem solving / enhanced streamlining

Logic Models: Phase III Lesson from the expansion site process evaluation: –There needs to be evidence of solidarity with the ADRC concept across DHR Divisions and Offices in order for local agency representatives to participate fully.

State Advisory Council Logic Model State Advisory Council is made up of state and regional partners Meets three times per year Main activity has been information sharing

State Advisory Council Logic Model Engaging in the logic modeling process has enabled the Council to begin to re-think their role from that of only information sharing to state-level problem solving.

Logic Model Outcomes to Date Program clarity Identification of measurable outcomes Role clarity among partners Program continuity Program/role transformation

More Information