Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties.

Slides:



Advertisements
Similar presentations
Program Evaluation: What is it?
Advertisements

MAPP Process & Outcome Evaluation
X4L Prog Mtg – March 05 Evaluation – What works best - when and why? Prof Mark Stiles Project Director: SURF X4L, SURF WBL, SUNIWE and ICIER Projects Head.
Learning from imGoats experiences with Outcome Mapping
Outcome mapping. Outcome Mapping Developed by the evaluation unit of Developed by the evaluation unit of
Local Control and Accountability Plan: Performance Based Budgeting California Association of School Business Officials.
Prepared by BSP/PMR Results-Based Programming, Management and Monitoring Presentation to Geneva Group - Paris Hans d’Orville Director, Bureau of Strategic.
Evaluating Collaboration National Extension Family Life Specialists Conference April 28, 2005 Ellen Taylor-Powell, Ph.D. Evaluation Specialist University.
DRAFT Strategic Planning U.S. Department of Energy Rebuild America Business Partners and Deanna Braunlin GAVIN Consulting, Inc. John Deakin Energy Program.
An Introduction to an Integrated P,M&E System developed by IDRC Kaia Ambrose October, 2005.
Targets & Improvement Activities State Improvement Planning Carol Massanari, MPRRC Western Regional Resource Center APR Clinic 2010 November 1-3, 2010.
Challenge Questions How good is our strategic leadership?
Evaluation. Practical Evaluation Michael Quinn Patton.
Continuous Assessment: Challenges and Opportunities for In-service Training Nizar Ibrahim 27/3/2011.
Strategic Planning with Appreciative Inquiry
A Report on Progress toward the Strategic Goals Presented to the Valencia District Board of Trustees on behalf of the College Planning Council.
Continuous Quality Improvement (CQI)
Domus Leadership Training TOPIC - Planning June 2015.
Phase Four: Process Improvement. “The beauty of using PTR in the implementation of programs of study is its focus on using data to analyze problems and.
Project P.O.S.T. Preparing Outstanding Science Teachers A Partnership of GCS & UNCG A Partnership of GCS & UNCG.
How Does Solid Foundation Work?. Thank you for considering Solid Foundation® as your tool in building strong school communities that support student success.
1. 2 Why is the Core important? To set high expectations –for all students –for educators To attend to the learning needs of students To break through.
Community Based Coalitions, Collaborations and Partnership: Pointers for Strengthening, Describing, and Tracking Them Beth Baker, PhD and Amy Estlund,
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
Indicators of Success -- Applying the TOC What will change? You must be able to test your theory!
Eight Steps to Improving Career Services in Schools, Colleges, and Agencies James P. Sampson, Jr. National Career Development Association Global Conference.
Demystifying the Business Analysis Body of Knowledge Central Iowa IIBA Chapter December 7, 2005.
Cathy Burack and Alan Melchior The Center for Youth and Communities The Heller School for Social Policy and Management, Brandeis University Your Program.
CHERRY DANIELSON ELLEN IVERSON ASSESSING STUDENT LEARNING AS A RESULT OF CIVIC ENGAGEMENT PROJECTS December 12, 2013.
Outcome Mapping and Monitoring HIA Progress in Thailand Decharut Sukkumnoed Rungthip Sukkumnoed Duangjai Rungrojcharuenkij Health Public Policy Foundation.
Setting the Stage: Workshop Framing and Crosscutting Issues Simon Hearn, ODI Evaluation Methods for Large-Scale, Complex, Multi- National Global Health.
Boston Geneva San Francisco Seattle Beginning the Evaluation Journey with FSG KCIC Boot Camp March 24, 2010 Prepared for:
Katie A. Learning Collaborative For Audio, please call: Participant code: Please mute your phone Building Child Welfare and Mental.
Welcome to LIB5080 The School Library Media Program.
1. Housekeeping Items June 8 th and 9 th put on calendar for 2 nd round of Iowa Core ***Shenandoah participants*** Module 6 training on March 24 th will.
Eloise Forster, Ed.D. Foundation for Educational Administration (FEA)
Center for Leadership Development Guarantee The Money: Making Your Case Through Program Evaluation.
Las Cruces Public Schools Principal Evaluation Overview Stan Rounds Superintendent Stan Rounds Superintendent.
Susan DeMatteo June 13, 2013 Putting EOF on the Map! Mapping Strategies for Assessment Design.
Mission Formation. m The Mission Statement should define the broad purposes the college is aiming to achieve, describe the community the program is designed.
Regional Educational Laboratory at EDC relnei.org Logic Models to Support Program Design, Implementation and Evaluation Sheila Rodriguez Education Development.
What do you need for your learning? Think about a time outside of education where you learned to do something successfully….
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
Logic Models: Laying the Groundwork for a Comprehensive Evaluation Office of Special Education Programs Courtney Brown, Ph.D. Center for Evaluation & Education.
Introduction to Outcome Mapping
Using Performance Criteria to Assess Student Outcomes Teaching & Learning Symposium May 20, 2009.
Evaluation capacity-building: An insider’s tale of value- adding Diana Beere.
Defending dignity. Fighting poverty. Peacebuilding Design, Monitoring & Evaluation Training Theory of Change Approach (TOC) 30 November 2011.
Developing Monitoring & Evaluation Frameworks: Process or Product? Anne Markiewicz.
Clarifying the Evaluation Focus in a Complex Program Context Howard Kress, PhD* Natalie Brown, MPH** *Battelle Memorial Institute, with National Center.
Facilitated by Kelly Bailey, Durham College Prepared by Ruth Rodgers, Durham College Based on the work of Ingrid Bens (Facilitation at a Glance)
A Template for Stakeholder Dialogue. Purpose To move its students to greater success with college and career readiness and in other state priorities the.
Developing Effective Performance Measures: A Skill-Building Workshop David J. Bernstein, Ph.D., Senior Study Director, Westat Sponsored by the Government.
Representing Simple, Complicated and Complex Aspects in Logic Models for Evaluation Quality Presentation to the American Evaluation Association conference,
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
A conceptual framework is described as a group of concepts broadly defined and systematically organized to provide a focus, rationale, and tool for the.
Learning Assessment Techniques
Rebecca McQuaid Evaluation 101 …a focus on Programs Rebecca McQuaid
Student Learning Outcomes (SLOs) Module #4: SLO Annual Report
Agcas Scotland Knowing your outcomes
Planning Your Own Adventure: Discovering Tools for Library Programs and Grants Planning   Ambra Gagliardi Grants and Assessment Coordinator, Marriott.
Implementing Career Resources, Service-Delivery Tools, and Services
“Implementing a Vision and Strategic Planning”
Introduction to Program Evaluation
Assessment: Measuring the Impact of our Programs on Students
Troubleshooting Logic Models
Implementing Career Resources, Service-Delivery Tools, and Services
Linking Evaluation to Coaching and Mentoring Models
Using Logic Models in Project Proposals
Presentation transcript:

Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties - MESI Ellen Iverson

Logic Model Theory of Change Theory of Action Program Theory Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 2 Logic Models for Smarties - MESI Ellen Iverson

Logic Model Theory of Change Theory of Action Program Theory How a given program, project, strategy, or policy is understood to influence or contribute to specific outcomes Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 3 Logic Models for Smarties - MESI Ellen Iverson

Logic ModelA systematic and visual way to show relationships among the resources of a program, project, strategy, or policy as well as the activities and the intended results Theory of Change Theory of Action Program Theory Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 4 Logic Models for Smarties - MESI Ellen Iverson

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 5 Logic Models for Smarties - MESI Ellen Iverson

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 6 Logic Models for Smarties - MESI Ellen Iverson

Logic Model Theory of Change How change comes about and what are the central processes/drivers for change in a given program, project, strategy, or policy Theory of Action Program Theory Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 7 Logic Models for Smarties - MESI Ellen Iverson

8

9

Logic Model Theory of Change Theory of Action What the program, project, strategy, or policy does (activities and level of success needed) to influence or contribute to outcomes Program Theory Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 10 Logic Models for Smarties - MESI Ellen Iverson

* Plan program or strategies * Define scope * Visualize complexity to anticipate uncertainties * Facilitate a shared understanding * Engage stakeholders * Document perceptions * Disseminate more broadly * Identify evaluation opportunities and monitor progress 11 Logic Models for Smarties - MESI Ellen Iverson

Logic Model Theory of Change Theory of Action Program Theory How a given program, project, strategy, or policy is understood to influence or contribute to specific outcomes 12 Logic Models for Smarties - MESI Ellen Iverson

* Articulate “mental models” of key stakeholders * Analyze via artifacts (documents, reports, forms) * Infer through observation of program including interviewing staff and participants Funnell and Rogers, Logic Models for Smarties - MESI Ellen Iverson

* Visioning * Describe how you now serve clients? * What specific improvements have been made? * What are people saying about the program now? * What problems have been solved? * What specific outcomes have been achieved? * How are people behaving differently? Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco 14 Logic Models for Smarties - MESI Ellen Iverson

* Visioning * Write individual responses * Compare with partner * Compare with another partner * Facilitate discussion Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco 15 Logic Models for Smarties - MESI Ellen Iverson

* Focus Group (Bens, page 22) * Reflective listening * Getting the right people to the table (even if “virtually”) * Iterate * Return and revise * Disseminate Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco 16 Logic Models for Smarties - MESI Ellen Iverson

* Snow Cards (Keystone, page 15) * Brainstorm Pre-Conditions * What change? * For whom? * How good? * By when Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco 17 Logic Models for Smarties - MESI Ellen Iverson

* What would a simple logic model look like? * What might a theory of change look like? * What might the models miss? * What outside forces might influence the program? * What might be some unexpected outcomes (positive/negative) * What questions would you have about the program and program theory? 18 Logic Models for Smarties - MESI Ellen Iverson

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide 19 Logic Models for Smarties - MESI Ellen Iverson

* W.K. Kellogg Foundation’s Logic Model Development Guide foundation-logic-model-development-guide Funnell, S. C. & Rogers, P. J. (2011). Purposeful program theory: Effective use of theories of change and logic models. San Francisco, CA: Jossey- Bass. Keystone. (2009). Developing a Theory of Change from g%20a%20theory%20of%20change.pdf McLaughlin, John A., & Jordan, Gretchen B. (1999). Logic models: A tool for telling your program’s performance story. Evaluation and Program Planning, 22(1), Milstein, Bobby, & Chapel, Tom. (N.D.). Developing a Logic Model or Theory of Change. The Community Toolbox. Retrieved 12 March 2014, from 20 Logic Models for Smarties - MESI Ellen Iverson