1. Orange County Public Schools Florida Grant Developers Network K-12 Fall Forum Ann Cisney-Booth and Kathleen Gary December 11, 2015 Importance of Strong Evaluation Measures and Logic Models – How to do it right!

2. Orange County Public Schools Presentation Overview Introduction Logic Models Transition SMART Objectives Questions 2

3. Orange County Public Schools 3

4. Bridge Design 4 Completed Bridge

5. Orange County Public Schools Bridge Design Program Logic Model 5 Completed Bridge Program

6. Orange County Public Schools Logic Models Theory of change model: A representation of how change is believed to occur. Program logic model: Visual representation of resources, activities, outputs, and outcomes over time. 6

7. Orange County Public Schools Logic Models Theory of change model: A representation of how change is believed to occur. Program logic model: Visual representation of resources, activities, outputs, and outcomes over time. 7

8. Orange County Public Schools 8

9. Program Logic Models Program logic models support Design Planning Communication Evaluation Learning 9

10. Orange County Public Schools Program Logic Models Example benefits: Inventories program from start to finish Limits risk Connects to program goals/objectives Focuses the evaluation 10

11. Orange County Public Schools My Rich Uncle Activity You suddenly discover that you have a rich and eccentric uncle who lives far away and he wants to give you $30,000 to buy a car. To get the money you will need to prove to him why you need the car. 11

12. Orange County Public Schools My Rich Uncle Activity What you need for proof: List 3 compelling reasons you need the car What will you need to have in place before you get your car? What will your main uses be? What evidence can you put in a brown paper envelope and mail to him? In 3 years, what changes has the car made in your life? 12

13. Orange County Public Schools My Rich Uncle Activity Program purpose, Long-term outcomes List 3 compelling reasons you need the car. What will you need to have in place before you get your car? What will your main uses be? What evidence can you put in a brown paper envelope and mail to him? In 3 years, what changes has the car made in your life? 13

14. Orange County Public Schools My Rich Uncle Activity Inputs List 3 compelling reasons you need the car. What will you need to have in place before you get your car? What will your main uses be? What evidence can you put in a brown paper envelope and mail to him? In 3 years, what changes has the car made in your life? 14

15. Orange County Public Schools My Rich Uncle Activity Activities List 3 compelling reasons you need the car. What will you need to have in place before you get your car? What will your main uses be? What evidence can you put in a brown paper envelope and mail to him? In 3 years, what changes has the car made in your life? 15

16. Orange County Public Schools My Rich Uncle Activity Outputs List 3 compelling reasons you need the car. What will you need to have in place before you get your car? What will your main uses be? What evidence can you put in a brown paper envelope and mail to him? In 3 years, what changes has the car made in your life? 16

17. Orange County Public Schools My Rich Uncle Activity Short- and Intermediate-Outcomes List 3 compelling reasons you need the car. What will you need to have in place before you get your car? What will your main uses be? What evidence can you put in a brown paper envelope and mail to him? In 3 years, what changes has the car made in your life? 17

18. Orange County Public Schools 18 W. K. Kellogg Foundation. (2004). Using logic models to bring together planning, evaluation, and action: Logic model development guidebook. Battle Creek, MI: W. K. Kellogg Foundation.

19. Orange County Public Schools Program Logic Models and Evaluation 19 W. K. Kellogg Foundation. (2004). Using logic models to bring together planning, evaluation, and action: Logic model development guidebook. Battle Creek, MI: W. K. Kellogg Foundation.

20. Orange County Public Schools SMART Objectives S – Specific M – Measurable A – Achievable R – Relevant T – Timely

21. Orange County Public Schools SMART Objectives S – Specific

22. Orange County Public Schools SMART Objectives M – Measurable

23. Orange County Public Schools SMART Objectives A – Achievable

24. Orange County Public Schools SMART Objectives R – Relevant

25. Orange County Public Schools SMART Objectives T – Timely

26. Orange County Public Schools SMART Objectives SMART Objectives Template

27. Orange County Public Schools SMART Objectives Poor Measurable Objective Improve reading comprehension and fluency by using Read 180.

28. Orange County Public Schools Questions? 28 Contact Information: Ann Cisney-Booth, ann.cisney-booth@ocps.net Kathleen Gary, kathleen.gary@ocps.net