1. Introduction to Evaluation Peter Chen, PhD Julie Gibbs, BSW Julie Maertens, MS Julie Sampson, MS Stefanie Putter, BA

2. ROADMAP Role of CSU What is evaluation? Overview of the TGYS evaluation process

3. Role of the CSU team Help & Support Sustainable Practices Sharing Knowledge

4. What is Evaluation? Formative Evaluation Focus: Implementation Goal: Improve Effectiveness Outcome Evaluation Focus: Participant Change Goal: Assess Impact

5. Evaluation Steps 1. Logic Model 2. Program Design 3. Measurement Tool(s) 4. Data Collection 5. Data Analysis 6. Data Reporting & Reflection

6. Evaluation Steps Program Logic Model Need Services Outputs Short-term Outcomes Long- Term Outcomes Monolingual Spanish- speakers Bilingual trainers for Spanish- speakers Increased # of classes held and clients served

7. Evaluation Steps Program Design Pre-test Your Program Post- test

8. Evaluation Steps Program Design Group 1: Program Participants Group 2: Waiting-List Group Pretest Your Program Posttest PretestWaitPosttest

9. Evaluation Steps Survey Selection

10. Data Collection Administration Management Sampling

11. Sampling Decisions Who? How many? Strategies

12. Survey Administration o Timeline o Confidentiality o Protocol

13. Survey Administration Protocol DeadlineTaskPerson in Charge August 16Order pre-test surveys (expect 2-week turn-a- round) Mark V. September 3Organize surveys: count, fill out admin section Susan C. September 22Administer surveys to youthLaura F. September 29Check surveys: bubbles filled-in, admin complete Susan C. December 1Mail pre-test surveys to CSU (2 weeks prior to Dec 15 deadline) Mark V.

14. Data Management

15. Pre-testPost-test 10011001 10031005 20022002 20032003 20142112 Sample Size = 3

16. Survey Ethics Voluntary Participation Professional Competence Confidentiality

17. CSU team contact information: Julie Maertens: jmtgys@lamar.colostate.edu Julie Sampson: jstgys@lamar.colostate.edu Stefanie Putter: sptgys@lamar.colostate.edujmtgys@lamar.colostate.edujstgys@lamar.colostate.edusptgys@lamar.colostate.edu For more information, please refer to our website!website