Introduction to Evaluation Peter Chen, PhD Julie Gibbs, BSW Julie Maertens, MS Julie Sampson, MS Stefanie Putter, BA

ROADMAP Role of CSU What is evaluation? Overview of the TGYS evaluation process

Role of the CSU team Help & Support Sustainable Practices Sharing Knowledge

What is Evaluation? Formative Evaluation Focus: Implementation Goal: Improve Effectiveness Outcome Evaluation Focus: Participant Change Goal: Assess Impact

Evaluation Steps 1. Logic Model 2. Program Design 3. Measurement Tool(s) 4. Data Collection 5. Data Analysis 6. Data Reporting & Reflection

Evaluation Steps Program Logic Model Need Services Outputs Short-term Outcomes Long- Term Outcomes Monolingual Spanish- speakers Bilingual trainers for Spanish- speakers Increased # of classes held and clients served

Evaluation Steps Program Design Pre-test Your Program Post- test

Evaluation Steps Program Design Group 1: Program Participants Group 2: Waiting-List Group Pretest Your Program Posttest PretestWaitPosttest

Evaluation Steps Survey Selection

Data Collection Administration Management Sampling

Sampling Decisions Who? How many? Strategies

Survey Administration o Timeline o Confidentiality o Protocol

Survey Administration Protocol DeadlineTaskPerson in Charge August 16Order pre-test surveys (expect 2-week turn-a- round) Mark V. September 3Organize surveys: count, fill out admin section Susan C. September 22Administer surveys to youthLaura F. September 29Check surveys: bubbles filled-in, admin complete Susan C. December 1Mail pre-test surveys to CSU (2 weeks prior to Dec 15 deadline) Mark V.

Data Management

Pre-testPost-test Sample Size = 3

Survey Ethics Voluntary Participation Professional Competence Confidentiality

CSU team contact information: Julie Maertens: Julie Sampson: Stefanie Putter: For more information, please refer to our website!website