CAST Evaluation Team Webinar March 10, 2011

 Different organizations & fields use different terminology  SC Prevention System has agreed-upon definitions CAST will use ◦ Incorporate some CADCA terminology  Some CAST/traditional system differences ◦ We’ll point out as we go

 Set vision for your coalition & your CAST strategic plan  Communicate what you hope to accomplish to others and yourselves ◦ May revise along the way; not unchangeable ◦ Evaluation team can help with understanding your findings  Provide a clear direction for your efforts  Motivate your coalition  Establish foundation for local evaluation plan ◦ Determines what you measure/collect

 General statement of what you hope to impact—underage drinking or DUI crashes  Does not have to be measurable  Should specify the target population  Example: To reduce alcohol use among year olds in Sunny County

 Specific statements describing the change you hope to accomplish  Must be measurable  Should include ◦ Who: target population* ◦ What: what you are changing ◦ Where: area ◦ When: by when will the change occur ◦ How Much: measurable quantity of change

 New for SC terminology: Long-term outcomes and Intermediate outcomes  Long-term Outcome Objectives* ◦ A measurable statement of the goal ◦ 1 per goal ◦ Should state the intended change on the priority issue at the end of the project  Example: To reduce the overall number of DUI crashes in Sunny County by 10% by 2014 * We don’t use for management plans

 Our “traditional” outcome objectives  Should relate to your priority Contributing Local Factors (CLF) ◦ Likely 1 per CLF*, but you’ll have multiple CLFs  May be “multi-year” for CAST ( not for management plans ) * For regular management plans, we recommend multiple OO’s per curriculum program

 Example 1 (quantifiable): To reduce the number of establishments offering a Happy Hour in Sunny County by 60% by 2014 ◦ Also OK: To reduce... from 10 to 4 by 2014  Example 2 (qualitative): To reduce the reported access to alcohol by youth at public events in Sunny County by 2014

 Specific statements describing the activities you want to implement  Should relate to most important components of implementation (the main activities)  Measure how much of an activity is done (e.g., conduct 40 checkpoints) or how many are reached (serve 100 merchants in PREP)

 Should include ◦ Who: target population ◦ What: what you are implementing ◦ Where: area ◦ When: by when will the activities be completed  PO’s will typically be annual ◦ How Much: how much of activity or how many reached  Try to avoid % changes in PO ◦ E.g. If there are 20 checkpoints/year now & you’re planning 40, write objective for 40 checkpoints, not 100% increase in # of checkpoints

 Examples: To safely disperse 30 underage drinking parties in Sunny County by June 30, 2012  Example: To conduct court monitoring for at least two different judges for a total of at least 20 DUI cases in Sunny County by June 30, 2012

 Multiple PO’s may be appropriate  Depends on how many key components to the strategy that deserve attention  Checkpoints Example ◦ Definite: To conduct 40 public safety checkpoints... ◦ Also consider: To generate 20 media coverage events of checkpoint activities...

 Goal: To reduce underage drinking in Sunny County by 2014  Long-Term Outcome Objective: To reduce underage drinking by 10% in Sunny County by 2014  Intermediate Outcome Objective: To reduce the reported availability of alcohol to youth at house parties in Sunny County by 2014  Process Objective: To pass a social host ordinance in Sunny County by 2013

 Long-Term Outcome Objectives: By 2014 ◦ CADCA says 5-10 years to change ◦ CAST will end in 2014; maybe you can measure beyond  Intermediate Outcome Objectives: By late 2013 and/or in 2014 ◦ **Most “post” measurement will be in 2014: CTC, 2 nd wave of focus groups & key informant interviews**  Process Objectives: By June 30, 2012 ◦ Set annually

South Carolina Community Action for a Safer Tomorrow (CAST) Environmental Logic Model: DUI Traffic Crashes Consumption Pattern Risk Factors & Underlying Conditions Environmental Strategies Contributing Local Factor 1 DUI traffic crashes Strategy 1 Consequence Goal & Long- Term Outcome Objective Drinking to the point of impairment Last updated 8/6/10 Likely won’t be measured Intermediate Outcome Objective 1 Contributing Local Factor 2 Intermediate Outcome Objective 2 Process Objective 1 Strategy 2 Process Objective 2 Strategy 3 Process Objective 3 Strategy 4 Process Objective 4, 5, 6, etc.

South Carolina Community Action for a Safer Tomorrow (CAST) Environmental Logic Model: Underage Drinking Consumption Pattern Risk Factors & Underlying Conditions Environmental Strategies Contributing Local Factor 1 Underage Drinking Strategy 1 Goal & Long- Term Outcome Objective Last updated 8/6/10 Intermediate Outcome Objective 1 Contributing Local Factor 2 Intermediate Outcome Objective 2 Process Objective 1 Strategy 2 Process Objective 2 Strategy 3 Process Objective 3 Strategy 4 Process Objective 4

 Best estimate of your coalition ◦ Consider 10% as a starting place for either issue  May be easier to think through if you consider the actual numbers (# of crashes, # of kids who drink) ◦ How many fewer is it realistic to achieve? ◦ Then calculate the % change  What you put in your strategic plan will be a “placeholder” ◦ Can revisit when working on your evaluation plan

GOALS LONG-TERM OUTCOME OBJECTIVE RISK FACTORS and CONTRIBUTING LOCAL FACTORSSTRATEGY “IF-THEN” STATEMENTSPROCESS OBJECTIVES INTERMEDIATE OUTCOME OBJECTIVES What is the consumption/ consequence (problem) to be changed? What is the specific, measurable, long- term outcome objective? What risk factors / underlying conditions and specific contributing local factors are driving the problem? What strategy or program do you propose to implement? Use the If-then approach to test the logic of your strategy. What steps or activities are involved in implementing this strategy? (How much and how many?) What is the specific, measurable, intermediate outcome objective? To reduce underage drinking in Gordon County (GC) by 2014 To reduce past- month use of alcohol by year olds in GC by 10% by 2014 Low capacity of medical providers to identify signs of underage drinking House parties where ample alcohol is available to youth Train medical providers to identify signs of underage drinking Party patrols/ controlled party dispersals If medical providers are trained to identify underage drinking, they will be able to address use with youth and parents If underage drinking house parties are identified and dispersed with appropriate consequences, then youth will be discouraged from having future house parties To train 25 youth GC health care providers on underage drinking signs by April 30, 2012 To get 20 GC providers to agree to use recommended screening items by June 30, 2012 To conduct 40 party dispersals GC by June 30, 2012 To generate 5 media events in GC on party dispersals/social availability by June 30, 2012 To improve GC medical providers’ reported capacity to identify the signs of underage drinking by 2014 To reduce the reported prevalence of underage drinking house parties in GC by 2014 Feel free to use multiple pages in your plan to keep connections clear (i.e., one page per CLF or per strategy)

 You are invited to include capacity building objectives in your CAST strategic plan  Do not worry about long-term vs. intermediate for outcome objectives—just focus on what you want to change and can measure  Process objectives would be about how you will make that change happen  Example: To increase Sunny County Coalition membership to 20 by 2013  Example: To establish the Sunny County Coalition as a 501(c)3 by 2014

 Additional guidance on goals & objectives can be found in “Goals & Objectives Cliff Notes” on & in the CAST guidance document “How To Engage in Strategic Planning”  Better addresses objectives related to DAODAS Standard Survey & other non- environmental strategies

Steven Burritt: Jessica Edwards: Elaine Dowdy Melvin Or contact your wonderful coaches