SPF SIG Evaluation Closeout Amy Mason, LMSW Evaluation Coordinator Iowa Consortium for Substance Abuse Research and Evaluation

Evaluation Closeout County Evaluation Plan Summary of Process Taken by Strategy County Evaluation Plan Summary of Process Taken by Strategy Evaluation Guidance Document Update Evaluation Guidance Document Update ODSS Indicators ODSS Indicators Summary of County Accomplishments to date Summary of County Accomplishments to date Summary of LEW Survey Results Summary of LEW Survey Results

County Evaluation Plan Summary of Process Taken by Strategy Summary on each strategy your county implemented, approximately 1 page Summary on each strategy your county implemented, approximately 1 page Pull from the County Strategic Plan that was developed at the beginning of the grant (October 2012) Pull from the County Strategic Plan that was developed at the beginning of the grant (October 2012) Template and example provide for reference in the Project Closeout Folder on the SPF SIG Website Template and example provide for reference in the Project Closeout Folder on the SPF SIG Website completed summary to Amy completed summary to Amy

County Evaluation Plan Summary of Process Taken by Strategy For Each Strategy: What was addressed? What was addressed? What was the proposed outcome? What was the proposed outcome? State main activities implemented. State main activities implemented. State where, who and/or how the strategy was implemented. State where, who and/or how the strategy was implemented.

Evaluation Guidance Document: Final Update Update data from June 24, 2014 thru December 31, 2014 Update data from June 24, 2014 thru December 31, 2014 Add column to your previous evaluation spreadsheet Add column to your previous evaluation spreadsheet Enter in data for the strategies, the plan for collection Enter in data for the strategies, the plan for collection Template and examples found in the Project Closeout Folder on SPF SIG Website Template and examples found in the Project Closeout Folder on SPF SIG Website Attach to County Evaluation Plan Summary Attach to County Evaluation Plan Summary

Evaluation Guidance Document QuestionData SourceApproaches TypeMeasure(s) - Sample Project End Strategies What modifications or adaptations were applied to address unique cultural groups? ODSS What efforts were undertaken to sustain this strategy? Quarterly Reports What media advocacy was used with this strategy? ODSS - M Number of ads, posters, direct mailings, letters to the editor, press releases, etc. Provide a brief summary of the process taken on each component of the strategy. ODSS - Description

ODSS Closeout Procedures Captures all data Captures all data Importance for evaluation and reporting Importance for evaluation and reporting Enter in data for services provided Enter in data for services provided Needs continual updating until December 31 st, Needs continual updating until December 31 st, 2014.

ODSS Entry Flags All entries throughout the project period should have a green flag. All entries throughout the project period should have a green flag. Goal is to have no red flags. Goal is to have no red flags. No flag may mean the entry should not be in ODSS or was not initially reviewed. No flag may mean the entry should not be in ODSS or was not initially reviewed. Questions about no flags contact Julie Hibben. Questions about no flags contact Julie Hibben.

ODSS: Indicators Enter and update new data as it comes available Enter and update new data as it comes available Note: Some indicators may not be available due to frequency of collection. Note: Some indicators may not be available due to frequency of collection. Review and enter in Start and Stop Dates up to November 2014 Review and enter in Start and Stop Dates up to November 2014

ODSS: Indicators Options if there is 0.00 in the value column with any of your indicators: 1. Have the indicator delete because you decide not use it OR 2. Enter in the value that belongs to that indicator or update that number OR 3. You want to keep that indicator but there was nothing captured for that period of time so it is real 0.00, if this fits your situation please make a note or attach a note to that indicator stating that you are still using the indicator.

ODSS: Indicator Reviews Reviews begin November 17 th and will last 2 weeks. Reviews begin November 17 th and will last 2 weeks. Feedback will be provided via starting the December 1 st. Feedback will be provided via starting the December 1 st. Review process will be repeated again before project end. Review process will be repeated again before project end. Questions call or Amy Mason Questions call or Amy Mason

County Accomplishments: All Activities Over 9,600 activities have been recorded in ODSS by 23 counties between October 1, 2012 and November 4, Over 9,600 activities have been recorded in ODSS by 23 counties between October 1, 2012 and November 4, Over 80% were recorded as Services Provided or Developmental Activities. Over 80% were recorded as Services Provided or Developmental Activities.

County Accomplishments: All Activities

LEW Survey Results Of the 23 Local Epidemiological Workgroup Chairpersons, 20 provided responses to the survey. Of the 23 Local Epidemiological Workgroup Chairpersons, 20 provided responses to the survey. Survey was administered in February, Survey was administered in February, The purpose of this survey was to get the LEWs response on their process in the SPF-SIG project. The purpose of this survey was to get the LEWs response on their process in the SPF-SIG project.

Tenure of Chair 45% reported being a LEW chairperson for the entire grant.

Coalition/Collaboration Council Chair 80% reported not being a Coalition/Collaboration Chair.

LEW Member Changes

Function of LEW Group

Group Function Overtime

How Well Coordinator Works With LEW? Almost 89% reported their SPF-SIG Coordinator worked well with the LEW.

Relationship With Coordinator Overtime Half reported improvement of the relationship overtime. Half reported no change of the relationship overtime.

LEW Meetings Lead to Changes Over 50% reported the LEW chair meetings did not change how LEW business was conducted.

Multiple Roles On average 60% or more had a role in completing other SPF-SIG products.

Other Substances 50% reported looking at other substance use.

Assistance to County Groups Over 70% provided assistance to other groups.

SPF-SIG Project Understanding Over 80% felt they have a concrete understanding of the project.

SPF-SIG Community Presentations Over 77% have discussed or presented to their communities.

Assessment Data Presentations Over 66% have presented on the LEW or county assessment data in their community.

“Have you discussed or presented on the LEW or the county assessment data to others in your community or workplace?” A total of six indicated the reasons shared about presenting data included: A total of six indicated the reasons shared about presenting data included: Change norms Provide data updates Recruit members Increase buy in

Lessons Learned Five out of thirteen indicated value and importance of data. Five out of thirteen indicated value and importance of data. Additional lessons learned included: Additional lessons learned included: Allow for LEW to set own priorities and/or selecting own resources Need for good information and leadership Need for positive change It is a long and difficult process Data has great importance Communities lack knowledge of alcohol abuse

Continue Post Project

“Do you have any suggestions on how the LEW process could be improved?” Choosing own county goals. Choosing own county goals. Increase structure of telephone conferences. Increase structure of telephone conferences. All meetings to have a specific goal or function. All meetings to have a specific goal or function. Clear and concise reports for the community. Clear and concise reports for the community. Establish needs and goals prior to the project starting. Establish needs and goals prior to the project starting. An outline for subsequent project years. An outline for subsequent project years. Increase integration with Iowa Department of Public Health for sustainability. Increase integration with Iowa Department of Public Health for sustainability.

Questions Phone: