5/29/2018 2:19:19 AM Infrastructure development for the continued provision of evaluation technical assistance through the establishment of a national network This is one approach the evaluation team at the Office on Smoking and Health has taken to build evaluation capacity among evaluators for the NTCP. At the end of the talk you will know what we did, why and how we did it, and the results we have seen so far. If you are looking for ways to increase evaluation capacity among a group of evaluators you work with, this might be one of the approaches you will want to consider. Karen Debrot, DrPH, RD Centers for Disease Control and Prevention Office on Smoking and Health Evaluation 2011: Values and Valuing in Evaluation Anaheim, California November 3, 2011 TM

Outline Office on Smoking and Health (OSH) Project description 5/29/2018 2:19:19 AM Outline Office on Smoking and Health (OSH) Project description Results so far .

Office on Smoking and Health 5/29/2018 2:19:19 AM Office on Smoking and Health . Vision A world free from tobacco-related death and disease Mission As the lead federal agency for comprehensive tobacco prevention and control, we develop, conduct, and support strategic efforts to protect the public's health from the harmful effects of tobacco use. Goals - Prevent initiation of tobacco use among youth and young adults - Promote tobacco use cessation among adults and youth - Eliminate exposure to secondhand smoke - Identify and eliminate tobacco-related disparities

Office on Smoking and Health 5/29/2018 2:19:19 AM Office on Smoking and Health National Tobacco Control Program MAPPS . National Tobacco Control Program To achieve our mission, we fund health departments in all 50 states, the District of Columbia, and seven U.S. territories for comprehensive tobacco prevention and control. Funded programs focus on tobacco use prevention, cessation, smoke-free environments, and tobacco-related disparities. To achieve impact, we work collaboratively with state and national partners and networks in providing strategic leadership, a solid science base, and technical assistance to advance evidence-based interventions at the state and local levels. Best Practices for comprehensive, sustained, and accountable tobacco control programs are based on scientific literature: what has been shown to work for organizing and funding of state programs. Handbook is divided into 5 sections: State and community interventions; Health communication interventions; Cessation interventions; Surveillance and evaluation; and Administration and management. Comprehensive tobacco control programs combine educational, clinical, regulatory, economic, and social strategies. MAPPS Strategies: Use Media to promote healthy foods/drinks and increase activity; restrict advertising and employ counter-advertising for tobacco and unhealthy foods/drinks. Increase Access to healthy food/drink choices and safe locations to be active and improve the built environment; reduce the availability of tobacco and unhealthy food/drinks. Use of Point of decision labeling/signage/placement to discourage consumption of tobacco, increase consumption of healthy foods/drinks, and prompt physical activity. Use Price to discourage consumption of tobacco and to benefit consumption of healthy foods/drinks. Use Social support/services to promote tobacco cessation, breastfeeding, and increased activity. M P O W E R M = Monitor tobacco use and prevention policies P = Protect people from tobacco smoke O = Offer help to quit tobacco use W = Warn about the dangers of tobacco E = Enforce bans on tobacco advertising, promotion and sponsorship R = Raise taxes on tobacco

Office on Smoking and Health – Resources* 5/29/2018 2:19:19 AM Office on Smoking and Health – Resources* . Here are some of the evaluation specific resources the evaluation team has developed over the years Currently we are working on 2 workbooks – how to write an evaluation plan and how to write an evaluation report. Other TA the team provides: Further development of products/manuals/guidance Personalized TA by request (e-mail, calls, LiveMeetings, in person when possible) Support to QL and Nat’l QL Data warehouse development Net-conferences Trainings and TA at national meetings (Reverse) site visits and local training *http://www.cdc.gov/tobacco/tobacco_control_programs/surveillance_evaluation/index.htm

Evaluators’ Network Development – Why? 5/29/2018 2:19:19 AM Evaluators’ Network Development – Why? Geographic range Peer-to-peer interaction . Travel Staffing: Numbers Turnover Skills Interest Time Talk about the following, not necessarily in this order: Limited staff Travel restrictions Time Geographic reach: provide assistance to entire US Decreased opportunities for training Decreased opportunities for (reverse) site visits and local training Range of evaluation needs - basic to advanced Turnover Peer-to-peer knowledge sharing Training Range of needs

Evaluators’ Network Development – What? 5/29/2018 2:19:19 AM Evaluators’ Network Development – What? Interest Timing Shape and size Enablers We needed some basic information from state evaluators on the need for the network – Were they interested? What were barriers? Enabling factors? What shape should the network take? What should we be aware of so we can avoid it, what do you need to go around? How should it be organized? How big should it be? When should it be started? Interest Barriers Enablers Shape Size Timing Recommendations Barriers and challenges Where to start?

Evaluators’ Network Development – Got data? 5/29/2018 2:19:19 AM Evaluators’ Network Development – Got data? Telephone – one-on-one interviews and focus groups Telephone – existing network members Discuss how we collected the information to answer our questions. Meeting with existing network One on one calls with existing program evaluators network members In-person invited meeting Telephone focus groups One-on-one calls Survey In-person invited meeting Online survey

Evaluators’ Network Development – Interest? 5/29/2018 2:19:19 AM Evaluators’ Network Development – Interest? Reached out to all NTCP evaluators we had access to – the ask to participate was extensive and we believe we reached all NTCP evaluators, but participation was voluntary. Individuals chose to participate or not, so the results we have are from those with enough interest to show up at the table. Of these, some did not feel the need for a network, some want just a local listserv, and some would like the CDC to provide a dedicated website for a national network in addition to local networks. Generally, there is support for an evaluators network in some form.

Evaluators’ Network Development – Desires 5/29/2018 2:19:19 AM Evaluators’ Network Development – Desires Include (or not): Listserv Webpage SharePoint or similar site Regular calls Webinars National/regional trainings National/regional meetings Directory Job board Calendar evaluation events Assigned state versus CDC No consensus – not expected Request for informal to formal organization, small (local) to large (all of US and territories) Request for monthly / quarterly / yearly meetings, calls, trainings, webinars Other discussions also developed around items that are not part of a network, such as requiring evaluation of programs and attendance at evaluation meetings in grants and cooperative agreements

Evaluators’ Network Development – Cautions 5/29/2018 2:19:19 AM Evaluators’ Network Development – Cautions Deaf ears Burden Beginnings Don’t overburden states / people Don’t be rigid Listen to states Start small and don’t bite off more than you can chew Straight and narrow

Evaluators’ Network Development – Steps 5/29/2018 2:19:19 AM Evaluators’ Network Development – Steps Network We acquired a contractor to help out - website development, listserv management, etc. We will be pulling together a group of stakeholders to provide input and feedback as we start planning and developing the network. Plan Stakeholders Contractor

Evaluators’ Network Development – Steps 5/29/2018 2:19:19 AM Evaluators’ Network Development – Steps Stakeholders Network Assess the network once it has been up and running a while and then update and change it as stakeholders needs and desires change, i.e. adapt to a changing environment. Plan

5/29/2018 2:19:19 AM

5/29/2018 2:19:19 AM Infrastructure development for the continued provision of evaluation technical assistance through the establishment of a national network Centers for Disease Control and Prevention Office on Smoking and Health kdebrot@cdc.gov www.cdc.gov/tobacco The findings and conclusions in this presentation are those of the author and do not necessarily represent the official position of the Centers for Disease Control and Prevention. TM