1. 5/29/2018 2:19:19 AM
Infrastructure development for the continued provision of evaluation technical assistance through the establishment of a national network
This is one approach the evaluation team at the Office on Smoking and Health has taken to build evaluation capacity among evaluators for the NTCP. At the end of the talk you will know what we did, why and how we did it, and the results we have seen so far. If you are looking for ways to increase evaluation capacity among a group of evaluators you work with, this might be one of the approaches you will want to consider.
Karen Debrot, DrPH, RD
Centers for Disease Control and Prevention
Office on Smoking and Health
Evaluation 2011: Values and Valuing in Evaluation Anaheim, California
November 3, 2011 TM

2. Outline Office on Smoking and Health (OSH) Project description
5/29/2018 2:19:19 AM
Outline
Office on Smoking and Health (OSH)
Project description
Results so far .

3. Office on Smoking and Health
5/29/2018 2:19:19 AM
Office on Smoking and Health .
Vision
A world free from tobacco-related death and disease
Mission
As the lead federal agency for comprehensive tobacco prevention and control, we develop, conduct, and support strategic efforts to protect the public's health from the harmful effects of tobacco use.
Goals
- Prevent initiation of tobacco use among youth and young adults
- Promote tobacco use cessation among adults and youth
- Eliminate exposure to secondhand smoke
- Identify and eliminate tobacco-related disparities

4. Office on Smoking and Health
5/29/2018 2:19:19 AM
Office on Smoking and Health
National Tobacco Control Program
MAPPS .
National Tobacco Control Program
To achieve our mission, we fund health departments in all 50 states, the District of Columbia, and seven U.S. territories for comprehensive tobacco prevention and control. Funded programs focus on tobacco use prevention, cessation, smoke-free environments, and tobacco-related disparities. To achieve impact, we work collaboratively with state and national partners and networks in providing strategic leadership, a solid science base, and technical assistance to advance evidence-based interventions at the state and local levels.
Best Practices for comprehensive, sustained, and accountable tobacco control programs are based on scientific literature: what has been shown to work for organizing and funding of state programs. Handbook is divided into 5 sections: State and community interventions; Health communication interventions; Cessation interventions; Surveillance and evaluation; and Administration and management. Comprehensive tobacco control programs combine educational, clinical, regulatory, economic, and social strategies.
MAPPS Strategies:
Use Media to promote healthy foods/drinks and increase activity; restrict advertising and employ counter-advertising for tobacco and unhealthy foods/drinks.
Increase Access to healthy food/drink choices and safe locations to be active and improve the built environment; reduce the availability of tobacco and unhealthy food/drinks.
Use of Point of decision labeling/signage/placement to discourage consumption of tobacco, increase consumption of healthy foods/drinks, and prompt physical activity.
Use Price to discourage consumption of tobacco and to benefit consumption of healthy foods/drinks.
Use Social support/services to promote tobacco cessation, breastfeeding, and increased activity.
M P O W E R
M = Monitor tobacco use and prevention policies
P = Protect people from tobacco smoke
O = Offer help to quit tobacco use
W = Warn about the dangers of tobacco
E = Enforce bans on tobacco advertising, promotion and sponsorship
R = Raise taxes on tobacco

5. Office on Smoking and Health – Resources*
5/29/2018 2:19:19 AM
Office on Smoking and Health – Resources* .
Here are some of the evaluation specific resources the evaluation team has developed over the years Currently we are working on 2 workbooks – how to write an evaluation plan and how to write an evaluation report.
Other TA the team provides:
Further development of products/manuals/guidance
Personalized TA by request ( , calls, LiveMeetings, in person when possible)
Support to QL and Nat’l QL Data warehouse development
Net-conferences
Trainings and TA at national meetings
(Reverse) site visits and local training *

6. Evaluators’ Network Development – Why?
5/29/2018 2:19:19 AM
Evaluators’ Network Development – Why?
Geographic range
Peer-to-peer interaction .
Travel
Staffing:
Numbers
Turnover
Skills
Interest
Time
Talk about the following, not necessarily in this order:
Limited staff
Travel restrictions
Time
Geographic reach: provide assistance to entire US
Decreased opportunities for training
Decreased opportunities for (reverse) site visits and local training
Range of evaluation needs - basic to advanced
Turnover
Peer-to-peer knowledge sharing
Training
Range of needs

7. Evaluators’ Network Development – What?
5/29/2018 2:19:19 AM
Evaluators’ Network Development – What?
Interest
Timing
Shape and size
Enablers
We needed some basic information from state evaluators on the need for the network – Were they interested? What were barriers? Enabling factors? What shape should the network take? What should we be aware of so we can avoid it, what do you need to go around? How should it be organized? How big should it be? When should it be started?
Interest
Barriers
Enablers
Shape
Size
Timing
Recommendations
Barriers and challenges
Where to start?

8. Evaluators’ Network Development – Got data?
5/29/2018 2:19:19 AM
Evaluators’ Network Development – Got data?
Telephone – one-on-one interviews and focus groups
Telephone – existing network members
Discuss how we collected the information to answer our questions.
Meeting with existing network
One on one calls with existing program evaluators network members
In-person invited meeting
Telephone focus groups
One-on-one calls
Survey
In-person invited meeting
Online survey

9. Evaluators’ Network Development – Interest?
5/29/2018 2:19:19 AM
Evaluators’ Network Development – Interest?
Reached out to all NTCP evaluators we had access to – the ask to participate was extensive and we believe we reached all NTCP evaluators, but participation was voluntary. Individuals chose to participate or not, so the results we have are from those with enough interest to show up at the table. Of these, some did not feel the need for a network, some want just a local listserv, and some would like the CDC to provide a dedicated website for a national network in addition to local networks. Generally, there is support for an evaluators network in some form.

10. Evaluators’ Network Development – Desires
5/29/2018 2:19:19 AM
Evaluators’ Network Development – Desires
Include (or not):
Listserv
Webpage
SharePoint or similar site
Regular calls
Webinars
National/regional trainings
National/regional meetings
Directory
Job board
Calendar evaluation events
Assigned state versus CDC
No consensus – not expected
Request for informal to formal organization, small (local) to large (all of US and territories)
Request for monthly / quarterly / yearly meetings, calls, trainings, webinars
Other discussions also developed around items that are not part of a network, such as requiring evaluation of programs and attendance at evaluation meetings in grants and cooperative agreements

11. Evaluators’ Network Development – Cautions
5/29/2018 2:19:19 AM
Evaluators’ Network Development – Cautions
Deaf ears
Burden
Beginnings
Don’t overburden states / people
Don’t be rigid
Listen to states
Start small and don’t bite off more than you can chew
Straight and narrow

12. Evaluators’ Network Development – Steps
5/29/2018 2:19:19 AM
Evaluators’ Network Development – Steps
Network
We acquired a contractor to help out - website development, listserv management, etc.
We will be pulling together a group of stakeholders to provide input and feedback as we start planning and developing the network.
Plan
Stakeholders
Contractor

13. Evaluators’ Network Development – Steps
5/29/2018 2:19:19 AM
Evaluators’ Network Development – Steps
Stakeholders
Network
Assess the network once it has been up and running a while and then update and change it as stakeholders needs and desires change, i.e. adapt to a changing environment.
Plan

14. 5/29/2018 2:19:19 AM

15. 5/29/2018 2:19:19 AM
Infrastructure development for the continued provision of evaluation technical assistance through the establishment of a national network
Centers for Disease Control and Prevention
Office on Smoking and Health
The findings and conclusions in this presentation are those of the author and do not necessarily represent the official position of the Centers for Disease Control and Prevention. TM