Leah Ranney, PhD, and Adam Goldstein, MD, MPH: University of North Carolina Tobacco Prevention & Evaluation Program, Department of Family Medicine Jason Derrick, MSW: UNC Carolina Population Center Kearston L. Ingraham, MPH: NC Department of Health and Human Services Laura K. Jones, MS, MA: UNC Greensboro, Department of Counseling and Educational Development

 Thomas Brown, MA, Ed  Nidu Menon, PhD  Sterling Fulton-Smith, MHA  Andre Stanley, MPH  Brandi Behlke, MA Ed  Candice Justice, MS

 Impact of Tobacco Use  North Carolina Comprehensive Tobacco Program  The Teen Tobacco Use Prevention and Cessation Initiative (Teen Tobacco Program)  Teen Tobacco Program Indicators  Tobacco Evaluation and Management System (TEAMS) ◦ How are program activities monitored? ◦ What type of outcome data is produced for evaluation? ◦ Utility of TEAMS for program managers, evaluators and Technical Assistance Providers  Evaluation of TEAMS

 Approximately 400,000 people die each year from their own cigarette smoke ◦ 12,200 people die each year in North Carolina  Over 6,000,000 youth under 18 years old alive today will ultimately die from smoking – unless smoking rates decline ◦ 193,000 youth under 18 and alive in North Carolina will die prematurely from smoking 1 Campaign for Tobacco-Free Kids (2011) / /

 Master Settlement funds used to establish Health and Wellness Trust Fund (HWTF):  Four primary components: ◦ Teen Initiative: 2003 ◦ TRU Media Campaign: 2004 ◦ Quitline: 2005 ◦ Colleges Initiatives: 2006

 Funds 43 School and Community Based Grantees ◦ Prevent Youth Initiation of Tobacco Use ◦ Promote Tobacco Use Cessation Among Youth ◦ Eliminate Youth Exposure to Secondhand Smoke ◦ Reduce Tobacco Related Disparities Among Priority Populations

 Major source of statewide tobacco prevention and cessation resources for North Carolina youth  Growth in policy outcomes ◦ 100% Tobacco Free Schools ◦ Smoke Free Restaurants and bars  Significant reductions in youth tobacco rates ◦ 53,000 fewer teen student smokers in 2009 than in 2003

 Tobacco Prevention ◦ # of tobacco use prevention education media messages aired or disseminated ◦ # of youth led prevention activities  Tobacco Cessation ◦ # of presentations promoting tobacco cessation resources ◦ # of printed materials distributed with QuitlineNC Logo

 Reduce Secondhand Smoke Exposure ◦ # of improved smoke-free policies (increase from smoke-free to tobacco-free) ◦ # of new smoke-free policies (i.e. Parks)  Reduce tobacco-Related Disparities ◦ # of culturally tailored activities conducted targeting an identified high risk group ◦ # of activities conducted where materials from the Heritage Toolkit (culturally tailored products and activities) were disseminated

Status Reports Indicator Reports Qualitative Data

Quantitative and Qualitative

GranteeVenueLocation Buncombe County Schools Buncombe County GovernmentBuncombe County, NC Public Parks and MunicipalitiesAsheville, NC Catawba County HDYousseff 242Hickory, NC Chowan RegionalOpen Door Baptist ChurchEdenton, NC Chowan Regional Church of ChristEdenton, NC Dare County HD Dare County Dept. of Public HealthDare County, NC Guilford County HDBryan YMCAGreensboro, NC Macon County PH CenterTown of FranklinFranklin, NC North Carolina Commission on Indian Affairs Sweet ExpressionsPembroke, NC Beauty Spot United Methodist ChurchRowland, NC Piney Grove United Methodist ChurchMaxton, NC Walls Chapel United Methodist ChurchRed Springs, NC Mt. Zion United Methodist ChurchHoke County Cool Spring United Methodist ChurchLaurinburgh, NC

Technical Assistance Providers Program Managers Evaluators

 Scope of Work  Calendar view ◦ Pending, Scheduled, and completed TA request  Tracking Services and materials via Spreadsheet

 Easily access grantee/TA profile information  View grantee Annual Action Plans online  Monitor grantee progress individually or by Region  Monitor grantee progress monthly, quarterly, or yearly  Check grantee status of monthly and semi- annual data entry

 Quickly check status of data submission for monthly and semi-annual reporting  Easily access grantee contact information  Use indicator report to review data monthly, quarterly and yearly  Download data in spreadsheet and conduct further analysis using statistical software  Use TEAMS reports to view qualitative data synopses to support or clarify quantitative data issues

 Functionality of Database ◦ Log-in/password ◦ Toggling between pages ◦ Using…  Pull down windows  radio buttons  Text boxes  Question Clarity  Responsiveness to Grantee and Program Manager needs Entry Needs

 Functionality Issues Resolved  Online Codebook and Definitions for Clarity  Program Manager Feedback: ◦ “There needs to be a place to report events not on the AAP.” ◦ “I thought this was set up perfectly for how most grantees conduct activities”  Grantee Feedback: ◦ “ I feel like more of the work we do is being captured by this system”. ◦ “I liked seeing my own AAP items in the drop-down window— that made it a lot easier to fill out without having to go back to the paper AAP.”

 TEAMS is a customized, flexible, web-based tracking system  TEAMS collects data related to performance indicators in accordance with the Teen Initiative Annual Action Plans  Evaluators and Program Managers can use TEAMS to monitor programmatic changes and evaluate program progress  Improved technology allows for the ability to make rapid program improvements

Website: