Evidenced Based Programs

Agenda  Review of Programs in Missouri  How to Select Programs of Your Own

Rigorously Defining EBP  Evaluation research shows that the program produces the expected positive results;  The results can be attributed to the program itself, rather than to other extraneous factors or events;  The evaluation is peer-reviewed by experts in the field; AND  The program is “endorsed” by a federal agency or respected research organization and included in their list of effective programs.

Practically Defining EBP  Included on Federal Lists or Registries of evidence based interventions (as an effective program); OR  Reported (with positive effects) in peer- reviewed journals / government publications; OR  Convincing scientific research proving the intervention’s effectiveness.

WHAT IS GOING ON IN MISSOURI?

Programs Used in Missouri  Regional Support Centers were asked which programs they used  12 total responses, 59 programs

Statewide Programs  Mental Health First Aid  QPR (Question, Persuade, and Refer)

Programs Used in Missouri (>33%) Evidenced Based Program (EBP) Currently Implementing Implemented in the Past but not Now Life Skills Training33%42% All Stars 33%42% Strengthening Families Program (SFP)33%25% Project Alert17%42% HALO33%8% Signs of Suicide (SOS)33%0% Peace Builders17%8% Too Good For Drugs and Violence17% Guiding Good Choices8%42% Project Towards No Drug Abuse8%25%

 Love and Logic  Olweus  BASICS (Brief Alcohol Screening and Intervention of College Students)  Lifelines  Project Northland  Above the influence Programs Used in Missouri (<33%)

 Al’s Pals  Building Strong Families  Families and Schools Together (FAST)  SMART Moves (Skills Mastery and Resistance Training)  Wyman’s Teen Outreach Program (TOP)  Protecting You / Protecting Me Programs Used in Missouri (<33%)

 ABC’s of Secondhand Smoke  Alcohol: True Stories  Ask Listen Refer  Aggressors, Victims, and Bystanders (AVB)  Big Brothers, Big Sisters Mentoring Program  Communities Mobilizing for Change on Alcohol Programs Used in Missouri (1 RSC)

 Choose Respect  How to Cope (youth & adult versions)  Creating Lasting Family Connections (CLFC)  Curriculum-Based Support Group (CBSG)  Good Behavior Game (GBG)  Not On Tobacco  Parents and the Law Programs Used in Missouri (1 RSC)

 Parents as Teachers  Positive Action  Project Toward No Tobacco Use  Second Step  Short, Brief Intervention and Referral to Treatment (SBIRT)  SmokeBusters Programs Used in Missouri (1 RSC)

 Too Smart to Start  SISTA  The Seven Challenges  Why Try Programs Used in Missouri (1 RSC)

LOOKING AT A FEW EBPs Note: This is a very brief overview of each program designed to illustrate some things to consider. It is not intended to fully describe the program. If you are considering choosing an EBP, please fully review all literature.

Mental Health First Aid - Design  What is it supposed to do?  Potential to reduce stigma, improve mental health literacy, and empower individuals  Who is the target audience?  Friends and family of individuals with mental illness or addiction, key professionals (such as police officers, human resource directors and primary care workers), school and college leadership, faith communities, or anyone interested in learning more about mental illness and addiction

Mental Health First Aid - Evidence  Research showing:  Improved mental health in those who attend the training  Decreases in stigmatising attitudes  Increases in the amount and type of support provided to others  Publication in peer reviewed journals

QPR - Design  What is it supposed to do?  Teach "gatekeepers” the warning signs of a suicide crisis and how to respond by following three steps  Who is the target audience?  Parents, friends, neighbors, teachers, coaches, caseworkers, police officers, etc.

QPR - Evidence  Research showing:  Increases in declarative and perceived knowledge about suicide; maintained at the 3- month follow-up  Higher gatekeeper self-efficacy score  Higher knowledge of suicide prevention resources  Publication in peer reviewed journals

Life Skills - Design  What is it supposed to do?  Prevent alcohol, tobacco, and marijuana use and violence  Who is the target audience?  Separate programs offered for elementary, middle, and high school; the research studies and outcomes reviewed involved middle school students

Life Skills - Evidence  Research showing:  Significant decrease in cigarette smoking, alcohol use (drunkenness), and polydrug use  Lower normative expectations than control students for peer smoking and drinking  Significant reductions in violence and delinquency at 3-month follow-up  Publication in peer reviewed journals

All Stars - Design  What is it supposed to do?  Prevent and delay the onset of high-risk behaviors such as drug use, violence, and premature sexual activity  Who is the target audience?  Middle school students (11-14 years old)

All Stars - Evidence  Research showing:  Average scores for personal commitment increased from pre- to posttest  Average scores for lifestyle incongruence increased from pre- to posttest  Average scores for school bonding increased from pre- to posttest  Publication in peer reviewed journals

Strengthening Families - Design  What is it supposed to do?  Designed to increase resilience and reduce risk factors for behavioral, emotional, academic, and social problems in children 3-16 years old  Who is the target audience?  Parents & Children

Strengthening Families - Evidence  Research showing:  Children who received SFP had lower scores on conduct disorder symptoms, oppositional defiance symptoms, and behavior problems than children in the control group.  Improvements in positive parenting, parental involvement, parenting skills, parental supervision, and parenting efficacy  Publication in peer reviewed journals

NREPP DEMONSTRATION Picking Your Own Programs

NREPP  SAMHSA’s tool  Good place to look for Behavioral Health  Not the only list out there!

NREPP Limitations  From NREPP’s website  “NREPP ratings do not reflect an intervention's effectiveness. Users should carefully read the Key Findings sections in the intervention summary to understand the research results for each outcome.”  “Use of NREPP as an exhaustive list of interventions is not appropriate, since NREPP has not reviewed all interventions.”

Not on NREPP!? Next Steps  Do a web search  Check for Program Website  Do they claim EBP? How?  Do they have positive evaluation results?  May pop up on another list (CDC, Dept of Ed, etc)  Google Scholar for Peer Reviewed Journals  Call Program Developer  Pilot test it yourself (Service to Science)

One Size does NOT Fit All  Targeted towards a particular problem  Targeted towards a particular population  (A cheesy comparison)

Start Small (if you can)  Get 1 copy of all materials to review  Pilot test with 1-2 groups

Fidelity  Programs are EBP based on implementing them as designed  The more modifications made, the less EBP they are  Possibly still effective but no proof  Care should be taken when calling it EBP

Contact Information Susan Depue, Ph.D. Research Assistant Professor Missouri Institute of Mental Health University of Missouri - St. Louis 5400 Arsenal St., St. Louis, MO PHONE: (314)