1. Performance Measurement Tool (PMT) What Data Tells Us About Current RSAT Programming Presented by: Jimmy Steyee New Orleans, LA July 17, 2015

2. Performance Measurement Tool (PMT) 2014 RSAT National Workshop Evaluation (Chicago) Avg.Scale What the RSAT Performance Data Tell Us (Jimmy Steyee) 1.75 1 = Satisfactory 2 = Neutral 3 = Unsatisfactory 2 “Jimmy did a very good job with a "less than exciting" yet very necessary topic.” “A little on the dry side” “This gave me some ideas of what I need to do differently for outcome measures.” “His presentation was very dry and not useful in the way it was presented. I know data is not the most exciting topic but please make it useful and not just recite what we can read from the screen.” In an effort to improve from last year…

3. Performance Measurement Tool (PMT) Overview Agenda  Goals of BJA-funded RSAT programs  Discuss the scope of BJA RSAT −Residential-Based Program −Jail-Based Programs −Aftercare  Discuss some data findings 3

4. Performance Measurement Tool (PMT) Residential-Based Programs  6-12 months long  Separate treatment facility  Focus on inmates substance use diagnosis and needs  Develop inmates cognitive, behavioral, social, vocational, and other skills  Urinalysis testing (pre, during, and post)  If possible, limit participation to those with 6-12 month remaining time  If possible, program design should be based on effective, scientific practices 4

5. Performance Measurement Tool (PMT) Jail Based Programs  At least 3 months long  If possible, separate treatment facility  Focus on inmates substance use diagnosis and needs  Develop inmates cognitive, behavioral, social, vocational, and other skills  If possible, jail-based programs should separate the treatment population from the general correctional population and program design should be based on effective, scientific practices. 5

6. Performance Measurement Tool (PMT) Scope of BJA RSAT Federal Fiscal YearRSAT Appropriation* FY2008$8,667,570 FY2009$9,736,924 FY2010$28,399,395 FY2011$22,910,384 FY2012$8,608,155 FY2013$10,589,247 FY2014$8,637,752 FY2015 $8,852,961 Total$106,402,388 6

7. Performance Measurement Tool (PMT) Scope of BJA RSAT Federal Fiscal YearRSAT Appropriation* FY2008$8,667,570 FY2009$9,736,924 FY2010$28,399,395 FY2011$22,910,384 FY2012$8,608,155 FY2013$10,589,247 FY2014$8,637,752 FY2015 $8,852,961 Total$106,402,388 7

8. Performance Measurement Tool (PMT) Scope of RSAT Putting Federal RSAT Funding Into Context  Average Federal RSAT Appropriations −$9.1 MILLION  Total Correctional Spending −$48.5 BILLION (2010, BJS) Per capita expenditures ranged from $21k- $40k ($28k average) (BJS, 2010) 8

9. Performance Measurement Tool (PMT) Scope of BJA RSAT Federal Fiscal YearRSAT Appropriation* FY2008$8,667,570 FY2009$9,736,924 FY2010$28,399,395 FY2011$22,910,384 FY2012$8,608,155 FY2013$10,589,247 FY2014$8,637,752 FY2015 $8,852,961 Total$106,402,388 9

10. Performance Measurement Tool (PMT) Scope of RSAT Fiscal YearBaseMeanMax FY 2010$113,598$514,609$2,782,546 FY 2011$91,642$409,918$2,286,376 FY 2012$34,433$151,635$865,205 FY 2013$42,357$197,301$1,103,224 FY 2014$34,551$160,938$881,054 10 Average RSAT Federal Awards

11. Performance Measurement Tool (PMT) Use of RSAT Funds 11 Per Capita Federal Expense at Closeout during FY 2014 MeanMax Jail Based Programs (N=27) $964$4,378 Prison Based Programs (N=48) $2,036$28,390 Aftercare Programs (N=27) $5,057$31,526

12. Performance Measurement Tool (PMT) Uses of RSAT Funds 12

13. Performance Measurement Tool (PMT) RSAT Programs Number of State Programs (Residential/Prison-based) = 55  Women’s = 10 (estimate based on project description)  Men’s = 44  Both = 1 Number of Jail-based programs = 47  Women’s = 4  Men’s = 34  Both = 9 As of April 30, 2015 13

14. Performance Measurement Tool (PMT) RSAT Programs Number of aftercare programs  Total Aftercare programs = 13  Women’s = 0 (estimate based on project description)  Men’s = 11  Both = 2 Number of programs serving youth  Total number of juvenile programs = 19 (estimate based on project description) *As of April 30, 2015 14

15. Performance Measurement Tool (PMT) Evidence-Based Practices Most Common Evidence-Based Practices Mentioned  Cognitive behavioral therapy (CBT) (generic)  Moral Reconation Therapy (MRT)  Thinking for Change (T4C)  Motivational Interviewing  Cognitive Restructuring  Individualized case planning/treatment planning (in coordination with needs assessment instruments)  Therapeutic communities (TC model)  12 steps  Anger Management  “Seeking Safety”  “MATRIX Model”  “Living in Balance” 15

16. Performance Measurement Tool (PMT) Enrollment 16

17. Performance Measurement Tool (PMT) 17 Enrollment

18. Performance Measurement Tool (PMT) Program Completion 18

19. Performance Measurement Tool (PMT) Program Completion 19

20. Performance Measurement Tool (PMT) Program Completion Participants Who Completed Program: TimeframeResidentialJailAftercare up to 3 months2,069 (11%)4,226 (44%)204 (17%) 4-6 months8,209 (42%)4,146 (43%)748 (61%) 7-9 months6,724 (34%)1,007 (10%)169 (14%) 10 months or more2,613 (13%)238 (2%)110 (9%) Total19,615 (100%)9,617 (100%)1,231 (100%) 20

21. Performance Measurement Tool (PMT) Risk and Needs Treatment Planning FY 2014, Programs that use Risk/Needs Assessment Instruments Prison-based: 47 of 55 (85%) Jail-based: 39 of 47 (83%) Aftercare: 9 of 13 (69%) 21

22. Performance Measurement Tool (PMT) Risk and Needs Treatment Planning Most Common Risk/Needs Treatment Tools Mentioned  LSCI/LSCI-R  LS/CMI  RANT  GAIN  TCU Drug Screen  SASSI  ASI  COMPAS  Bio-Psycho Social Assessment  Various “state” level instruments (Ohio, Wisconsin, Michigan, Oregon etc.)  DSM (IV and V) Criteria 22

23. Performance Measurement Tool (PMT) 23

24. Performance Measurement Tool (PMT) 24

25. Performance Measurement Tool (PMT) 25 FY 2014, Percent of Individuals Completing Program and had a New Criminal Charge Length of Award % 0 to 12 months (N=37) 1.4% 13 to 24 months (N=16) 2% 25 to 36 months (N=13) 16% 37 months or more (N=9) ++ Court and Criminal Involvement – Residential Based Programs

26. Performance Measurement Tool (PMT) Court and Criminal Involvement – Residential Based Programs 26 FY 2014, Individuals Completing Program with Revocation Length of Award % 0 to 12 months (N=37) 8.4% 13 to 24 months (N=16) 15.6% 25 to 36 months (N=13) 31% 37 months or more (N=9) ++

27. Performance Measurement Tool (PMT) What’s the Bottom Line? Effective treatment attends to multiple needs of the individual (National Institute on Drug Abuse’s 13 Principles of Effective Treatment (NIDA))  In FY 2014 −The majority of all participants in jail and residential based program received substance abuse treatment and cognitive behavioral services. −In residential-based programs, between 24-30% of participants received mental health, housing, and employment services −In jail-based programs, between 15-25% of participants received mental health, housing, and employment services. 27

28. Performance Measurement Tool (PMT) What’s the Bottom Line? Treatment plans should be individualized and continually monitored and modified as necessary (NIDA)  In FY 2014 −In FY 2014, over 21,000 individuals received a case plan upon enrollment  Common risk/needs assessment used by grantees include LSCI/LSCI-R, LS/CMI, RANT, GAIN, TCU Drug Screen, SASSI, ASI, COMPAS, Bio-Psycho Social Assessment, Various “state” level instruments (Ohio, Wisconsin, Michigan, Oregon etc.), and DSM (IV and V) Criteria 28

29. Performance Measurement Tool (PMT) What’s the Bottom Line? Effective treatment call for adequate period of treatment—at least 3 months (NIDA)  In FY 2014 −Of those residential-based inmates completing program requirements, almost 90% stayed in the program for more than 3 months. −For jail-based programs, over 79% completed all the program requirements and of those, 98% stayed in the program for up to 9 months. 29

30. Performance Measurement Tool (PMT) What’s the Bottom Line? Substance abuse testing (i.e., urinalysis testing) is a best practice among treatment programs (NIDA)  In FY 2014 −RSAT Participants are tested both prior to entering the program and during program participation −jail- and residential-based programs tested almost 21,000 individuals. Of those, only 3.6% tested positive for the presence of drug use. −24% of individuals in Aftercare program tested positive 30

31. Performance Measurement Tool (PMT) Questions? 31

32. Performance Measurement Tool (PMT) Resources  PMT Web Site: https://www.bjaperformancetools.org −Webinar trainings, performance measure grids/questionnaires, user guides, FAQs, and helpful links  PMT Help Desk: −Monday–Friday 8:30 a.m.–5:30 p.m. EST −Toll-free number: 1-888-252-6867 −E-mail: bjapmt@csrincorporated.com  Jimmy Steyee −E-mail: James.D.Steyee@ojp.usdoj.gov or jsteyee@csrincorporated.comJames.D.Steyee@ojp.usdoj.govjsteyee@csrincorporated.com 32