1. Urban Institute Serious and Violent Offender Multi-site Evaluation Funded by NIJ Grant No. 2004-RE-CX-0002 What Works in Reentry: Findings from the SVORI Multi-site Evaluation Christy A. Visher, Ph.D. University of Delaware and The Urban Institute John Jay College of Criminal Justice Prisoner Reentry Institute October 23, 2009

2. Urban Institute Serious and Violent Offender Multi-site Evaluation Overview n The Serious & Violent Offender Reentry Initiative n The evaluation design and data collection n Findings: Did “it” work? n Challenges finding what works—for programs, for evaluators n Lessons: Takeaways for reentry strategies & evaluations

3. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org So What Was the SVOR Initiative? n In 2002, the US DOJ, DOL, ED, DHUD, and DHHS funded one round of three-year grants for state and local agencies to develop programs to improve criminal justice, employment, education, health, and housing outcomes for released prisoners n 69 agencies received Federal funds ($500,000 - $2,000,000) to develop 89 programs that l Targeted adult and juvenile populations l Incorporated partnerships among state and local agencies to provide comprehensive services to prisoners returning home l Were locally designed to meet local needs and organizational capabilities

4. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org SVORI Logic Model

5. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org SVORI Funding Came with Few Requirements n Unlike many Federal programs, SVORI grants imposed only a few requirements l Focus on “serious and violent offenders” 35 years of age or younger l Address different stages of reentry through services delivered (1) prior to release, (2) post release during supervision, and (3) post supervision l Base services on needs and risk assessments l Include partnerships among state and local agencies and community and faith-based organizations

6. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org So… What was a “SVORI Program”? n SVORI programs were locally designed to meet local needs & organizational capabilities n Most programs used assessments to tailor services & programs for program participants n SVORI was not a program in the sense of traditional programs (e.g., cognitive behavior therapy or residential drug treatment) n SVORI was a funding stream that agencies used to enhance & expand existing programs or to develop new reentry programs

7. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Evaluation Challenge “…determine whether the selected programs have accomplished the overall goal of the Reentry Initiative – increasing public safety by reducing recidivism among the populations served by the program – and determine the relative costs and benefits of the program.”

8. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Did SVORI Work? n What does that mean? l Were agencies able to develop & implement SVORI programs? l What did those programs look like? l Did program participants receive more services than others? l Did program participants have better outcomes?

9. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org SVORI Multi-site Evaluation n Implementation assessment collected multiple waves of survey data from all 89 SVORI program directors, as well as data from program participants & comparison subjects n Impact evaluation focused on SVORI participants and non-SVORI comparison subjects in 12 adult programs (11 for adult females) and 4 programs for juvenile males in 14 states n Interviews with individuals who entered SVORI programs and were released from prison between July 2004 and November 2005 l 30 days prior to release l 3, 9 and 15 months post release

10. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org SVORI Impact Evaluation Subjects 12 Adult Programs; 4 Juvenile Programs WaveMenWomenBoysTotal SNSTotalSNSTotalSNSTotal Pre86383416971532043571521853372391 3 M5294559841101342441051312361464 9 M56547010351191342531081312391527 15 M58253111131241522761071412481637 Total253922904829506624113047258810607019 n Wave 1 response rate: 86% n Wave 2: 58% (Men), 68% (Women), 71% (Boys) n Wave 3: 61% (Men), 71% (Women), 72% (Boys) n Wave 4: 66% (Men), 77% (Women), 74% (Boys)

11. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Population Characteristics 30 Days Prior to Release MenWomenBoys Age at release293217 Black54%41%55% Hispanic4%6%20% Currently married/steady relationship40%48%43% Children63%83%9% HS/GED60%62%17% Employed 6 m prior prison66%53%38% Supported self w/ job 6 m prior prison61%48%29% Age 1 st arrest (years)161913 Prior arrests (number)14127 Person/violent crime (current)41%29%46% Lifetime illicit drug use95%94%88% AOD/MH treatment prior prison51%73%43%

12. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Implementation n SVORI funds resulted in the development of local programs that provided an increase in programs and services for participants…

13. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Characterizing & Comparing SVORI Programs n Coordination & Supervision: risk assessment, needs assessment, treatment/release plan, and (post-release only) supervision n Employment/Education/Skills Building: education/GED/ tutoring/literacy, vocational training, employment referral/job placement, resume/interviewing skills, work release, cognitive skills development, life skills n Health Services: AA/NA, counseling, comprehensive AOD treatment, mental health, medical, dental, anger mgmt/violence counseling n Transition Services: legal, id assistance, benefits assistance, financial support/ emergency assistance, peer support, mentoring, housing, and (post-release only) transportation n Family Services: parenting skills, family counseling, family reunification, domestic violence services Service Bundles

14. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Coordination Services Receipt: Men ReceivedPrerelease3M Post S N=863 NS N=834 S N=529 NS N=455 Reentry Plan?57%*25%n/a Met w/anyone re: release/reintegration? 66%*31%46%*22% Needs assessment for release?49%*23%n/a Met with case manager?66%*41%58%*34% Note: Average bundle scores weighted to compensate for differences between groups. * p < 0.05.

15. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Service Receipt: Men Coordination Services Bundle n Needs assessment n Case manager n Treatment/release plan or help reintegrating n P/P supervision (post-release only) Note: Average bundle scores weighted to compensate for differences between groups. * p < 0.05.

16. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Selected Transition Services Receipt: Men ReceivedPrerelease3M Post S N=863 NS N=834 S N=529 NS N=455 Programs for release?75%*52%n/a Help obtaining job docs?41%*26%25%*16% Help finding place to live?28%*13%12%11% Help getting driver’s license?22%*8%12%*7% Public health care access?13%*9%11%8% Note: Average bundle scores weighted to compensate for differences between groups. * p < 0.05.

17. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Service Needs & Receipt: Men Transitional Services Bundle Note: Average bundle scores weighted to compensate for differences between groups. * p < 0.05. n Legal n Financial n Health care n Mentoring n Employment documents n Housing n Transportation n Driver’s license n Clothes/food banks n Program/class to prepare for release (prerelease only)

18. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Employment/Education/SkillsBuilding Services: Men ReceivedPrerelease*3M Post* S N=863 NS N=834 S N=529 NS N=455 Any E/E/SB Service?79%*69%50%*31% Any Employment Service?37%*20%34%*20% Any Educational Service?51%*44%11%8% Asst w/ Personal Relationships?25%*17%7%*4% Trng Change Criminal Attitudes?51%*36%18%*10% Note: Average bundle scores weighted to compensate for differences between groups. * p < 0.05.

19. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Service Needs & Receipt: Men Employment/Education/Skills Bundle n Education/ vocational training n Employment services n Life skills n Personal relationships n Change criminal behavior attitudes n Money management Note: Average bundle scores weighted to compensate for differences between groups. * p < 0.05.

20. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Implementation n SVORI funds resulted in the development of local programs that provided an increase in programs and services for participants…according to the SVORI Program Directors. n Our impact site respondents confirmed more services for those participating in programs. n Self-reported need was similar across sites…self-reported service receipt varied.

21. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Little Site Variation in Needs Employment/Education/Skills Bundle Source: Wave 1 interviews with adult males

22. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Much Variation in Service Receipt Employment/Education/Skills Bundle Source: Wave 1 interviews with adult males

23. Urban Institute Serious and Violent Offender Multi-site Evaluation Impact: Did the SVORI Programs Make A Difference?

24. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Remember the Logic Model

25. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Did SVORI Work? Approach n Overall, our SVORI and non-SVORI groups are similar although there are a few differences n Propensity score models were estimated to address observable differences in SVORI & Non-SVORI with respect to assignment to SVORI n Propensity score weighted models were estimated to determine effect of SVORI participation on outcomes

26. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Housing Independence

27. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Currently Support Self with Job

28. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Job Has Benefits* *Benefits = paid leave or health insurance

29. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Job Has Formal Pay

30. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org No Self-reported Drug Use Past 30 Days

31. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org No Self-reported Drug Use Past 30 Days Except Marijuana

32. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org No Self-reported Drug Use Past 30 Days or Positive Test

33. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org No Self-reported Criminal Behavior Since Last Interview

34. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Recidivism: Men

35. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Recidivism: Women

36. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Issues & Challenges: For Reentry Programs n Participant needs are multi-faceted n Implementation means identifying, developing, and providing a range of services often in collaboration and cooperation with multiple agencies and organizations—which is difficult n Services should be customized to individual participants based on needs and risks—there is no one “program” to be implemented

37. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Issues and Challenges: For Evaluators n Services are customized to individual participants based on needs and risks—there is no one “program” to be evaluated n Programs vary from location to location in response to available resources and service providers n Characteristics of participants across programs may vary, either because of targeting by administrators or underlying demographic differences in populations

38. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Conclusions n SVORI: Ambitious effort to improve integrated, individually targeted services through coordination of state & community agencies & organizations n SVORI participants were more likely to report receiving services pre and post release—although at levels far below 100% n From release through 15 months post release, SVORI participants are doing better—if only moderately so— across a wide range of outcomes n Official measures of recidivism show little difference in arrest & reincarceration rates, although we see l slightly lower rearrest rates l slightly higher reincarceration rates

39. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Lessons for the Field n Modest funding focused on improving coordination and developing reentry strategy can result in substantial increases in services. n Improvement in services leads to modest gains in outcomes. n Incomplete implementation of service components may explain modest outcomes. n Critical component: careful, systematic assessment of needs and matching of services n Continuity of service delivery! n SVORI was first major attempt to develop and deliver systematic reentry strategy.

40. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org A Cautionary Note “ Services can assist the individual in sustaining recovery, but only if the client has the capacity and readiness to constructively utilize those services.” George De Leon

41. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org Post Script n There are no “silver bullets”! n Federal funding has been a series of one-time efforts with different foci and population targets since 2001: l SVORI (2002) -- DOJ l Prisoner Reentry Initiative (2005) -- DOL l Responsible Fatherhood, Marriage and Family Strengthening (2006) -- HHS l Second Chance (2009) -- DOJ n State funding for corrections has always been small & is now buffeted by budget shortfalls that threaten to eliminate gains in those states that have invested in reentry n SVORI was a good start – a place to build

42. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org

43. Urban Institute Serious and Violent Offender Multi- site Evaluation www.svori-evaluation.org For Women and Juvenile Males n Levels of self-reported need were similar for the SVORI and non-SVORI groups for both the adult females and the juvenile male subjects n Women participating in SVORI programs were much more likely to report receipt of services and substantial differences persisted for many services through the 15-month follow-up interview n Juvenile males, overall, reported much higher levels of service receipt than the adults—particularly, pre- release—and there were many fewer differences in the likelihood of service receipt between the SVORI and non-SVORI groups