1. Vocational Training of High-Risk Youth: Evaluation Results of an Innovative State Model Dr. Dan Kaczynski University of West Florida dkaczyns@uwf.edu dkaczyns@uwf.edu

2. Overview Third year of multi-year evaluation study Third year of multi-year evaluation study Formative evaluation Formative evaluation Orientation Shaping Orientation Shaping Factors Influencing Results Factors Influencing Results

3. Vocational Training Transition Model State-funded program State-funded program 30 adjudicated males 30 adjudicated males Adolescents 16 – 17 years old Adolescents 16 – 17 years old Vocational / career training Vocational / career training Semi-structured independent living Semi-structured independent living

4. Vocational Training Transition Model

5. Conceptual Framework Initial Design Initial Design Objectives-Oriented and Management-Oriented Objectives-Oriented and Management-Oriented Emergent Design Emergent Design Management Accountability Management Accountability Objectives-Oriented and Utilization-Focused Objectives-Oriented and Utilization-Focused

6. Emergent Design Issues Conflicting Stakeholder Agendas Conflicting Stakeholder Agendas Profit Margin Profit Margin Cost-Effectiveness Cost-Effectiveness Competency Training Competency Training Risk-Taking Risk-Taking Conflicting Agendas

7. Methodology Data Collection Data Collection Individual interviews Individual interviews Focus group interviews Focus group interviews On-site observations On-site observations Community observations Community observations Participants Participants Family Program staff Community partners Administration State agency sponsor

8. Data Analysis Model Components Data Sources Employability Employment data Job readiness skills Program work training Community service projects Education Academic achievement Vocational competencies Treatment Social skills training Independent living skills Transition Home visits Case management Performance plans

9. NVivo Code Structure Interagency Activity Youth Characteristics Program Services Facility Private Employment Criminal History Employability Skills Behavior Management Program Employment Educational History Social Skills Professional Development WHTC Academic Employment History Recreational Activities Youth Supervision WHTC Rule Violation Family History Transitional Activities WHTC Social Skills

10. Qualitative Analysis Software NVivo 2.0

11. Reporting to Sponsor Formative Formative Monthly Reports Monthly Reports Quarterly Reports Quarterly Reports Summative Summative Annual Reports

12. Evaluation Findings Year 1 Year 1 Management- Orientation Management- Orientation Model Modifications Model Modifications Delivery of educational services Delivery of educational services Community core values orientation Community core values orientation Parental accountability Parental accountability Social and coping skills Social and coping skills Year 2 Year 2 Failure and Risk- Taking Model Modifications Skills training Standardized measures Life and social skills

13. Obstacles to Objectives-Oriented Evaluation Lack of definitions and methods Lack of definitions and methods Organizational changes Organizational changes Staff turnover Staff turnover Lack of measures Lack of measures

14. Defining Youth Success in Years 1 and 2 Desired Performance Desired Performance GED or high school diploma GED or high school diploma Vocational certification Vocational certification Direct release Direct release Actual Outcomes Actual Outcomes No successes to date No successes to date

15. Defining Youth Success in Year 3 Vocational achievement Vocational achievement Academic achievement Academic achievement Social/independent living skills Social/independent living skills Employability skills Employability skills Restorative justice Restorative justice

16. Future Considerations Community demands Community demands Developmental needs Developmental needs Partnerships and shared responsibilities Partnerships and shared responsibilities Curriculum design Curriculum design