1. Introduction Results and Conclusions Comparisons on the TITIS fidelity measure indicated a significant difference between the IT and AS models on the Staffing and Treatment Team Structure scale score but no differences were found on the Treatment Program Structure and Services, Integrated Treatment Documentation, or Overall Fidelity scores. Group contrasts on individual TITIS items revealed that the AS programs scored higher on one item measuring Integrated Progress Notes. Results of client outcome analyses revealed no differences between the two models in the number of psychiatric hospitalization days or arrests at 1-year post-baseline. The two implementation models that emerged from the process evaluation reflected differences in service structure. One model displayed structural characteristics that had greater fidelity to the ideal implementation of IDDT, with the dual diagnosis team coordinating and delivering services. By contrast, the other model implemented a case manager structure with the dual diagnosis team as one of an array of adjunct service types. Few differences were found between these two models on TITIS fidelity scores other than treatment team structure, suggesting that although the method of service delivery may have differed, both model types implemented comparable levels of the essential elements of IDDT and achieved similar 1-year client outcomes. These findings indicate that, in this sample of IDDT programs, the departure from the ideal IDDT service delivery structure did not differentially affect client outcomes, suggesting that other critical elements of the treatment model may be a stronger factor in determining client outcomes than method of service delivery. Acknowledgements Presented at the Addiction Health Services Research Conference, Little Rock, Arkansas, October 24, 2006 Number of Arrests During Past Year Texas Integrated Treatment Integrity Scale Scores Psychiatric Hospitalization Days During Past Year The measurement of treatment fidelity is an important, yet often omitted component in examining the efficacy of various treatment models. Fidelity measures are useful in evaluation studies as a means of documenting appropriate implementation and adherence to the model under study, as well as confirming treatment differentiation in research designs that include control groups. Further, fidelity measures may also provide a method for determining critical ingredients in treatment models that are most strongly associated with client outcomes. Although research is limited, most studies examining the effects of treatment fidelity in the areas of supported employment and assertive community treatment have revealed a positive association between degree of fidelity and outcomes in clients with severe mental illness. Continued research is needed to determine the effects of departures from fidelity; as evidence-based practices are diffused in real-life clinical settings, treatment models are often adapted according to local resource constraints and other community and system characteristics. Measurement of the potential effects of these adaptations may inform technology transfer practices by identifying crucial aspects of treatment models associated with client outcomes that are less amenable to change. The current study examines the effect of integrated dual diagnosis treatment (IDDT) fidelity on 1-year outcomes of 256 clients with severe mental illness and substance use disorders. Treatment programs were participating in the Texas Dual Diagnosis Pilot Project, which was designed to develop integrated treatment programs through coalitions of state-funded substance abuse and mental health treatment providers. Each program was trained on the essential elements of the IDDT model and subsequently designed and implemented a treatment program unique to their local characteristics. The authors acknowledge the Texas Department of State Health Services (TDSHS), Mental Health and Substance Abuse Services Division for their assistance in retrieving archival data for this study. The findings and conclusions of this presentation are the opinions of the authors and do not necessarily reflect the official position of TDSHS. Sample and Method Fidelity was assessed through two process evaluation site visits during the second year of the project, consisting of semi-structured interviews assessing the essential elements of IDDT. In addition, the Texas Integrated Treatment Integrity Scale (TITIS) was completed for each site using multiple data sources, including interview data, site self- report instruments, client chart review, and service records. The TITIS is based on the Dartmouth Assertive Community Treatment Scale (DACTS), adapted to capture service system features in Texas. Each TITIS item is scored on a 5-point scale, with higher scores indicating greater fidelity. The process evaluation site visit data identified two general modes of implementation across programs: the integrated treatment model (IT; n = 3) and the adjunct services model (AS; n = 3). Programs in the IT category were characterized by complete integration of substance abuse and mental health systems, with the dual diagnosis team coordinating and delivering services. In the AS model, a case manager coordinated a team of specialized service providers and the dual diagnosis team was one type of service in this array. TITIS ratings of the IT and AS models were compared using Wilcoxon rank sums tests to explore potential differences in fidelity scores. One-year outcome analyses were conducted contrasting clients who received IT (n = 120) versus AS (n = 136) on psychiatric hospitalization days and arrests. Baseline comparisons indicated that the IT group was older, had a higher proportion of schizophrenia-spectrum diagnoses, and had greater levels of psychiatric hospitalization in the year prior to admission; consequently, propensity scores were used to adjust for these initial group differences in outcome analyses. General linear modeling with repeated measures and Poisson distribution was conducted to compare psychiatric hospitalization and arrests during the 1-year periods pre- and post-baseline. Integrated Treatment IDDT Implementation Models and Fidelity Scores Adjunct Services Effects of Integrated Treatment Fidelity on 1-Year Client Outcomes: A Comparison of Implementation Models Laurel Mangrum a, Richard Spence a, & Molly Lopez b a University of Texas at Austin, Addiction Research Institute, b Texas Department of State Health Services Client Characteristics and 1-Year Outcomes IntegratedAdjunct TreatmentServices ( n =3)( n Staffing and Treatment Team Structure Caseload Size4.54 DDX Provider Meeting44.33 Team Approach52.33 Attendance at Staffings4.673.67 Continuity of Staffing4.32 Staff Capacity4.54 Intake Rate55 Substance Abuse Specialist on Staff53.67 Mental Health Specialist on Staff55 Psychiatrist on Staff23.33 Dual Diagnosis Training3.332 Open Communication43.33 Centralized Treatment3.673 Total 4.213.51 * Treatment Program Structure and Services Intensity of Service 2.334 Frequency of Contact1.331.5 Dual Disorders Groups2.674.33 Adapted Substance Abuse Treatment33.33 In-Vivo Services2.331.67 Work with Support System2.671.67 Assertive Outreach1.333 Assertive Engagement Mechanisms11.67 Housing Services13 Employment Services1.333 Tailored Intensity2.672.33 Assertive Retention2.671.67 Total 2.032.23 Integrated Treatment Documentation Admission Criteria44 Integrated Treatment Plans4.55 Integrated Progress Notes 45 * Involvement in Discharge Planning2.673.33 Stage of Treatment3.334 Total 3.44.27 Overall Fidelity Score 3.213.34 * p <.05