Evaluation to Support Strategic Planning in Indian/Native Communities Doug Novins, PhD Candace Fleming, PhD

The Role of the Evaluation in CoC Provide a knowledge base for the planning effort Facilitate the process for developing the capacity for ongoing evaluation efforts Examine the feasibility of the service system models Document and disseminate the results of the initiative 2

Key Differences: CoC versus Typical Evaluation In CoC, evaluation provides important information (“data”) that is used in the planning effort 2

A Typical Evaluation Model for Strategic Planning Efforts Design Service System Model Assess Planning Effort (Process Evaluation) Assess Service System Model (Feasibility Assessment) Refine Service System Model

The Circles of Care Evaluation Model Assess Needs and Existing Services Measure Development Design Service System Model Assess Planning Effort (Process Evaluation) Assess Service System Model (Feasibility Assessment) Refine Service System Model

Key Differences: CoC versus Typical Evaluation In CoC, evaluation provides important information (“data”) that is used in the planning effort In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer 2

A Typical Evaluation Model for Strategic Planning Efforts Program Staff Evaluator

The Circles of Care Evaluation Model Program Staff Evaluator

The Circles of Care Evaluation Model Program & Evaluation Team

Key Differences: CoC versus Typical Evaluation In CoC, evaluation provides important information (“data”) that is used in the planning effort In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer In CoC, the community is an active participant in designing and implementing the evaluation plan, not simply the “target” of evaluation activities 2

A Typical Evaluation Model for Strategic Planning Efforts Program Staff Evaluator Community

The Circles of Care Evaluation Model Community Program & Evaluation Team

The Circles of Care Evaluation Model Community Program & Evaluation Team

Components of the Evaluation Outline Goals Marshal Resources Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources 2

Components of the Evaluation Outline Goals Marshal Resources Assess Community Needs Define Serious Emotional/Behavioral Disturbance Describe System of Services Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources 2

Components of the Evaluation Outline Goals Marshal Resources Assess Community Needs Define Serious Emotional/Behavioral Disturbance Describe System of Services Design/Modify the Service System Model Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources 2

Components of the Evaluation Outline Goals Marshal Resources Assess Community Needs Define Serious Emotional/Behavioral Disturbance Describe System of Services Design/Modify the Service System Model Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources Develop Outcome Measures 2

Components of the Evaluation Outline Goals Marshal Resources Assess Community Needs Define Serious Emotional/Behavioral Disturbance Describe System of Services Design/Modify the Service System Model Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources Develop Outcome Measures Assess Feasibility 2

Components of the Evaluation Outline Goals Marshal Resources Assess Community Needs Define Serious Emotional/Behavioral Disturbance Describe System of Services Design/Modify the Service System Model Assessment of the System of Services: Identification of continuities/dyscont. Proiritizing of discont. Marshalling resources Develop Outcome Measures Assess Planning Effort (Process Evaluation) Assess Feasibility 2

Our Role and Mandate To provide a clear framework for the grantees to use in designing their evaluation efforts To allow the grantees to design an evaluation effort that is most consistent with the priorities of their communities. To facilitate a process for identifying common domains for each of the evaluation components. 2

Our Role and Mandate To provide a clear delineation of CoCETAC and grantee roles and responsibilities in the evaluation effort. To provide consistently high quality technical assistance through a specific set of activities. 2

CoCETAC Technical Assistance Activities Grantee Meetings Evaluator Meetings Site Visits Scheduled Technical Assistance Conference Calls Ad Hoc Conference Calls and Email Exchanges Detailed Reviews and Critiques of Evaluation Reports Maintain World Wide Web Site CoC Distribution List 2

Grantees Role and Mandate Development of site specific domains, constructs, and measures Obtain necessary IRB and other research approvals Data collection, reduction, and analysis Provide site-specific content to CoCETAC website The writing and submission of local interim and final reports. 2

AIANP Resources on the World Wide Web http://www.uchsc.edu/ai CoCETAC: http://www.uchsc.edu/ai/coc NCAIANMHR http://www.uchsc.edu/ai/ncaianmhr The Healthy Nations Initiative http://www.uchsc.edu/ai/hni 2