Provincial Evaluation Plan By Kathleen Douglas-England The Innovative Approaches to Preschool Developmental Screening and Follow-up Services Initiative Provincial Evaluation Plan April 2009 By Kathleen Douglas-England Karen Tofflemire Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Outline Initiative goals Provincial Logic Model Provincial Evaluation Objectives Provincial Evaluation Framework Overview of methods to be used Work Flow for the Provincial Evaluation Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Goals of the initiative To increase the number of children receiving appropriate developmental screening and follow-up services between the ages of 18 months to 36 months. To try out new approaches and improve timely access to assessment for the children referred from screening. To try out new ways of providing intervention approaches and improve timely access to interventions for children identified as requiring services through assessment. To provide parents with increased number of access points for screening and follow-up. Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Goals of the initiative To develop, implement and evaluate new models of coordinated community based screening/assessment/intervention approaches for preschool children. To improve timely identification and referral of children eligible for educational programming. To test the use of range of service providers and alternative service provision to determine cost-effective approaches. To gather data and disseminate findings and evidence form the funded projects to inform decision-making regarding how to improve access to developmental screening and follow-up services in Alberta. Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Goals of the Initiative Figure 1: Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative – Logic Model WHY Early identification of developmental delays may allow for early intervention and more positive health outcomes for children, their families and the community. Rationale WHO & WHAT Communication * Collaboration * Partnership * Sustainability Innovative approaches to service delivery * Funding Families and Children Goals of the Initiative Goals want to achieve & Levels of reach Alberta Health And Wellness Alberta Education Alberta Children & Youth Services HOW Key principles & Resources Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Projects Millwood Community Preschool Screening Project (Capital) Grow Along with Me Project (Chinook) Growing Together Project (David Thompson) Pediatric Regional Integrated Services Model (PRISM)(East Central) Teaming for Tots (Palliser) Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Provincial Evaluation Objectives To address the goal of the provincial evaluation seven evaluation objectives have been identified: To determine to what extent the implementation of the projects had on the access of children and families to screening and follow-up services. To determine what factors facilitated access to screening and follow-up services. To determine how barriers that impeded access to screening and follow-up services were addressed by the projects. To determine what practices enhanced or hindered communication between service delivery partners. Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Provincial Evaluation Objectives To determine what were the most effective ways of coordinating or facilitating movement of children and their families through the continuum of services within and outside of those offered by the projects. To determine to what extent did the models/approaches have had on parent knowledge, parent practices, parenting self-efficacy and parent satisfaction. To describe successes and challenges of specific approaches developed to work with cultural communities. Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Evaluation objectives Provincial Evaluation Framework Goal: To determine the effectiveness of the projects in generating practices that advance preschool developmental screening and follow-up services at a system level in Alberta. Structure Process Outcome Evaluation objectives 1.To determine to what extent the implementation of the projects had on the access of children and families to screening and follow-up services. To determine what factors facilitated access to services. To determine how barriers that impeded access were addressed by the projects. To determine what practices enhanced or hindered communication between service delivery partners. To determine what were the most effective ways of coordinating or facilitating movement of children and their families through the continuum of services within and outside of those offered by the projects. To determine to what extent did the models/approaches have had on parent knowledge, parent practices, parenting self efficacy and parent satisfaction. To describe successes and challenges of specific approaches developed to work with cultural communities. Approaches/models Partnerships – service delivery & stakeholders Funding Staff mix Infrastructure Policies Barriers Facilitators Sustainability Communication with service delivery partners Communication between stakeholders Partnership development Coordination of services Client description and differences Barriers Facilitators Improved access to: screening, assessment and interventions Patient satisfaction with service Improved parent knowledge and self- efficacy Improved parent practices Measurement Quantitative- review of project data (e.g. parent surveys, project data on screening, assessment and referrals) Qualitative – staff/partner and stakeholder (e.g. communication, collaboration) Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Methodology Overview Data for the provincial evaluation will collected using the following approaches: Document review Interviews/focus groups with project leads/stakeholders Surveys with staff/partners Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

Workflow Overview Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire

For additional information CONTACT Kathleen Douglas-England, MSc kdouglas.england@shaw.ca 403-944-8923 Provincial Evaluation Plan - Innovative Approaches to Preschool Developmental Screening and Follow-Up Services Initiative 2006-2010 Provincial Evaluation Consultants: Kathleen Douglas-England & Karen Tofflemire