TRACKING AND REPORTING PROGRESS AND CONTINUOUS IMPROVEMENT AmeriCorps Program Directors’ Kickoff: 2015 –

Overview  Tracking, Recording, and Reporting Progress  Data collection and reporting  Data collection strategies  Continuous Improvement  Gauging satisfaction: members, sites, stakeholders, recipients  Utilizing feedback 2

Tracking, Recording, and Reporting Progress To ensure the program is collecting, documenting, and reviewing necessary data and that it is on track to meet its stated objectives and to ensure accurate and timely reporting of AmeriCorps- related performance measure objectives. 3

Data Collection  Use performance measures to guide your data collection  Collect high-quality data  Validity: collecting the right data; measuring what we intended  Completeness: all sites represented; thorough, appropriate collection process  Consistency: consistent definitions of data across sites; documentation and training  Accuracy: procedure to collect and review data; error checks; documentation of procedure; does not vary significantly  Verifiability: quality control measures; data accuracy 4

Data Collection Strategies: Output School Turnaround  5 30 at-risk students will begin participation in the School Turnaround Initiative. Upon referral, student information will be collected and on a daily basis, members will track the time spent with each student, as well as the type of intervention administered, using an online Intervention/Time Log.  371 at-risk students will complete participation in the School Turnaround Initiative, receiving a minimum of 10 hours of intervention during the academic year. On a daily basis, members will track the time spent with each student, as well as the type of intervention administered, using an online Intervention/Time Log. 5

Data Collection Strategies: Tools Intervention/Time Log 6

Data Collection Strategies: Tools Intervention Hours Report 7

Data Collection Strategies: Tools Intervention Hours Report 8

Data Collection Strategies: Outcomes School Turnaround  220 (60%) of students will demonstrate increased academic engagement based on one or more of the following factors: increased attendance rate by at least 5%, decreased disciplinary referrals by at least 10%, increased interest in school by at least 20%, improved perspective on school climate by at least 20%, increased attachments to school by at least 20%, increased educational aspirations by at least 20%, and/or achievement of grade level or gaining 2 levels as measured by standardized District-based Kindergarten Math and Kindergarten Reading Assessments (KMA and KRA); District-Based Assessments (DBAs) for grades 1-12; Fountas and Pinnell assessments (grades K-2), and the math and Literacy ANet assessments (grades 3-8). 9

Data Collection Strategies: Outcomes School Turnaround  Attendance, Behavior, Academic Assessments: Data sharing as part of partnership agreement with Springfield Public Schools  Academic Engagement: Pre/Post Student Engagement Surveys Measures interest, perspective, attachment aspirations Pre-test administered by end of October; post in June Google Drive K-3, 4-12 Members administer 10

Data Collection Strategies: Outcomes Student Engagement Surveys: Google Drive 11

Data Collection Strategies 12  Validity: collecting the right data for what we want to measure  Completeness: every member at every site responsible for same data collection; program staff monitor data sheets on a monthly basis  Consistency: same tools for documentation across members/schools; members trained on data collection methods  Accuracy: provide training on procedure to collect and review data; documentation of collection monthly/end of year  Verifiability: data directly from SPS Data Warehouse

Data Collection Strategies 13  Ensure data being collected and analyzed in time to include in progress reports in March (midyear) and October (end of year) Keeps you on track and allows staff to submit progress reports on time  Documentation of all collected data and appropriate storage

Continuous Improvement 14 To ensure the program makes an effort to evaluate the quality of its service activities on an ongoing basis, which includes involving extensive broad-based representation from the following: the community served, members and potential members, site partners, community-based agencies with a demonstrated record in providing services, foundations, and businesses.

Continuous Improvement  Formal methods to gauge member, recipient, partner, stakeholder satisfaction  Quarterly feedback forms (Google Drive)  Site Visit Schedule (Site Visit Review Form)  Evaluations of orientations/trainings/member meetings  Journals  Mid-Year Member Evaluations  Exit Interview and End of Year Survey  Post Student Engagement Survey: questions on impact of AmeriCorps program  SWOT analyses  Internal/External Evaluations  Site Supervisor Meetings

Continuous Improvement  Systems to share information with stakeholders/community  Regular meetings  updates  Newsletter  Press releases  Participation on committees, boards, etc.

Continuous Improvement  Utilizing Feedback  Program/process improvements Member involvement in school-based PD  Training/development opportunities: members and site supervisors Implementing trainings identified in need assessments or at meetings ands site visits  Interventions Offer more options based on student needs, data