Program Evaluation In addition to the school and district data the team routinely collected throughout the year, we also collected some project-wide… Implementation, continuous improvement, and evidence of effectiveness … data along the way. ALD4ALLALD4ALL 1

Program Evaluation Implementation: The project was successfully implemented because it did more than it said it would do. Continuous Improvement: The project continuously evolved and adapted to take advantage of new knowledge and opportunities. Evidence of Effectiveness: The project demonstrated its value by the lasting changes it spearheaded and/or helped to bring about. ALD4ALLALD4ALL 2

ALD4ALLALD4ALL 9 Program Evaluation System-wide Indicator Assessment Results from Inquiry Process School-by-School to get a sense of how good schools distribute effort, focus, and resources Process included open-coding and axial sorting techniques

ALD4ALLALD4ALL 9 Program Evaluation Program-wide indicator assessment of all included schools System-wide Indicator Assessment Results from Inquiry Process

Professional Learning Content 1.Content was relevant… 2.The content was organized and meaningful… 3.Content will be helpful to me in my role as an educator of diverse students… 4.The content will help me to improve how I teach or work with diverse students and families… 5.I will be able use the content to raise the my level of activity, advocacy, understanding, or quality of performance in the service of diverse students. Professional Learning Process 6.Facilitator(s) used engaging activities, strategies, or methods... 7.Facilitator(s) ensured that I was a participant in the process… 8.Good use of materials, visuals, and/or artifacts…. ALD4ALLALD4ALL 9 Program Evaluation

ALD4ALLALD4ALL 9 Professional Learning feedback results for 2014 – 2016 Note. N=144. Started gathering data using feedback forms in Generally highly positive feedback rate, but what else does it mean?

Teacher Self- Assessment Scales (TSAS) Online and paper questionnaire Based on NMTEACH (four domains) and Teacher Efficacy Schools receive a personalized report Provides results based on highs and lows for each element ALD4ALLALD4ALL 9 Program Evaluation

TSAS program-wide results for ALD4ALLALD4ALL 9 Program Evaluation

TSAS program-wide results for ALD4ALLALD4ALL 9 Program Evaluation ALD4ALL schools versus non-ALD4ALL TSAS dataset

TSAS program-wide results for ALD4ALLALD4ALL 9 Program Evaluation Example of trend lines using Domain 1

TSAS program-wide results for ALD4ALLALD4ALL 9 Program Evaluation Example of trend lines combining Spring and Fall 2015, using Domain 3 as an example.

TSAS program-wide PD-Related TSAS results for ALD4ALLALD4ALL 9 Program Evaluation Teacher Efficacy differences by participation in ALD4ALL Professional Learning activities.

TSAS program-wide results for ALD4ALLALD4ALL 9 Program Evaluation Just another view: Teacher Efficacy differences by participation in ALD4ALL Professional Learning activities.

30 ALD4ALL.org Website