1. Elliott Asp Special Assistant to the Commissioner Colorado Department of Education Assistant Superintendent Cherry Creek Schools Reflections on “Student Outcomes Component” ACEE February 15, 2013

2. Together We Can 2 Vision All students in Colorado will become educated and productive citizens capable of succeeding in a globally competitive workforce. Mission The mission of CDE is to shape, support, and safeguard a statewide education system that prepares all students for success in a globally competitive world.

3. Successful students Prepare students to thrive in their education and in a globally competitive workforce.  Ensure every student is on track to graduate postsecondary and workforce ready.  Increase achievement for all students and close achievement gaps.  Ensure students graduate ready for success in postsecondary education and the workforce.  Increase national and international competitiveness for all students. Great teachers and leaders Ensure effective educators for every student and effective leaders for every school and district.  Increase and support the effectiveness of all educators.  Optimize the preparation, retention, and effectiveness of new educators.  Eliminate the educator equity gap. Outstanding schools and districts Build the capacity of schools and districts to meet the needs of Colorado students and their families.  Increase school and district performance.  Turnaround the state’s lowest performing districts and schools.  Foster innovation and expand access to a rich array of high quality school choices for students. Best education system in the nation Build the best education system in the nation.  Lead the nation in policy, innovation, and positive outcomes for students.  Operate with excellence, efficiency, and effectiveness to become the best SEA in the nation.  Attract and retain outstanding talent to CDE. Goals Students Educators Schools/ Districts State 3

4. Overview  Clarify “assessment vocabulary”  Frame the process of specifying and measuring student outcomes  Share an example of how a district might approach the “student outcomes component” for principals  Reflect on the “Guidance” document and process  Share ideas and processes for developing teacher and district student outcomes ratings

5. Assessment Vocabulary: Place/source  Teacher developed  Classroom  School  Common (across grade/dept., school, district)  Vendor  District  State  National

6. Assessment Vocabulary: Time/Sequence  Pre  Post  On-the-spot  Frequent  Daily  Weekly  Short cycle  Interim  End-of-Unit  End-of-Course  End-of-Year  Mid-term  Final

7. Assessment Vocabulary: Purpose “Assessment is as assessment does”  Diagnostic  Formative  Benchmark  Anchor/calibration  Predictive  Summative  Growth

8. Assessment Vocabulary: Formative  Inform instruction  Provide meaningful feedback to students about progress towards learning targets  Non-evaluative  Specific  Actionable  Process vs instrument  Methods  Questioning  Feedback (self/peer/teacher)  Lots of strategies

9.  Current system is not “highly effective” (not be “partially effective”)  Takes time to do this well, some folks don’t understand this  Caught between rock and a hard spot  Policy makers, the law, reform groups vs psychometric issues, feasibility…..  Process is complex, beyond the understanding of most practitioners and policy measures  Instructional value of assessments vs technical quality is a long-standing issue  Bringing teachers together to talk about “Student Learning Outcomes” (or growth) and how to measure it is a useful thing Issues 9

10.  Will need to emphasize collective attributions vs individual to begin  This is not without “political” consequences  Moving toward valid and reliable may need to start with logical process that is transparent  This process will be arbitrary, but should not be capricious Issues 10

11. Student Learning Outcomes 11

12. Student Learning Outcomes 12

13. Student Learning Outcomes 13

14. Student Learning Outcomes 14

15. DEPARTMENT OF EDUCATION Colorado State Board of Education RULES FOR ADMINISTRATION OF A STATEWIDE SYSTEM TO EVALUATE THE EFFECTIVENESS OF LICENSED PERSONNEL EMPLOYED BY SCHOOL DISTRICTS AND BOARDS OF COOPERATIVE SERVICES 1 CCR 301-87

17. Requirements for Principal “Growth Standard” Data from the school performance framework At least one other measure of student academic growth Measure growth of students in all subjects and grades Assure that assessments are valid and reliable Involve principals in discussion of measures

18. First Steps: Process Incorporating Student Outcomes Data into Educator Effectiveness Ratings Review the law, rules, and the assurances Review of literature and research (ongoing) Discussion with other metro area districts and professional educational measurement organizations (ongoing) Create guiding principles (ongoing)

19. First Steps: Process Incorporating Student Outcomes Data into Educator Effectiveness Ratings Review of “Guidance Document” Create multiple principal and teacher evaluation frameworks for a School Student Outcomes Index Examine results of multiple models for principal evaluation Discussion of progress with Educational Operations Initial discussion of progress with AdC0 – February

20. A CCSD System for Incorporating Student Outcomes into Principal Evaluation Will: Reflect district goals of excellence and equity Encourage professional collaboration and mutual capacity‐building among educators Incentivize effective educators to seek positions in lower performing schools Guiding Principles for our Work

21. A CCSD System for Incorporating Student Outcomes into Principal Evaluation Will: Be clearly understandable, employing data readily available from existing reporting systems Create support for shared ownership of student progress Comply with State rules and assurances to the best of our ability Guiding Principles for our Work

22. Overall Principal Effectiveness Rating

23. Draft Framework for School Student Outcomes Index Data Sources and Proportions of Contribution EXCELLENCEEQUITY Shared District Attribution School Demographics Data Source: District DPF ratingSPF plan rating KPI growth for students of color Impact factor Focus: How the State perceives the district, overall How the State perceives the school, overall Overall school growth goals for students of color Factors outside the school that can impact student performance Measure/ Metric: State-assigned accreditation ranges State-assigned school plan & % points earned Overall growth‐TCAP MGP (students of color only) Current elementary “risk factor index” Weights (=100%) TBD

24. Sample Student Outcomes Index: Categories School student outcome categories will be derived from our district KPIs and SPFs from the State. Much less than Expected Less than Expected More than Expected

25. Draft Decision Making Matrix Professional Practices Rating Exemplary Partially Effective Highly Effective Highly Effective Accomplished Partially Effective ProficientIneffective Partially Effective Not Evident/ Partially Proficient Ineffective Partially Effective Student Outcomes Index Much Less Than Expected Less Than Expected Above Expected

26. Next Steps Incorporating Student Outcomes Data into Educator Effectiveness Ratings Finalize principal evaluation framework and weightings for each data source Finalize Student Outcomes Index ranges for principal evaluation Create and verify final principal evaluation model with 2012 CCSD school data, level directors, and pilot principals Make relevant research and literature available to all Continue to study guidance documents from CDE

27. Next Steps Incorporating Student Outcomes Data into Educator Effectiveness Ratings Continue communication with EdOp and AdCo Continue work on parallel model for teacher evaluation Share progress with AdCo in April Create and verify final teacher evaluation model with 2012 CCSD school data, level directors, and pilot principals

28.  What questions/comments/feedback do you have in regard to the “Guidance” document and the process you experienced today?  How is your district thinking about/planning to and/or proceeding in defining the student outcomes component of the educator effectiveness ratings? Small Group Discussion 28

29. Elliott Asp Special Assistant to the Commissioner Colorado Department of Education Reflections on “Student Outcomes Component” ACEE February 15, 2013