1. Florida Department of Education’s Florida Department of Education’s Teacher Evaluation System Student Learning Growth

2. Established by Student Success Act (SB 736) Teacher Evaluation System Evaluation Criteria for All Instructional Personnel and School Administrators – Professional Practice – Student Learning Growth JTEC & Principal Evaluation Committee

3. Apply Weights IP = 60% SLG = 40% Apply Weights IP = 60% SLG = 40% Instructional Practice (IP) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Instructional Practice (IP) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Student Learning Growth (SLG) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Student Learning Growth (SLG) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Final Rating HE Eff NI U Final Rating HE Eff NI U Established by Student Success Act (SB 736) Teacher Evaluation System

4. VAM & Student Learning Growth Contribution to a change in a student’s achievement Calculated from a measure of student learning growth

5. What is the Student Learning Growth Score? The difference between Current test score and Predicted test score What is the Predicted Student Score?

6. It is score you would predict a student to achieve based on the student’s performance on prior tests and other information available on the student

7. FLDOE Value-Added Model Variables determining predicted score Two or more years of prior achievement scores Gifted status Class size Student Attendance (Days) Mobility (number of transitions) Difference from modal age in grade (indicator of retention) The number of subject-relevant courses in which the student is enrolled Homogeneity of entering test scores in the class

8. FLDOE Value-Added Model Variables determining predicted score Students with Disabilities (SWD) status – Language impaired – Hearing impaired – Visually impaired – Emotional/behavioral – Specific learning disability – Dual sensory impaired – Autism spectrum disorder – Traumatic brain injury – Other health impaired – Intellectual disability English Language Learner (ELL) status – LY

9. FLDOE Value-Added Model Variables not determining predicted score Gender Race Ethnicity Socioeconomic status

10. What is the Student Learning Growth Score? Predicted - Current

11. FLDOE Value-Added Model Variables determining student learning growth TERMS District Data Base of All Student Records

12. What is the Predicted Student Score? CURRENT TEST PRIOR TEST …100 200 300 400 500 600 700 800 900 1000… (FY10 FCAT) (FY11 FCAT)

13. What is the Predicted Student Score? CURRENT TEST PRIOR TEST 900 800 700 (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

14. What is the Predicted Student Score? CURRENT TEST PRIOR TEST 900 800 700 600 500 400 300 (FY10 FCAT) W (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

15. What is the Predicted Student Score? CURRENT TEST PRIOR TEST 900 800 700 600 500 400 300 PREDICTED SCORE 600 Answer: Average of current scores of similar students (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

16. Student Learning Growth is the Amount Above or Below Predicted Score CURRENT TEST PRIOR TEST 900 800 700 600 500 400 300 PREDICTED SCORE 600 Above Predicted Score Below Predicted Score ACTUAL SCORE (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

17. CURRENT TEST PRIOR TEST CURRENT TEST PRIOR TEST 10 20 30 40 50 60 70 80 90 100… Based on Prior Achievement OnlyBased on Prior Achievement & ELL What is the Predicted Student Score? Based on Prior Achievement 400 50 600 800 70 90 Each prior year test score has a Predicted current year test score. (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

18. FLDOE Value-Added Model Variables determining student learning growth Two or more years of prior achievement scores Attendance Mobility (number of transitions) Difference from modal age in grade (indicator of retention) Class size The number of subject- relevant courses in which the student is enrolled Homogeneity of entering test scores in the class LY Gifted status Language impaired Hearing impaired Visually impaired Emotional/behavioral Specific learning disability Dual sensory impaired Autism spectrum disorder Traumatic brain injury Other health impaired Intellectual disability

19. Reading Grade 7 Indicators Ranked By Statistical Significance IndicatorT-Statistic Achievement: Prior Year75.667 Achievement: Two Prior Years38.167 Enrolled in 2 or more courses18.354 Difference from Modal Age15.977 Attendance13.571 Number of students in Class 18.439 Homogeneity of Class 2 Prior Year Test Scores7.182 Language Impaired5.362 Specific Learning Disability5.013 Homogeneity of Class 1 Prior Year Test Scores4.750 ELL Indicator4.673 Homogeneity of Class 3 Prior Year Test Scores3.188 Number of students in Class 52.385 Enrolled in 2 or more class periods2.289 Mobility: Number of School Transfers2.271 Intellectual Disability2.141

20. Illustrative Growth Points All other variables being equal VariablesGrowth Points* Typical100 ELL100 more Low Attendance100 points less *adapted from AIR materials presented at August 2, 2011,meeting These are illustrative values, not actual values

21. CURRENT TEST PRIOR TEST CURRENT TEST PRIOR TEST 10 20 30 40 50 60 70 80 90 100… Based on Prior Achievement OnlyBased on Prior Achievement & ELL What is the Predicted Student Score? 400 50 600 800 70 90 (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

22. CURRENT TEST PRIOR TEST CURRENT TEST PRIOR TEST Based on Prior Achievement OnlyBased on Prior Achievement & ELL What is the Predicted Student Score? 400 500 600 800 700 900 (FY10 FCAT) (FY11 FCAT) (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

23. CURRENT TEST PRIOR TEST CURRENT TEST PRIOR TEST Based on Prior Achievement OnlyBased on Prior Achievement & Low Attendance What is the Predicted Student Score? 400 300 600 800 500 700 (FY10 FCAT) (FY11 FCAT) (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

24. How to calculate the student learning growth score? CURRENT TEST PRIOR TEST DRE The diagonal line is the predicted growth observed among similar students. (FY10 FCAT) (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000…

25. How to calculate the student learning growth score? CURRENT TEST PRIOR TEST StudentPYCYPredGrowth A200300400-100 B305545 10 C40 50-10 D507060 10 DRE (FY10 FCAT) (FY11 FCAT) FY10 FY11 FY11 FY11 FCAT FCAT …100 200 300 400 500 600 700 800 900 1000…

26. How to calculate the student learning growth score? CURRENT TEST PRIOR TEST StudentPYCYPredGrowth A200300400-100 B C40 50-10 D507060 10 DRE (FY10 FCAT) (FY11 FCAT) FY10 FY11 FY11 FY11 FCAT FCAT 300 550450 100 W …100 200 300 400 500 600 700 800 900 1000…

27. How to calculate the student learning growth score? CURRENT TEST PRIOR TEST StudentPYCYPredGrowth A200300400-100 B300550450 100 C400 500-100 D507060 10 DRE (FY10 FCAT) (FY11 FCAT) FY10 FY11 FY11 FY11 FCAT FCAT ? ? ? ? Y …100 200 300 400 500 600 700 800 900 1000…

28. How to calculate the student learning growth score? CURRENT TEST PRIOR TEST StudentPYCYPredGrowth A200300400-100 B300550450 100 C400 500-100 D500700600 100 DRE (FY10 FCAT) (FY11 FCAT) FY10 FY11 FY11 FY11 FCAT FCAT …100 200 300 400 500 600 700 800 900 1000…

29. School Growth Score CURRENT TEST PRIOR TEST DRE StdtPYCYPredGrowth A200300400-100 B300550450 100 C400 500-100 D500700600 100 E200300400- 100 F300550450 100 G400750500250 H500700600 100 I200300400-100 J300250450- 200 K400 500-100 L500700600 100 (FY10 FCAT) (FY11 FCAT) FY10 FY11 FY11 FY11 FCAT FCAT …100 200 300 400 500 600 700 800 900 1000…

30. Calculating Teacher Value-Added Score Part 1 DRE Student Growth Scores Teacher EffectSchool Component

31. Teacher VAM

32. FLDOE Teacher Value-Added Score Conceptual.5 + ( X ) = DRE () Teacher Effect School Component

33. A Real Picture is Worth a Thousand Words

34. SDPBC Teacher VAM (Grade 5 Subject: Reading) Mean = 3.3 N = 561 Class >= 10

35. State Teacher VAM (Grade 5 Subject: Reading) Mean = 0.1 N = 12182

36. Teacher VAM Distribution for Reading

37. What you need to receive a VAM score? Assigned students 10 or more students with a learning growth score Instructional job code – Reading/math – Class, school, district 37

38. Sample Elementary School ReadingMath Average Reading and Math ArtSchool Grade 1School Grade 4Assigned Reading Assigned

39. Sample Middle School ReadingMath Average Reading and Math English Assigned Science Assigned Math Assigned Art School

40. Sample High School ReadingMath Average Reading and Math English Assigned Science Assigned Math Assigned Art School

41. Teachers Get What Score? JTEC Teacher receives the value-added score based on the students assigned to them in TERMS who have a student growth score. – teacher < 10 students assigned to them who have a student growth score receive the school component score.

42. Teachers Get What Score? JTEC School indicates that the teacher receives the school component score. – Teacher assigned to one school receives school component score. – Teacher assigned to two schools receives the weighted average of the schools' component scores. – Teacher assigned to more than two schools receives District component score.

43. School Component

44. SDPBC School Component Grade 5 Subject: Reading Mean = 4.0 N = 120

45. State School Component Grade 5 Subject: Reading Mean = 0.02 N = 2082

46. School Component Distribution for Reading

47. Apply Weights IP = 60% SLG = 40% Apply Weights IP = 60% SLG = 40% Instructional Practice (IP) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Instructional Practice (IP) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Student Learning Growth (SLG) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Student Learning Growth (SLG) (4) Highly Effective (3) Effective (2) Needs Improvement (1) Unsatisfactory Final Rating HE Eff NI U Final Rating HE Eff NI U Established by Student Success Act (SB 736) Teacher Evaluation System

48. VAM and School Component Estimated Distributions Unsatisfactory (1) Needs Improvement (2) Effective (3) Highly Effective (4) 2%13%72%13%

49. Highly Effective (13%) Teachers in Florida

50. Effective (72%) Teachers in Florida

51. Needs Improvement (13%) Teachers in Florida

52. Unsatisfactory (2%) Teachers in Florida

53. Summary: Student Learning Growth State Mandated Student Learning Growth – Difference between current score and predicted score – Based on prior achievement and selected student characteristics

54. Summary: Student Learning Growth Some teachers get VAM score, which includes both teacher effect and school component Other teachers get school component score 72% teachers effective based on Student Learning Growth