Download presentation
Presentation is loading. Please wait.
Published byAmos Welch Modified over 9 years ago
1
Accountability Panel: Growth Analysis
2
Values Table and Frequency
3
Categorical Growth: Values Table Overview Accountability Panel subgroups defined the significance of categorical status changes by applying a rating of -2 to +2 for each possible status change outcome. These ratings have been averaged to determine the value for each status change outcome. The status improvement values table was then used to create and evaluate various scenarios of points applied to each value. Details Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. This analysis contains only Performance and Categorical Growth data. Target Growth data is not included. After further review of the Pass Plus category band, the determination was made that Pass Plus could only be -divided into 2 sub-groups rather than 3. Therefore, please note the data and analysis does not contain the “PP3” subgroup.
4
Categorical Growth: Values Table Status Improvement Table: Accountability Panel Ratings and Average Value Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2Pass Plus-3 -2 (-2, -2, -2) -1.7 (-2, -2, -1) -1.3 (-2, -1, -1)-0.3 (-1, 0, 0)+0.7 (0, +1, +1) Pass Plus-2-2 (-2, -2, -2) -1.7 (-2, -2, -1)-1 (-1, -1, -1)0 (0, 0, 0)+0.7 (0, +1, +1) Pass Plus -1-2 (-2, -2, -2) -1.7 (-2, -2, -1)-1 (-1, -1, -1)0 (0, 0, 0)+0.7 (0, +1, +1)+1.3 (+1, +1, +2) Pass-2-2 (-2, -2, -2) -1 (-1, -1, -1)0 (0, 0, 0)+0.7 (0, +1, +1)+1.7 (+1, +2, +2)+2 (+2, +2, +2) Pass-1-2 (-2, -2, -2) -1.3 (-2, -1, -1)0 (0, 0, 0)+0.7 (0, +1, +1) +1.7 (+1, +2, +2)+2 (+2, +2, +2) Did Not Pass-3-2 (-2, -2, -2)-1.3 (-2, -1, -1)-0.7 (-1, -1, 0)+0.3 (0, 0, +1)+1.7 (+1, +2, +2)+2 (+2, +2, +2) Did Not Pass-2-1.3 (-2, -1, -1)-0.7 (-1, -1, 0)+0.3 (0, 0, +1)+1 (+1, +1, +1)+2 (+2, +2, +2) Did Not Pass-1-1 (-1, -1, -1)+0.3 (0, 0, +1) +1.3 (+1, +1, +2)+2 (+2, +2, +2) **Points for consideration: DNP2-P1; PP1-PP3; PP3-P1
5
Categorical Growth: Values Table Status Improvement Table: Frequency Distribution Based on 2012-13 ISTEP Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2Pass Plus-3 Pass Plus-20000.01%0.20%1.08%0.26% Pass Plus -1000.04%0.97%5.92%8.80%0.99% Pass-200.00%0.87%8.54%15.29%6.35%0.22% Pass-10.00%0.04%6.93%16.65%6.98%0.81%0.01% Did Not Pass-30.02%0.65%12.06%4.82%0.59%0.03%0 Did Not Pass-20.03%0.21%0.39%0.01%***00 Did Not Pass-10.01%0.02%0.01%*** 00
6
Options for Point Allocations
7
Categorical Growth: Data Analysis Grade Distribution with Performance 40%-Growth 60% *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
8
Categorical Growth: Data Analysis Grade Distribution with Performance 50%-Growth 50% *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
9
Categorical Growth: Options for Point Allocations Four options have been created for Panel consideration. Each option has been evaluated with data from the 2011-12 and 2012-13 school years. Options can be categorized by two groups: A.Application of the Categorical Status Improvement growth component places focus on a student improving at least one category each year. a)See A1 b)See A2 B.Application of the Categorical Status Improvement growth component places focus on a student maintaining proficiency or improving at least one category each year. a)See B1 b)See B2
10
Categorical Growth: Option A(1) Description Remains completely true to original value table Uses 150 point scale and assigns points using a scalar model to fit values table (e.g., -2 = 0; -1.7 = 12.5; -1.3 = 25; -1 = 37.5; -0.3 = 62.5; 0 = 75, etc.) Assumptions +2 is valued at a premium, meaning 150 points (built-in bonus) +1 is full points (100) “Neutral” is mediocre—in other words, it is a C (75), except at the very high level Expectations This model sets the expectation that in order to receive full points, a student must either: -move up one level, if at the pass level; OR, -move up more than one level, if at the did not pass level; OR - remain at the highest category (Pass Plus 2) Since neutral (no movement) is a C, that translates into: if a school had all of its students go from Pass 1 to Pass 1 between years, it would get a C for growth
11
Categorical Growth: Option A(1) Pros and Cons PROS: -Easy to explain (scalar model)—point values don’t seem arbitrary -Remains 100% true to original value table -Requires growth (in other words, tells schools that in order to receive an A or B, there must be growth, regardless of where a student starts, even at the higher levels) -Highly aspirational CONS: -Does not fully reward growth across the did not pass categories -Requires growth, but in essence, sets up the expectation that all students can get to Pass Plus (for example: a student who starts 3 rd grade as a Did Not Pass 1 would need to be a Pass Plus by 8 th grade, moving up a category each year, in order for the school to get full points) -Devalues staying at high levels (e.g., Pass 2, Pass Plus 1, Pass Plus 2) -May be more aspirational than feasible (very difficult to achieve an A) -Inclusion of growth tends to have a negative impact on schools, especially when doing 60/40 weighting
12
Categorical Growth: Option A(1) Option A1 Points Opt A1Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2Pass Plus-3 Pass Plus-200012.537.575100 Pass Plus -100012.55075100 Pass-200037.575100137.5 Pass-1002575100137.5150 Did Not Pass-302575100137.5150 Did Not Pass-2255087.5112.5150 Did Not Pass-137.587.5125150
13
CASE STUDIES: Option A(1) Performance + Categorical Growth
14
SAMPLE SCHOOL A: OPTION A(1) JAMES T. KIRK ELEMENTARY SCHOOL Grade Span: PK-5 Location: Urban Demographics: 26% White; 36% Black; 21% Hispanic; 17% Other 91.1% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA69.9%99.2%69.9 Math68.0%99.2%68.0 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA66.182.074.1 Math75.578.977.2 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance69.0.5034.5Performance69.0.4027.6 Growth75.6.5037.8Growth75.6.6045.4 FINAL GRADE (Perf + Growth)72.3 (C)FINAL GRADE (Perf + Growth)73.0 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
15
SAMPLE SCHOOL B: OPTION A(1) MALCOLM REYNOLDS MIDDLE SCHOOL Grade Span: 7-8 Location: Rural Demographics: 98% White; 1% Hispanic; 1% Other 40.8% Free/Reduced Price Lunch 2013 Grade:B Performance SubjectPass RatePart. RatePoints E/LA79.2%99.4%79.2 Math85.6%100%85.6 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA68.873.371.0 Math75.177.776.4 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance82.4.5041.2Performance82.4.4033.0 Growth73.7.5036.9Growth73.7.6044.2 FINAL GRADE (Perf + Growth)78.1 (C)FINAL GRADE (Perf + Growth)77.2 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
16
SAMPLE SCHOOL C: OPTION A(1) J.L. PICARD ELEMENTARY SCHOOL Grade Span: PK-4 Location: Suburban Demographics: 76% White; 4% Black; 10% Hispanic; 10% Other 23.4% Free/Reduced Price Lunch 2013 Grade:A Performance SubjectPass RatePart. RatePoints E/LA90.6%100%90.6 Math90.5%100%90.5 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA74.368.671.4 Math69.370.169.7 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance90.6.5045.3Performance90.6.4036.2 Growth70.5.5035.3Growth70.5.6042.3 FINAL GRADE (Perf + Growth)80.6 (B)FINAL GRADE (Perf + Growth)78.5 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
17
SAMPLE SCHOOL D: OPTION A(1) TURANGA LEELA CHARTER ACADEMY Grade Span: K-8 Location: Urban Demographics: 2% White; 74% Black; 19% Hispanic; 5% Other 89.4% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA71.0%100%71.0 Math75.7%100%75.7 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA67.375.271.3 Math65.575.870.6 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance73.4.5036.7Performance73.4.4029.3 Growth70.9.5035.5Growth75.6.6042.6 FINAL GRADE (Perf + Growth)72.1 (C)FINAL GRADE (Perf + Growth)71.9 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
18
Categorical Growth: Option A(2) Description Makes slight changes to the value table: Staying at both Pass Plus levels is worth more than staying at Pass levels (in other words, starts to create different levels of “neutral”) Staying at Did Not Pass 3 category is slightly adjusted; in other words, staying at Did Not Pass 2 is a “worse” neutral than staying at Did Not Pass 3 Uses 125 point scale and assigns points using a flattened scalar model to fit modified values table (E.g. -2 = 0; -1.7 and -1.3 = 25; -0.7 = 70; 0 = 85; +0.3 and +0.7 = 100; +1 = 112.5; +1.3, +1.7, and +2 = 125) Assumptions Any positive movement is full points (100) Two category or more movement in the lower performance categories, and one category or more movement in the higher performance categories, are valued at a premium (more than 100 points) “Neutral” is not an A, but it’s better than mediocre—in other words, it is a B (85), except at the very high level
19
Categorical Growth: Option A(2) Expectations This model sets the expectation that in order to receive full points, a student must either: -move up one level, OR - remain at the highest category (Pass Plus 2) Since neutral (no movement) is a B, that translates into: if a school had all of its students go from Pass 1 to Pass 1 between years, it would get a B for growth
20
Categorical Growth: Option A(2) Pros and Cons PROS: -Remains fairly true to original value table -Recognizes growth across all categories -Requires growth (in other words, tells schools that in order to receive an A or B, there must be growth, regardless of where a student starts, even at the higher levels) -Can have a slight positive impact on mid-level performing schools (i.e., schools that would be C or D schools based on performance) CONS: -Can depress grades for higher performing schools -Requires growth, but still sets up the expectation that all students can get to Pass Plus (for example: a student who starts 3 rd grade as a Did Not Pass 1 would need to be a Pass Plus by 8 th grade, moving up a category each year, in order for the school to get full points) -Still somewhat devalues staying at high levels (e.g., Pass 2, Pass Plus 1, Pass Plus 2) -Impact of growth is primarily neutral, even with weighting (in other words, schools’ grades don’t really change when including growth), ALTHOUGH can have a slight negative impact for higher performing schools
21
Categorical Growth: Option A(2) Option A2 Points Opt A2Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2 Pass Plus-3 Pass Plus-2000507085100 Pass Plus -10005070100112.5 Pass-20007085100112.5 Pass-1007085100112.5125 Did Not Pass-305070100125 Did Not Pass-22550100125 Did Not Pass-150100112.5125
22
CASE STUDIES: Option A(2) Performance + Categorical Growth
23
SAMPLE SCHOOL A: OPTION A(2) JAMES T. KIRK ELEMENTARY SCHOOL Grade Span: PK-5 Location: Urban Demographics: 26% White; 36% Black; 21% Hispanic; 17% Other 91.1% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA69.9%99.2%69.9 Math68.0%99.2%68.0 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA83.680.382.0 Math85.980.683.2 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance69.0.5034.5Performance69.0.4027.6 Growth82.6.5041.3Growth82.6.6049.6 FINAL GRADE (Perf + Growth)75.8 (C)FINAL GRADE (Perf + Growth)77.2 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
24
SAMPLE SCHOOL B: OPTION A(2) MALCOLM REYNOLDS MIDDLE SCHOOL Grade Span: 7-8 Location: Rural Demographics: 98% White; 1% Hispanic; 1% Other 40.8% Free/Reduced Price Lunch 2013 Grade:B Performance SubjectPass RatePart. RatePoints E/LA79.2%99.4%79.2 Math85.6%100%85.6 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA84.680.182.4 Math90.886.488.6 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance82.4.5041.2Performance82.4.4033.0 Growth85.5.5042.7Growth85.5.6051.3 FINAL GRADE (Perf + Growth)83.9 (B)FINAL GRADE (Perf + Growth)84.3 (B) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
25
SAMPLE SCHOOL C: OPTION A(2) J.L. PICARD ELEMENTARY SCHOOL Grade Span: PK-4 Location: Suburban Demographics: 76% White; 4% Black; 10% Hispanic; 10% Other 23.4% Free/Reduced Price Lunch 2013 Grade:A Performance SubjectPass RatePart. RatePoints E/LA90.6%100%90.6 Math90.5%100%90.5 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA86.081.883.9 Math89.279.684.4 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance90.6.5045.3Performance90.6.4036.2 Growth84.2.5042.1Growth84.2.6050.5 FINAL GRADE (Perf + Growth)87.4 (B)FINAL GRADE (Perf + Growth)86.7 (B) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
26
SAMPLE SCHOOL D: OPTION A(2) TURANGA LEELA CHARTER ACADEMY Grade Span: K-8 Location: Urban Demographics: 2% White; 74% Black; 19% Hispanic; 5% Other 89.4% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA71.0%100%71.0 Math75.7%100%75.7 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA83.477.580.5 Math81.779.380.5 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance73.4.5036.7Performance73.4.4029.3 Growth80.5.5040.2Growth80.5.6048.3 FINAL GRADE (Perf + Growth)76.9 (C)FINAL GRADE (Perf + Growth)77.6 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
27
Categorical Growth: Option B(1) Description Slightly adjusts values table and increases scale Established intervals of increasing points across the pass proficiency levels (e.g., Pass 1 to Pass 1 is 0; Pass 2 to Pass 2 is.1; Pass Plus 1 to Pass Plus 1 is.2; Pass Plus 2 to Pass Plus 2 is.3) Established intervals of decreasing points across the did not pass proficiency levels (e.g., Did Not Pass 3 to Did Not Pass 3 is -.7; Did Not Pass 2 to Did Not Pass 2 is -1; Did Not Pass 1 to Did Not Pass 1 is -1.3) Uses 190 point scale and assigns points using a formula: (Value + 2) * adjustment rate = points, where value = adjusted value on values table; adjustment rate = 47.5; therefore, “neutral” (0) is 95 Assumptions Any positive movement is worth full points or a premium (100 or higher) Two category or more movement is considered exceptional; staying proficient is not only acceptable, but it is valued “Neutral” is an A
28
Categorical Growth: Option B(1) Expectations This model sets the expectation that in order to receive 95 or more points (“A” level), a student must either: - stay at a passing level (i.e., Pass 1 or higher), OR - increase one level in the Did Not Pass categories Since neutral (no movement) is an A, that translates into: if a school had all of its students go from Pass 1 to Pass 1 between years, it would get an A for growth
29
Categorical Growth: Option B(1) Pros and Cons PROS: -Highly rewards growth that occurs infrequently (i.e., movement across more than one category) -Provides more than full points for staying at high levels of proficiency -Recognizes the difficulty of bringing students up through the Did Not Pass categories (rewards more than full points for one category of improvement in the DNP categories) -Highly deincentivizes “negative” growth (dropping one or more category) -Growth is still somewhat neutral, but starts to have a positive impact (in other words, schools can increase by one or two letter grades after growth is added to performance) CONS: -190-point scale could be perceived as too many “bonus” points -Adjustments to values table could be considered arbitrary -Formula could be difficult to understand for the public
30
Categorical Growth: Option B(1) Option B1 Values Opt B1Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2Pass Plus-3 Pass Plus-2-2 -1.3-.7-.3.3 Pass Plus -1-2 -.5.2.7 Pass-2-2 -.7.1.71.7 Pass-1-2 0.71.72 Did Not Pass-3-2-1.5-.7.31.722 Did Not Pass-2-1.7.31.3222 Did Not Pass-1-1.3.31.32222 Option B1 Points Opt B1Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2Pass Plus-3 Pass Plus-200033.2561.7580.75109.25 Pass Plus -100047.571.25104.5128.25 Pass-200061.7599.75128.25175.75 Pass-10047.595128.25175.75190 Did Not Pass-3023.7561.75109.25175.75190 Did Not Pass-214.2547.5109.25156.75190 Did Not Pass-133.25109.25156.75190
31
CASE STUDIES: Option B(1) Performance + Categorical Growth
32
SAMPLE SCHOOL A: OPTION B(1) JAMES T. KIRK ELEMENTARY SCHOOL Grade Span: PK-5 Location: Urban Demographics: 26% White; 36% Black; 21% Hispanic; 17% Other 91.1% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA69.9%99.2%69.9 Math68.0%99.2%68.0 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA96.681.689.1 Math91.778.785.2 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance69.0.5034.5Performance69.0.4027.6 Growth87.2.5043.6Growth87.2.6052.3 FINAL GRADE (Perf + Growth)78.1 (C)FINAL GRADE (Perf + Growth)79.9 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
33
SAMPLE SCHOOL B: OPTION B(1) MALCOLM REYNOLDS MIDDLE SCHOOL Grade Span: 7-8 Location: Rural Demographics: 98% White; 1% Hispanic; 1% Other 40.8% Free/Reduced Price Lunch 2013 Grade:B Performance SubjectPass RatePart. RatePoints E/LA79.2%99.4%79.2 Math85.6%100%85.6 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA93.779.686.6 Math100.589.995.2 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance82.4.5041.2Performance82.4.4033.0 Growth90.9.5045.5Growth90.9.6054.5 FINAL GRADE (Perf + Growth)86.7 (B)FINAL GRADE (Perf + Growth)87.5 (B) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
34
SAMPLE SCHOOL C: OPTION B(1) J.L. PICARD ELEMENTARY SCHOOL Grade Span: PK-4 Location: Suburban Demographics: 76% White; 4% Black; 10% Hispanic; 10% Other 23.4% Free/Reduced Price Lunch 2013 Grade:A Performance SubjectPass RatePart. RatePoints E/LA90.6%100%90.6 Math90.5%100%90.5 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA92.185.488.7 Math100.081.990.9 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance90.6.5045.3Performance90.6.4036.2 Growth89.8.5044.9Growth89.8.6053.9 FINAL GRADE (Perf + Growth)90.2 (A)FINAL GRADE (Perf + Growth)90.1 (A) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
35
SAMPLE SCHOOL D: OPTION B(1) TURANGA LEELA CHARTER ACADEMY Grade Span: K-8 Location: Urban Demographics: 2% White; 74% Black; 19% Hispanic; 5% Other 89.4% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA71.0%100%71.0 Math75.7%100%75.7 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA90.873.382.0 Math88.180.984.5 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance73.4.5036.7Performance73.4.4029.3 Growth83.2.5041.6Growth83.2.6049.9 FINAL GRADE (Perf + Growth)78.3 (C)FINAL GRADE (Perf + Growth)79.2 (C) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
36
Categorical Growth: Option B(2) Description Slightly adjusts values table and increases scale Established intervals of increasing points across the pass proficiency levels (e.g., Pass 1 to Pass 1 is 0; Pass 2 to Pass 2 is.1; Pass Plus 1 to Pass Plus 1 is.2; Pass Plus 2 to Pass Plus 2 is.3) Established intervals of decreasing points across the did not pass proficiency levels (e.g., Did Not Pass 3 to Did Not Pass 3 is -.7; Did Not Pass 2 to Did Not Pass 2 is -1; Did Not Pass 1 to Did Not Pass 1 is -1.3) Uses 200 point scale and assigns points using a formula: (Value + 2) * adjustment rate = points, where value = adjusted value on values table; adjustment rate = 45 if below passing, or 50 if at passing; therefore, “neutral” (0) is 100 Assumptions Any positive movement or staying at a passing level is full points or more (100 or more) Two category or more movement is considered exceptional; staying proficient is not only acceptable, but it is valued “Neutral” is an A (full points)
37
Categorical Growth: Option B(2) Expectations This model sets the expectation that in order to receive 100 or more points (“A” level), a student must either: - stay at a passing level (i.e., Pass 1 or higher), OR - increase one level in the Did Not Pass categories Since neutral (no movement) is full points, that translates into: if a school had all of its students go from Pass 1 to Pass 1 between years, it would get an A for growth
38
Categorical Growth: Option B(2) Pros and Cons PROS: -Highly rewards growth that occurs infrequently (i.e., movement across more than one category) -Provides more than full points for staying at high levels of proficiency -Recognizes the difficulty of bringing students up through the Did Not Pass categories (rewards more than full points for one category of improvement in the DNP categories) -Highly deincentivizes “negative” growth (dropping one or more category) -Growth has more positive influence, with more schools moving up one or two categories CONS: -200-point scale could be perceived as too many “bonus” points -Adjustments to values table could be considered arbitrary -Formula could be difficult to understand for the public
39
Categorical Growth: Option B(2) Option B2 Values B2Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2Pass Plus-3 Pass Plus-2-2 -1.3-.7-.3.3 Pass Plus -1-2 -.5.2.7 Pass-2-2 -.7.1.71.7 Pass-1-2 0.71.72 Did Not Pass-3-2-1.5-.7.31.722 Did Not Pass-2-1.7.31.3222 Did Not Pass-1-1.3.31.32222 Option B2 Points B2Current Year Level Previous Year LevelDid Not Pass-1Did Not Pass-2Did Not Pass-3Pass-1Pass-2Pass Plus-1Pass Plus-2Pass Plus-3 Pass Plus-2000356585115 Pass Plus -10005075110135 Pass-200065105135185 Pass-10045100135185200 Did Not Pass-3022.558.5115185200 Did Not Pass-213.545103.5165200 Did Not Pass-131.5103.5148.5200
40
CASE STUDIES: Option B(2) Performance + Categorical Growth
41
SAMPLE SCHOOL A: OPTION B(2) JAMES T. KIRK ELEMENTARY SCHOOL Grade Span: PK-5 Location: Urban Demographics: 26% White; 36% Black; 21% Hispanic; 17% Other 91.1% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA69.9%99.2%69.9 Math68.0%99.2%68.0 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA95.878.086.9 Math101.079.590.2 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance69.0.5034.5Performance69.0.4027.6 Growth88.6.5044.3Growth88.6.6053.2 FINAL GRADE (Perf + Growth)78.8 (C)FINAL GRADE (Perf + Growth)80.8 (B) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
42
SAMPLE SCHOOL B: OPTION B(2) MALCOLM REYNOLDS MIDDLE SCHOOL Grade Span: 7-8 Location: Rural Demographics: 98% White; 1% Hispanic; 1% Other 40.8% Free/Reduced Price Lunch 2013 Grade:B Performance SubjectPass RatePart. RatePoints E/LA79.2%99.4%79.2 Math85.6%100%85.6 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA98.480.589.4 Math105.792.899.2 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance82.4.5041.2Performance82.4.4033.0 Growth94.3.5047.2Growth94.3.6056.6 FINAL GRADE (Perf + Growth)88.4 (B)FINAL GRADE (Perf + Growth)89.6 (B) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
43
SAMPLE SCHOOL C: OPTION B(2) J.L. PICARD ELEMENTARY SCHOOL Grade Span: PK-4 Location: Suburban Demographics: 76% White; 4% Black; 10% Hispanic; 10% Other 23.4% Free/Reduced Price Lunch 2013 Grade:A Performance SubjectPass RatePart. RatePoints E/LA90.6%100%90.6 Math90.5%100%90.5 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA105.283.994.5 Math96.987.992.4 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance90.6.5045.3Performance90.6.4036.2 Growth93.5.5046.7Growth93.5.6056.1 FINAL GRADE (Perf + Growth)92.0 (A)FINAL GRADE (Perf + Growth)92.3 (A) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
44
SAMPLE SCHOOL D: OPTION B(2) TURANGA LEELA CHARTER ACADEMY Grade Span: K-8 Location: Urban Demographics: 2% White; 74% Black; 19% Hispanic; 5% Other 89.4% Free/Reduced Price Lunch 2013 Grade:D Performance SubjectPass RatePart. RatePoints E/LA71.0%100%71.0 Math75.7%100%75.7 Categorical Growth SubjectTop 75%Bottom 25%Points E/LA94.971.983.4 Math92.281.486.8 Combined (50/50)PointsWeightScoreCombined (60/40)PointsWeightScore Performance73.4.5036.7Performance73.4.4029.3 Growth85.1.5042.5Growth85.1.6051.1 FINAL GRADE (Perf + Growth)79.2 (C)FINAL GRADE (Perf + Growth)80.4 (B) *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
45
Data Summary
46
Categorical Growth: Data Analysis 2013 OverallPerf 40/Growth 602013 OverallPerf 50/Growth 50 Performance Only Performance with Growth Performance Only Performance with Growth Option A(1) Option A(2) Option B(1) Option B(2) Current A-F Model Option A(1) Option A(2) Option B(1) Option B(2) Current A-F Model A36824218669841672A36837244611752672 B678573988644511321B678695926659559321 C343816308196159277C343687323224190277 D117118302826182D117110443932182 F4419613 98F44211317 98 2012 OverallPerf 40/Growth 602012 OverallPerf 50/Growth 50 Performance Only Performance with Growth Performance Only Performance with Growth Option A(1) Option A(2) Option B(1) Option B(2) Current A-F Model Option A(1) Option A(2) Option B(1) Option B(2) Current A-F Model A3284175565701620A3288207520644620 B628503931653575275B628610878652581275 C404850380261207315C404746385295246315 D12717155 51211D127158646661211 F64231017 130F6429171819130 *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
47
Categorical Growth: Data Analysis 2013 OverallPerf 40/Growth 602013 OverallPerf 50/Growth 50 Movement with Growth Category MovementOption A(1)Option A(2)Option B(1)Option B(2) Category MovementOption A(1)Option A(2)Option B(1)Option B(2) -232000-24000 7711655166413651 0656105685166808021145952780 191320664829180267582749 20930522021120 2012 OverallPerf 40/Growth 602012 OverallPerf 50/Growth 50 Movement with Growth Category MovementOption A(1)Option A(2)Option B(1)Option B(2) Category MovementOption A(1)Option A(2)Option B(1)Option B(2) -236000-25000 7511637368212963 0676105588571007911132985812 188326646810173286553728 207132820478 *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
48
Categorical Growth: Data Analysis Grade Distribution with Performance 40%-Growth 60% *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
49
Categorical Growth: Data Analysis Grade Distribution with Performance 50%-Growth 50% *Information evaluated is preliminary. The evaluation has been based on temporary cut scores for sub-categories that will be vetted and altered throughout the process. Final data may differ. **This analysis contains only Performance and Categorical Growth data. Target Growth data is not included.
50
Recommendations
51
Categorical Growth: Recommendations Which option best reflects the Panel’s vision of Categorical Growth? What modifications, if any, should be applied to the selected option? Additional considerations?
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.