SGP Logic Model Provides a method that enables SGP data to contribute to performance evaluation when data are missing. The distribution of SGP data combined.

Slides:



Advertisements
Similar presentations
The SCPS Professional Growth System
Advertisements

Connecting Teacher Evaluation to Student Academic Progress Implementing Standard 7 0 August 2012.
District Determined Measures
Virginia Teacher Performance Evaluation System 0 August 2012.
Student Learning Targets (SLT) You Can Do This! Getting Ready for the School Year.
Student Growth Percentiles (SGP): A Comparison of Legislative Intent with Implemented Results at one Utah School (Timpanogos Academy)
Student Growth Percentile Model Question Answered
1 New England Common Assessment Program (NECAP) Setting Performance Standards.
Implementing Virginia’s Growth Measure: A Practical Perspective Deborah L. Jonas, Ph.D. Executive Director, Research and Strategic Planning Virginia Department.
Student Growth Percentiles For Classroom Teachers and Contributing Professionals KDE:OAA:3/28/2014:kd:rls 1.
Overview of the Idaho Five Star Rating System Dr. TJ Bliss Director of Assessment and Accountability
Student Growth Percentile (SGP) Model
Other Measures of Student Academic Progress What should we know about how to include other measures of student academic progress? 0 August 2012.
Virginia Teacher Performance Evaluation System
0 Session 3 The APP Process for Reading and Writing.
99th Percentile 1st Percentile 50th Percentile What Do Percentiles Mean? Percentiles express the percentage of students that fall below a certain score.
Today’s website:
1 Connecting Principal Performance to Student Academic Progress February 2013.
Introduction to the Georgia Student Growth Model Student Growth Percentiles 1.
Dr. Michael Flicek Education Consultant October 8, 2013 Wyoming School Performance Rating Model Report to: Wyoming State Board of Education.
Connecting Principal Evaluation to Student Academic Progress Student Academic Progress Goals 1.
Classroom Assessment and Grading
Document Review STANDARDEVIDENCE Standard 1 - Professional KnowledgeDocumentation and Observation Standard 2 - Instructional PlanningDocumentation and.
Student Impact Rating Teacher Professional Growth and Effectiveness System Daviess County Public Schools.
How Can Teacher Evaluation Be Connected to Student Achievement?
1 New York State Growth Model for Educator Evaluation 2011–12 July 2012 PRESENTATION as of 7/9/12.
Update on Virginia’s Growth Measure Deborah L. Jonas, Ph.D. Executive Director for Research and Strategic Planning Virginia Department of Education July-August.
Adequate Yearly Progress (AYP) and Accountability Status Determinations.
Laying the Groundwork for the New Teacher Professional Growth and Effectiveness System TPGES.
SMARTR Goals for School-Based Administrators
Rating Teacher Performance on Standard 7 Using Student Achievement Goal Setting Greater than or equal to 50 percent of students exceeded the goal. Greater.
 Closing the loop: Providing test developers with performance level descriptors so standard setters can do their job Amanda A. Wolkowitz Alpine Testing.
Professional Performance Process Presented at March 2012 Articulation Meetings.
Comprehensive Educator Effectiveness: New Guidance and Models Presentation for the Special Education Advisory Committee Virginia Department of Education.
Comprehensive Educator Effectiveness: New Guidance and Models Presentation for the Virginia Association of School Superintendents Annual Conference Patty.
PERSONNEL EVALUATION SYSTEMS How We Help Our Staff Become More Effective Margie Simineo – June, 2010.
New York State Scores 2011—2012 School Year. Growth Ratings and Score Ranges Growth RatingDescriptionGrowth Score Range (2011–12) Highly EffectiveWell.
Steps for Using SGP Data in Performance Evaluation 1.Prepare and summarize data to show the number and percent of students demonstrating low growth, moderate.
Making Plans for the Future April 29, 2013 Brenda M. Tanner, Ed.D.
Standard Setting Results for the Oklahoma Alternate Assessment Program Dr. Michael Clark Research Scientist Psychometric & Research Services Pearson State.
Department of Secondary Education Program Assessment Report What We Assessed: Student Learning Outcomes (SLOs) and CA State Teaching Performance.
July 2 nd, 2008 Austin, Texas Chrys Dougherty Senior Research Scientist National Center for Educational Achievement Adequate Growth Models.
Primary Purposes of the Evaluation System
What you need to know about changes in state requirements for Teval plans.
Median Student Growth Percentile For Classroom Teachers and Contributing Professionals 1 ONGL-12/15/14.
Guidelines for Uniform Performance Standards and Evaluation Criteria for Teachers Virginia Department of Education Approved April 2011.
Summative Jeopardy Summing Up Summative Decision- Making.
Guidelines for Uniform Performance Standards and Evaluation Criteria for Teachers Virginia Department of Education Approved April 2011.
Principal Evaluation Code of Virginia states that: Principal evaluations be consistent with the 7 Standards set forth by the state.
Standardized Testing EDUC 307. Standardized test a test in which all the questions, format, instructions, scoring, and reporting of scores are the same.
Student Growth Measures ODU Leadership Conference June 19, 2014.
Copyright © 2014 American Institutes for Research and Cleveland Metropolitan School District. All rights reserved. March 2014 Interpreting Vendor Assessment.
KS2 SATs Presentation to parents 20 th April 2016.
Understanding How Evaluations are Calculated Professional Practices, Measures of Student Learning/ Outcomes- Calculating Scores & Translating SLOs/SOOs.
V: Maryland’s High School Assessments (HSAs) & the Bridge Plan for Academic Validation Overview.
PRINCIPAL STATE GROWTH SCORES / Principal Performance/Visit= 50 Student Performance=50.
Breakout Discussion: Every Student Succeeds Act - Scott Norton Council of Chief State School Officers.
1 New York State Growth Model for Educator Evaluation June 2012 PRESENTATION as of 6/14/12.
Every Student Succeeds Act (ESSA) Accountability
2016 Primary Assessment Update 27th September 2016
PARENTS’ INFORMATION SESSION -YEAR 6 SATS 2017
Key Stage 2 SATs Parent Presentation October 2017.
2015 PARCC Results for R.I: Work to do, focus on teaching and learning
Kentucky’s New Accountability Model
PARENTS’ INFORMATION SESSION -YEAR 6 SATS 2017
Standards Based Grading
Understanding How Evaluations are Calculated
School Improvement Ratings Rule 6A , F.A.C.
Assessment Literacy: Test Purpose and Use
BURNSIDE ACADEMY INSPIRES KS2 SATS Guidance for Parents
Presentation transcript:

SGP Logic Model Provides a method that enables SGP data to contribute to performance evaluation when data are missing. The distribution of SGP data combined with the amount of missing data determines the data’s utility. Use of the logic model may:  Result in a determination that contributes directly to the summative decision.  Narrow down the possible determination to support a summative evaluation.  Demonstrate that too much missing data is present to draw valid conclusions. Provides a method that enables SGP data to contribute to performance evaluation when data are missing. The distribution of SGP data combined with the amount of missing data determines the data’s utility. Use of the logic model may:  Result in a determination that contributes directly to the summative decision.  Narrow down the possible determination to support a summative evaluation.  Demonstrate that too much missing data is present to draw valid conclusions.

SGP LevelsSOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Passing scores (proficient or advanced) Total Students Total SGP Summary Tables: Example 1 SGP Levels (Percentages)SOL Proficiency Levels (Percentages) Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing Scores (proficient or advanced) Percentage of Total Students % 30%17%9% 30%61% 91%100% %40%36%12%28% 56%16% 72%100% Percent of Total 19%33% 15% 19% 44%38% 81%100% These tables illustrate how data from mathematics assessments for two years may be viewed to support making determinations based from SGP data. Some total percentages may not equal 100 percent due to rounding.

SGP LevelsSOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Passing scores (proficient or advanced) Total Students Total SGP Summary Tables: Example 1 SGP Levels (Percentages)SOL Proficiency Levels (Percentages) Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing Scores (proficient or advanced) Percentage of Total Students % 30%17%9% 30%61% 91%100% %40%36%12%28% 56%16% 72%100% Percent of Total19%33% 15%19% 44%38% 81%100% These tables illustrate how data from mathematics assessments for two years may be viewed to support making determinations based from SGP data. Some total percentages may not equal 100 percent due to rounding.

Rating a Teacher’s Performance on Standard 7 using SGPs More than 50 percent of students demonstrated high growth and no more than 10 percent demonstrated low growth Exemplary At least 65 percent of students demonstrated moderate or high relative growth (the percentage of students with high growth + moderate growth > 65 percent) Proficient

Rating a Teacher’s Performance on Standard 7 using SGPs < 65 percent of students demonstrated moderate or high growth; AND < 50 percent of students demonstrated low growth. Note: To make this determination, there must be sufficient SGP data documented (i.e., not missing) to show that < 65 percent of students demonstrated moderate or high growth. Missing data may result in an “undetermined” conclusion. Developing/ Needs Improvement > 50 percent of students demonstrated low growth Unacceptable

SGP Levels (N=48 over 2 years)SOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing DataFailing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing scores (proficient or advanced) Percentage of Total Students Percent of Total19%33% 15%19%44% 38% 81%100% Calculating Rating: Example 1 Question Response (Yes/No) Action 1.Do 90 percent or more of students taught have SGP data? 15 percent missing Yes Use percentages and pre-defined criteria to make SGP-based determinations. √ No Continue 2.Do more than 50 percent of students taught demonstrate low growth? 19 percent low growth Yes Rating=Unacceptable √ NoContinue 3.Do 50 percent or more students taught demonstrate high growth and fewer than 10 percent demonstrate low growth? 33 percent high growth and 19 percent low growth Yes Exemplary determination is possible. Due to more than 10 percent missing data, it may not be possible to finalize a determination. √ NoContinue

Calculating Rating: Example 1 Question Response (Yes/No) Action 4. Add the percentage of students earning moderate or high growth (moderate + high). Is this total 65 percent or higher? 33 moderate growth + 33 percent high growth = 66% √ Yes; Rating is Proficient or higher. √ % high + % missing is less than 50: 33 percent high growth + 15 percent missing data = 48% Determination is proficient.* NoContinue *In this example, the process stopped here because a determination was made. SGP Levels (N=48 over 2 years)SOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing DataFailing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing scores (proficient or advanced) Percentage of Total Students Percent of Total19%33% 15%19%44% 38% 81%100%

Example 1: What Did We Learn and What Else May Be Considered? The rating based on two years of combined data is proficient.  66 percent of students demonstrated moderate or high growth, and  An exemplary determination was ruled out. In reviewing these data over time, are there trends that should be accounted for (e.g., more students showed high growth each consecutive year)? Are there data from English (e.g., SGP reading data) that should be considered in the same manner? Do the SGP data result in different interpretations in different course levels or with certain student groups? [Consistent with Board of Education guidelines, SGP results should contribute to no more than 20 percent of a teacher’s summative evaluation.] The rating based on two years of combined data is proficient.  66 percent of students demonstrated moderate or high growth, and  An exemplary determination was ruled out. In reviewing these data over time, are there trends that should be accounted for (e.g., more students showed high growth each consecutive year)? Are there data from English (e.g., SGP reading data) that should be considered in the same manner? Do the SGP data result in different interpretations in different course levels or with certain student groups? [Consistent with Board of Education guidelines, SGP results should contribute to no more than 20 percent of a teacher’s summative evaluation.]

SGP Tables: Example 2 SGP Levels (Percentages)SOL Proficiency Levels (Percentages) Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing scores (proficient or advanced) Percentage of Total Students %22%35% 9% 30%61% 91%100% %24%40%32%28% 56%16% 72%100% Percent of Total 6%23%38%33%19% 44%38% 81%100% These tables illustrate how data from mathematics assessments for two years may be viewed to support making determinations based from SGP data. Some total percentages may not equal 100 percent due to rounding. SGP LevelsSOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Passing scores (proficient or advanced) Total Students Total

SGP Tables: Example 2 SGP Levels (Percentages)SOL Proficiency Levels (Percentages) Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing scores (proficient or advanced) Percentage of Total Students %22%35% 9% 30%61% 91%100% %24%40%32%28% 56%16% 72%100% Percent of Total 6%23%38%33%19% 44%38% 81%100% These tables illustrate how data from mathematics assessments for two years may be viewed to support making determinations based from SGP data. Some total percentages may not equal 100 percent due to rounding. SGP LevelsSOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Passing scores (proficient or advanced) Total Students Total

Calculating Rating: Example 2 Question Response (Yes/No) Action 1.Do 90 percent or more of students taught have SGP data? 33 percent missing SGP data Yes Use percentages and pre-defined criteria to make SGP-based determinations. √ No Continue 2.Do more than 50 percent of students taught demonstrate low growth? 6 percent low growth  Yes Rating=Unacceptable √ NoContinue 3.Do 50 percent or more students taught demonstrate high growth and fewer than 10 percent demonstrate low growth? 38 percent high growth and 6 percent low growth  Yes Exemplary determination is possible. Due to more than 10 percent missing data, it may not be possible to finalize a determination. √ No Continue SGP LevelsSOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing scores (proficient or advanced) Percentage of Total Students Percent of Total 6%23%38%33%19% 44%38% 81%100%

Calculating Rating: Example 2 Question Response (Yes/No) Action 4. Add the percentage of students earning moderate or high growth (moderate + high). Is this total 65 percent or higher? 23% + 38% = 61% Yes; Rating is Proficient or higher. Add % high+% missing % high + % missing is less than 50 Determination is proficient. % high + % missing is greater than 50: Determination is proficient or higher. Continue. √ No Continue SGP LevelsSOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing scores (proficient or advanced) Percentage of Total Students Percent of Total 6%23%38%33%19% 44%38% 81%100%

Missing Data: Example 2 Question Response (Yes/No) Action A.If all of the students who have missing data showed high growth, would at least 50 percent of students show high growth (add percentage of students with high growth and missing data)? 38% + 33% = 71% √ Yes Rating continues to be undetermined  No Exemplary rating is not possible. The data support a rating of Proficient or lower. B. If all students who have missing data showed moderate growth, would 65 percent or more show moderate or high growth (add percentage of students with moderate growth, high growth, and missing data)? 23% + 38% + 33% = 94% √ YesRating continues to be undetermined  No Data support a rating below Proficient, but it is not clear whether the rating would be Developing/Needs Improvement or Unacceptable. C. If all students who have missing data showed low growth, would 50 percent or more students demonstrate low growth? 6% + 33% = 39%  Yes Rating is undetermined √ No The data support a rating above Unacceptable, but the specific rating may not be available. D. Use information above to further narrow rating if possible. Here are two examples:  If answers to questions A and C are “NO”, the data support a rating of either Proficient or Developing/Needs Improvement. The rating would not be Exemplary or Unacceptable.  If the answer to questions A and B are “NO”, and the answer to question C is “NO”, the rating must be Developing/Needs Improvement, as the other ratings are not possible. SGP LevelsSOL Proficiency Levels Mathematics Low Growth Moderate Growth High Growth Missing Data Failing Scores Proficient Scores Advanced Proficient Scores Percentage of Total Passing scores (proficient or advanced) Percentage of Total Students Percent of Total6%23%38%33%19%44%38%81%100%

Example 2: What Did We Learn and What Else Might We Look For? There is too much missing data to make a determination for these two years using SGP data.  The process of elimination ruled out an unacceptable rating.  No other ratings were eliminated, and therefore, these data should play an extremely limited role (if any) in the evaluation. For example, these data may be used to support a rating above unacceptable if other student academic progress data support a rating above unacceptable. Review other types of student academic progress data for use in performance evaluation. There is too much missing data to make a determination for these two years using SGP data.  The process of elimination ruled out an unacceptable rating.  No other ratings were eliminated, and therefore, these data should play an extremely limited role (if any) in the evaluation. For example, these data may be used to support a rating above unacceptable if other student academic progress data support a rating above unacceptable. Review other types of student academic progress data for use in performance evaluation.

SGP data should be considered over time and patterns of performance should be considered when making SGP-based determinations in performance evaluations. Teachers who teach multiple classes may benefit from reviewing data for each class separately. When there are conflicting data, evaluators must use professional judgment to make determinations. In all cases, administrators must ensure that teachers receive appropriate feedback on their strengths and areas for improvement from each component of the comprehensive evaluation. General SGP Considerations