Western Suffolk BOCES Boot Camp Emma Klimek Eastern Suffolk BOCES 2012.

Slides:



Advertisements
Similar presentations
1 New York State Education Department Interpreting and Using Your New York State-Provided Growth Scores August 2012.
Advertisements

New York State’s Teacher and Principal Evaluation System VOLUME I: NYSED APPR PLAN SUBMISSION “TIPS”
EngageNY.org State-Calculated Growth Measures Overview July 2013 Network Training Institute.
LCSD APPR Introduction: NYS Teaching Standards and the Framework for Teaching Rubric Welcome! Please be seated in the color-coded area (marked off by colored.
New York State District-wide Growth Goal Setting Process: Student Learning Objectives Webinar 2 (REVISED FEBRUARY 2012)
Annual Professional performance review (APPR overview) Wappingers CSD.
Student Learning Objectives NYS District-Wide Growth Goal Setting Process December 1, 2011 EVOLVING.
Teacher Effectiveness
Student Learning Objectives It’s Been a SLO Summer.
Aligning Priorities, Goals and Initiatives for School and Student Success Presenters: Dr. Regina Cohn Dr. Robert Greenberg January 2013.
Student Learning targets
New York State District-wide Growth Goal Setting Process: Student Learning Objectives Webinar 1: December 2011.
1 New York State Education Department Using Growth Measures for Educator Evaluation August 2012.
New York State District-wide Growth Goal Setting Process: Student Learning Objectives & the Assessments needed Mary Ann Luciano, Director.
Student Impact Rating Teacher Professional Growth and Effectiveness System Daviess County Public Schools.
Creating a Student Learning Objective (SLO). Training Objectives Understand how Student Learning Objectives (SLOs) fit into the APPR System Understand.
EngageNY.org State-Calculated Growth Measures Overview July 2013 Network Training Institute Revised 8/22/2013.
1 New York State Growth Model for Educator Evaluation 2011–12 July 2012 PRESENTATION as of 7/9/12.
* Provide clarity in the purpose and function of the Student Learning Objectives (SLOs) as a part of the APPR system * Describe procedures for using.
Annual Professional Performance Review (APPR). What are the components of APPR? Teacher Evaluation –60 points (observation*/goal setting) –20 points (State.
Teacher Effectiveness Day 5. Housekeeping Parking Breaks and lunch Emergencies.
OCM BOCES Day 7 Lead Evaluator Training 1. 2 Day Seven Agenda.
Information for school leaders and teachers regarding the process of creating Student Learning Targets. Student Learning targets.
The APPR Process And BOCES. Sections 3012-c and 3020 of Education Law (as amended)  Annual Professional Performance Review (APPR) based on:  Student.
Evidence-Based Observations Training for Observers of Teachers Module 5 Dr. Marijo Pearson Dr. Mike Doughty Mr. John Schiess Spring 2012.
OCM BOCES SLOs Workshop. Race To The Top: Standards Data Professional Practice Culture APPR.
New York State Scores 2011—2012 School Year. Growth Ratings and Score Ranges Growth RatingDescriptionGrowth Score Range (2011–12) Highly EffectiveWell.
STUDENT LEARNING OBJECTIVES AND YOUR TEACHER EVALUATION NYSUT Education and Learning Trust NYSUT Field and Legal Services NYSUT Research and Educational.
APPR:§3012-d A Preview of the changes from :§3012-c Overview.
FEH BOCES Student Learning Objectives 3012-c.
New York State District-wide Growth Goal Setting Process: Student Learning Objectives Webinar 2: January 2012.
Winter, 2012 Teacher Effectivensss Day 5. To download powerpoint:
Student Growth Percentiles Basics Fall Outcomes Share information on the role of Category 1 assessments in evaluations Outline steps for districts.
Student Learning Objectives SLOs April 3, NY State’s Regulations governing teacher evaluation call for a “State-determined District-wide growth.
TEACHER EFFECTIVENESS INITIATIVE VALUE-ADDED TRAINING Value-Added Research Center (VARC)
March 23, NYSCSS Annual Conference Crossroads of Change: The Common Core in Social Studies.
1 New York State Growth Model for Educator Evaluation 2011–12 July 2012 PRESENTATION as of 7/9/12.
Race to the Top (RTTT) and the New York State Regents Reform Agenda Dr. Timothy T. Eagen Assistant Superintendent for Instruction & Curriculum South Huntington.
Student Learning and Growth Goals Foundations 1. Outcomes Understand purpose and requirements of Student Learning and Growth (SLG) goals Review achievement.
Teacher SLTs General Format for Teacher SLTs with a District-wide Common Assessment The percent of students scoring proficient 1 in my 8 th.
Teacher Scores from the State
Creating a Student Learning Objective (SLO). Training Objectives Understand how Student Learning Objectives (SLOs) fit into the APPR System Understand.
Student Growth Percentiles For Classroom Teachers and Contributing Professionals 1 October 22, 2014.
Student Learning Objectives NYS District-Wide Growth Goal Setting Process December 1, 2011 EVOLVING.
October 24, 2012 Jonathan Wiens, PhD Accountability and Reporting Oregon Department of Education.
Forum on Evaluating Educator Effectiveness: Critical Considerations for Including Students with Disabilities Lynn Holdheide Vanderbilt University, National.
Best Practices in CMSD SLO Development A professional learning module for SLO developers and reviewers Copyright © 2015 American Institutes for Research.
Value Added Model Value Added Model. New Standard for Teacher EvaluationsNew Standard for Teacher Evaluations Performance of Students. At least 50% of.
Understanding Growth Targets and Target Adjustment Guidance for Student Learning Objectives Cleveland Metropolitan School District Copyright © 2014 American.
PRINCIPAL STATE GROWTH SCORES / Principal Performance/Visit= 50 Student Performance=50.
EngageNY.org State-Calculated Growth Measures Overview July 2013 Tracy Rowlands & Deb Duffy.
1 New York State Growth Model for Educator Evaluation June 2012 PRESENTATION as of 6/14/12.
EngageNY.org State-Calculated Growth Measures Overview July 2013 Deb Duffy.
Richard Woods, Georgia’s School Superintendent “Educating Georgia’s Future” gadoe.org Overview of the Georgia Student Growth Model 1.
1 Overview of Teacher Evaluation 60% Multiple Measures of Teacher Performance At least 31 points based on “at least 2” observations At least one observation.
Teacher SLTs
Teacher SLTs
FY17 Evaluation Overview: Student Performance Rating
CORE Academic Growth Model: Results Interpretation
Lead Evaluator for Principals Part I, Series 1
Danvers Public Schools: Our Story
Understanding How Evaluations are Calculated
Student Learning Objective (SLO) Staff Development
Teacher SLTs
New York State Education Department Using Growth Measures for Educator Evaluation August 2012.
Creating Student Learning Objectives (SLOs)
Teacher SLTs
Roadmap November 2011 Revised March 2012
A student learning objective is an academic goal for a teacher’s students that is set at the start of a course. It represents the most important learning.
Teacher SLTs
Presentation transcript:

Western Suffolk BOCES Boot Camp Emma Klimek Eastern Suffolk BOCES 2012

Emma Klimek 2012

What do we mean by “Growth”? Growth is change from point A to point B Growth is an expectation of learning Growth is a relative measure compared to like students in like conditions

The What, Why, and How of Growth Models and Measures

By the End of This Section…. You should be able to:  Explain why the state is measuring student growth and not achievement  Describe how the state is measuring growth compared to similar students  Define a student growth percentile and mean growth percentile

Prior Year Performance for Students in Two Teachers’ Classrooms ─ Proficiency

Current Year Performance of Same Students ─ Proficiency

Prior and Current Year Performance for Ms. Smith’s Students Ms. Smith’s Class Prior ScoreCurrent Score Student A Student B Student C Student D Student E600650

Prior and Current Year Performance for Ms. Smith’s Students Ms. Smith’s Class Prior ScoreCurrent Score Student A Student B Student C Student D Student E600650

10 ELA Scale Score Studen t A 450 High SGPs Low SGPs Student A’s Current Year Performance Compared to “Similar” Students If we compare student A’s current score to other students who had the same prior score (450), we can measure her growth relative to other students. We describe her growth as a “student growth percentile (SGP”). Student A’s SGP is 45, meaning she performed better in the current year than 45 percent of similar students.

Comparing Performance of “Similar” Students Prior Year Score Current Year Score Given any prior score, we see a range of current year scores, which give us SGPs of 1 to 99.

SGPs for Ms. Smith’s Students Ms. Smith’s Class Prior Score Current Score SGP Student A Student B Student C Student D Student E

Which Students Count in a Teacher or Principal’s MGP for ? Student has valid test scores for at least and Student scores do not count for Yes Student meets continuous enrollment standard for No Student growth is attributed to the teacher and the school Yes No Expected for : students weighted by duration of instructional linkage

From Student Growth to Teachers and Principals In order for an educator to receive a growth score, he or she must have a minimum sample size of 16 student scores in ELA or mathematics across all grades he or she teaches. Examples:  A teacher has a self-contained classroom with 8 students who take the 4 th grade ELA and math assessments; this teacher would then have 16 student scores contributing to his or her growth score.  A teacher has a class with 12 students who are in varied grades (4 th, 5 th, 6 th ) who take the ELA and math assessments for their respective enrolled grade level; this teacher would then have 24 student scores contributing to his or her growth score. If an educator does not have 16 student scores, they will not receive a growth score from the State and will not receive information in the reporting system at the educator level.  Educators likely to have fewer than 16 scores should use SLOs.

From Student Growth to Teachers and Principals (continued) Ms. Smith’s Class SGP Student A45 Student B40 Student C70 Student D60 Student E40 To measure teacher performance, we find the mean growth percentile (MGP) for her students. To find an educator’s mean growth percentile, take the average of SGPs in the classroom. In this case: Step 1: =255 Step /5=51 Ms. Smith’s mean growth percentile (MGP) is 51, meaning on average her students performed better than 51 percent of similar students. A principal’s performance is measured by finding the mean growth percentile for all students in the school.

Expanding the Definition of “Similar” Students So far we have been talking about “similar” students as those with the same prior year assessment score We will now add two additional features to the conversation: Two additional years of prior assessment scores Remember—a student MUST have current year and prior year assessment score to be included Student-level factors Economic disadvantage Students with disabilities (SWDs) English language learners (ELLs)

Adjustments for Three Student-Level Factors in Measuring Student Growth Student performance Teacher Instruction Other factors (12-13) Economic disadvantage Language proficiency Disability

ELA Scale Score Studen t A 450 High SGPs Low SGPs Going Back to Student A’s Current Year Performance Compared to “Similar” Students If we compare student A’s current score to other students who had the same prior score (450), we can measure her growth relative to other students. We describe her growth as a “student growth percentile (SGP”). Student A’s SGP is 45, meaning she performed better in the current year than 45 percent of similar students.

ELA Scale Score Studen t A 450 High SGPs Low SGPs Expanding the Definition of “Similar” Students to Include Economically Disadvantaged—An Example Now if student A is economically disadvantaged, we compare student A’s current score to other students who had the same prior score (450) AND who are also economically disadvantaged. In this new comparison group, we see that student A now has an SGP of 48.

Further Information on Including Student Characteristics in the Growth Model The following slides were developed using sample data from  The “combined” MGPs on the charts have been calculated at the educator level (combining all grades and subjects).  Not all districts provided data linked to teachers for grades 4-8 ELA/Math in

Teacher MGPs after Accounting for Economic Disadvantage Taking student-level characteristics into account helps ensure educators with many students with those characteristics have a fair chance to achieve high or low MGPs. For example, note that for teachers with any percent of economically disadvantaged students, teacher MGPs range from 1 to 99. NOTE: Beta results using available data.

Teacher MGPs after Accounting for SWD NOTE: Beta results using available data.

Teacher MGPs after Accounting for ELL Percent of ELL Students in Class NOTE: Beta results using available data.

“Similar” Students: A Summary “Similar” Student Characteristics Unadjusted Mean Growth Percentiles Adjusted Mean Growth Percentiles Up to Three Years of Prior Achievement English Language Learner (ELL) Status Students with Disabilities (SWD) Status Economic Disadvantage Reported to Educators Used for Evaluation

One Last Feature of the Growth Model…. All tests contain measurement error, with greater uncertainty for highest and lowest- achieving students The New York growth model accounts for measurement error in computing student growth percentiles.

State Growth Model Summary Regulations allow Prior years of student test results Three student- level variables: SWD, ELL, Econ Disadvantage Measurement error correction Model includes Up to three years, as available All three Measurement error correction Growth model for only for grades 4-8 ELA/Math for teachers and principals

Using Growth Measures for Educator Evaluation

MGPs and Statistical Confidence 87 Confidence Range Uppe r Limit Lowe r Limit MGP NYSED will report a 95 percent confidence range, meaning we can be 95 percent confident that an educator’s “true” MGP lies within that range. Upper and lower limits of MGPs will also be reported. An educator’s confidence range depends on a number of factors, including: number of student scores included in their MGP and the variability of student performance in their classroom.

Illustrating Possible Growth Ratings MGP 1 MGP 99 Well Below Average Below Average Average Well Above Average MGP 50 MGP

From MGPs to Growth Ratings: Teachers Rules on last slide result in these HEDI criteria for Yes No Is your MGP ≥ 69? Is your Lower Limit > Mean of 52? Highly Effective: Results are well above state average for similar students Is your MGP ≤ 35? Is your Upper Limit < 44? Ineffective: Results are well below state average for similar students Developing: Results are below state average for similar students No Effective: Results equal state average for similar students Mean Growth Percentile Confidence RangeHEDI Rating Is your MGP 42-68? Any Confidence Range Yes No Is your MGP 36-41? Is your Upper Limit < Mean of 52? Yes No

Illustrating Possible Growth Ratings MGP 1 MGP 99 Well Below Average Below Average Average Well Above Average MGP 50 MGP

Illustrating Possible Growth Ratings MGP 1 MGP 99 Well Below Average Below Average Average Well Above Average MGP 50 MGP Ineffective Developing Highly Effective Effective

Illustrating Possible Growth Ratings MGP 1 MGP 99 Well Below Average Below Average Average Well Above Average MGP 50 MGP Developing Effective

Assignment of Points with HEDI Category HEDI Points Min MGP Max MGP N of Teachers HEDI Points Min MGP Max MGP N of Schools Point value of 3 includes educators with MGPs in the Ineffective category but CRs above 44 (for teachers) and above 46 (for principals) Point value of 9 includes educators with MGPs in the Developing category but CRs above state average Point value of 17 Includes educators with MGPs in the Highly Effective category but CRs below state average Teachers Principals

Definitions SGP (student growth percentile): measure of a student’s growth relative to similar students Similar students: students with the same prior test scores, ELL, SWD, and economic disadvantage status ELLs: English language learners SWD: students with disabilities Economic disadvantage: a student who participates in, or whose family participates in, economic assistance programs such as the Free- or Reduced-price Lunch Programs (FRPL), Social Security Insurance (SSI), Food Stamps, Foster Care and others High-achieving, low-achieving: defined by the performance of students based on prior year State assessment scores (i.e., Level 1 = low-achieving, Level 4 = high-achieving)

Definitions MGP (mean growth percentile): the average of the student growth percentiles attributed to a given educator “Unadjusted” MGP: an MGP based on SGPs for which ELL, SWD, and economic disadvantage status have NOT been accounted “Adjusted” MGP: an MGP based on SGPs for which ELL, SWD, and economic disadvantage status have been accounted Growth rating: HEDI rating based on growth Growth score: growth subcomponent points from 0-20

Definitions Measurement error: uncertainty in test scores due to sampling of content and other factors Standard error: a measure of the statistical uncertainty surrounding a score Upper/lower limit: highest and lowest possible MGP taking statistical confidence into account Confidence range: range of MGPs within which we have a given level of statistical confidence that the true MGP falls (95 percent statistical confidence level used for state growth measure)

Break

STUDENT LEARNING OBJECTIVES:

The State Language “For teachers where there is no State- provided measure of student growth, “comparable measures” are the state- determined District-wide growth goal- setting process. Student Learning Objectives (SLOs) are the State determined process.”

Student Learning Objective Do a close reading of the state’s paragraph on Student Learning Objectives Highlight or underline 5 key words (only 5) with a shoulder partner Use all 5 of the words, if possible, in a “sound bite” or graphic Emma Klimek 2012

State Message Regarding Student Learning Objectives  SLOs name what students need to know and be able to do at the end of the year.  SLOs place student learning at the center of the conversation.  SLOs are a critical part of all great educator’s practice.  SLOs are an opportunity to document the impact educators make with students. Emma Klimek 2012

Key Messages for SLOs continued…  SLOs provide principals with critical information that can be used to manage performance, differentiate and target professional development, and focus support for teachers.  The SLO process encourages collaboration within school buildings.  School leaders are accountable for ensuring all teachers have SLOs that will support their District and school goals. Emma Klimek 2012

Who has SLOs and how will SLOs be set? WHO NEEDS AN SLO? Emma Klimek 2012

47 Emma Klimek 2012

General Rules If 50% or more of a teacher’s students receive a State Growth Percentile (SGP) then the teacher does not need an SLO Common Branch teachers, who do not get an SGP, must have 2 SLOs, one in ELA and one in math A common branch teacher will not have an SLO in other subjects If a teacher has 16 or more State test scores in grades 4-8, ELA or math, but that is less than 50% of his/her students, he/she must use this as the first SLO Emma Klimek 2012

IDENTIFYING WHO NEEDS AN SLO AND WHICH ONE Emma Klimek 2012

Determining SLOs Locate the handout With a partner or in a triad, complete the table Be prepared to share out one scenario Emma Klimek 2012

Lunch

STATE RULES REGARDING SLOS

Assessment Rules Emma Klimek 2012

Assessment Rules Teacher developed assessments are not permitted The same assessment may be used for the 2 nd 20% but it must be used in a different way Emma Klimek 2012

Assessment Rules Use common assessments across grade levels or courses, if at all possible Use high quality assessments, if possible Emma Klimek 2012

Third Party Assessments There is no variance process in place to use a non-Approved 3 rd party assessment for the purposes of APPR. Emma Klimek 2012

Attendance Rule You may not exclude students due to attendance for the computation of the SLO Emma Klimek 2012

Format Rules Must include all the elements of the SLO as outlined by the state  Population  Learning Content  Instructional Interval  Target  Baseline  Evidence  HEDI  Rationale Emma Klimek 2012

Other Criteria Rules 50% rule for students is set on BEDS day Individual student growth must be determined, but the final outcome is on the aggregate group No teacher may score an assessment in which they have a vested interest Lead evaluators must be trained Emma Klimek 2012

Target Setting Emma Klimek 2012

District determines: Who, specifically in the district needs and SLO and in what academic area,based on state rules System for scoring and teacher ratings District wide process for setting, reviewing and assessing SLOs Emma Klimek 2012

Determine District-wide Priorities and Academic Needs Assess and identify District-wide priorities and academic needs. Start with commitments and focus areas in District strategic plans. Decide how prescriptive the District will be and where decisions will be made by principals, or principals with teachers. Emma Klimek 2012

SLO EXCEPTIONAL CASES Emma Klimek 2012

Case 1: Less than 50% of students have a SGP measurement Emma Klimek 2012

Case 2: Multiple Sections w/wo SGP Emma Klimek 2012

Case 3: ESL/Bilingual/SWD Emma Klimek 2012

Case 4: Co-Teachers Emma Klimek 2012

Case 5: Push-in, pull-out Emma Klimek 2012

Case 6: NYSESLAT Students Emma Klimek 2012

Case 7: NYSAA Emma Klimek 2012

Case 8: Special Cases Emma Klimek 2012

SLO EXCEPTIONAL CASES Emma Klimek 2012

Case 1: Less than 50% of students have a SGP measurement Emma Klimek 2012

Case 2: Multiple Sections w/wo SGP Emma Klimek 2012

Case 3: ESL/Bilingual/SWD Emma Klimek 2012

Case 4: Co-Teachers Emma Klimek 2012

Case 5: Push-in, pull-out Emma Klimek 2012

Case 6: NYSESLAT Students Emma Klimek 2012

Case 7: NYSAA Emma Klimek 2012

Case 8: Special Cases Emma Klimek 2012

Individual Teacher’s Student Option For all teachers an SLO can be based solely on the students they specifically teach  For example: a second grade teacher’s class room of students determine the “first 20%” of the teacher’s APPR Emma Klimek 2012

Team, school, district, BOCES wide measures If a group measure is chosen then the following apply:  This cannot be used for 6-8 science and social studies teachers and any teacher whose SLO course ends in a Regents  A state assessment must be used Emma Klimek 2012

An example: Emma Klimek 2012

An Example: Emma Klimek 2012

SLO EXCEPTIONAL CASES Emma Klimek 2012

Case 1: Less than 50% of students have a SGP measurement Emma Klimek 2012

Case 2: Multiple Sections w/wo SGP Emma Klimek 2012

Case 3: ESL/Bilingual/SWD Emma Klimek 2012

Case 4: Co-Teachers Emma Klimek 2012

Case 5: Push-in, pull-out Emma Klimek 2012

Case 6: NYSESLAT Students Emma Klimek 2012

Case 7: NYSAA Emma Klimek 2012

Case 8: Special Cases Emma Klimek 2012

Individual Teacher’s Student Option For all teachers an SLO can be based solely on the students they specifically teach  For example: a second grade teacher’s class room of students determine the “first 20%” of the teacher’s APPR Emma Klimek 2012

Team, school, district, BOCES wide measures If a group measure is chosen then the following apply:  This cannot be used for 6-8 science and social studies teachers and any teacher whose SLO course ends in a Regents  A state assessment must be used Emma Klimek 2012

An example: Emma Klimek 2012

An Example: Emma Klimek 2012

REVIEWING EXAMPLES Emma Klimek 2012

Reviewing Examples Locate handout of examples Each team choose one example to review Identify which method was used:  Target for mastery of standards  Target for score gain  Individual student growth gain Emma Klimek 2012

Identify which assessment was chosen or required Does the assessment exist? If not, how will it be developed? Is the assessment measure an equal interval unit assessment? Will the metric work for all students in all conditions? Explain the scoring method

Is the SLO as presented “executable”? Does the SLO meet state requirements? Is the SLO fair and reasonable? Rate it on the SLO rubric

Thank you