ASW Process for Standard 6 Virtual Meeting July 10, 2015

NCDPI ASW Team Arts Education Christie Lynch Ebert Slater Mapp AP/IB Sneha Shah- Coltrane Healthful Living Burt Jenkins World Languages Ann Marie Gunter Coordinator Jen DeNeal

ASW Questions Please capture your questions by writing them down. As we progress through today’s meeting, listen carefully for the answer. Periodically, we will ask you to enter any unanswered questions from the sections we’ve just covered in the Questions box to be answered.

Poll Questions Who are you with ASW? ASW Coordinator for my district or charter school ASW Lead for my school or department Teacher who uses ASW for Standard 6 Curious Onlooker or Observer

Poll Questions Where are you joining us from today? Office/School Home On the Road Vacation Location That information cannot be disclosed.

Poll Questions Did your district/charter implement ASW during 2014 – 2015? Yes, so I have some experience with ASW. Yes, but ASW is new to me this year. Not sure. No, but some training was done on ASW. No, I/we are all new to ASW.

Standard I: Teachers demonstrate leadership. Standard II: Teachers establish a respectful environment for a diverse population of students. Standard III: Teachers know the content they teach. Standard IV: Teachers facilitate learning for their students. Standard V: Teachers reflect on their practice. Standard VI: Teachers contribute to the academic success of students. NC Professional Teaching Standards

5 Rating Categories Demonstrate Leadership Establish Environment Know Content Facilitate Learning Reflect on Practice Contribute to Academic Success 3 Rating Categories Not Demonstrated Developing Proficient Accomplished Distinguished Effectiveness Status NC Educator Evaluation System

Overview of Standard 6 Contribute to Academic Success End of Grade (EOG) or End of Course (EOC) tests 6 NC Final Exams 6 Career Technical Education Assessment 6 Analysis of Student Work K-3 Checkpoints 6 6

Analysis of Student Work 6 Contribute to Academic Success ASW is the Standard 6 measure for teachers in: Advanced Placement, Arts Education, Healthful Living, International Baccalaureate, and World Languages. Growth is based on student work submitted by teachers and rated by content experts in a “blind review” process.

Principal’s Input Confirm Teacher Participation

Overview: Analysis of Student Work ASW Process

2015 – 2016 ASW Process Timeline

Overview: Analysis of Student Work ASW Process

ASW Process: A Quick Guide

Teaching Context Screen shot

Principal receives a notification once a teacher’s schedule has been validated. The principal will then log into the Online Platform to confirm that the schedule is correct. Principal’s Input

ASW Process: A Quick Guide

Class Selection The online platform will select the classes in which the teacher must collect artifacts.

ASW Questions Now is the time to enter any unanswered questions from the sections we’ve just covered in the Questions box to be answered by the ASW Team and shared with all.

ASW Process: A Quick Guide

Objectives: Using the Strands and Standards Guidance Charts, the teacher will choose 5 objectives. Objective Selection

Principal meets with the teacher to confirm that the 5 objectives chosen use the parameters in the Strands & Standards Guidance Chart Some examples of meetings: PDPs teacher meetings Principal’s Input

ASW Process: A Quick Guide

Teacher decisions needed to compile a Timelapse Artifact (TA): a)A specific objective b)Sample type Individual Student or Whole Class c)Collection Method d)Student work samples from Point 1 and Point 2 e)Context 5 Timelapse Artifacts

A.S.W. The Clarifying Objective or CO that is chosen must match the teacher’s instruction and artifacts. A.S.W. Analysis of Student Work Specific Objective

The Teacher may choose: Option 1 – Individual Student Work Samples Collect and keep 2 work samples: for each class member for a specific objective at 2 separate points in time OR Sample Type

The Teacher may choose: Option 2 – Whole Class Work Samples 2 work samples that represent the entire class for a specific objective at 2 separate points in time Sample Type

Pre Test Sljdflkjdf sdfljsdfljdf sdflkjsdf sdflnksdflnsdf sdfllsdf sdflnsdf sdfklsdflkjf fsl flk sdflkjsdf sdf Ljsdflksdf ;mf sdflmdf sdf;df msdf;sdf sdfmsdf lmf, sdfmsd. Sdmsdf0 lsdjlkjsdflkjsdfljk Ljdflkjf ljkdlkjsdf tjtlkjltj ;jke;ljkw;jkw ;kw;lkwet ;w;jw ;jkw;ljkw klwe ljsdfljsdf sdljsdfljsdf Sljd Collection Method → File Size Up to 20 MB per file!

Time passes Teachers Collect Work Samples for Timelapse Artifacts... weeks... months...

ASW Process: A Quick Guide

TA 1 Timelapse Artifact Option 1 – Individual Student Work Samples Online platform will select 3 students The TA will be compiled using the Individual Student Work Samples from these selected students. Student Selection

Timelapse Artifact Option 1 – Individual Student Work Samples If a student work sample is unavailable, that student will be reshuffled and another student will be selected. Student Selection TA 1

Principal’s Input The Principal is notified when a reshuffle is used by a teacher.

ASW Virtual Meeting Activity Go to the Teacher Resources page on the ASW wiki at and download the ASW Quick Guide, plus... 1 or more resources that will be helpful to you and/or your team as you implement the ASW Process in 2015 – 2016

ASW Questions Now is the time to enter any unanswered questions from the sections we’ve just covered in the Questions box to be answered by the ASW Team and shared with all.

Poll Questions What did you download from the Teacher Resources page after the ASW Quick Guide? ASW Course Codes Planning Worksheet(s) Strands & Standards Chart(s) Other... I got distracted  but I’ll do it later.

ASW Process: A Quick Guide

Frequency and Duration: How often and for how long do you see your students? Examples: 45 minutes once per week for an entire year, 30 minutes twice per week for a semester. Include information about missed classes or special scheduling information that might be helpful to the reviewer. Context

What is the purpose of the Narrative Context? To communicate to the reviewer where the students’ skill or knowledge is in relation to the selected objective at two points in time during instruction, How does this artifact show where the student is in relation to the chosen clarifying objective? Context How does this artifact show where the student is in relation to the chosen clarifying objective? This artifact was created using an 8 th grade Healthful Living Health Education Class containing 32 students before instruction on the objective began. In this video, the student did not show proper technique in the their performance of CPR in the following ways. 1. The students body position has him sitting on the victims waist. 2. The hands have been placed separately on the victims upper chest. 3. The compressions given are of insufficient depth and are given too slow. 4. The elbows are bending during the compression.

To describe the amount of growth that occurred in relation to the selected objective between the two points in time. Describe the growth that occurred between Points 1 and 2, including how much time passed between the two points in time. Context Describe the growth that occurred between Points 1 and 2. CPR performed with the technique in video #1 was inadequate and would not have given the victim an opportunity to survive. The technique in video #2 would provide blood flow and oxygen to give the victim a chance of survival

Timelapse Artifact – Individual Student Work Samples Timelapse Artifact Upload Evidence

Timelapse Artifact – Whole Class Work Samples Timelapse Artifact Upload Evidence

All 5 Timelapse Artifacts will be uploaded to the online platform as the teacher’s Evidence Collection for the school year. TA 3 Individual Students TA 3 Individual Students TA 4 Individual Students TA 4 Individual Students TA 5 Whole Class TA 5 Whole Class TA 1 Individual Students TA 2 Whole Class Upload Evidence

ASW Process: A Quick Guide

The Evidence Collection will be reviewed by 2 content area specialists. Reviewer #1 Reviewer #2 Blind Review ED M

Reviewer #1 Reviewer #2 The platform sends the evidence collection to two reviewers who have been matched to the teacher because of their similar content area expertise. Blind Review

Category Rating: Meets Expected Growth Reviewer #1 Reviewer #2 If the category ratings from each reviewer are the same, then the review process is complete and the Standard 6 rating will be posted for that year. M Blind Review M

Reviewer #1 Reviewer #2 If the category ratings from the two reviewers are not the same, the Evidence Collection is automatically sent to a 3 rd reviewer for an additional review to get a rating for that year. M Reviewer #3 Blind Review E

2-Step ASW Process Review These will be explained in detail in later modules. #1 Evidence Collection Checklist #2 ASW Quality Rubric Blind Review

ASW Questions Now is the time to enter any unanswered questions from the sections we’ve just covered in the Questions box to be answered by the ASW Team and shared with all.

ASW Process: A Quick Guide

D = Does Not Meet Expected Growth M = Meets Expected Growth E = Exceeds Expected Growth Transfer your rating for each TA from the quality rubric to the table below: Use this table to determine the overall rating for the evidence collection Overall Rating for the entire Evidence Collection Does Not Meet Expected Growth Meets Expected Growth Exceeds Expected Growth Evidence Collection Rating Form: TA 1TA 2TA 3TA 4TA 5 Receive Rating

D = Does Not Meet Expected Growth M = Meets Expected Growth E = Exceeds Expected Growth Transfer your rating for each TA from the quality rubric to the table below: Evidence Collection Rating Form : TA 1TA 2TA 3TA 4TA 5 Receive Rating DMMME

Synthesis table to determine Standard 6 rating a Receive Rating a Does Not MeetMeetsExceeds D D D D DM M M M ME E E E E D D D D EM M M M EM E E E E D D D D MD M M M MM M E E E D D D E EM M M E ED E E E E D D D M ED D M M MD M E E E D D D M MD M M M E D D M M E D D M E E D M M E E D D E E E

An educator receives an Effectiveness Status when he or she has 3 years of their own data for Standard 6 Effectiveness Status 3 Years of Combined Data for Standard Year 1Year 2Year 3 Standard

66 Contribute to Academic Success 6 Year Does Not Meet Expected Growth Year Meets Expected Growth Year Meets Expected Growth Standard Ms. NC’s 3 years of growth data: Does Not Meet (Year 1) Meets (Year 2) Meets (Year 3) Ms. NC’s Standard 6 rating for Meets Expected Growth Effectiveness Status LEAs/Charter Schools who took part in ASW in 2014 Best 2 out of 3 years of data

66 Contribute to Academic Success 6 Year Meets Expected Growth Year Does Not Meet Expected Growth Year Meets Expected Growth Standard Mrs. NC’s 3 years of growth data: Meets (Year 1) School Wide Data Does Not Meet (Year 2) Meets (Year 3) Mrs. NC’s Standard 6 rating for Meets Expected Growth Effectiveness Status LEAs/Charter Schools who waived out of ASW in 2014 Best 2 out of 3 years of data School Wide Data

66 Contribute to Academic Success 6 Year Does Not Meet Expected Growth Year Meets Expected Growth Year Meets Expected Growth Standard Mr. NC’s 3 years of growth data: Does Not Meet (Year 1) Meets (Year 2) Meets (Year 3) Mr. NC’s Standard 6 rating for Meets Expected Growth Effectiveness Status Charter Schools that are part of ASW for the first time in 2015

Effectiveness Status for DevelopingProficientAccomplishedDistinguished Standard 1 Demonstrate leadership Standard 2 Establish Environment Standard 3 Know Content Standard 4 Facilitate Learning Standard 5 Reflect on Practice Standard 6 Three year growth data X X X X X 3 years of growth data for 2014 – 2017 Meets Expected Growth Principal Role

In Need of Improvement Effective Highly Effective Any rating lower than proficient Proficient or Higher on Standards 1-5 Accomplished or Higher on Standards Demonstrate Leadership 2 Establish Environment Know Content Facilitate Learning Reflect on Practice Standards Does Not Meet Expected Growth Meets or Exceeds Expected Growth Exceeds Expected Growth Effectiveness Status for Contribute to Academic Success (3 yrs. of data)

Effectiveness Status for DevelopingProficientAccomplishedDistinguished Standard 1 Demonstrate leadership Standard 2 Establish Environment Standard 3 Know Content Standard 4 Facilitate Learning Standard 5 Reflect on Practice Standard 6 Three year growth data X X X X X Best 2 out of 3 years of growth data for 2014 – 2017 Meets Expected Growth Effective Principal Role

ASW Questions Now is the time to enter any unanswered questions from the sections we’ve just covered in the Questions box to be answered by the ASW Team and shared with all.

Questions about Educator Effectiveness, NCEES or ASW Visit or NCEES+Wiki or ASW Wiki at You can also questions to

Thank you for joining us today! This broadcast will be archived on the ASW Wiki under Virtual Meetings on the Professional Development tab approximately 1 week from today Don’t forget... The next virtual meeting is about ASW Professional Development and will be on Tuesday, July 28. Register using the link on the Virtual Meetings wikipage.