New teacher reports October Training 2013.

new teacher reports October Training 2013

Deanene Deaton, SAS Institute Curt C. Miller, SAS Institute
Webex presenter Deanene Deaton, SAS Institute Educator Support Specialist Curt C. Miller, SAS Institute Educator Support Specialist

Making Good & Careful Use of Teacher Reports
Agenda Making Good & Careful Use of Teacher Reports Understanding the New Teacher Reports for 2013 Navigation in EVAAS: Getting to the Reports Navigation within Teacher Reports: Default Landing Pages Navigation within Teacher Reports: Demonstration Understanding the Report Q & A

Making good use of teacher reports
Developing a culture Not only share how to get to the reports and read them, but how to nurture and build a culture that uses TR to inform practice.

Teacher Reports can be:
Developing a culture Making good use of teacher reports Teacher Reports can be: Personal Sensitive Uncomfortable Frightening Teacher Reports can be emotional and very personal. We have to prepare teachers to receive these reports in the right frame of mind. EVAAS TR are intended to inform and help improve practice.

Reward: A Great Harvest
Developing a culture Teacher reports are much like planting a garden Gardening 101 Reward: A Great Harvest Till the soil Plant the seed/plants Fertilize Water Weed Prune Ward off pests Using TR is much like planting a garden. In order to receive the reward of a great harvest you must:

Reward: A Great Teacher
Developing a culture Teacher reports are much like planting a garden Teacher Reports 101 Reward: A Great Teacher Educate Communicate Collaborate Challenge Security Support Feedback In order to reap the benefits of TR, districts, schools, and teachers must:

how good will the harvest be for that season?
Developing a culture Teacher reports are much like planting a garden If seeds are thrown on unprepared ground, left to their own devices to survive or die without water or care, how good will the harvest be for that season? If teacher reports are thrown at teachers without training, understanding, coaching, support and validation, how effective will the reports be in influencing teacher performance?

Making good use of teacher reports
Purpose: Inform teaching practice in order to guide replication, changes, or improvement for continual professional growth. Professional Reflection and Dialogue Professional Growth Plans Targeted individualized professional development Sharing of human resources to lead/guide professional development Pinpoint excellence and capitalize on best practices Model classrooms Identification of mentors for new teachers Identify low performing teachers for targeted support Others The purpose of teacher reports are to: (replication, change/tweak, or improvement) There are a number of ways to utilize the reports.

Getting to the reports We will get to a live demonstration in just a second, lets first talk about the different access levels and what each has the ability to view.

Accessing Teacher Reports
EVAAS account with teacher report access Identification number for the second level of authentication 10 digit UID EVAAS password All account holders must have:

Accessing teacher reports
Second level of authentication The 10 digit UID along with the person’s EVAAS password will be used in the second level of authentication.

district Admin For the DISTRICT ADMIN:

School Admin For the SCHOOL ADMIN:

School Admin If the DISTRICT or SCHOOL Admin wishes to search for a specific teacher, they would choose Teacher Search

Teacher search That selection bring the user to the search page where they can:

School Admin Choosing the Teacher List By School will enable the Admin to view all teachers at the school in a list that looks like:

Teacher list by school this. Notice that the teacher encircled in orange is listed 3 times. Once for Math grade 8, once for Algebra 1, and once for an Evaluation Composite.

School Admin Finally, the District or School Admin can access the School Teacher Summary.

School teacher summary
Here they can select a specific subject, grade, evaluation composite, or ALL to create a graph that looks like:

School teacher summary
this Here the admin can narrow their search to a specific effectiveness level if desired

School Admin CAUTION: I come back to this screen particularly because of the title School Teacher Summary. Any District User or School User that has access to the School Teacher Summary report access WILL HAVE access to ALL teacher reports for your school. Make sure only intended persons have this access right.

Last Year Now on to Teachers, Last Year teacher access looked like this:

This Year This year, Teacher access will have only one option for Teacher Reports. This is due to the fact that the teacher report is all inclusive of value added and diagnostic reporting in one cohesive report.

Navigation within the reports
Default landing pages Let’s talk a moment about Default landing pages.

District / School Admin
Default landing District / School Admin When a District or School Admin clicks on the Teacher List by School link they will land on this page.

School or District Admin
Default landing When They click, where will they land? School or District Admin Teachers are listed in alpha order by test, subject, grade and effectiveness level. The Admin will make a selection regarding which subject/grade they wish to view or whether they wish to view the composite. Once they select the name and click on it, they are brought to

School or District Admin
Default landing When They click, where will they land? School or District Admin The teacher Value Added report for this particular grade and subject. This is the default landing page for District and School Admins.

Teacher Default landing When They click, where will they land?
When a teacher enters the reporting by clicking on the Teacher Reports link,

Teacher Default landing When They click, where will they land?
They are brought to the Teacher Value Added Summary. They can navigate to individual subjects from there.

Navigation within the Report
Tabs / links / drop-down navigation Now that we know how to get to the reports and where we will land by default, let’s talk about navigation WITHIN the reporting itself.

Navigation within the Report
Tabs / links / drop-down navigation Let’s Go to the Demo Give me a moment to get to some demonstration data to illustrate how to navigate the report itself.

Report Title Description Getting around Where are you?
Teacher Value Added Summary Summary view of all grades/subjects the teacher taught in the most recent year and also the teacher composite Teacher Diagnostic Summary Shows the progress of a teacher’s students by achievement group in a pie chart for each grade and subject Teacher Value Added Shows a visual representation of the Index value for one or more years and a multi-year trend when available for each grade and subject taught Teacher Diagnostic Shows the progress of a teacher’s students grouped by entering achievement level and allows comparison to the growth standard (0), and when available, to previous cohorts of students (NEW this year, available in pie charts also) It’s vitally important to know where you are within the report so that you don’t become confused. Let’s talk for a moment about the types of reports. Summary Reports: Value Added and Diagnostic Reports for individual subjects/grades

Understanding the reports
Teacher Value Added Summary & Teacher Diagnostic Summary Now that we know how to access the reports, where we will land on default, and how to navigate using the tabs, links, drop-downs, and summary button, let’s get to the meat of the reports and understanding them.

Understanding the reporting
Same language as the old reporting Teacher Estimate A conservative estimate of a teacher’s influence on students’ academic progress, compared to the average progress of students in the same grade and subject statewide Standard Error Provides confidence bands around the teacher estimate Index Value that tells the teacher how far they are (+ or -) away from the growth standard (The index is calculated by dividing the teacher estimate by its associated standard error) State Growth Standard Average progress across the state for this grade/subject/course (Represented by (0) on the graph) The language of Teacher Reports has NOT changed from last year.

Understanding the Report
Same Language, New Explanation The index value is the growth measure divided by its standard error, and it provides a signal as to whether the progress estimate is significantly different from the expected growth. The index value also standardizes growth measures across different models, subjects, grades and/or years for a more equitable comparison than the growth measure alone. This will be new language on the reporting and we will talk a bit more about this a little later.

Understanding the report
Teacher value added summary Let’s begin with the Teacher Value Added Summary. This is the landing page for Teachers and Admins can access this Summary report by clicking on the Summary Button. PROVIDE ORIENTATION TO THE PAGE.

Teacher value added summary Teacher Estimate ÷ Standard Error = Teacher Index ÷ = Keep in mind that the Index value for each teacher comes from this equation: The Teacher Estimate

Teacher value added summary Teacher Estimate ÷ Standard Error = Teacher Index ÷ = Divided by the Standard Error Let’s pause and discuss possible things that impact the Standard Error: SE is a mathematical formula and is used to find the standard error for each data set The Standard Error provides a confidence band around the estimate SE can be impacted by the number students used in the analysis. Typically the larger the data set, the smaller the standard error and the smaller the data set, the larger the standard error. Number of scores each student has can impact the SE. If scores are missing from the student history, which ones? If we’re generating a VA measure for 8th-grade math, a missing 7th-grade math score creates more uncertainty than a missing 4th- grade reading score.

Teacher value added summary Teacher Estimate ÷ Standard Error = Teacher Index ÷ = Equals the Teacher Index

Teacher value added summary Teacher Estimate ÷ Standard Error = Teacher Index ÷ = -0.24 -2 -1 1 2 Growth Standard The teacher Index is then plotted on a scale as compared to the Growth Standard.

Teacher value added summary Teacher Estimate ÷ Standard Error = Teacher Index ÷ = -0.24 -2 -1 1 2 Growth Standard NC business rules as the legend indicates determine if the teacher’s level is Green: Meeting Expected Growth, Blue: Exceeding Expected Growth, or Red: Not meeting expected growth.

Teacher value added summary That number line we just created using the Teacher Estimate, Standard Error and Index is what is pictured here in this graph

Teacher value added summary From the Value Added Summary, an educator can click on the Teacher Diagnostic Summary Tab to access the Teacher Diagnostic Summary report.

Teacher diagnostic summary The Diagnostic Summary shows how well the teacher impacted student learning at different achievement levels. Let’s take a closer look.

Teacher diagnostic summary Each slice of the pie chart is labeled and corresponds with the table below.

Teacher diagnostic summary Let’s go back to the Teacher Value Added Summary by click on the tab.

Teacher value added summary From here admins and teachers can access the individual subject value added report or the teacher composite report. Let’s look at the composite report first.

Teacher value added composite Let’s talk through the Composite Report: Index graph at the top for each school year composite The table at the bottom provides a bit more information The right hand side of the page will allow the user to change years in the drop down menu Let’s drill on a specific subject

Teacher Value Added Report When you click on a specific subject link, it will take you to the teacher’s value added report for that specific subject. Let’s take a closer look:

Teacher Value Added Report Talk about the parts of this report for each year, grade, and subject

Teacher Value Added Report Remember there are dropdowns on the Teacher Value Added and Diagnostic Reports, this drop down allows the teacher or admin to view the Teacher Estimate and Coordinating Standard Error

Teacher Value Added Report Here you will notice there aren’t color designations at all. This graph simply shows the teacher estimate and corresponding standard errors. It is very important to keep in mind that teachers and admins can NEVER compare teacher estimates.

Time out For understanding
Let’s talk for just a moment about why you cannot compare teacher estimates but you can compare teacher Indexes.

Teacher value added report Teacher Teacher Estimate Standard Error Index Level Ms. Above 1.5 0.5 3.0 Ms. Below 1.0 Let’s say we have two teacher at this school. Ms. Above and Ms. Below.

Teacher value added report -1.0 -0.5 0.5 1.0 Ms. Above 1 SE 2 SE -1 SE -2 SE Growth Standard Teacher Teacher Estimate Standard Error Index Level Ms. Above 1.5 0.5 3.0 Let’s do the math for Mrs. Above. READ THE CHART.

Teacher value added report -1.0 -0.5 0.5 1.0 Ms. Above 1 SE 2 SE -1 SE -2 SE Growth Standard Teacher Teacher Estimate Standard Error Index Level Above 1.5 0.5 3.0 1.5 ÷ 0.5 = 3.0 Teacher Estimate ÷ Standard Error = Index According to NC Business rules, Ms. Above is 2 or more standard errors above the growth standard and is identified as a teacher that Exceeds the Growth Standard in the Blue area.

Teacher value added report Teacher Teacher Estimate Standard Error Index Level Ms. Below 1.5 1.0 -2.0 -1.0 1.0 2.0 Ms. Below 1 SE 2 SE -1 SE -2 SE Growth Standard Let’s take a look at Ms. Below. Ms. Below also has a Teacher Estimate of 1.5.

Teacher value added report 1.5 ÷ 1.0 = 1.5 Teacher Estimate ÷ Standard Error = Index Teacher Teacher Estimate Standard Error Index Level Ms. Below 1.5 1.0 -2.0 -1.0 1.0 2.0 Ms. Below 1 SE 2 SE -1 SE -2 SE Growth Standard Ms. Below, while having the same teacher estimate, her Index rating places her in the green area as a teacher that Meets Expected Growth.

Teacher value added report -1.0 -0.5 0.5 1.0 1 SE 2 SE -1 SE -2 SE Growth Standard Teacher Teacher Estimate Standard Error Index Level Ms. Above 1.5 0.5 3.0 Ms. Below 1.0 -2.0 -1.0 1.0 2.0 1 SE 2 SE -1 SE -2 SE Growth Standard Index values are always the quotient of the teacher estimate divided by the standard error. This allows as we indicated earlier in the Index language you will see on the Teacher Reports the ability to standardizes growth measures across different models, subjects, grades and/or years for a more equitable comparison than the growth measure alone.

Back to the report Let’s keep going
Let’s head back to the report and take a look at the right hand side for this sample teacher.

Teacher Value Added Report By default the 2 Yr. Average or Multi-year Trend is shown by default. This teacher’s effectiveness rating of Meets Expected Growth is identified for the 2 year average. This teacher was 1 of 867 teachers in this grade and subject to reach the Meets Expected Growth level of effectiveness. If the teacher or admin wants to see individual years, they can use the drop down arrow to select an individual year.

Teacher Value Added Report Such as Notice the heading changes as does the values in the Nr. Of Teachers column. To look at 2012, select that year.

Teacher Value Added Report The heading and values change again

Teacher Value Added Report Let’s move now to the Teacher Diagnostic Report. I bet you can guess how to get there. If you’re thinking the Tabs above the graph, you’re right. Clicking on the Teacher Diagnostic tab will navigate to that report.

Teacher diagnostic Report The teacher diagnostic report will look very similar to what you have been used to seeing. Let’s look a bit closer.

Teacher diagnostic Report Talk through the Diagnostic Report. Blue / gold bars Standard Errors have changed. We now show 1 standard error with the solid whiskers, but we also show 2 standard errors with the dashed line. Nothing in the table below is clickable as you may remember in the old reports.

Teacher diagnostic Report That is because we have redesigned the report so that teachers can examine their diagnostic report along side their students. The right hand side will expand and contract to show the student in each achievement level.

Teacher diagnostic Report There is another report available to teachers from the diagnostic report. This tab will allow teachers to create a Custom Teacher Report very similar to the Student Pattern Report. Let’s see how this works.

Teacher diagnostic Report Here are the list of students that were included in the VA analysis after business rules were applied. These would also be students that this teacher claimed last year during RV. Let’s suppose… The teacher would select a minimum of 15 students and click the Create button at the bottom of the page.

Teacher Custom diagnostic Report When the teacher clicks the Create button, he/she will have a “Custom Diagnostic” based on the students selected. You can easily tell which students were impacted by this strategy or program and which needed something different possibly.

Teacher diagnostic Report From the Diagnostic Report a teacher can also look at subgroups of students based on demographic factors.

Subgroup Sorting

Winding down Q & A / Additional Needs

Thank you for coming Good luck with your training The information on these slides reflects the most current information as of October 15, The information was shared with District and School Admins via Webex participation throughout the month of October 2013.

Webex presenter & NCDPI Contact
Deanene Deaton, SAS Institute Educator Support Specialist Jenn Preston, NCDPI Race to the Top Project Coordinator for Teacher and Leader Effectiveness Curt C. Miller, SAS Institute Educator Support Specialist

New teacher reports October Training 2013.

Similar presentations

Presentation on theme: "New teacher reports October Training 2013."— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

New teacher reports October Training 2013.

Similar presentations

Presentation on theme: "New teacher reports October Training 2013."— Presentation transcript:

Similar presentations

About project

Feedback