1. Looking at Student Work November 2013
Data Analysis
Looking at Student Work
November 2013

2. High School Regents Analysis
allows us to:
to learn more about the competencies and deficiencies of the individual being tested.
to identify specific problem areas and/or needs.
to evaluate the individual's performance in relation to others, a set of standards or goals.
High School Regents Analysis

3. High School Regents Analysis
and also……
Provide teachers with feedback on effectiveness of:
-Instruction
-Teaching Strategies
-Interventions
Action plans from Teacher Leads
We knew in March and April that they couldn’t write why did we end up in last place
Questions 24, 3, & 9
Ineffective teaching
High School Regents Analysis

4. Looking at Student Work from Regents
item analysis:
A method of assessment of how a question on a test measures the performance of a student.
Analyzing each item on a test to determine the proportions of students selecting each answer.
Evaluate student strengths and weaknesses.
Looking at Student Work from Regents

5. Looking at Student Work from Regents
main uses:
Understanding patterns of achievement in your school-wide Regents performance
Identifying particular areas in which students need assistance in
Looking at Student Work from Regents

6. High School Regents Analysis
for each question number:
Content Standard (strand.)
Question Type (T); MC, CR, etc.
Question Number (#)
Correct Answer ( )
Distractor Analysis (A, B, C, D)
Correct Answer ( ) % Correct (G,Y,R)
Individual Student Answers (A, B, C, D)
High School Regents Analysis

7. High School Regents Analysis
individual student responses:
Incorrect – White
Correct – Light Green
M – Multiple Answers
X – Missing Answer (left blank)
(-) - ???
High School Regents Analysis

8. High School Regents Analysis
written essay responses on Disc:
Individual Student (taking the Regents for the 2nd time)
Written Reponses printed and provided to teachers for analysis
Teachers adjust curriculum and instruction to address individual student areas of weakness
In class
After school Regents Prep
High School Regents Analysis

9. Looking at Student Work from Regents
what does it tell us:
Were students guessing?
What should I re-teach?
Common Misconceptions?
Strengths?
Looking at Student Work from Regents

10. Looking at Student Work from Regents
in addition:
Focus on questions that the students answered between 30% and 80% correct
These are the ones that are most valuable
Looking at Student Work from Regents

11. Looking at Student Work from Regents
Distractors:
Information on the (frequency of) selection can help teachers identify student/class/school misconceptions and problems.
Looking at Student Work from Regents

12. Looking at Student Work from Regents
before you get started:
Identify 5 questions (each) from the M/C section that they believe students would find the …
“Least Challenging” (circle) – Why?
“Most Challenging” (star) – Why?
Looking at Student Work from Regents

13. Looking at Student Work from Regents
Then, based on the data analysis
Identify the lowest 5 questions or strands, and begin to think about: Why were these the most difficult for students?
Looking at Student Work from Regents

14. Item and or essay question Discussion
What is this question asking students to know (content) and be able to do (process/skills)?
What is/are the reason(s) this was a difficult question for our students?
How does this question assess student mastery of an idea, concept, … , and/or skill/process?
What are the implications for instruction?

15. Reflections on Item/ESSAY QUESTION Analysis
What surprised me most about the data was …
From the data I learned …
The impact of the data on my future teaching/assessment will be …
In thinking about revising the curriculum, the data clearly indicates …

16. Looking at Student Work from Regents
Identify:
Major Concepts and Big Ideas that students would need to understand to successfully complete this test item.
The requisite process skills (inquiry or problem solving) that are embedded in the test item
The cognitive demand as indicated by the Webb Depth of Knowledge level are identified.
Looking at Student Work from Regents

17. Looking at Student Work from Regents
additional resources: 

Looking at Student Work from Regents

18. Middle School Item Analysis
arisnyc.org:
Click on connect
Select TAPCo. Private
Download item skills analysis tool
Middle School Item Analysis

19. Middle School Item Analysis
identify:
Find most common mistakes
Standards associated with each question
Compare writing scores to NYC Performance Assessments
Can you see a pattern?
Middle School Item Analysis

20. Middle School Item Analysis
support:
EngageNY.org
-Common Core Curriculum & Assessments
-Data Driven Instruction
-Video Library
Middle School Item Analysis

21. Middle School Item Analysis
featured resources:
EngageNY.org
-Curriculum Modules for ELA & Math
-NYS Metrics & Expectations
( )
Middle School Item Analysis

22. Middle School SAMPLE EXAM QUESTIONS (Multiple CHOICE AND ESSAY)
featured resources:
EngageNY.org
Middle School SAMPLE EXAM QUESTIONS (Multiple CHOICE AND ESSAY)

23. Item AND/oR QUESTION Discussion
What is this question asking students to know (content) and be able to do (process/skills)?
What is/are the reason(s) this was a difficult question for our students?
How does this question assess student mastery of an idea, concept, … , and/or skill/process?
What are the implications for instruction?

24. Reflections on Item and/or QUESTION Analysis
What surprised me most about the data was …
From the data I learned …
The impact of the data on my future teaching/assessment will be …
In thinking about revising the curriculum, the data clearly indicates …

25. CLOSING THE DATA LOOP
Upload your class Data Analysis results and action plans to teacher-only pages on our school website.
Have meeting with Administration at end of each marking period to discuss Scholarship reports, instructional and other interventions.
Be prepared to share student work that has changed as a result of your closing the data loop!