1. Using Formative (Diagnostic) Data to Plan for Instruction: NAPLAN Reading, Numeracy, Spelling & Grammar and Punctuation Presented by Philip Holmes-Smith School Research Evaluation and Measurement Services

2. Overview of Session Using Diagnostic Data to Plan for Instruction Item Analysis – looking for guessing and misconceptions. Item Analysis – looking for required skills Zone of Proximal Development - Summarising strengths and weaknesses.

4. The Item Analysis Report Roughly equal numbers selecting each of the wrong answers = guessing Nearly all students who got this wrong gave the same wrong answer = common misconception

6. Correct = ? Most common incorrect = ? Year 3 Reading (Q16) Year 5 Reading (Q10)

7. Year 3 Reading (Q16) Year 5 Reading (Q10) ABCD Year 3257588 Year 5152803

8. Correct = ? Most common incorrect = ? Year 5 Reading (Q25) Year 7 Reading (Q19)

9. Year 5 Reading (Q25) Year 7 Reading (Q19) ABCD Year 52716551 Year 71713367

10. Correct = ? Most common incorrect = ? Year 3 Numeracy (Q24) Year 5 Numeracy (Q18)

11. Year 3 Numeracy (Q24) Year 5 Numeracy (Q18) ResponsesABCD Year 348251213 Year 5801343

12. Year 7 Numeracy (N08) Year 9 Numeracy (N07) Correct = ? Most common incorrect = ?

13. ResponsesABCD Year 72310364 Year 9175275 Year 7 Numeracy (N08) Year 9 Numeracy (N07)

14. Year 7 Numeracy (N23) Year 9 Numeracy (N18) Correct = ? Most common incorrect = ?

15. Year 7 Numeracy (N23) Year 9 Numeracy (N18) ResponsesABCD Year 74039416 Year 94933414

16. Correct = ? Most common incorrect = ? Year 3 Numeracy (Q21) Year 5 Numeracy (Q15)

17. Year 3 Numeracy (Q21) Year 5 Numeracy (Q15) ResponsesABCD Year 3957276 Year 5473203

18. Suggested School activities

19. The Student Response Report Choose “Student Response Report” Choose dimension and then either “Item Order” or “Difficulty order”

20. The Student Response Report

21. Data sorted by Item Difficulty and Student Ability Increasing Level of Difficulty Increasing Level of Ability Mostly correct Mostly incorrect

22. Zone of Proximal Development (Vygotsky) The known: What students can already do independently. Increasing Level of Difficulty Increasing Level Ability Zone of Proximal Development: What students are capable of learning with the assistance of explicit instruction from the teacher (scaffolding). The unknown: What students are incapable of learning before prior concepts are taught.

23. Summarising strengths and weaknesses see SPA

24. Year 3 Reading – The Known (What students can already do independently)

25. Year 3 Reading – The Unknown (What students are incapable of learning before prior concepts are taught)

26. Year 3 Reading – The Zone of Proximal Development (What students are capable of learning with the assistance of explicit instruction from the teacher [scaffolding]

27. Diagnostic Testing (Feedback) Hattie (2003)† shows that our most effective teachers (in terms of improving the learning outcomes of students) constantly use diagnostic information (Feedback) to inform their teaching. Hattie (2009)* shows that using feedback (i.e. using diagnostic information about what each student can and can’t do to inform teaching) has one of the biggest impacts on improving student learning outcomes. (Effect size =0.73) 2003: http://www.acer.edu.au/documents/RC2003_Hattie_TeachersMakeADifference.pdfhttp://www.acer.edu.au/documents/RC2003_Hattie_TeachersMakeADifference.pdf 2009: Hattie, John. (2009). Visible Learning: A synthesis of over 800 meta-analyses relating to achievement. NY: Routledge. † *

28. Suggested School activities Use the currently available diagnostic tools such as: –Fountas & Pinnell Benchmark Assessment System, –Marie Clay Obs. Survey, –English Maths Online ; SINE, –English & Maths Online (Government schools); SINE (CEO schools), –Probe 2, –Stars & Cars, –On-Demand Linear Tests. Develop your own diagnostic tests –As part of your curriculum planning process, think about the knowledge and skills you will be covering in the upcoming unit of work and put together a pre-test to determine who knows what. Using diagnostic information –Whether you are using a pre-existing test or your own pre-tests, use this diagnostic information to inform your teaching and learning activities and use them to inform your student groupings.