1. Virginia State University Summer Data Institute: Digging into Data to Identify the Learner-Centered Problem Presented by: Justina O. Osa, Ed.D

2. Introduction If schools and school systems are to continuously improve, they must measure growth in student achievement. After all, the core of all activity in schools and school systems is teaching and learning.

3. Food for Thought Data do not provide right answers or quick fixes, but data offer decisionmakers an opportunity to view a phenomenon through a number of different lens, to put forward hypotheses, to challenge beliefs, and to pose more questions. (Earl & Katz, 2005.) School Improvement is a systemic, research-based, data-driven process that helps schools maximize student performance. ( NCA CASI, SACS CASI, and NSSE, 2008.)

4. Data Analysis, A Process Of Looking For Meaning In Data Data analysis is a process of looking for meaning in data. Knowing what data is available and knowing how to use them are of vital importance in this era of school accountability and continuous improvement In order to adequately use assessment data to improve student performance we need a deeper understanding of data. We need to refine our skills in analyzing, interpreting, and making informed decisions. Use data to identify gaps and trends.

5. Data Use and Key Questions 1. Are the students learning? 2. What are they not learning? 3. Why are they not learning? 4. What needs to be done to help them learn? 5. Who needs to be involved to help them learn? 6. How do we know when they are learning?

6. What Data Do We Need?

7. Three Steps To Digging Into Data 1. Getting more out of what you are given 2. Understanding data elements that make it possible to get more than what are given. 3. Exploring trends in performance

8. Step 1: Getting More Out Of What You Are Given Knowing how to look at what you are given Look for surprising and expected results in data in your hand

9. Step 2: Understanding Data Elements That Make It Possible To Get More Than What Are Given Know the many data elements and coding options incorporated into the data management systems.

10. Step 3: Exploring Trends In Performance Can be done in many ways. Look at overall data Look at breakdowns Look at changes in test scores across grades within a given year – e.g. scores for students in grades 3,4,5, in 2006 can be compared Examine data across years to identify changes in the scores of students within specific grades e.g. the performance of grade 4 students can be compared in 2004 - 2005, 2005 - 2006, 2006 – 2007 Look at the performance of the same student as they progress across grades. Thurton, Elliott, and Ysseldyke, 2003

11. Remember !!! Look at the nature of errors that significant numbers of students have made. Benchmark your district’s curriculum and instruction to the errors that many students have made -- you are likely to produce significant improvements in student achievements.

12. Digging into Data – Identify Levels

13. Triangulation of Data Sources Enhances the accuracy and specificity of learner-centered problem An individual piece of data has little meaning until it is compared to a larger benchmark Most useful when done objectively and prepared for surprises, unexpected trends and leads

14. Triangulation of Data Sources -- Examples

15. Error Analysis – How? Test item analysis – content and type Look for patterns across item groups Look at individual test items Find student logic pattern

16. Identifying Learner-Centered Problem Dig into data Triangulate data Identify problems Prioritize problems Choose the problem(s) to tackle

17. Action 1. What is our real situation or problem? 2. What is our goal -- where do we want to be? 3. Why are we not where we want to be? 4. How can we counteract the causes of the focused learner-centered problem? 5. What do we need – human and material? 6. Planning 7. Develop evaluation tool (s) 8. Implementation 9. Evaluation

18. Group Work – Dig into Data Dig into as many sources of data as possible Identify learner-centered problem Develop a plan of action Prepare to share

19. Group Work -- Questions What is the overall score? Is it at benchmark? What is the accuracy rate? What error patterns do you observe? Are there similar trends in the data from one grade level to the next? … THEN THINK ABOUT INSTRUCTIONAL IMPLILCATIONS … REMEMBER THAT A COMPLEX SET OF FACTORS INTERACT TO IMPACT STUDENT LEARNING

20. Group Work Study the distributed data Complete the tasks on previous slide Design a plan of action

21. Reports, Sharing & Comments

22. Perceived Barriers To Using Data

23. Identifying & Solving Learner-Centered Problems: Tips Establish and maintain a safe and non-threatening work environment Promote culture of collaboration, collegiality, respect and trust Promote culture of inquiry Share leadership for improvement of teaching and learning Encourage constructive criticism Design adequate guidelines to guide conversation Address issues and not persons Promote participation by all Schedule regular faculty review and work sessions Engage in practices that support the ongoing improvement of teaching and learning

24. Enhancing Teacher Collaborative Identification of Learner-Centered Problem -- Cont’d Develop a common language to use during teacher collaborative identification of learner- centered problem Develop a glossary of terms to guide discussions – for consistency and accuracy

25. Thanks for Your Attention & Contribution *