2. 2001 NCES MIS Conference Mohawk Regional Information Center Online Data Analysis at the School Building Level Meeting Local Needs Donald D. Peasley, Program Information and Improvement Specialist Joan Sotherden, Director Mohawk Regional Information Center

3. 2001 NCES MIS Conference Mohawk Regional Information Center Goals for Today Define Who Wants the Data Analysis Define What they need from the Data –Assessing Existing Data –Assessing Important Questions Identify the Planning Needed for the Collection, Organization, Analysis, Interpretation, and Utilization of Data at the Local Level Define Cultural Considerations

4. 2001 NCES MIS Conference Mohawk Regional Information Center Data Based Decision Making...

5. 2001 NCES MIS Conference Mohawk Regional Information Center Data, Data Analysis and Technology... “When you work with technology, you’re really working with people, their social attitudes, their superstitions, and their rules” –Jorg Haake, German National Research Center for Information Technology

6. 2001 NCES MIS Conference Mohawk Regional Information Center Why Base Decisions on the Data? Mandated Accountability Need for Documented Growth and Improvement of Learning Outcomes Market Forces Increased Expectations of Clientele Opportunities Afforded by Technology

7. 2001 NCES MIS Conference Mohawk Regional Information Center Who Needs Data Analysis at the Local Level? Primary Audience: –Principals –Superintendents, Central Office Admin. Secondary Audience: –Department Chairs –Teachers –School Boards –State Education Department

8. 2001 NCES MIS Conference Mohawk Regional Information Center What is the Client Need that Drives Data Analysis Requests? Federal Reporting State Reporting Regional Accountability—Comparisons Local Instructional Improvement Decisions Self Preservation!!!

9. 2001 NCES MIS Conference Mohawk Regional Information Center Planning and Assessing Needs for A Locally Based Data Analysis System What’s the big picture? School/ Community Information Student Information Teacher / Instructional Information Parent/ Family Information Student Performance/ Success

10. 2001 NCES MIS Conference Mohawk Regional Information Center Planning and Assessing Needs for a Locally Based Data Analysis System What are your primary questions? Example—Is retention related to race or gender? What is the grade distribution broken down by race, gender? What is the attendance rate broken down by race, gender?

11. 2001 NCES MIS Conference Mohawk Regional Information Center What is the grade distribution broken down by race, gender? Attempt One

12. 2001 NCES MIS Conference Mohawk Regional Information Center Question 2: What is the relationship of course grades to state exit exams?—Attempt One

13. 2001 NCES MIS Conference Mohawk Regional Information Center Question 3: What is the Effect of Attendance on Achievement? Attempt One

14. 2001 NCES MIS Conference Mohawk Regional Information Center Do you know how you measure the answers to your questions? What will the report look like?

15. 2001 NCES MIS Conference Mohawk Regional Information Center General Considerations in any Data Analysis Project What are the “business rules” for the organization? –(what are the important questions????) Where is the data now? –(what format is the data in?) –(what “shape” is the data in?) What constitutes “valid” data? –(when you deem the data to be “good”?) How often should the data be updated? –(what is the “refresh” cycle?) Who gets to use the data –(what are the security policies?)

16. 2001 NCES MIS Conference Mohawk Regional Information Center A Gateway to Performance Data

17. 2001 NCES MIS Conference Mohawk Regional Information Center Attempt Two—Preformatted Answers to Primary Questions

18. 2001 NCES MIS Conference Mohawk Regional Information Center Attempt Two, Cont.

19. 2001 NCES MIS Conference Mohawk Regional Information Center Attempt Two, Cont.

20. 2001 NCES MIS Conference Mohawk Regional Information Center Attempt Two, Cont.

21. 2001 NCES MIS Conference Mohawk Regional Information Center Attempt Two, Cont.

22. 2001 NCES MIS Conference Mohawk Regional Information Center Planning for a Data Analysis System Are you sure that you are getting the most out of your existing student management system? Do you know how to use your student management system? What data exists in a system now? What reports do you use now? What reports could you use now? Who is going to enter this data? Who is going to verify and maintain this data? Who is going to use this data? Are you sure you are not duplicating efforts? It only looks easy

23. 2001 NCES MIS Conference Mohawk Regional Information Center Delivering and Supporting A Data Analysis System Student, Financial, Personnel System(s) Report Functionality OLAP Access to Key Performance Indicators The Data Storage Shed…. Ad-Hoc Analysis Capability*** Training on Access Training on Interpretation Training on Data Management Regional collaboration Statewide collaboration

24. 2001 NCES MIS Conference Mohawk Regional Information Center Hints for Success Involve Teachers as Leaders and Planners Start Somewhere Promise Low, Deliver High It’s OK to Say “I don’t know” Get Help (and pay for it) when you need it “I’m from BOCES and I’m here to help” Involve Teachers as Leaders and Planners

25. 2001 NCES MIS Conference Mohawk Regional Information Center Top Ten Data Analysis Tools 1.Ad-Hoc Procedures 2.Spreadsheets--The Duct Tape of Data Analysts 3.Frequency Distributions 4.Average, Median, Standard Deviation 5.Bar Charts (see frequency distributions) 6 thru 10. Crosstabs tables and 2 and 3 Way Bar Charts

26. 2001 NCES MIS Conference Mohawk Regional Information Center Try our site…cognos.moric.org—log on as guest Contact: dpeasley@mohawk.moric.org jsotherd@mohawk.moric.org Thank You!!!!