International Center for Leadership in Education Dick Jones

Data Driven Decisions  Student Achievement  Standards  Curriculum and Assessment  Reading

Add these numbers ???

Add these numbers

Data is Powerful  Assess the current and future needs of students  Decide what to change  Determine if goals are being met  Engage in continuous school improvement  Identify root causes of problems  Promote accountability

Barriers  Lack of training in data use  No uniform data collection  Lack of leadership at the school and district level  Outdated technology  Unclear priorities  Distrust of data use

Types of Data  Curriculum  Demographics  Student Learning  School Processes  Perceptions of Quality

Types of Data Example Type of DataLiteracy Curriculum Demographics Student LearningPerformance on State Test Processes Perceptions of Quality

Types of Data Example Type of DataLiteracy CurriculumLevel of Reading Comprehension on State Test Real World Postsecondary Learning DemographicsIncoming Student Reading Levels Student LearningPerformance on State Test Local Assessment ProcessesReading Levels of Textbooks Teaching Materials Success of Reading Practices Perceptions of Quality Student Surveys

Suggestions for Using Data  Be Careful What you Count  Look At Distribution Rather than Averages  Disaggregate  Look at Trends  Collect Data to Answer Questions  Make Data Understandable  Analyze Deeper

Student Achievement  Training - group processes, software, definitions  Disaggregate  Do item analysis  Ask Questions  Dig for Root Causes (Don’t accept excuses)  Use multiple sources

 Evaluate lesson plans/curriculum for standards alignment  Revise plans/curriculum to ensure standards alignment  Identify at-risk students  Develop academic intervention plan

 Recognize need for professional development to support standards and strengthen instructional strategies  Identify students meeting or exceeding standards

International Center for Leadership in Education, Inc. Resources for Data Driven Decisions

Deciding Curriculum Priorities  Standards  Community expectations  State Tests  Blueprint  Type  Rigor/Relevance

International Center for Leadership in Education, Inc. Curriculum Matrix

Needed Time McREL 15,465 Hours Available Time 9,042Hours

Teachers struggling to teach an overloaded curriculum!

Curriculum Survey  ?? What should be priority??  Language Arts, Math, Science  20,000 surveys  Districts across U.S  School and Community  Select 35 priority content topics  Sub-group analysis

Curriculum Survey  Top Ranked - skill and content based  Low Ranked - more strategy  Educators and Community similar except subject specialists  Basic skills low ranked by subject area specialists  Top Ranked English could be responsibility of all

ICLE Curriculum Survey Language Arts - Top 10 Topics  Apply in writing the rules of grammar, punctuation and spelling  Gather, analyze and summarize information from a variety of sources  Give oral directions that are clear and understood  Follow oral directions  Identify and select pertinent information while reading  Follow written directions carefully and accurately  Understand rules of grammar, usage, punctuation, and spelling  Develop processes for understanding and remembering  Prepare and deliver individual speeches  Know how to decipher unfamiliar words

 Perform operations with numbers include, decimals, ratios, percents and fractions  Understand characteristics of parallel, perpendicular, and intersecting lines  Understand basic algebraic properties  Understand characteristics of angles  Understand best procedures for statistical data collection, organization and display  Understand basic geometry ( point, line, plane)  Understand and use variables in expressions  Use correct order for performing algebraic expressions  Compute the distance between two points  Understand properties of circles ICLE Curriculum Survey Mathematics - Top 10 Topics

 Understand how and why rotation and revolution of earth affect day, seasons and weather  Understand systems of human body  Understand nutrition  Know the metric system and conversion  Make observation of the local environment using senses and instruments  Understand technology changes environment  Know processes in water cycle  Understand reproduction of living things from cells to species  Understand cells and functions  Understand human impact on environment and ways to improve ICLE Curriculum Survey Science - Top 10 Topics

Curriculum Matrix Kit

Curriculum Matrix State Standard Related Essential Skills and priority Priority on State Test Overall Priority

Summary

State/Regents ELA Curriculum Survey of Essential Skills

State/Regents ELA Performance Indicators Tested

State/Regents Math Performance Indicators Tested

State/Regents Science Performance Indicators Tested

International Center for Leadership in Education, Inc. Career and Technical Education

CTE Kit components  Awareness  Overview (I)  New Foundations for CTE(II)  Data Driven Achievement (III)  How to – Rigor Relevance (IV)  Videos

CTE Kit components  Data  Priority standards  Integration by Cluster

CTE Matrix State Standard Related Essential Skills and priority Priority on State Test Appropriateness For Integration

Using CTE Matrix  Curricular Mapping Prioritize Instruction  Integrated (Interdisciplinary Instruction)  PR--Validate CTE Program  Options for Students  Accountability--CTE Program

International Center for Leadership in Education, Inc. ARTS

ARTS Matrix State Standard Related Essential Skills and priority Priority on State Test Appropriateness For Integration

How would you use this data?

Options  Adding Rigor and Relevance to your instruction  Theme-based Units taught by multiple teachers  Including other Standards in your instruction

 Rigor  Relevance  All students

Rigor/Relevance Framework

Assimilation of knowledge Acquisition Thinking Continuum

1.Awareness 2.Comprehension 3.Application 4.Analysis 5.Synthesis 6.Evaluation Knowledge Taxonomy

Basic Nutrition 1Label food by nutritional groups 2Explain nutritional value of foods 3Use nutrition guidelines in planning meals 4Examine success in achieving nutrition goals 5Develop personal nutrition goals 6Appraise results of personal eating habits over time Knowledge Taxonomy

Application Model

Acquisition of knowledge Application Action Continuum

Application Model 1 Knowledge of one discipline 2 Application within discipline 3 Application across disciplines 4 Application to real-world predictable situations 5 Application to real-world unpredictable situations

Basic Nutrition 1Label food by nutrition groups 2Rank foods by nutritional value 3Make cost comparison of foods considering nutritional value 4Develop nutritional plan for a health problem affected by food 5Devise a sound nutritional plan for a group of 3 year-olds who are “picky” eaters Application Model

12345 Application Knowledge Rigor/Relevance Framework

A

A B

A B C

A B D C

Rigor/ Relevance Handbook

A B D C Rigor/Relevance Framework Express probabilities as fractions, percents, or decimals. Classify triangles according to angle size and/or length of sides. Calculate volume of simple three- dimensional shapes. Given the coordinates of a quadrilateral, plot the quadrilateral on a grid. Analyze the graphs of the perimeters and areas of squares having different-length sides. Determine the largest rectangular area for a fixed perimeter. Identify coordinates for ordered pairs that satisfy an algebraic relation or function. Determine and justify the similarity or congruence for two geometric shapes. Obtain historical data about local weather to predict the chance of snow, rain, or sun during year. Test consumer products and illustrate the data graphically. Plan a large school event and calculate resources (food, decorations, etc.) you need to organize and hold this event. Make a scale drawing of the classroom on grid paper, each group using a different scale. Calculate percentages of advertising in a newspaper. Tour the school building and identify examples of parallel and perpendicular lines, planes, and angles. Determine the median and mode of real data displayed in a histogram Organize and display collected data, using appropriate tables, charts, or graphs.

A B D C Rigor/Relevance Framework Analyze the graphs of the perimeters and areas of squares having different-length sides. Determine the largest rectangular area for a fixed perimeter. Identify coordinates for ordered pairs that satisfy an algebraic relation or function. Determine and justify the similarity or congruence for two geometric shapes. Obtain historical data about local weather to predict the chance of snow, rain, or sun during year. Test consumer products and illustrate the data graphically. Plan a large school event and calculate resources (food, decorations, etc.) you need to organize and hold this event. Make a scale drawing of the classroom on grid paper, each group using a different scale. Calculate percentages of advertising in a newspaper. Tour the school building and identify examples of parallel and perpendicular lines, planes, and angles. Determine the median and mode of real data displayed in a histogram Organize and display collected data, using appropriate tables, charts, or graphs. Express probabilities as fractions, percents, or decimals. Classify triangles according to angle size and/or length of sides. Calculate volume of simple three- dimensional shapes. Given the coordinates of a quadrilateral, plot the quadrilateral on a grid.

A B D C Rigor/Relevance Framework Express probabilities as fractions, percents, or decimals. Classify triangles according to angle size and/or length of sides. Calculate volume of simple three- dimensional shapes. Given the coordinates of a quadrilateral, plot the quadrilateral on a grid. Analyze the graphs of the perimeters and areas of squares having different-length sides. Determine the largest rectangular area for a fixed perimeter. Identify coordinates for ordered pairs that satisfy an algebraic relation or function. Determine and justify the similarity or congruence for two geometric shapes. Obtain historical data about local weather to predict the chance of snow, rain, or sun during year. Test consumer products and illustrate the data graphically. Plan a large school event and calculate resources (food, decorations, etc.) you need to organize and hold this event. Make a scale drawing of the classroom on grid paper, each group using a different scale. Calculate percentages of advertising in a newspaper. Tour the school building and identify examples of parallel and perpendicular lines, planes, and angles. Determine the median and mode of real data displayed in a histogram Organize and display collected data, using appropriate tables, charts, or graphs.

A B D C Rigor/Relevance Framework Express probabilities as fractions, percents, or decimals. Classify triangles according to angle size and/or length of sides. Calculate volume of simple three- dimensional shapes. Given the coordinates of a quadrilateral, plot the quadrilateral on a grid. Obtain historical data about local weather to predict the chance of snow, rain, or sun during year. Test consumer products and illustrate the data graphically. Plan a large school event and calculate resources (food, decorations, etc.) you need to organize and hold this event. Make a scale drawing of the classroom on grid paper, each group using a different scale. Calculate percentages of advertising in a newspaper. Tour the school building and identify examples of parallel and perpendicular lines, planes, and angles. Determine the median and mode of real data displayed in a histogram Organize and display collected data, using appropriate tables, charts, or graphs. Analyze the graphs of the perimeters and areas of squares having different-length sides. Determine the largest rectangular area for a fixed perimeter. Identify coordinates for ordered pairs that satisfy an algebraic relation or function. Determine and justify the similarity or congruence for two geometric shapes.

A B D C Rigor/Relevance Framework Express probabilities as fractions, percents, or decimals. Classify triangles according to angle size and/or length of sides. Calculate volume of simple three- dimensional shapes. Given the coordinates of a quadrilateral, plot the quadrilateral on a grid. Analyze the graphs of the perimeters and areas of squares having different-length sides. Determine the largest rectangular area for a fixed perimeter. Identify coordinates for ordered pairs that satisfy an algebraic relation or function. Determine and justify the similarity or congruence for two geometric shapes. Calculate percentages of advertising in a newspaper. Tour the school building and identify examples of parallel and perpendicular lines, planes, and angles. Determine the median and mode of real data displayed in a histogram Organize and display collected data, using appropriate tables, charts, or graphs. Obtain historical data about local weather to predict the chance of snow, rain, or sun during year. Test consumer products and illustrate the data graphically. Plan a large school event and calculate resources (food, decorations, etc.) you need to organize and hold this event. Make a scale drawing of the classroom on grid paper, each group using a different scale.

Knowledge Taxonomy Verb List

Application Model Decision Tree

Decision Tree Application Model International Center for Leadership in Education 1997

Decision Tree Is it Application?  If NO Application Model Level 1 International Center for Leadership in Education 1997

Decision Tree Is it Application?  If NO If YES - Is it real world?  If NO and one discipline  If NO and interdisciplinary Application Model Level 1 Level 2 Level 3 International Center for Leadership in Education 1997

Decision Tree Is it Application?  If NO If YES - Is it real world?  If NO and one discipline  If NO and interdisciplinary If YES - Is it unpredictable?  If NO  If YES Application Model Level 1 Level 2 Level 3 Level 4 Level 5 International Center for Leadership in Education 1997

Reflection on Your Teaching

KNOWLEDGEKNOWLEDGE A P P L I C A T I O N A B D C AcquisitionApplication Adaptation Assimilation Identify one experience in your class in each quadrant

KNOWLEDGEKNOWLEDGE A P P L I C A T I O N A B D C AcquisitionApplication AdaptationAssimilation Rigor/Relevance Framework

Skill Identify, collect or sort pertinent information while reading.

Quadrant A Read a science experiment and identify the necessary materials to perform the experiment.

Quadrant B Locate and read current articles on biotech.

Quadrant C Read and analyze 3 original newspaper articles from WW II and identify reasons for opposition to US entry into the war.

Quadrant D Read pertinent information related to El Nino weather patterns and propose possible summer vacation destinations.

Rigor/Relevance Framework 1.Awareness 2.Comprehension 3. Application 4.Analysis 5.Synthesis 6.Evaluation 1. Knowledge of one discipline 2. Application within discipline 3. Application across disciplines 4. Application to real world predictable situations 5. Application to real world unpredictable situations KnowledgeApplication

Rigor/Relevance Challenge

R/R Challenge StandardQuadrant A Performance Understand rules of grammar, usage, punctuation, and spelling Memorize spelling Words Perform operations with numbersSolve word problems Demonstrate U S geographyLabel States on a map Understand systems of human body Write description of human system

Rigorous and Relevant Assessment

NYS Math A Question June 2003 D

NYS Math A Question June 2002 C

NYS Math Question A

KNOWLEDGEKNOWLEDGE A P P L I C A T I O N A B DC NY Math A 26 % 42 % 10 % 22 %

KNOWLEDGEKNOWLEDGE A P P L I C A T I O N A B DC FCAT Math Grade 10 7%7% 25 % 50 % 18 %

R/R and Assessment Determine the level of Rigor and Relevance on state tests. Develop your tests to parallel state tests when preparing for them. Use performance assessment when you want Quadrant D achievement Keep level of assessment consistent with expectation for performance.

Rigorous and Relevant Instructional Strategies

Instructional Strategies: How to Teach for Rigor and Relevance

“Unification” in Science Temperature 1700 Time 1890 Reading 2000

Lexile Framework Independent measure Independent measure 200 to to 2000 Books, Tests, Students Books, Tests, Students

Lexile Framework Semantic Difficulty Semantic Difficulty Syntactic Complexity Syntactic Complexity

Lexile Literature On Ancient Medicine The Scarlet Letter Brown vs. Board of Ed War and Peace Pride and Prejudice Black Beauty Tom Swift in the Land of Wonders The Adventures of Pinocchio Bunnicula: A Rabbit Tale of Mystery A Baby Sister for Frances The Magic School Bus Inside the Earth Frog and Toad are Friends Clifford’s Manners

Last Grade Completed Data: National Adult Literacy Study (1992) Reader measure (in Lexiles)

Current Job Data: National Adult Literacy Study (1992) Reader measure (in Lexiles)

Data: National Adult Literacy Study (1992) Reader measure (in Lexiles)

Reading Requirements Research Analyze actual reading materials Analyze actual reading materials 16 Clusters and sub clusters 16 Clusters and sub clusters 3 Levels of Workers 3 Levels of Workers

Reading Requirements Research Ag/Natural Resources 1510 Transportation/Distr./Log Architecture/Construction 1350 Manufacturing 1330 Retail/Wholesale 1320 Business and Admin Law/Public Safety 1300 Scientific Research/Engr Arts/AV Tech/Comm Health Services 1200 Human Services 1140 Information Tech 1100

Culinary Arts Academy

Tourism, Hospitality & Resort Management

Environmental Science & Field Research

International Center for Leadership in Education, Inc. Determining Root Causes

Fishbone Diagram

Student Absenteeism

Fishbone Diagram Student Absenteeism

Fishbone Diagram Student Absenteeism People ProceduresPublicPhysical Plant Policies

Fishbone Diagram Student Absenteeism People ProceduresPublicPhysical Plant Policies

Fishbone Diagram Student Absenteeism People ProceduresPublicPhysical Plant Policies No teacher follow-up Increase in illness Parents don’t support No rewards Policy unclear Lack of business support Uninteresting teaching No health services Open campus Lack of security Limited facilities

Resources for Data Driven Curriculum DecisionResource Which Standards?Aligning Standards Kit NCLB Kit Special Ed Kit Which Standards to Integrate? CTE Resource Kit Arts Kit How to Teach for Relevance?R/R Handbook Strategies Gold Seal Lessons How do we address adolescent literacy? Leading w/ Reading Kit Reading in the Content Area

Data References  Bernhardt, V. L. The school portfolio toolkit: A planning, implementation, and evaluation guide for continuous school improvement. Larchmont, NY: Eye On Education  Preuss, Paul G. Root Cause Analysis: School Leader’s Guide to Using Data to Dissolve Problems. Larchmont, NY: Eye on Education,  Love, Nancy. Using Data/Getting Results: A Practical Guide for School Improvement in Mathematics and Science Norwood, MA: Christopher-Gordon Publishers  Toolbelt. 10 Feb  COSN.

Data Driven Decisions  Student Achievement  Standards  Curriculum and Assessment  Reading

PowerPoint Slides or