Power of Proficiency Scaling ATI Summer 2014

Slides:



Advertisements
Similar presentations
Curriculum Work Group Grade 1.
Advertisements

Depths of Knowledge and Reading
Webb’s Depth of Knowledge
The Network of Dynamic Learning Communities C 107 F N Increasing Rigor February 5, 2011.
Leadership for the Common Core in Mathematics, University of Wisconsin-Milwaukee Reviewing the Cognitive Rigor Matrix and DOK Tuesday September.
Science Break Out Session New Math and Science Teacher Dec 2008 Becky Smith.
Standards Scaling– Teacher Leaders LMS Team
Leadership for the Common Core in Mathematics, University of Wisconsin-Milwaukee Linking Assessment Targets to Instructional Tasks and DOK This.
Marzano Art and Science Teaching Framework Learning Map
Smarter Balanced Assessment Consortium. Structure of the Common Core State Standards for Mathematics Research-based learning progressions Internationally.
Michigan Assessment Consortium Common Assessment Development Series Module 6 – The Test Blueprint.
An Overview of Webb’s Depth of Knowledge
The Marzano Framework Design Question 1
Webb’s Depth of Knowledge USD 457. Objectives CO – Analyze and apply the four levels of Webb’s Depth of Knowledge. LO – Read for the purpose of understanding.
Common Core State Standards in Mathematics: ECE-5
Teaching with Depth An Understanding of Webb’s Depth of Knowledge
Depth of Knowledge in Math K-5 Math Back to School Conference
The SLO Process Session 2 Denver Public Schools Assessment, Research and Evaluation, 2014.
Common Core Elementary Symposium Transitioning to the Common Core
A Look at Standards for Mathematical Practice, Grades K-2
Categorizing Classroom Experiences
Introduction to Depth of Knowledge
Philomath School District Board of Directors Work Session May 10, 2012.
Shifting to a Standards- Based Mindset Through Quality Assessments and Backwards Design LMS Department Everett High School October 10, 2014.
Everett Public Schools DOK to Unit Planning LMS Department August 28, 2014.
Everett Public Schools Madison Elementary School LMS Department August 28, 2014.
Building Effective Assessments. Agenda  Brief overview of Assess2Know content development  Assessment building pre-planning  Cognitive factors  Building.
Nicole Paulson CCSSO Webinar March 21, 2012 Transition to the Common Core State Standards in Elementary Math.
1 REACH Performance Tasks SY14-15 Library Science June 16, 2014.
DOK Depth of Knowledge An Introduction.
Hueneme Elementary School District Staff Development Day #3 March 10, 2014 CCSS Mathematic Unit of Study Grade 1.
Webb’s Depth of Knowledge
Webb’s Depth of Knowledge (DOK) Aligning Assessment Questions to DOK Levels Assessing Higher-Order Thinking.
Preparing to Cultivate 21 st Century Skills. Development of instruction and assessment that is rigorous and relevant. Measure progress in adding rigor.
NEW REALITY STUDENTS MUST HAVE HIGHER-ORDER THINKING SKILLS 1.
Sunnyside School District
Task Analysis Connecting Math and Science through class discussions.
Kindergarten Research Presentation Brianne Ciarlo Karly Millar Amanda Todd.
Quality Instruction The ♥ of the matter is the depth of knowledge.
Modified from Depth of Knowledge presentation by Dr. Robin Smith at 2009 PRESA Leadership Conference… Adapted from Kentucky Department of Education, Mississippi.
DEPTH OF KNOWLEDGE (DOK)
Developing Assessments for and of Deeper Learning [Day 2b-afternoon session] Santa Clara County Office of Education June 25, 2014 Karin K. Hess, Ed.D.
Depth of Knowledge Assessments (D.O.K.) Roseville City School District Leadership Team.
Page 1 Teaching with Depth: An Understanding of Webb’s Depth of Knowledge by Karen Taylor
Depth of Knowledge (DOK)
Depth of Knowledge and the Cognitive Rigor Matrix 1.
PLANTING THE SEEDS OF RIGOR Region I Principals’ Meeting November 5, 2010.
Patty Stephens, M.Ed, NBCT 7-12 Math Instructional Specialist, Northshore School District Jeanne Flahiff, M.A., NBCT 7-9 ELA teacher & instructional coach,
Standards-Based Instruction Implementation: Badge 4-Analyzing Standards.
DOK and 4th Grade Mathematics Smarter Balanced Assessment Questions
Today’s Learning Target I can explain how Webb’s Depth of Knowledge compliments Bloom’s Taxonomy to build rigor in the classroom.
Shifting to a Standards-Based Mindset
Teaching with Depth An Understanding of Webb’s Depth of Knowledge.
Common Core: Depth of Knowledge Rigor for Coaches.
What is RIGOR in the Math Classroom?. Presenter Introduction: Stephanie Darley East Valley RttT Math Coach Curriculum Coach at DHHS Been with TLG for.
COMMON CORE STANDARDS C OLLEGE - AND C AREER - READINESS S TANDARDS North East Florida Educational ConsortiumFall 2011 F LORIDA ’ S P LAN FOR I MPLEMENTATION.
COMMON CORE STANDARDS C OLLEGE - AND C AREER - READINESS S TANDARDS North East Florida Educational ConsortiumFall 2011 F LORIDA ’ S P LAN FOR I MPLEMENTATION.
Common Core State Standards Mapping to the Core May 21, 2013.
New Hope-Solebury School District. Develop a shared understanding of the concept of cognitive rigor Begin the conversation about Webbs’ Depth of Knowledge.
Palmyra Area School District Summer Goals  Develop an understanding of the Common Core State Standards (CCSS) in the area of Math, including the.
Instructional Leadership Supporting Common Assessments.
Understanding Depth of Knowledge. Depth of Knowledge (DOK) Adapted from the model used by Norm Webb, University of Wisconsin, to align standards with.
Dr. Lois McKee- Assistant Principal Curriculum Mr. William Scales- Testing Coordinator The Florida Standards: What Every Parent Should Know Seminole High.
Linking Curriculum, Instruction and Assessment in Mathematics March 10, 2016 CONNECTICUT STATE DEPARTMENT OF EDUCATION.
Day Two: February 25, :30-3:00. Series Goals Participants will have the opportunity to:  Work collaboratively to:  Deepen their knowledge of the.
Depth Of Knowledge Basics © 2010 Measured Progress. All rights reserved. He who learns but does not think is lost. He who thinks but does not learn is.
Everett Public Schools Evergreen Middle School LMS Department August 28, 2014.
CCSS & Smarter Balanced Mathematics: Key Shifts to Claims tinyurl.com/UPK5math University of Portland Brian Graham Camas School District TOSA M.Ed.
Teaching with Depth An Understanding of Webb’s Depth of Knowledge
Marzano Art and Science Teaching Framework Learning Map
Presentation transcript:

Power of Proficiency Scaling ATI Summer 2014 Everett Public Schools Power of Proficiency Scaling Jo Anne Buiteweg, Director of Learning Management Systems Jana Sanchez, STEM Mathematics Facilitator ATI Summer 2014

Entry Task Write down some of your thoughts for these two questions; be prepared to share. What does a “2” represent? (approaching proficiency) For a teacher? For a student? For a parent? For a transcript reviewer? What does a “4” represent? (beyond proficiency) Have participants share their thinking with and elbow partner. Have a few groups share their discussion with the whole group for each of the representative groups

“Clearly a better method for developing and scoring assessments is needed – one that ensures that the scale (the size of an inch) stays the same from one assessment to the next and that a teacher applies the same logic to scoring of each assessment.” Marzano, Robert J. Formative Assessment and Standards-Based Grading 2010

Session’s Overview How does“ Depth of Knowledge” (DOK) as defined by Norman Webb facilitate the implementation of standards-aligned program? How is the “Depth of Knowledge” a foundation for the construction of a proficiency scale to “unpack” clusters/ standards? How can we use the implementation of CCSS and NGSS as a way to infuse standards-focused practices? What implications does scaling have as the foundation for building leveled assessments and instructional plans? How can instructional leaders utilize proficiency scaling as a focal point for a more coherent system for curriculum, assessment and instruction? Print TM

Backwards Design Model Identify/Select Course Standards “Common Core” Scale Standards Design/Use Common “Leveled” Assessments Instructional Plan/Map Determine Reporting Variables Develop Interventions/Enrichment

Norman Webb’s Depth of Knowledge Adapted from the model used by Norm Webb, University of Wisconsin, to align standards with assessments The degree of depth or complexity of knowledge reflected in the content standards and assessments How deeply a student needs to understand the content for a given response/assessment

Webb’s Depth of Knowledge (DOK) Addresses the content being assessed and the depth to which we expect students to demonstrate understanding of that content. Is a reference to the complexity of mental processing that must occur to answer a question, perform a task, or generate a product Is about cognitive complexity, not difficulty Is not grade contextualized Offers a pathway to rigor

Webb’s email: I did not create the DOK wheel. I believe someone in Florida used my work to create the DOK wheel. Because the wheel is not mine, I cannot grant or deny its use.   I think the DOK chart is misleading and I do not recommend its use. Depth of Knowledge depends on more than the verb. The complexity also depends on what the verb is acting on. For example, “draw” is in the DOK level 1 sector. But a student who draws a blueprint of a new building is doing more than recall of information. Explain also can be at different levels--explain by repeating a definition (DOK level 1), explain by putting a paragraph into your own words (DOK level 2), or explain by describing an analysis of the factors contributing to the economic down turn of the US (DOK level 3).   So I cannot provide you the requested permission and, in fact, I discourage you from using the DOK wheel. It is a simplification of my work that does not fully represent the issues of content complexity. The only possible use of the chart I can see is if someone took a verb and ask how it could be placed in each of the four sectors.   I did create the definitions similar to the shorten version at the bottom of the chart. I have attached shorten definitions that you are free to use.I hope these are useful. I am sorry I do not have a precise graphic such as the wheel. Created based on work of Webb, Norman L. and others. “Web Alignment Tool” 24 July 2005. Wisconsin Center of Educational Research. University of Wisconsin-Madison. 2 Feb. 2006

Explain also can be at different levels--explain Depth of Knowledge depends on more than the verb. The complexity also depends on what the verb is acting on. For example, “draw” is in the DOK level 1 sector. But a student who draws a blueprint of a new building is doing more than recall of information. Explain also can be at different levels--explain by repeating a definition (DOK level 1), explain by putting a paragraph into your own words (DOK level 2), or explain by describing an analysis of the factors contributing to the economic down turn of the US (DOK level 3). Correspondence from Norman Webb – cautioning use of the wheel.

Bloom’s and Webb’s Different models to describe cognitive rigor Bloom – What type of thinking (verbs) are needed to complete the task? Webb – How deeply do you have to understand the content to successfully interact at a given depth? How complex is the content?

Cognitive Rigor Matrix This matrix from the Smarter Balanced Content Specifications for Mathematics draws from both Bloom’s (revised) Taxonomy of Educational Objectives and Webb’s Depth-of-Knowledge Levels below. The depth of knowledge levels defined by Smarter Balanced are informed by the Cognitive Rigor matrix. The Cognitive Rigor matrix combines two common taxonomies that categorize levels of cognition and shows how the Smarter Balanced depth of knowledge categories relate to these taxonomies. Here, the concept of remembering information only relates to the first depth of knowledge level. In contrast, evaluation does not relate to either of the first two levels of depth of knowledge. This table, which can be found in the Smarter Balanced Content Specifications for Mathematics, is a useful aid for guiding the development of items at different depth of knowledge levels. Now let’s examine the content specifications.

What do you think makes each of these tasks a different DOK level if it is not about the verb?

DOK Levels 4: Extended Thinking 1: Recall 2: 3: Strategic Thinking Skill /Concept 3: Strategic Thinking

Depth of Knowledge Recall— Identify this utensil. Concept— Explain the function of the fork. Strategic— Identify two examples of when a fork would not be the best utensil for a type of food and explain why. Extended— Design an investigation to determine the optimal number and length of tines for a salad fork. This example is meant to provide a simple, academic example of the difference between the Webb levels. It is meant to mirror the basic labels provided for each level on the first Webb slide. Level 1 – Recognizing and identifying a fork is at the factual recall level of understanding and application of the “concept” of a utensil. Level 2 - Requires a relatively simple level of understanding of how a fork functions and the skill of translating that understanding into an explanation. Level 3 - Requires some analysis and connecting to the understanding of forks and food to generate a conclusion and explanation for a real situation. Level 4 – Requires a deeper and more involved application of the understanding of forks as part of a complex investigation. From: Lois Barnes SREB/HSTW

Depth of Knowledge Recall— Identify the type of tree. Concept— Explain the function of the leaves. Strategic— Explain how a drought might affect the growth of the tree. Extended— Design an investigation of seedling growth to determine the best fertilizer for this type of tree. This example is meant to provide a simple, academic example of the difference between the Webb levels. It is meant to mirror the basic labels provided for each level on the first Webb slide. Level 1 – Recognizing and identifying a type of tree (coniferous, deciduous, etc.) is at the factual recall level of understanding and application of the “concept” of a tree. Level 2 - Requires a relatively simple level of understanding of how a tree functions and the skill of translating that understanding into an explanation. Level 3 - Requires some analysis and connecting to the understanding of trees to generate a conclusion and explanation for a real situation. Level 4 – Requires a deeper and more involved application of the understanding of trees as part of a complex investigation. From: Lois Barnes SREB/HSTW

Card Sort Activity? Working with an elbow partner label each task/prompt with the appropriate DOK level and justify your decision.

Cognitive Complexity vs Difficulty What is the difference between Cognitive Complexity and Difficulty Level? Difficulty refers to how many students answered the question correctly. High Order Thinking refers to how many steps it takes to answer the question. Add: 4,678,895+ 9,578,885 What is the DOK?

DOK Snapshot DOK is a scale of cognitive demand DOK is not an exact science DOK is not about difficulty but how much thinking is required for the student to complete the prompt/task DOK is about the item/standard not the student The context of the item/standard must be considered to determine the DOK level not just a look at what verb was chosen. DOK is lowered when too much information is given *Break*

How can we be consistent in applying DOK at our grade level? Depth of Knowledge = Cognitive Demand = Rigor How much and what kind of “thinking” is called for in each CCSS cluster, for classroom instruction and on assessments? What kinds of “thinking” is called for approaching the cluster and beyond the cluster?

Proficiency Scaling The process of identifying and developing the cognitive demand or level of rigor for a given standard. Starting with the standard: educators use a framework … (Bloom’s, Costa’s , Webb’s DOK or combination) …as way to build “a rigorous rubric-based approach in the interest of valid and reliable assessing” which informs both teacher and student If Proficient is the standard: What is Advanced? What is a Basic? Marzano, Robert J. Formative Assessment and Standards-Based Grading 2010

Common Core Grades K Grades 1 Grades 2 Understand addition as putting together and adding to, and understand subtraction as taking apart and taking from. 1. Represent addition and subtraction with objects, fingers, mental images, drawings2, sounds (e.g., claps), acting out situations, verbal explanations, expressions, or equations. 2. Solve addition and subtraction word problems, and add and subtract within 10, e.g., by using objects or drawings to represent the problem. 3. Decompose numbers less than or equal to 10 into pairs in more than one way, e.g., by using objects or drawings, and record each decomposition by a drawing or equation (e.g., 5 = 2 + 3 and 5 = 4 + 1). 4. For any number from 1 to 9, find the number that makes 10 when added to the given number, e.g., by using objects or drawings, and record the answer with a drawing or equation. Represent and solve problems involving addition and subtraction. 1. Use addition and subtraction within 20 to solve word problems involving situations of adding to, taking from, putting together, taking apart, and comparing, with unknowns in all positions, e.g., by using objects, drawings, and equations with a symbol for the unknown number to represent the problem.2 2. Solve word problems that call for addition of three whole numbers whose sum is less than or equal to 20, e.g., by using objects, drawings, and equations with a symbol for the unknown number to represent the problem. Use addition and subtraction within 100 to solve one- and two-step word problems involving situations of adding to, taking from, putting together, taking apart, and comparing, with unknowns in all positions, e.g., by using drawings and equations with a symbol for the unknown number to represent the problem. TM

Proficiency Scale Advanced Cognitive task extending from standard; requiring decision-making, expressing reasoning, or applying what has been explicitly taught in new contexts Proficient   Standard as defined by the state including expectations for content, process, skills, and/or performance to be explicitly taught. Basic Cognitive step just before standard that is explicitly taught; includes concepts broken into distinct segments, foundational skills and key vocabulary. Foundational With help, partial success of Basic or Proficient content and/or elements preceding Basic level. Print TM

Proficiency Scale level does not equal DOK level Recall/ Reproduction DOK 1 Skills/ Concepts DOK 2 DOK 3 Strategic Thinking Extended Thinking DOK 4 We’ll show you an example …

Proficiency Scale K-Math Advanced Proficient Basic Foundational Cognitive task extending from standard; requiring decision-making, expressing reasoning, or applying what has been explicitly taught in new contexts Count backwards from a given number by ones. Write numbers from various starting points beyond 20 and continue the number pattern. Write given numbers out of sequence above 20. Proficient   Standard as defined by the state including expectations for content, process, skills, and/or performance to be explicitly taught. Know number names and the count sequence. (MTH.K.CC.KNNCS) Count to 100 by ones (MTH.K.CC.KNNCS.1) Count to 100 by tens (MTH.K.CC.KNNCS.1) Count forward beginning from a given number within the known sequence (instead of having to begin at 1). (MTH.K.CC.KNNCS.2) Write numbers from 0 to 20. (MTH.K.CC.KNNCS.2) Represent a number of objects with a written numeral 0-20 (with 0 representing a count of no objects). (MTH.K.CC.KNNCS.3) Basic Cognitive step just before standard that is explicitly taught; includes concepts broken into distinct segments, foundational skills and key vocabulary Uses the pattern of 1-9 to count within a decade (e.g. in twenties, in thirties, etc) Writes numbers from 0 to 20 using a tool (e.g. number line, 100s chart) Represents a number of objects with a visual tool 0-20 (refer to a number line or number card). Recognizes the numbers from 0 to 20. Foundational With help, partial success of Basic or Proficient content and/or elements preceding Basic level. Print TM

Proficiency Scale Advanced Cognitive task extending from standard; requiring decision-making, expressing reasoning, or applying what has been explicitly taught in new contexts Proficient   Standard as defined by the state including expectations for content, process, skills, and/or performance to be explicitly taught. Basic Cognitive step just before standard that is explicitly taught; includes concepts broken into distinct segments, foundational skills and key vocabulary. Foundational With help, partial success of Basic or Proficient content and/or elements preceding Basic level. Print TM

Difference Between Scales and Rubrics Scales are built for teachers use in planning assessments and instruction Scales are tied to standard – independent of performance task Basic tasks are deliberate performance expectations not written to be “lacking” or “missing” proficient elements Rubrics are tied to specific performance expectations Rubrics are smaller picture Proficiency Scales are the bigger picture Print TM

Build Summative Assessments and Assessment Maps Reliable and Valid Items/Prompts aligned to standards Items/Prompts leveled Scoring and reporting variables determined Formative Assessment being used correctly Fix 7: Don’t organize by type but by standard Fix 8: Don’t grade unclear standards; provide clear expectations Fix 10: Don’t rely on weak assessments; use quality assessments

Leveraging Scaling Scaling and Leveling Rigorous, Informative Assessment Scaling and Leveling Curriculum & Instruction Reporting Variables/ Grading Practices

Schimmer’s Key Questions Emphasize COMPLETION or STANDARDS? Is school about ACTIVITIES or LEARNING? Is school about POINTS or EVIDENCE? Tom Schimmer, teacher and principal who is now authoring books and providing professional development around shifting to a Standards – Based Mindset asks these four questions. Is learning an EVENT or a PROCESS? Lead to O’Connor’s Fixes

Shift from Completion to Standards Emphasize COMPLETION or STANDARDS? Tom Schimmer, teacher and principal who is now authoring books and providing professional development around shifting to a Standards – Based Mindset asks these four questions. Fix 3: Don’t add “extra” points Fix 4: Don’t punish with grades (dishonesty) Fix 5: Don’t reduce grade based on attendance Fix 6: Don’t include “group” scores Fix 7: Don’t organize by type but by standard Fix 8: Don’t grade unclear standards; provide clear expectations Fix 9: Don’t assign grades through comparison to others Fix 10: Don’t rely weak assessments; use quality assessments Fix 11: Don’t rely on mean; use other measures and professional judgment Fix 12: Don’t include 0s – use “I” for insufficient evidence and gather information to make determination. Fix 13: Don’t use formatives in grade; use only summative evidence Fix 14: Don’t summarize evidence over time; emphasize recent achievement Fix 15: Don’t leave students out of the learning process- they should play key roles in assessment process. Fix 1: Don’t include student behavior Fix 2: Don’t reduce score for late work Fix: 14: Don’t summarize evidence over time: emphasize recent achievement.

Shift from Activities to Learning Is school about ACTIVITIES or LEARNING? Tom Schimmer, teacher and principal who is now authoring books and providing professional development around shifting to a Standards – Based Mindset asks these four questions. Fix 5: Don’t reduce grade based on attendance Fix 6: Don’t include “group scores” Fix 9: Don’t assign grades through comparison to others

Shift from Points to Evidence Tom Schimmer, teacher and principal who is now authoring books and providing professional development around shifting to a Standards – Based Mindset asks these four questions. Fix 3: Don’t add “extra” points Fix 4: Don’t punish with grades (dishonesty) Fix 11: Don’t rely on the mean; use other measures and professional judgment Fix 12: Don’t include 0s – use “I” for insufficient evidence and gather information to make determinations

Shift from Event to Process Is learning an EVENT or a PROCESS? Tom Schimmer, teacher and principal who is now authoring books and providing professional development around shifting to a Standards – Based Mindset asks these four questions. Fix 13: Don’t use formatives in grade; use only summative evidence Fix 15: Don’t leave students out of the learning process – they should play key roles in the assessment process”

Welcome, Encourage, Inspire to Build Confident Learners Dweck: Praise http://www.youtube.com/watch?v=TTXrV0_3UjY Ted Talk TTThttp://www.youtube.com/watch?v=pN34FNbOKXc Dweck http://www.youtube.com/watch?v=9hC1DwZS8tI