1. Arroyo Valley High School August 19, 2013
Depth of Knowledge
Arroyo Valley High School
August 19, 2013

2. Goals and Objectives Determine why states opted to choose the CCSS
Articulate the characteristics of Webb’s Depths of Knowledge Levels and use the Cognitive Rigor Matrix to identify the DOK and Bloom’s level for various skills
Ali

3. Prior Knowledge Questions
1) What do you already know about Common Core State Standards?
Ali

4. 3-Minute Common Core Video

5. Discuss with Groups:
With a partner, discuss your reactions to the video.
Why did most states choose to adopt the common core state standards?
Ali

6. What Does Rigor Look Like?
Connect the Dots: Implementing & Assessing the Common Core Standards
Lauryn
Taken from the work of Karin K. Hess, Ed.D.

7. Before we begin…
Take a minute to discuss your personal definition of “cognitive rigor” as it relates to instruction, learning, and/or assessment
Lauryn

8. Now let’s apply your rigor definition…
Your class has just read some version of Little Red Riding Hood.
What is a basic comprehension question you might ask?
What is a more rigorous question you might ask?
Lauryn

9. Developing the Cognitive Rigor Matrix
Different states/schools/teachers use different models to describe cognitive rigor. Each addresses something different.
 Bloom’s: What type of thinking (verbs) is needed to complete a task?
Webb’s DOK: How deeply do you have to understand the content to successfully interact with it? How complex is the content?
Lauryn

10. Bloom’s Taxonomy [1956 ] & Bloom’s Cognitive Process Dimensions [2005]
Knowledge—Define, duplicate, label, list, name, order, recognize, relate, recall
Remember—Retrieve knowledge from long-term memory, recognize, recall, locate, identify
Comprehension—Classify, describe, discuss, explain, express, identify, indicate, locate recognize, report, review, select, translate
Understand—Construct meaning, clarify, paraphrase, represent, translate, illustrate, give examples, classify, categorize, summarize, generalize, predict…
Application—Apply, choose, demonstrate, dramatize, employ, illustrate, interpret, practice, write
Apply—Carry out or use a procedure in a given situation; carry out or use/apply to an unfamiliar task
Analysis—Analyze, appraise, explain, calculate, categorize, compare, criticize discriminate, examine
Analyze—Break into constituent parts, determine how parts relate
Synthesis—Rearrange, assemble, collect, compose, create, design, develop, formulate, manage, write
Evaluate—Make judgments based on criteria, check, detect inconsistencies/fallacies, critique
Evaluation—Appraise, argue, assess, choose, compare, defend, estimate, explain, judge, predict, rate, core, select, support, value
Create—Put elements together to form a coherent whole, reorganize elements into new patterns/structures
Lauryn

11. Webb’s Depth-of-Knowledge Levels
DOK-1 – Recall & Reproduction - Recall of a fact, term, principle, concept, or perform a routine procedure
DOK-2 - Basic Application of Skills/Concepts - Use of information, conceptual knowledge, select appropriate procedures for a task, two or more steps with decision points along the way, routine problems, organize/display data, interpret/use simple graphs
DOK-3 - Strategic Thinking - Requires reasoning, developing a plan or sequence of steps to approach problem; requires some decision making and justification; abstract, complex, or non- routine; often more than one possible answer
DOK-4 - Extended Thinking - An investigation or application to real world; requires time to research, problem solve, and process multiple conditions of the problem or task; non-routine manipulations, across disciplines/content areas/multiple sources
Lauryn

12. Video Application
What are the main differences among the DOK levels according to the video?
DOK Video
Ali

13. Reflection
What are the main differences between a DOK 2 and a DOK 3 question or task?
Ali

14. Bloom’s and DOK
First, locate what Bloom’s Level a task or question is:
Remember
Understand
Apply
Analyze
Evaluate
Create
Ali

15. Bloom’s and DOK
Then, determine which DOK level the question or task is:
Ali
DOK 1
DOK 2
DOK 3
DOK 4
Recall and Reproduction
Basic Application of Skills and Concepts
Strategic Thinking
Extended Thinking

16. DOK is about complexity— not difficulty!
The intended student learning outcome determines the DOK level. What mental processing must occur?  
While verbs may appear to point to a DOK level, it is what comes after the verb that is the best indicator of the rigor/DOK level.
Describe the physical features of a plant.
Describe the properties of integer exponents.
Describe how the two political parties are alike and different.
Describe the most significant effect of WWII on the nations of Europe.
Lauryn

17. Identifying Bloom’s and DOK
“Describe”: What new Bloom’s Level is this skill?
Remember
Understand
Apply
Analyze
Evaluate
Create

18. Identifying Bloom’s and DOK
What DOK Level are these tasks? Describe the physical features of a plant. Describe the properties of integer exponents. Describe how the two political parties are alike and different. Describe the most significant effect of WWII on the nations of Europe.
Lauryn
DOK 1
DOK 2
DOK 3
DOK 4
Recall and Reproduction
Basic Application of Skills and Concepts
Strategic Thinking
Extended Thinking

19. Identifying Bloom’s and DOK
Describe the physical features of a plant. Remember, DOK 1 Describe the properties of integer exponents. Understand, DOK 1 Describe how the two political parties are alike and different. Understand, DOK 2 Describe the most significant effect of WWII on the nations of Europe. Understand, DOK 3

20. The Hess Cognitive Rigor Matrix:
Depth +
thinking
Level 1 Recall & Reproduction
Level 2 Skills & Concepts
Level 3
Strategic Thinking/ Reasoning
Level 4
Extended Thinking
Remember
-Recall, locate basic facts, details, events
Not appropriate at this level
Understand
-Select appropriate words to use when intended meaning is clearly evident
-Specify or explain relationships
-summarize
-identify central idea
-Explain, generalize, or connect ideas using supporting evidence (quote, example…)
-Explain how concepts or ideas specifically relate to other content domains or concepts
Apply
-Use language structure (pre/suffix) or word relationships (synonym/antonym) to determine meaning
-Use context to identify meaning of word
-Obtain and interpret information using text features
-Use concepts to solve non-routine problems
-Devise an approach among many alternatives to research a novel problem
Analyze
-Identify whether information is contained in a graph, table, etc.
-Compare literary elements, terms, facts, events
-analyze format, organization, & text structures
-Analyze or interpret author’s craft (literary devices, viewpoint, or potential bias) to critique a text
-Analyze multiple sources
-Analyze complex/abstract themes
Evaluate
-Cite evidence and develop a logical argument for conjectures
-Evaluate relevancy, accuracy, & completeness of information
Create
-Brainstorm ideas about a topic
-Generate conjectures based on observations or prior knowledge
-Synthesize information within one source or text
-Synthesize information across multiple sources or texts
Lauryn

21. Identifying Bloom’s & DOK Levels
For each task listed below, identify where it would fall on the Cognitive Rigor and Relevance Matrix:
Identify transitional words and phrases and helped you know the sequence of events in the story.
Are all wolves (in literature) like the wolf in this story? Support your response using evidence from other texts.
Retell or summarize the story in your own words
What is your opinion about the intelligence of the wolf? Justify using details and evidence from the story.
Write a telephone conversation between little Red Riding hood and her mother that explains the wolf incident.
Who was the main character? What was the story’s setting?
Ali

22. Reflection and Share-Out:
How does DOK build upon your knowledge of Bloom’s?
How will this impact how teachers design class assignments or performance tasks?
Ali

23. Defining DOK
In small groups, use the resources provided to create your own user-friendly definitions for each DOK level on the chart paper provided
Ali

24. Group Share Out!
Group 1
Group 2
Group 3
Group 4

25. Wrap Up and Reflection
Take the low and high level questions that you receive, and now place them on the NEW Bloom’s and DOK matrix in order to determine their rigor level
How has your definition of rigor changed, and how will this affect how you create assessment tasks and questions?
Ali

26. Objective Reflection Determine why states opted to choose the CCSS
Articulate the characteristics of Webb’s Depths of Knowledge Levels and use the Cognitive Rigor Matrix to identify the DOK and Bloom’s level for various skills
Ali