1. California Mathematics Council November 2, 2013 Ivan ChengJaspreet Sandha icheng@csun.edujxs9368@lausd.net Lina Kim lina.n.kim@gmail.com The Right Answer Is NOT Enough

2.  The proportion = can be used to solve which of the following situations? Situation 1:For every 1 teacher, there are 2 TAs at Some HS. If there are 10 teachers, how many TAs are there? Situation 2:Abel is 1 year old and Betty is 2 years old. When Abel is 10 years old, how old will Betty be? A.Situation 1 B.Situation 2 C.Both Situations 1 and 2 D.Neither Situation 1 nor 2 Presented by Jimmy de la Torre at AERA 2013 Just for Fun – Try This Now

3.  The proportion = can be used to solve which of the following situations? Situation 1:For every 1 teacher, there are 2 TAs at Some HS. If there are 10 teachers, how many TAs are there? Situation 2:Abel is 1 year old and Betty is 2 years old. When Abel is 10 years old, how old will Betty be? A.Situation 1 B.Situation 2 C.Both Situations 1 and 2 D.Neither Situation 1 nor 2 Presented by Jimmy de la Torre at AERA 2013 The Right Answer is NOT Enough

4. Suppose on one test…  Period 1 students averaged 75% correct  Half the class scored 100% and the other half scored 50%  Period 2 students averaged 75% correct  Half the class scored 76% and the other half scored 74%  How do these two classes differ?

5. The Right Answer is NOT Enough Suppose on one test…  Two students both scored 75% Sample problem: 12 – 2(3 – 5)  One student got –20 for an answer and another student got 8 for an answer  How do their errors differ?  What does this mean for our teaching practice?

6.  Mathematical content  Ratios & proportions, the number system, expressions & equations, functions, geometry, statistics & probability  Mathematical practices 1.Make sense of problems and persevere in solving them 2.Reason abstractly and quantitatively 3.Construct viable arguments and critique the reasoning of others 4.Model with mathematics 5.Use appropriate tools strategically 6.Attend to precision 7.Look for and make use of structure 8.Look for and express regularity in repeated reasoning The Right Answer is NOT Enough

7. Depth of Knowledge (DOK)  Cognitive rigor for each type of thinking  Remember (Level 1 only)  Understand (Levels 1 – 4)  Apply (Levels 1 – 4)  Analyze (Levels 1 – 4)  Evaluate (Levels 3 – 4)  Create (Levels 1 – 4)  What is the DOK for current CSTs?

8. Depth of Knowledge (DOK) DOK 3DOK 4 Current CST <2%0% New SB Assessment 49%21% Yuan & Le (2012); Herman & Lin (2013), from Linda Darling-Hammond Assembly Testimony, 3/6/13

9. Depth of Knowledge (DOK) DOK 3DOK 4 Current CST <2%0% New SB Assessment 49%21% Yuan & Le (2012); Herman & Lin (2013), from Linda Darling-Hammond Assembly Testimony, 3/6/13

10. Smarter Balanced Blueprints  “Claims”  Assessment “Targets” ELAMath 1ReadingConcepts and Procedures 2WritingProblem Solving 3Speaking/ListeningCommunicating Reasoning 4ResearchModeling/Data Analysis

11.  “Claims” integrate content and practices  Assessment “Targets” ELAMath 1ReadingConcepts and Procedures 2WritingProblem Solving 3Speaking/ListeningCommunicating Reasoning 4ResearchModeling/Data Analysis Smarter Balanced Blueprints

12.  “Claims” integrate content and practices  Assessment “Targets” specify what will be tested ELAMath 1ReadingConcepts and Procedures 2WritingProblem Solving 3Speaking/ListeningCommunicating Reasoning 4ResearchModeling/Data Analysis

13. Smarter Balanced Blueprints  “Claims” integrate content and practices  Assessment “Targets” specify what will be tested ELAMath 1ReadingConcepts and Procedures 2WritingProblem Solving 3Speaking/ListeningCommunicating Reasoning 4ResearchModeling/Data Analysis

14. Claim 1–Concepts and Procedures

15.  Assessment Targets–Grade 8 A.Numbers (NS.1, NS.2) B.Radicals and exponents (EE.1, EE.2, EE.3, EE.4) C.Proportional relationships and equations (EE.5, EE.6) D.Expressions and equations (EE.7, EE.8) E.Functions (F.1, F.2, F.3) F.Modeling relationships (F.4, F.5) G.Geometric relationships (G.1, G.2, G.3, G.4, G.5) H.Pythagorean Theorem (G.6, G.7, G.8) I.Volume (G.9) J.Data analysis (SP.1, SP.2, SP.3, SP.4)

16. Claim 2–Problem Solving

17.  Assessment Targets–Grades 6–8, 11 A.Applying mathematics to solve problems B.Select and use appropriate tools strategically C.Interpret results in the context of a situation D.Identify important quantities in a practical situation and map their relationships

18. Claim 4–Modeling and Data Analysis  Assessment Targets–Grades 6–8, 11 A.Apply mathematics B.Construct chains of reasoning to justify models, solutions C.State logical assumptions being used D.Interpret results in the context of a situation E.Analyze the adequacy of and improve models F.Identify important quantities in a practical situation and map their relationships

19. Claim 3–Communicating Reasoning

20.  Assessment Targets–Grades 6–8, 11 A.Test propositions or conjectures with specific examples B.Construct chains of reasoning to justify or refute C.State logical assumptions being used D.Breaking arguments into cases E.Distinguishing correct logic F.Base arguments on concrete referents G.Determine conditions under which arguments apply

21. Claim 1 Concepts & Procedures Claim 2 Problem Solving Claim 3 Communicating Reasoning Claim 4 Modeling & Data Analysis Selected Response (SR) 33 Constructed Response (CR) 33 Extended Response (ER) 3333 Technology Enhanced (TE) 33 Performance Task (PT) 3 Item Types for SBAC Assessments

22. From Smarter Balanced Assessments, MAT.06.SR.1.000EE.F.072 Sample Selected Response Item

23. From Smarter Balanced Assessments, MAT.07.CR.1.000EE.D.165 Sample Constructed Response Item

24. From Smarter Balanced Assessments, MAT.06.ER.2.000EE.C.172 Sample Extended Response Item

25. From Smarter Balanced Assessments, MAT.HS.TE.1.0AREI.I.088 Sample Technology Enhanced Item

26.  Mathematical content  Ratios & proportions, the number system, expressions & equations, functions, geometry, statistics & probability  Mathematical practices 1.Make sense of problems and persevere in solving them 2.Reason abstractly and quantitatively 3.Construct viable arguments and critique the reasoning of others 4.Model with mathematics 5.Use appropriate tools strategically 6.Attend to precision 7.Look for and make use of structure 8.Look for and express regularity in repeated reasoning The Right Answer is NOT Enough

27.  Mathematical content  Ratios & proportions, the number system, expressions & equations, functions, geometry, statistics & probability  Mathematical practices 1.Make sense of problems and persevere in solving them 2.Reason abstractly and quantitatively 3.Construct viable arguments and critique the reasoning of others 4.Model with mathematics 5.Use appropriate tools strategically 6.Attend to precision 7.Look for and make use of structure 8.Look for and express regularity in repeated reasoning What Do We Need to Do?

28.  Have clear objectives for each test item we make  Use the standards and blueprints  Specify precise learning goals  Create problems that reveal understanding  Use SBAC samples as a guide  Reveal mastery of specific concept or skill  Analyze student work for understanding  Go beyond the score  Look for patterns of errors and misunderstandings What Do We Need to Do?

29.  Have clear objectives for each test item we make  Use the standards and blueprints  Specify precise learning goals  Create problems that reveal understanding  Use SBAC samples as a guide  Reveal mastery of specific concept or skill  Analyze student work for understanding  Go beyond the score  Look for patterns of errors and misunderstandings Assessment Planning Matrix

31.  Have clear objectives for each test item we make  Use the standards and blueprints  Specify precise learning goals  Create problems that reveal understanding  Use SBAC samples as a guide  Reveal mastery of specific concept or skill  Analyze student work for understanding  Go beyond the score  Look for patterns of errors and misunderstandings Creating Assessments with the APM

32. From Smarter Balanced Assessments, MAT.06.SR.1.000EE.F.178

33.  Claim 1 – Target F – Grade 6 Concepts & Procedures – Expressions & Equations Model 1: SR (DOK 2) – Stimulus: The student is presented with a one-variable equation or inequality in a problem and/or problem set. Prompt: The student is prompted to use substitution to identify the solution to one-variable equations and inequalities. Model 2: SR (DOK 2) – Stimulus: The student is presented with a verbal expression in a real-world or mathematical problem involving a one-variable equation in the form x + p = q or px = q or a one variable inequality in the form of x > c or x < c. Prompt: The student is prompted to identify the variable equations or inequalities that correspond to verbal expressions in real-world and mathematical problems. Or the student is prompted to identify the solution to one-variable equations and inequalities in real-world and mathematical problems. Model 3: SR (DOK 1, 2) – Stimulus: The student is presented with a one-variable inequality presented in a real-world or mathematical problem. Prompt: The student is prompted to identify a number line that represents the solution to a one-variable inequality presented in a real-world or mathematical problem. Creating Assessments with the APM

36.  Selected Response (SR)  Constructed Response (CR)  Extended Response (ER)  Technology Enhanced (TE)  Performance Task (PT)  Choose one sample as a model  Note the Assessment Target and the DOK  Note the type of stimulus and the prompt  Create a similar task Creating Assessments with the APM

37. Online Resources  Common Core resources  CA Common Core Standards http://www.cde.ca.gov/be/st/ss/documents/ccssmathstandardaug2013.pdf http://www.cde.ca.gov/be/st/ss/documents/ccssmathstandardaug2013.pdf  Smarter Balanced sample interactive problems http://sampleitems.smarterbalanced.org/itempreview/sbac/index.htm http://sampleitems.smarterbalanced.org/itempreview/sbac/index.htm  Howard County https://secondarymathcommoncore.wikispaces.hcpss.org https://secondarymathcommoncore.wikispaces.hcpss.org  MARS/Shell http://map.mathshell.org/materials/stds.php http://map.mathshell.org/materials/stds.php  Illustrativemathematics.org  Schools.nyc.gov/Academics/CommonCoreLibrary  Achievethecore.org  Serpmedia.org

38. Thank You Ivan ChengJaspreet Sandha icheng@csun.edujxs9368@lausd.net Lina Kim lina.n.kim@gmail.com The Right Answer Is NOT Enough