Assessing Content Proficiency MAINE CURRICULUM LEADERS’ ASSOCIATION, SEPTEMBER 29, 2014 HEIDI MCGINLEY, EXECUTIVE DIRECTOR,

Outcomes 1.Apply a four-step standards-based assessment design/alignment process. 2.Explore options to decide what evidence is necessary and how much is sufficient to document student proficiency. 3.Be aware of key principles of alignment.

Two key concepts 1. It’s only about the standard. 2. It’s all about fairness to students.

Assumptions 1.Assessment is essential in the teaching and learning process. 2.The principles of valid assessment design and use apply in a proficiency-based system. 3.How student evidence is generated and evaluated matters in determining proficiency.

Steps in SB Assessment Design Step 1. Unpack the indicator. Step 2. Write the scoring guide. Step 3. Determine what methods/types of demonstration will allow students to provide the required evidence of proficiency. Step 4. Write/align the assessment.

Step 1. Unpack the indicator. What exactly are we measuring??

Identify the main ideas or concepts and the supporting details in informational text. 1. Content domain, strand 2. Level of demand (verbs) 3. Types/kinds

Identify the main ideas or concepts and the supporting details in informational text. 1. Content domain, strand ◦Informational text 2. Level of demand (verbs) 3. Types/kinds

Identify the main ideas or concepts and the supporting details in informational text. 1. Content domain, strand ◦Informational text 2. Level of demand (verbs) ◦Identify 3. Types/kinds

Identify the main ideas or concepts and the supporting details in informational text. 1. Content domain, strand ◦Informational text 2. Level of demand (verbs) ◦Identify 3. Types/kinds ◦Main ideas/concepts ◦Supporting details for each main idea

Rhetorical Essay Grading Checklist 1. Introductory paragraph and thesis statement20 points 2. Organization and coherence produce a coherent whole15 points 3. Support for the main idea.20 points 4. Conclusion15 points 5. Voice15 points 6. Conventions15 points

Step 2. Write the scoring guide The student: Identifies: 1.the main ideas/concepts 2.the supporting details for each main idea.

Step 2. Write the scoring guide The student: Identifies: 1.the main ideas/concepts in informational text. (How many main ideas? What kind of text?) 2.the supporting details for each main idea. (How many supporting details?)

Step 2. Write the scoring guide The student: Identifies fewer than ___ main ideas/concepts and provides accurate supporting details for those identified. OR Identifies the required main ideas and provides few or inaccurate supporting details for some or all. The student: Identifies: 1.the main ideas/concepts in informational text. (How many main ideas? What kind of text?) 2.the supporting details for each main idea. (How many supporting details?)

Step 2. Write the scoring guide The student: Identifies fewer than _____ main ideas with few/no relevant details. The student: Identifies fewer than ___ main ideas/concepts and provides accurate supporting details for those identified. OR Identifies the required main ideas and provides few or inaccurate supporting details for some or all. The student: Identifies: 1._____ main ideas/concepts in informational text. (How many main ideas? What kind of text?) 2.the supporting details for each main idea. (How many supporting details?) The student identifies all main ideas and all supporting details.

Step 3. Determine what methods/types of demonstration will allow students to provide the required evidence of proficiency. Read a new informational text with:  More than 1 main idea.  Ample supporting details for each main idea.  Appropriate level of text complexity. AND the student must:  Be provided with a way to communicate the main ideas and their associated details without re-writing the text.

Go to Open Porky 1

Open Porky 2

SBA Design Principles 1.Assessing student proficiency of an indicator is a literal process. 2.The scoring guide is aligned with the requirements of the indicator. 3.The range of acceptable student responses is clearly stated at each score point and determined by what the indicator requires. 4.One demonstration of proficiency must allow students to demonstrate at all score points. 5.Methods of demonstration are aligned with the requirements of the indicator.

Example 1: Describe, model, and classify shapes and figures using applicable properties. 1. Content domain, strand 2. Level of demand (verbs) 3. Types/kinds

Example 1: Describe, model, and classify shapes and figures using applicable properties. 1. Content domain, strand Math, geometry 2. Level of demand (verbs) 3. Types/kinds

Example 1: Describe, model, and classify shapes and figures using applicable properties. 1. Content domain, strand Math, geometry 2. Level of demand (verbs) Describe, model, classify, use 3. Types/kinds

Example 1: Describe, model, and classify shapes and figures using applicable properties. 1. Content domain, strand Math, geometry 2. Level of demand (verbs) Describe, model, classify, use 3. Types/kinds Shapes and figures, applicable properties

Step 2. Write the scoring guide The student uses applicable properties to demonstrate one of the 3 requirements or does not demonstrate any. The student uses applicable properties to demonstrate two of the 3 requirements. The student uses applicable properties to: 1.Describe shapes 2.Model shapes 3.Classify shapes. 4.Errors or omissions are minor and do not indicate gaps in understanding. All three of the required demonstrations employ properties accurately and thoroughly. Properties used may be sophisticated or insightful.

Step 3: Determine what methods/types of demonstration will allow students to provide the required evidence of proficiency. Provide shapes for description and classification. Items must make clear to students which of the three requirements they’re being asked to demonstrate. More than 1 property must be applicable in each situation. Students must be able to respond without significant writing.

Practice Example 2 Step 1 Individually. Find a buddy and get and give feedback. Feedback: 1.Ask clarifying questions. 2.Make statements using what is in the indicator. 3.Teach when you can.

Example 2: Solve real-life problems using addition and subtraction of simple fractions. 1. Content domain, strand 2. Level of demand (verbs) 3. Types/kinds

Example 2: Solve real-life problems using addition and subtraction of simple fractions. 1. Content domain, strand Math, fractions 2. Level of demand (verbs) Solve, add, subtract 3. Types/kinds Real-life problems, simple fractions

Practice Example 2 Step 2 Individually. Find a buddy and get and give feedback. Feedback: 1.Ask clarifying questions. 2.Make statements using what is in the indicator. 3.Teach when you can.

Step 2. Write the scoring guide The student attempts to add or subtract simple fractions. The student either adds or subtracts simple fractions. Flaws indicate gaps in understanding. The student correctly adds and subtracts simple fractions. The student correctly add and subtracts simple fractions and justification or workspace shows sophisticated understanding of fractions.

Practice Example 2 Step 3 Individually. Find a buddy and get and give feedback. Feedback: 1.Ask clarifying questions. 2.Make statements using what is in the indicator. 3.Teach when you can.

Step 3: Determine what methods/types of demonstration will allow students to provide the required evidence of proficiency. Real-life problems – more than 1. Low text complexity. Provide multiple opportunities to add and subtract. Students do not need to identify fractions – they can be given the fractions to add and subtract. All fractions are simple fractions.

Practice Examples 3 – 6: All 4 steps. Get feedback from your buddy when you need it! Ask for help from me when you need it!

Example 3: Solve multi-step real-life problems using the four operations with whole numbers simple fractions. 1. Content domain, strand Math, operations 2. Level of demand (verbs) Solve, add, subtract, multiply, divide 3. Types/kinds Multi-step problems, real-life problems, whole numbers

Step 2. Write the scoring guide The student successfully uses 2 or fewer operations to solve problems. The student successfully uses 3 of the 4 operations to solve problems. The student successfully uses all four operations to solve problems. Minor flaws do not indicate misunderstandings. The student successfully uses all four operations to solve problems and ??

Step 3: Determine what methods/types of demonstration will allow students to provide the required evidence of proficiency. Multi-step, real-life problems – more than 1, more than 1 step Low text complexity. Multiple opportunities to demonstrate each of the 4 operations. Whole numbers.

Example 4: h. Present and defend a well- supported position to a variety of audiences using a prescribed format. Step 1: Unpack the indicator. 1. Content domain 2. Level of demand (verbs) 3. Types/kinds

h. Present and defend a well- supported position to a variety of audiences using a prescribed format. 1. Content domain Current SS issues 2. Level of demand (verbs) Present Defend Use 3. Types/kinds Supported position, variety of audiences, proscribed format

h. Present and defend a well-supported position to a variety of audiences using a prescribed format. 1. Content domain, strand 2. Level of demand (verbs) + types/kinds ◦Present a position to a variety of audiences ◦Defend with support ◦Use a prescribed format

Step 2. Write the scoring guide The student demonstrates one/none of the three requirements. The student demonstrates two of the three requirements. The student: 1.Presents a position to a variety (how many? What kinds?) of audiences. 2.Defends the position with (adequate and relevant?) support. 3.Uses the prescribed format (appropriately?) The student’s position is thoroughly supported with evidence appropriate to the specific audience. The demonstration may employ the prescribed format in a sophisticated or insightful manner.

Step 3. Determine what methods/types of demonstration will allow students to provide the required evidence of proficiency.  Could be either orally or in writing. (Could a position be adequately supported in another format?)  A common format must be provided.

Content Domain: Writing; informative/explanatory text Levels of demand: Introduce Organize Format Types & kinds: Topic Complex ideas Concepts Information Headings, graphics, multimedia

Content Domain: Writing; informative/explanatory text Levels of demand + types and kinds: Introduce ◦topic Organize ( as a unified whole) ◦Complex ideas ◦Concepts ◦Information Format to aid comprehension (headings, graphics, and/or multimedia)

Step 2. Write the scoring guide The student: Introduces the topic and develops ideas, concepts, and information in a unified whole, but does not include obvious formatting. OR The student introduces the topics and uses appropriate formatting, but does not develop a unified piece. The student: 1.Introduces the topic 2.Develops a unified piece by organizing (relevant?): Complex ideas Concepts Information 3.Uses headings, graphics, or multimedia (when appropriate for audience and purpose?) as aids to comprehension The student’s work demonstrates all the characteristics of a “3” and includes insightful or sophisticated organization of ideas, concepts and information.

Fair Opportunity to Demonstrate 1.The method must allow students to demonstrate. 2.Last best demonstrations are counted. Evidence collected before the student is ready (or has had opportunity to learn) are not. 3.Evaluation of student evidence is uniform by all scorers. The scoring guide! 4.Student work is often the best indicator of fairness/unfairness.