1. Writing Rubrics
Module 5
Activity 4

2. Overview
This presentation is about writing rubric. It covers the following topics: Developing a rubric Student learning outcomes Descriptors

3. Rubrics
Rubrics consist of a set of criteria that are used to evaluate an examinee’s performance. A rubric can be holistic or analytic. Let’s review these two types of rubrics.

4. Holistic Rubrics Strengths Weaknesses
Emphasizes what student does well
One score does not provide diagnostic information
Reduces risk of the rater focusing on one aspect of writing (e.g., grammar)
It is difficult to interpret a single score
Students may have uneven abilities across subskills
Reduced reliability

5. Analytic Rubrics Strengths Weaknesses
Training raters is easier when there are different categories
Writing is more than the sum of its parts
Analytic rubrics keep raters from collapsing categories
Information from analytic rubrics may not be easy for students to interpret
There is no assurance that analytic rubrics will be used the way that they are intended.

6. Developing a Rubric
Think about the process of developing a rubric. Where would you begin? What process would you follow?

7. Developing a Rubric
You probably guessed that we begin with the writing construct and the target language use domain. We also want to think about student learning outcomes.

8. Student Learning Outcomes
Student Learning Outcomes are what we want students to be able to do at the end of a learning experience. For example, in this class one of your learning outcomes is to distinguish between good and poor prompts. Another learning outcome is to distinguish between holistic and analytic rubrics.

9. Student Learning Outcomes
Let’s imagine that one of the learning outcomes for our students is to be able to write a formal business letter. We would think about the features that are important for successful completion of this task. What do you think are some of the important features?

10. Business Letter Example
If it’s a professional letter, then the following are important: Correct format Correct spelling and punctuation Formal language Accurate grammar and vocabulary

11. Business Letter Example
Correct format Correct spelling and punctuation Formal language Accurate grammar and vocabulary We can use this information to make an analytic rubric or a holistic rubric.

12. Business Letter Example: Holistic Rubric3
Format is correct; spelling, punctuation, grammar, and vocabulary are accurate; language is formal. 2
Format is generally correct; spelling, punctuation, grammar, and vocabulary are mostly accurate; language is almost all formal. 1
Major errors with format, spelling, punctuation, grammar, and vocabulary. Informal language.
No response

13. Business Letter Example: Analytic Rubric
Format
Vocabulary & Grammar
Language
Spelling & Punctuation 3
No errors in format.
Vocabulary & grammar are correct.
Language is formal.
Spelling & punctuation are correct. 2
Very few errors in format.
Vocabulary & grammar are mostly correct.
Language is mostly formal.
Spelling & punctuation are mostly correct. 1
Some errors in format.
Vocabulary & grammar are somewhat correct.
Language is somewhat formal.
Spelling & punctuation are somewhat correct.
Significant errors in format; No response.
Significant errors in vocabulary & grammar; No response.
Significant errors in formality of language; No response.
Significant errors in spelling & punctuation; No response.

14. Descriptors

15. Descriptors
How do you write appropriate descriptors for a rubric? There are three methods:
Use your intuition and experience as a teacher.
Collect samples of writing, rank them from best to worst, and describe them.
Collect and analyze samples of writing.

16. Rubrics
As with questions and prompts, revising and piloting is very important. Sometimes what is clear to us is not clear to our students or to other raters.

17. Rubrics
When you give students a task or assignment, it is helpful to also give them a copy of the rubric. This will tell them what to focus on.

18. Reflect
Directions: write a one to two paragraph response to the following questions. This is an offline, non-graded assignment. 1. What are five important things to remember when creating a writing rubric?

19. Key Terms & Concepts
Review: Construct Target Language Use Domain Prompt Rubric Analytic Holistic (to) pilot / piloting

20. Next Steps
Now, you should read the PPT presentation about assessing grammar. This is activity #5.

21. Sources
Cohen, A. (1994). Assessing language ability in the classroom. Boston: Heinle, ELT.