1. Strategies to Measure Student Writing Skills in Your Disciplines Joan Hawthorne University of North Dakota

2. Todays Agenda Introduction and overview Aligning tools and goals Designing and using rubrics Break Adapting rubrics to programs and purposes Outcomes and ownership Conclusions and evaluations

3. Whats wrong with assessment? Imposed Strategies we didnt choose and dont trust They dont trust us. What we need to turn in. Owned Our own methods and our own answers Lets see how students learn. What we want to know.

4. The most important purpose of assessment should not be improvement or accountability but their common aim: everyone wants students to get the best possible education. Linda Suskie

5. Making assessment better Actual student work Actual NIU classes Faculty-determined criteria Faculty-determined good enough vs. not so satisfying Conclusions speak to our own students learning

6. What do we want from these assessments of written communication?

7. When choosing a tool… What questions do you want to answer? Why do you want to know that? Who will this information matter to? What kinds of information would be interesting and useful to those people?

8. Rubric options Traditional rubrics Performance lists Checklists

9. The writing shows control of sentence level features of written language (grammar, spelling, punctuation, and usage). Sentence level features (grammar, spelling, punctuation, and usage) are used appropriately.

10. Presentation, syntax, mechanics Uses graceful language that skillfully communicates meaning to readers with clarity and fluency and is virtually error-free Uses straightforward language that generally conveys meaning to readers with few errors.

11. Benefits of using rubrics They help faculty articulate what they mean and want to see. They help students know what to aim for. They focus assessment activities on student work products and student learning. They focus assessment on faculty judgment. They link outcomes across levels.

12. Principles of rubric use Dont reinvent the wheel. Involve the people wholl use it. Involve the people wholl get their work scored. Dont wait for the perfect wording. And then start tweaking….

13. Using rubrics in your classes Assume the rubric will provide grading information as well as assessment information. Identify criteria first. Know what questions you want to be able to answer. Use principles of backwards course design. Engage students with rubric criteria.

14. Using rubrics at the program level Link writing goals/criteria with program goals/criteria. Identify specific concerns to be addressed. Identify questions to be answered. Consider means of engaging your students. Consider availability of student work products.

15. Program level – continued Reach agreements regarding traceability. Consider how methodology decisions will impact participation. Identify range of goals addressed by the work products. Plan analysis Descriptive vs. statistical Course level vs. program level

16. Using rubrics at the institutional level Identify information needs for the GE program. Plan faculty ownership and engagement. Find a source of papers likely to yield useful campus-wide information. Build on current rubric and current data. Plan student participation and engagement.

17. Institutional level -- continued Involve faculty in data analysis and meaning-making. Involve students in consideration of data. Identify opportunities to feed information into campus-wide discussions. Consider accreditation needs. Remember: a key element of rubric use is that faculty judgment is central.

18. YOUR TASK: Form table groups or pairs. Agree on a context (i.e., course, program, institution level). Begin planning adaptations to the NIU communication rubric to make it usable for your questions and purposes. Be ready to tell us about what changes you made and why.

19. Issues to be resolved… How much of the rubric is relevant to our purpose? Whats not in the rubric that we need? How do we adapt for first year vs. graduating? How much of an issue is language which doesnt feel right in another context? In your context, are the additional goals which would need to be counted or scored, maybe at the same time as the rubric is applied?

20. Assessment, one might say, must live where faculty live, in the classrooms where they teach the field they love. Pat Hutchings