Of Team-Meeting Criteria Gray Scott, Ph.D., grayscott@twu.edu Peer Rating Of Team-Meeting Criteria Gray Scott, Ph.D., grayscott@twu.edu

Overview The following approach is best suited for Assignments in which students are meeting with each other for collaborative work, and you want to use their impressions of how their peers handled that collaboration for assessment data.

Step 1: Find Your Criteria

Where to Find Assessment Criteria Address http://www.twu.edu/academic- assessment/7008.asp Navigation TWU / Academic Assessment / Core Assessment / (Google Drive) What to Do Open the Teamwork rubric. Keep that rubric open as you move to Step 2.

Step 2: Review the Team-Meeting Criteria The next page lists five criteria often associated with team meetings, for which students are likely to have a more accurate perspective than observers would. Find those criteria on the Teamwork rubric.

Which Criteria to Review Assignment PEER RATING/TEAM- MEETINGS Relevant Objective TEAMWORK Appropriate Criteria 1. Contributes to Team Meetings 2. Facilitates the Contributions of Team Members 3. Fosters Constructive Team Climate 4. Individual Contributions Outside of Team Meetings 5. Responds to Conflict

Step 3: Read the Performance Descriptors Those are the cell-by-cell descriptions of high-, middle-, and low-quality performances. After reading them, you should choose 3 to 5 of the criteria that best apply to what the students are doing. It’s okay to pick only three.

A Screenshot of the Relevant Part of the Rubric Assignment PEER RATING/TEAM- MEETINGS 3 2 1

Step 4: Find the Yes/No Questions for Your Criteria For each of the five Team-Meeting criteria, we have created a set of Yes/No questions that students can answer in surveys. You will find those questions on the next three slides.

Yes/No Survey Questions, by Criterion Assignment PEER RATING/TEAM- MEETINGS Contributes to Team Meetings Does the team member offer alternative solutions or courses of action that build on the ideas of others? Does the team member attend team meetings consistently and participate appropriately in team activities? Facilitates the Contributions of Team Members Is the team member respectful and constructive in team communications, providing assistance and/or encouragement to others? Does the team member build on or synthesize what others have contributed?

Yes/No Survey Questions, by Criterion Assignment PEER RATING/TEAM- MEETINGS Fosters Constructive Team Climate Is the team member respectful and constructive in team communications, providing assistance and/or encouragement to others? Does the team member convey a positive attitude about the team's work and its ability to accomplish it? Individual Contributions Outside of Team Meetings Does the team member come to meetings having completed assigned work in ways that advance or improve the project? Does the team member proactively take an interest in the outside-of-meeting contributions of other team members? (Examples: Coordinating what the group members do, evaluating work being done, helping to keep the group on-deadline.)

Yes/No Survey Questions, by Criterion Assignment PEER RATING/TEAM- MEETINGS Responds to Conflict Does the team member respond to constructive alternative perspectives with active listening? (That is, asking questions in an attempt to understand differences of opinion.) Does the team member respond to personal attacks and other non-constructive conflict in ways that strengthen overall team cohesion and future effectiveness? (Examples include troubleshooting personal conflicts and changing the subject back to the team's mission.)

Step 5: Create a Survey Instrument Create a survey for students to fill out, in which they can identify a student on their team and answer the Yes/No Questions for each of the criteria that you picked. Ideally, each student should be evaluated in this way by multiple team members.

Step 6: Fill Out an Assignment Profile on CASSIE An Assignment profile tells us what you have asked your students to do. By completing the form, you tell us what you did and which criteria our raters should be scoring. CASSIE is our online core-assessment system, a link to which appears on the following page, along with instructions.

CASSIE Creating Assignments Address https://twuls.twu.edu/CoreAssessment/Default.aspx Navigation TWU/Pioneer Portal/My Tools/Core Assessment Tasks 1. Click Assignments on the top menu 2. Pick term, course 3. Enter title and instructions. Mention you’re using this approach. 4. Identify objective(s) 5. Identify relevant criteria (3-5 per objective) 6. Important! Under supplemental documents, include a Key, letting us know which survey questions align with which criteria.

Step 7: Submit Artifacts Through CASSIE Once your students have completed their surveys, collect all of the peer-ratings for each of the students being sampled and pool the results by individual. For example, if Jane Pioneer has been rated by three of her teammates, create a document listing how each of those three teammates rated her for each of the Criteria. Then submit that document as an Artifact through CASSIE by following the instructions on the next page. Do this for each student in your sample.

CASSIE Uploading Artifacts Address https://twuls.twu.edu/CoreAssessment/Default.aspx Navigation TWU/Pioneer Portal/My Tools/Core Assessment Tasks 1. Choose Artifacts from the top menu 2. Pick term, course, student(s) (up to 3 at a time) 3. Choose Assignment that artifact fulfills 4. Attach artifacts 5. If student was not peer-rated, check the No Artifact Available option.

Step 8: That’s It!