1. Why Peer Review? Rationale #4

2. Some advantages of peer review
Feedback is
more extensive
quicker
scalable
Can’t blame the reader!
Forces students to think metacognitively

3. Five types of feedback
Describe what you see in the work, e.g., by summarizing.
Clarify what is being said, e.g., ask qq.
Alter or point out corrections to be made
Suggest improvements
Evaluate how well it meets its objectives
DESCRIBING helps quality control, easy to spot a reviewer who missed the main points.
CLARIFY can be done in F2F review, or in “back reviews”/”rejoinders” in an online system
ALTER: Don’t do this first in a review!
SUGGEST is often the most helpful
EVALUATE is often the least useful, if not well explained

4. Helpful vs. unhelpful feedback
Helpful feedback is
Constructive
Specific
Balanced
Succinct
Respectful
vs.
Unhelpful feedback is:
Too positive or too negative
General & unspecific
Rambling
Aggressive – makes author feel “attacked”
“Helpful vs. unhelpful” slides taken from Pearce & Mulder, “Student peer review: an introductory tutorial.”

5. Helpful vs. unhelpful feedback
1. What are the main strengths of this report?
Unhelpful comment:
“Your report was really good! I enjoyed reading it.”
Author’s response: “I’m flattered you liked my report, but I don’t have a sense of what you thought was good about it.”
Helpful comment:
“This report was succinct and well written. The aims of the report were clear and I found it easy to identify your take- home messages...”
Gehringer, Providing effective peer feedback

6. Helpful vs. unhelpful feedback
2. Where are the main areas for improvement?
Unhelpful comment:
“Your report was poorly written and hard to read!”
Author’s response: “This comment doesn’t really help me to improve anything!”
Helpful comment:
“There are a few areas that might make this report stronger. Expanding the Introduction to include more background information would help set the scene a little more (para 2). The arguments could also be strengthened by adding additional references, for examples lines 3, 16 and 55...”

7. Helpful vs. unhelpful feedback
3a. Is the balance between the sections about right?
Unhelpful comment:
“No – there wasn’t enough space left for covering the background of the study.”
Helpful comment:
“The balance feels very good; however you may consider expanding the background section with greater information on theoretical concepts being tested”
Author’s response: “Although stating good and bad points, none of it was portrayed negatively. The comments were given helpfully, with clear points for me to follow.”

8. Helpful vs. unhelpful feedback
3b. Is the balance between the sections about right?
Unhelpful comment:
“The overall balance was good, with no section outweighing any other at all.”
Author’s response: “Very positive review, but not much given that I can improve on - I highly doubt it was almost perfect.”
Helpful comment:
“Not the best balance: The introduction and rationale sections were too lengthy. While very clear, they could be trimmed down quite a bit and made to be much more concise. For example, I think lines 108 to are unnecessary...”

9. How to say it Psychology is as important as assessment
Proceed from general to specific
Suggestions should be realistic in scope
Review the content, not the author
Avoid “always,” “never,” etc.
Start and end with positive

10. How to “receive” a review
Realize that reviews will vary in quality.
Make an effort to digest comments.
Even if they seem “off the wall,” they could still be how your readers see the work.
Be grateful for others’ help.
Ask for clarifications.

11. Learn from doing peer reviews
Lundstrom & Baker 2009
Class divided into 2 groups
Group A provided feedback to Group B
Students in Group A improved more than students in Group B.
Shah-Nelson 2014
Survey answered by 1040 students in MOOCs
Educational value of
“grading others’ papers” was 3.17 on a scale of 1 to 4
“feedback from other students” was only 2.92 on scale.