Peer review in an economics writing course: the Pen is still mightier than the SWoRD Jennifer Imazeki Department of Economics

Slides:



Advertisements
Similar presentations
Online Course Design Online Course Design EVALUATION AND REVISION
Advertisements

1 The New Technology Internet Tablet PC (wireless) Projector (wireless) Router (wireless) Students/student groups (with laptops, handhelds, etc.)
Andrea Han and Joanne Fox
This course will develop your ability to research, critically read and effectively integrate academic and popular sources. Specifically in Freshman II.
[ 1 ]Confidential Benefits for Teaching. Impact on Learning. Introduction to Turnitin 1.
Energy-Intensive Industrial Rates Workgroup Information Session Steve Bakkal Michigan Energy Office Michigan Economic Development Corporation March 24,
Chapter 8 Criteria and Validity PERSIAN GROUP. ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون.
Using Rubrics for Assessment: A Primer Marcel S. Kerr Summer 2007 
Integrating writing into (even large) economics classes All handouts available at Jennifer Imazeki San Diego State University jenniferimazeki.com.
LEARNING TO WRITE: A COMPUTER SUPPORT FOR A COOPERATIVE PROCESS.
You feedback includes: 1.Your original case submission (with comments). 2.Your original protocols (with comments) 3.A rubric form (with comments). Computing.
Assessing Peer Performance in PBL Groups: how technology can help Carolyn K. Manning Associate Professor Dept of Health, Nutrition & Exercise Sciences.
Can Students Write their own Textbook? Dr. Jennifer Kidd.
1 Smart Quiz System, An Active Learning Tool. Dr. Ahmed Salem, IE-201 Course Coordinator Faculty of Engineering, KAU. October 2008 Dr. Ahmed Salem, IE-201.
The purpose of this workshop is to introduce faculty members to some of the foundation issues associated with designing assignments for writing intensive.
Viral Knowledge for Any Discipline: A Health Communication Instructional Case Exemplar for Teaching Students to Distribute Learning! Jessica J. Eckstein,
By Richard Schutt For Colorado Christian University Management of Web Based Classes EDU543 Professor Andrew Roob.
Course Introduction CS 2302 SPRING Course Introduction In this part we'll discuss course mechanics. Most of this will apply to all sections of the.
Digital Course Support PRESENTER [First & Last Name] [Title] InSite Getting Started.
The “Flipped Classroom” Experience Chris DiPalma, P.E. Operations Discipline Champion Federal Highway Administration Office of Operations.
Are You Connected?. Connect Composition 2.0 McGraw-Hill 2 nd edition 2013 © Your required materials…
Talent Management System Mike Rounds and Ola Faucher Human Resource Management November 6,
Burton Style Analysis Essay: Plan, Outline, & Draft Plan, outline, and draft your essay (see rubric) Remember the prompt: What have you learned about style.
1 The Use of Standards for Peer Review of Online Courses Barbara Battin Little, DNP, MPH, RN
UH - Downtown. Our Journey…Our Goals  Evaluate course management systems  Raise standards and expectations  Provide consistency for both faculty and.
Pilot Training for Volunteers General Education Assessment Committee.
A review of peer assessment tools. The benefits of peer assessment Peer assessment is a powerful teaching technique that provides benefits to learners,
Chapter 23 Writing Portfolios. Copyright © Houghton Mifflin Company. All rights reserved.23 | 2 Chapter overview Looks at the use of portfolios, as well.
The Call to Write, Third edition Chapter 23, Writing Portfolios.
The Writing Process. Step-by-Step Climb Mount Fuji, O snail, but slowly, slowly. Basho.
The Four P’s of an Effective Writing Tool: Personalized Practice with Proven Progress April 30, 2014.
Communication Skills: Connecting Personally Sheridan Institute of Technology and Advanced Learning Wednesday, April 27, 2005 Michael Kunka, TCDSB Literacy.
LT512 Reading in the Content Areas Professor: Donna Numeroff-Martin, EdD Seminar: Monday 7:00pm EST Week 5: Unit 5 Comprehension Strategies.
Effective Grading Strategies Alison Morrison-Shetlar Faculty Center for Teaching and Learning Adapted from the book Effective Grading by Barbara Walvoord.
Who is Desire2Learn? Ian Smissen Yvonne Monterroso Scenarios for the use of ePortfolios in Education.
Writing Across the Curriculum One way to facilitate critical thinking.
EAL WRITERS AS PEER REVIEWERS Challenges and Opportunities Amanda Goldrick-Jones, SFU Student Learning Commons Shauna Jones, SFU Beedie School of Business.
English Department Glendale Community College English Assessment Program Documents are available online on the Assessment Program webAssessment Program.
Dual Enrollment English 101 Valerie Best
Evaluating Student Presentations Speaking Intensive Workshop.
WRA 150: EVOLUTION OF AMERICAN THOUGHT THURSDAY, OCT. 2, 2013.
The Use of Formative Evaluations in the Online Course Setting JENNIFER PETERSON, MS, RHIA, CTR DEPARTMENT OF HEALTH SCIENCES.
Acadia Institute for Teaching and Technology Peer Review.
LET’S DO THIS THING! Today We Peer Edit Rough Drafts.
STUDENT SURVEY OF INSTRUCTION (SSI) INSTRUCTOR WORKSHOP SARAH GORDON, JAMES KNECHT & ANNETTE MOORE UNIVERSITY ASSESSMENT AND TESTING SESSION I: MONDAY,
Project Title/Research Question Name University and Department Add a picture of you!
Bridget Riggs CI 551 A11 Final Project Fall 2011 What are the best practices in teaching writing to high school students?
Building Resources for Teaching Computer Architecture Through Peer Review Edward F. Gehringer Dept. of Electrical & Computer Engineering Dept. of Computer.
Research Assignment Design Kerri Carter – ext Diane VanderPol
Innovative Applications of Formative Assessments in Higher Education Beyond Exams Dan Thompson M.S. & Brandy Close M.S. Oklahoma State University Center.
Student Learning Outcomes Assessment Montgomery College Fall 2011 Orientation.
Assessment in HuskyCT Janet Jordan Manager, Instructional Resource Center.
Sharon Lalla, Ed.D. Wenona Nutima ASSESSMENT AND FEEDBACK.
Assessment in Higher Education: Supporting students’ first experiences Rita Headington University of Greenwich.
This is a game changer – a new way to do writing assignments in a large enrollment class Jon Harbor 7 Writing Assignments 7 Weeks 700 Students 1 TA.
A Roundtable Discussion of Best Practices in Online Learning.
Computer Mediated Peer Review
File Exchange Assignments
The Learning Portfolio and Assessing Learning
Why & How to use Rubrics in Canvas
Introduction to Wikipedia & Wikipedia assignment
Institutional Learning Outcomes Assessment
Providing Annotated Examples Increases Science Learning
STUDENTS, WE VALUE YOUR INPUT!
Jesus Jr. Camposeco ECE 682 Dr. David L. Brown
Impact on Learning: Feedback in On-line Assignments
January 2019 Designing Upper Economics Electives with a significant writing component Helen Schneider The University of Texas at Austin.
Developing a Rubric for Assessment
WAC & English Language Learners
Presentation transcript:

Peer review in an economics writing course: the Pen is still mightier than the SWoRD Jennifer Imazeki Department of Economics

SWoRD Scaffolded Writing and Reviewing in the Disciplines –Students submit papers –Students review papers of 4-6 peers Comments and 7-point numeric rating –Students ‘back evaluate’ reviews they receive 5-point numeric rating

What makes SWoRD different? Student review and backevaluation scores  grades for both writing and reviewing –Reviewing grade: “Accuracy” + “Helpfulness” Accuracy: Consistency compared to other reviewers Helpfulness: Back evaluation ratings –Writing grade: adjusted average of numeric ratings from reviewers –Scoring algorithm to remove bias

Econ 449W: Economic Literacy “The goal of this course is to make you better economists by making you better writers… This course will focus on how to apply and use [economic] knowledge, by incorporating economic material and the economic way of thinking into writing for a more general audience.”

Econ 449W: Structure 2010: 6 peer-reviewed papers, exchanged in class 1 reviewer for each paper, plus instructor feedback No feedback for reviewers, participation points only

Potential benefits of SWoRD (vs. other peer review tools) Students read multiple papers, receive feedback from multiple reviewers Back evaluations provide incentive to take reviews seriously, give students feedback for improving reviews (without requiring instructor intervention) Rubric scores converted to grades with adjustment for bias

Econ 449W: 2010 vs : 6 peer-reviewed papers, exchanged in class 1 reviewer for each paper, plus instructor feedback No feedback for reviewers, participation points only 2011: 4 peer reviewed papers, all online submission 4-5 reviewers for each paper, no/less instructor feedback on draft 1 Writers back-evaluate reviewers, reviewing score based 50% on those back evaluations

Assignment timeline First Draft 5 days Reviews (5) 5 days Final draft 5 days Final reviews (5) Back reviews by Thurs Back reviews by Wednesday 9pm Sunday9pm Friday9pm Wednesday 9pm Monday

Issues Lack of flexibility Lack of transparency Scoring algorithm questionable

Peer review in an economics writing course: the Pen is still mightier than the SWoRD Jennifer Imazeki Department of Economics