Physics Education Research The University of Edinburgh The benefits of giving feedback: investigating patterns of student exchanges over the PeerWise system.

Slides:

Advertisements

Similar presentations

Quantitative and Scientific Reasoning Standard n Students must demonstrate the math skills needed to enter the working world right out of high school or.

Advertisements

Internal Assessment Your overall IB mark (the one sent to universities after the IB test) in any IB science course is based upon two kinds of assessments.

HN BUSINESS GRADED UNIT Feedback from Verification.

Physics Education Research The University of Edinburgh Students as co-creators: The development of student learning networks Alison E. Kay and Judy Hardy.

A Guide to Feedback. What is feedback? A response that helps to evaluate performance Used in Quizzes Instant – After answering a MCQ Summary – Overview.

Eva Sørensen Department of Chemical Engineering University College London Experiences of using peer assessment in a 4th year design module.

How This Course Promotes “Learning Efficiencies” The following slide show provides an explanation of the assessment and grading process used in the Online.

Glenn Ledder Department of Mathematics University of Nebraska-Lincoln Assessment Using Online Assignment Management Systems.

Stat 301 – Day 14 Review. Previously Instead of sampling from a process  Each trick or treater makes a “random” choice of what item to select; Sarah.

Physics 151 Week 11 Day 2 Topics: Forces, Apparent Weight, & Friction  Energy  Dot Produce  Work  Conservation of Energy with Work  Work-Energy Theorem.

SW388R7 Data Analysis & Computers II Slide 1 Multiple Regression – Basic Relationships Purpose of multiple regression Different types of multiple regression.

Scientific Method.

How to Assess Student Learning in Arts Partnerships Part II: Survey Research Revised April 2, 2012 Mary Campbell-Zopf, Ohio Arts Council

The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.

DESIGNING EFFECTIVE DQS/TESTS Dr. Jey Veerasamy 1.

2003 Evaluations and Assessment conference 25 November 2003Copyright © 2003 The University of AdelaideSlide Number 1 Rubrics And Online Assessment Judi.

Is PeerMark a useful tool for formative assessment of literature review? A trial in the School of Veterinary Science Duret, D & Durrani,

The Good The Bad & The Ugly Real-Life Examples of the SLO Assessment Report Form With Tips on How to Complete It August 21, 2012.

DePaul Assessment Certificate Culminating Project Assessment of STEM Center Algebra Initiative Learning Outcome Max Barry Department Assistant STEM Center.

Warm-up Discuss the free response problems from the practice or come up with any last minute questions.

Aim: How do we test hypothesis? HW#6: complete last slide.

Section A Experiments.

Jacqueline Wroughton. 1. There are n set trials, known in advance 2. Each trial has two possible outcomes (success/failure). 3. Trials are independent.

1 Bacon – T. A. Webinar – 7 March 2012 Transforming Assessment with Adaptive Questions Dick Bacon Department of Physics University of Surrey

How to Evaluate Student Papers Fairly and Consistently.

Wiley eGrade. What is eGrade? Web-based software that enables instructors to automate the process of assigning and grading homework and quiz assignments.

Andrew Thomson on Generalised Estimating Equations (and simulation studies)

1 Issues in Assessment in Higher Education: Science Higher Education Forum on Scientific Competencies Medellin-Colombia Nov 2-4, 2005 Dr Hans Wagemaker.

Analysis of Online Discussions MSU VIPP Program Gerd Kortemeyer, July 2006.

Open-ended Essay Review Class notes and knowledge (3)

The Mechanical Vibrations Quiz An example of formative assessment Ines Lopez Arteaga 19th March 2012.

New Zealand Diploma in Business National External Moderation Reports Tertiary Assessment & Moderation.

CATEGORICAL VARIABLES Testing hypotheses using. When only one variable is being measured, we can display it. But we can’t answer why does this variable.

Open Ended Questions. What is an open-ended question? Question that is designed to allow a full, meaningful answer that uses  Quotes/ examples from.

Standardized Test-taking Tips Pre-Test Day Know where your test is being givenKnow where your test is being given NO REVIEW the night beforeNO REVIEW.

GATEWAY INITIATIVE Hillsborough Community College Fall 2007 Preliminary Results A Formative Evaluation.

Welcome to Marking Period 2! Changes in procedures – After-school hours – Lateness – Phones – Cheating policy – Homework – Tests/quizzes in relation to.

© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.

International Conference on Enhancement and Innovation in Higher Education Crowne Plaza Hotel, Glasgow 9-11 June 2015 Welcome.

Higher and National 5 Course Assessment: Question Paper.

1 Evaluating the User Experience in CAA Environments: What affects User Satisfaction? Gavin Sim Janet C Read Phil Holifield.

Help students evaluate their own learning ~ Using constructive feedback in library instruction Jill Nathanson Mei Ling Lo.

CSM06: Information Retrieval Notes about writing coursework reports, revision and examination.

Research Problem Students with poor quantitative reasoning skills are less successful in STEM fields.

Language Testing How to make multiple choice test.

ASSESSMENT TO IMPROVE SELF REGULATED LEARNING 5 th July 2006, 10 th CAA conference, Poppy Pickard Assessment to improve Self Regulated Learning.

Multiple Linear Regression An introduction, some assumptions, and then model reduction 1.

Year 10 New AQA Triple Science What you will be doing.

Approaches to learning and self study materials in quantitative subjects Gary Simpson ABS270.

Investigate Plan Design Create Evaluate (Test it to objective evaluation at each stage of the design cycle) state – describe - explain the problem some.

Assessment and the Institutional Environment Context Institutiona l Mission vision and values Intended learning and Educational Experiences Impact Educational.

Creating Assessments that Engage Students & Staff Professor Jon Green.

SPSS Port Folio SEAN MCBRIDE B UNIVERSITY OF THE WEST OF SCOTLAND.

ASH EDU 644 W EEK 3 DQ 1 W EBSITE S HARING AND F EEDBACK Check this A+ tutorial guideline at

Understanding Standards: Advanced Higher Event

PeerWise Student Instructions

AICE Psychology Research Processes

“Tell me and I'll forget; show me and I may remember; involve me and I'll understand.”

“Tell me and I'll forget; show me and I may remember; involve me and I'll understand.”

IB Assessments CRITERION!!!.

Understanding Standards An overview of course assessment

Office of Education Improvement and Innovation

Sign test/forensic mini mock

Beth Perrell Arri Stone

Workshop A – HN Enhancement Project: A Practitioner’s Perspective

RESEARCH METHODS Trial

THE WARS OF INDEPENDENCE

Midterm Evaluations Results from CELT

January 2019 Designing Upper Economics Electives with a significant writing component Helen Schneider The University of Texas at Austin.

Presentation transcript:

Physics Education Research The University of Edinburgh The benefits of giving feedback: investigating patterns of student exchanges over the PeerWise system Alison Kay and Judy Hardy

Phys. 1AGGAChem. 1B Students % of mark Authored Answered Rate & comment Total comments Implementation of PeerWise

1 Nonsense; totally irrelevant; symbols; undecipherable 2 Clear reply to a previous post – no reference to question or content 3 Basic statement that got question correct or incorrect; hit wrong button 4 Surface comments on question Surface comments on answer 5Deeper comments on question and specific features Deeper comments on own understanding 6 More evaluative - specific about HOW to improve the question or giving more detail WHY the question was good or not Possibly suggesting a different way of working out the answer – showing examples or calculations 7As 6 but much more detail – how to take question or explanation further. More in-depth discussion Comment coding

Comments examples 1“Why oh why. Sigh.” 2“Glad I could help ;D” 3“Haha! misread the question :P” 4“Wow! What a question! Superb effort!” 5“I too was caught out with the area of a sphere instead of a circle. Good explanation and good alternatives in multiple choice.” 6 “I'm not sure if your solution is correct. We can use a trajectory equation only if the initial and final heights are the same !!!” 7“Nice question, but bad distractors (imo). I didn't expect an inelastic collision and just worked with energy conservation (m1gh1 = (m1+m2)gh2) and got 1.76 m. Would have totally thrown me off if that was an available answer.”

Which activity is most strongly associated with exam performance? DV: Exam score IV: Number of answers or comments made Physics 1A Std. Beta No. answers submitted.248** Total no. comments.239*** No. comments >3.240*** No. comments >4.281***

Example: Physics 1A Is writing quality comments associated with higher exam performance when controlling for other factors? Dependent Variable: Exam score Independent Variables: No. comments coded > 4 Pre-test mark (FCI) Scottish Major Gender

Building the model R2R2 Adjusted R 2 F ValueP (one tailed) Independent Variables BetaStandardized Beta P (one tailed) Intercept Comments > FCI Scottish The model predicts that each new high quality comment, is associated with a 0.35% increase in exam score. The minimum 6 comments associated with a 2% increase. The mean of 14 comments associated with a 5% increase.

Conclusions Total engagement with PeerWise far exceeded minimum requirements Across all disciplines, writing meaningful comments has a significant, positive association with exam performance when controlling for other known influential factors Especially interesting given that PeerWise requires minimal instructor intervention; that PeerWise is only worth ~4% of the total course mark; and that providing feedback is only one aspect of the PeerWise assessment