Evaluating the Impact of Peer Programmes on Student Learning and Academic Attainment – A Cross-Discipline Approach Presenters: Amanda Pocklington, Bella.

Slides:



Advertisements
Similar presentations
University of Maryland Baltimore County Department of Psychology Eileen OBrien, Ph.D. Introductory Psychology University of Maryland System Course Redesign.
Advertisements

Students’ experience of the process of practice assessment; a multi-professional case study from Social work, Midwifery and Emergency Care. Tracey Proctor-Childs;
V v Adaptive Quizzing Associated with an Increase in Overall Learning Keiko Bostwick, Kathryn Becker-Blease, PhD Oregon State University School of Psychological.
International Conference on Enhancement and Innovation in Higher Education Crowne Plaza Hotel, Glasgow 9-11 June 2015 Welcome.
Using a Board game to enhance mentor engagement within nurse education in practice settings Jo Hirdle and Belinda Humphries University Practice Learning.
An investigation of the impact of student support initiatives on the retention of computer science students Clem O’Donnell 1, James Murphy 2, Abdulhussain.
METHODS Study Population Study Population: 224 students enrolled in a 3-credit hour, undergraduate, clinical pharmacology course in Fall 2005 and Spring.
Psychology students’ experiences of peer tutoring in academic writing European Congress of Psychology, Oslo, July 2009 Kathy Harrington, Savita Bakhshi.
Other People’s Writing Peer Mentoring for Academic Writing Christine Hardy and Ed Foster.
Ismaila Odogba Department of Geography and Geology The Impact of Collaborative Testing on Student Learning in an Introductory Level Geography Course INTRODUCTION.
Making a difference? Measuring the impact of an information literacy programme Ann Craig
Introducing small-group workshops as formative assessment in large first year psychology modules Suzanne Guerin School of Psychology, University College.
Eileen O’Brien, Ph.D. Department of Psychology Tampa, Fl December, 2011.
Adolescent Sexual Health Work Group (ASHWG)
ULTSEC Innovation Fund Ruth Valentine School of Dental Sciences Simon Cotterill Learning and Teaching Support Unit, Faculty of Medical Sciences.
The Role of Automation in Undergraduate Computer Science Chris Wilcox Colorado State University 3/5/2015.
Is PeerMark a useful tool for formative assessment of literature review? A trial in the School of Veterinary Science Duret, D & Durrani,
Dr Elena Luchinskaya, Lancaster University/ Leeds Metropolitan University, UK.
Report on Semester 1, 2012 PASS Trial and Proposal for 2013 Prepared by Chris Ma’auga, PASS Coordinator. Assistance from Caitriona Cameron and Alison Lister.
PROPONENTS: Isabelita R. Hizon, Ed. D. Susan O. Habacon INQUIRY-BASED COLLABORATIVE LEARNING PROGRAM (ICLP) FOR MANAGING LARGE CLASSES AND ITS EFFECT ON.
 Lunch and Learn April 22, 2015 Office of Human Research.
Printed by Structured weekly study sessions for students in participating courses  Rooted in cooperative learning theory*  Research.
Marion Oliver Educ 709.  It is of incredible importance to students’ connection to school, as well as their ability and desire to stay in school (McNeely.
Review Characteristics This review protocol was prospectively registered with BEME (see flow diagram). Total number of participants involved in the included.
Navigating Ethical Challenges The importance of professional mentorships in development evaluation Sarah Mason Independent Consultant.
Group writing tutorials: Do they improve student writing? Roger Graves University of Alberta, CAN
Notes from Careers Guidance Practice A study into the impact of embedding practical career management skills within a module preparing students to apply.
Learning to Learn: Embedding Peer Support as a Core Learning Skill at 3 rd Level. Gerard Ryder Philip Russell Martha Burton Institute of Technology Tallaght.
Name of presentation Month 2009 Conflict of interest: None to declare.
UNIVERSITY OF EDINBURGH DEPARTMENT OF PEER LEARNING AND SUPPORT KATIE SCOTT.
Introduction Feedback is ‘one of the most powerful ways to… enhance and strengthen student learning’ (Hepplestone et al 2009) Anecdotal evidence suggests.
Marcia Ody Edinburgh - March 2012 Peer Support – the approach at the University of Manchester ‘Students as Partners’ Programme The University of Manchester.
Quality Enhancement Report Learning Initiative
Maximising the Nursing Team
The Power of Supplemental Instruction (SI)
Figure1: Figure 1. Study design diagram.
Issues in Evaluating Educational Research
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
Freshmen to PhD, Empowering with Research
Inter-Professional Education and Practice in Autism Spectrum Disorders
Expanding induction and using the VLE to enhance induction to First Year Life Science Dr Chris Finlay & Dr Maureen Griffiths School of Life Sciences.
Individualized research consultations in academic libraries: Useful or useless? Let the evidence speak for itself Karine Fournier Lindsey Sikora Health.
Pulling up your briefs: Accessible assessment processes
Table 1: Patient BMI data pre and post a 12-week ER programme.
Psychology Minor Tutorial
Developing Problem Statement for Dissertation
Assessment brief Post graduate route.
Does Peer Assisted Learning Promote Transitions Amongst Students?
Peer Assisted Learning
Creating Meaningful Information Literacy Assignments for an Introductory Agriculture Course Marianne Stowell Bracke Purdue University Libraries
Can Online Technology Enhance Work Related Learning?
Supplemental Instruction and Embedded Tutoring Equal Student Success
Teaching Medical Students Oral Presentations Skills
CLICK TO GO BACK TO KIOSK MENU
This presentation will include:
WELCOME TO VICTORIA UNIVERSITY
Peer Assisted Learning
Interprofessional learning and teaching in evidence-based practice
Effect of Second Life on Student Motivation
SOLSTICE & CLT Conference 2013
The Effect of Teaching on Student Learning in the Onsite and MOOC Version of the Nonprofit Governance Course June 1, 2016 Research Presentation 2016.
The impact of small-group EBP education programme: barriers and facilitators for EBP allied health champions to share learning with peers.
Evaluation of S294 Early start
Distance students’ preference for type of tutorial participation
ROSE STATE COLLEGE   “CLICK”  Community Learning in Critical Knowledge
Heather Bower and Mandy Stevenson SHIFT conference, 2018
To RCT, or not RCT: that is the question
2017 Postgraduate Research Experience Survey (PRES) Results
A Moodle-based Peer Assessment Tool
Embry-Riddle Aeronautical University, College of Aviation
Presentation transcript:

Evaluating the Impact of Peer Programmes on Student Learning and Academic Attainment – A Cross-Discipline Approach Presenters: Amanda Pocklington, Bella Magner & Ferdinand Boucher Project research team: Tim Fawcett, David MacDonald, Ellis Langley & Jonny Gurr

Project Background - Literature Participation in peer-learning programmes is associated with: higher mean grades; lower failure and withdrawal rates and higher retention and graduation rates. However, the methodology used in many studies has been heterogenous (Dawson et al., 2014) Many studies reviewed use a quasi-experimental design and have required qualitative synthesis due to a lack of definition in qualifying what the ‘treatment’ of peer-learning is (Dawson et al., 2014; Keenan, 2014; Stigmar, 2016; Asgari & Carter, 2016) Some quantitative research has been conducted, however this has mainly been on small samples with inadequate methodology e.g., no randomization of groups (Asgari & Carter, 2016) or has only been on specific subjects with no comparison groups in other disciplines (Kim et al., 2013)

Methodology – Study Design Two Peer-Programmes at The University of Exeter were evaluated, which ran in the Colleges of Medicine & Health and Life & Environmental Sciences during Term 2 In addition, a pilot study in the Medical school was conducted in Term 1 to test the study design All studies followed the same design, consisting of four different protocols, which participant groups were randomly assigned to.

Methodology – Study Design Weekly pre- and post-session quizzes to evaluate participant learning gain Completed by all participants 10 MCQ questions delivered online using Qualtrics software 1min to attempt each question Confidence rating included with each question Answers provided following completion of study David screengrab showing MCQ quiz and confidence bar.

Methodology - Recruitment Recruitment of Peer Impact Mentors: Existing Peer Mentors were eligible to join the project as Peer Impact Mentors Underwent project-specific training Received remuneration Recruitment of student participants: Open to all Year 1 students in respective programmes Project information sessions timetabled where participant sign-up forms were circulated £10 voucher offered to participants completing the study

* * Results: MCQ performance Attending the introductory session increased the proportion of correct answers, but this did not reach significance (p = 0.079) * * Attending the review session led to a significant improvement in the proportion of correct answers (p = 0.023*)

* ** ** Results: confidence Attending the introductory session led to a significant increase in self-reported confidence (p = 0.047*) * ** ** Attending the review session led to a significant increase in self-reported confidence (p = 0.007**)

* Results: response speed Attending the introductory session led to significantly quicker responses (p = 0.015*) * Attending the review session had no effect on response speed

“They could share common mistakes made by themselves and their peers” Evaluation Survey Statements “They could share common mistakes made by themselves and their peers” “Comfortable environment where it feels easier to ask questions to clarify misunderstandings, PALS are very encouraging and approachable ” Ferdinand & Bella “explanations were made for/by students so they know how to effectively convey information to their audience”

Review sessions led to significant improvement in MCQ performance Conclusions Review sessions led to significant improvement in MCQ performance Introductory and review sessions led to a significant increase in self reported confidence – individually & combined Introductory session led to significantly faster response times Ferdinand and Bella

Comments Students that participate in peer programmes may have different qualities to those who do not; e.g. higher motivation and engagement in their studies Participant attrition was high across all studies. Conflicting demands on student time (e.g. coursework submissions during final weeks of Term 2) may have contributed to this The study design of delivering student-led introductory and review sessions each week was time intensive, but was valued by participating students Could this peer support programme operate without financial incentives for Peer Mentors? Ferdinand and Bella

Any questions?

References (1) Dawson P, van der Meer J, Skalicky J, Cowley K. On the effectiveness of supplemental instruction: A systematic review of supplemental instruction and peer-assisted study sessions literature between 2001 and 2010. Review of Educational Research. 2014 Dec;84(4):609-39. (2) Keenan C. Mapping student-led peer learning in the UK. York: Higher Education Academy. 2014 Nov. (3) Martin Stigmar. Peer-to-peer Teaching in Higher Education: A Critical Literature Review, Mentoring & Tutoring: Partnership in Learning. 2014; 24:2, 124-136, DOI: 10.1080/13611267.2016.1178963 (4) Asgari S and Carter Jr F. Peer mentors can improve academic performance: A quasi-experimental study of peer mentorship in introductory courses. Teaching of Psychology. 2016 Apr;43(2):131-5. (5) Kim SC, Oliveri D, Riingen M, Taylor B, Rankin L. Randomized controlled trial of graduate-to- undergraduate student mentoring program. Journal of Professional Nursing. 2013 Nov 1;29(6):e43-9. (6) Ody, M. and Carey, W. Peer Education. In: E. Dunne and D. Owens (eds). The Student Engagement Handbook: Practice in Higher Education. Bingley. Emerald Publishing. 2013.

gave more correct answers Results—Psychology study In the post-MCQ test, students who had attended the introductory session … gave more correct answers (P = 0.041) answered more quickly (P < 0.001) had higher confidence (P = 0.006) Attending the review session also led to higher confidence (P = 0.008), but did not affect answering speed or correctness

Results—Medical Sciences study Attending the introductory session did not affect confidence, answering speed or correctness Attending the review session led to higher confidence (P = 0.027), but did not affect answering speed or correctness