Streaming Video Tutorials for Complex Laboratory Techniques: Lessons Learned in Sophomore and Junior Biomechanics Courses Kristen L. Billiar, Ph.D. Dept.

Slides:



Advertisements
Similar presentations
A NEW MODE OF TEACHING FOR SELF-DIRECTED LEARNING
Advertisements

The Inside Edge. electronic newsletters webcasts secure and reliable hosting search engine marketing surveys dynamic website elements.
Developing Learner-led Knowledge Generating Online Communities
Elements of an Online Syllabus Contact: Melody Buckner Instructional Designer.
Approaches for students engagement outside the classroom.
Daniel Peck January 28, SLOs versus Course Objectives Student Learning Outcomes for the classroom describe the knowledge, skills, abilities.
Register Laulima Workshop for Instructors Solutions to help you engage your students through Laulima.
Iain Weir, Rhys Gwynllyw & Karen Henderson CETL-MSOR 2014
LEARNER CENTERED LEARNER DESIGNED Learning & Preparation Objectives Learning Resources and Strategies Evidence of Accomplishment of Objectives Criteria.
Problem-Based Learning for Laboratory & Professional Skills Teaching Kevin Wells SCEPTrE Fellow Dept of Electronic Engineering, FEPS University of Surrey.
AAFCS Annual Conference Research-to- Practice Session June 27, 2013 EMBRACE AND MANAGE ONLINE TEACHING METHODS.
Active and Cooperative Learning in an Introductory Computer Science Course Dr. Cheryl A. Dugas.
Challenges in Improving Course Delivery Technology in Developing Countries: The Case of the IDE at UNISWA By Prof. C. W. S. Sukati 1.
Using the IDEA Student Ratings System: An Introduction University of Saint Thomas Fall
Worcester Polytechnic Institute 1 Providing Technology Orientation for New Faculty and Staff Copyright © 2005 Worcester Polytechnic Institute This work.
Designing Instructionally Sound Courses Kristina Leonardo, Senior Consultant Blackboard, Inc. April 14, 2005.
Mary Ann Cordeau PhD, RN. From participating in this presentation the participant should be able to: Define assessment and validation as they relate to.
The development of lessons, case studies, scenarios and simulations in the Moodle Virtual Learning Environment for self directed learning (SDL) By Michael.
Peer-Led Team Learning: A Model for Enhancing Student Learning Claire Berardini & Glenn Miller Third Annual Faculty Institute Pace University.
Enhancing the Quality of both Student Learning and Faculty Teaching through Assessment.
School of Engineering & Technology UH Learning & Teaching Conference 2010 “ Use of video to enhance learning opportunities for engineering students ” David.
Cooperative Efforts Using Theater Students for Construction Management Technology Philip Dunn PE Assistant Professor Construction Management Technology.
Facilitator Training Program
1 The Teaching and Learning Strategy, including Projects Roy Crole Department of Computer Science University of Leicester.
Effective Math Online LearningLDT 2001EMOL EMO L Effective Mathematics Online Learning.
Project Management Take a Tour of the Online Course.
State Assessment Meeting Thursday, June 20, 2013 Get Ready for College – Math: A MOOC Designed for Remediation.
Tools of the Trade: Using Technology in Your Course Tools of the Trade: Using Technology in Your Course 1 Ms. Darla Runyon Assistant Director/Curriculum.
Techniques for Improving Student Learning Outcomes Lynn M. Forsythe Ida M. Jones Deborah J. Kemp Craig School of Business California State University,
Bassam Hammo (Ph.D) Department of Computer Information Systems King Abdullah II School for Information Technology Jordan University Amman Jordan e- mail:
Multimedia Tutorials for an Electrical and Computer Engineering Course S. Supanakorn, University of Wyoming and R. Thamvichai, Saint Cloud University.
Getting Started E-Learning Module Storyboard Jessica Kluntz LHDT 548.
Evaluation and analysis of the application of interactive digital resources in a blended-learning methodology for a computer networks subject F.A. Candelas,
The Role of Automation in Undergraduate Computer Science Chris Wilcox Colorado State University 3/5/2015.
This product was developed by Florida’s Positive Behavior Support Project through University of South Florida, Louis de la Parte Florida Mental Health.
Implementing Active Learning Strategies in a Large Class Setting Travis White, Pharm.D., Assistant Professor Kristy Lucas, Pharm.D., Professor Pharmacy.
A Case Study in Evaluation & Assessment for a Virtual Learning Commons Mellon Library/Faculty Fellowship for Undergraduate Research Pat Davitt Maughan.
University Teaching Seminar 2011 Leading a Lab Possibly the most formative method of instruction for your students Draft Version 2.
Creating Effective Revision Tools Ms Parrouty Tuesday 14 th of April 2009.
SITE Conference – 3/ Successful Online Assessment, Evaluation, and Interaction Techniques Presented by: Dr. Barbara K.Mckenzie – Dept. of MIT, State.
Curriculum materials are available at no cost and are licensed under a Creative Commons Attribution-Noncommercial 3.0 Unported License. This means you.
Evaluation Research and Engineering Education Lesley Jolly For AaeE ERM wiki at
Evaluating Online Learning: Issues and Strategies Mark Hawkes Dakota State University Innovations, Educating New Generations March 1, 2002.
Mass Producing a Masterpiece: Designing a Required One Credit, Distributed Learning Information Literacy Course Sharon Verba Head, Research, Instruction,
Download the curriculum from Available at no cost and licensed under a Creative Commons Attribution-Noncommercial 3.0.
Planning for Successful Simulation Simulation Planning Guide - A Guided Discussion.
Instructional Plan | Slide 1 AET/515 Instructional Plan December 17, 2012 Kevin Houser.
1. Housekeeping Items June 8 th and 9 th put on calendar for 2 nd round of Iowa Core ***Shenandoah participants*** Module 6 training on March 24 th will.
How to design reliable processes in Healthcare Moving to 95% Roger Resar MD Hilton Head June 2012.
EDUCAUSE 2005 Annual Conference October 19, 2005.
Advanced Microsoft Office Applications Online Course – Lessons Learned.
MAP the Way to Success in Math: A Hybridization of Tutoring and SI Support Evin Deschamps Northern Arizona University Student Learning Centers.
Intel ® Teach Program International Curriculum Roundtable Programs of the Intel ® Education Initiative are funded by the Intel Foundation and Intel Corporation.
Curriculum materials are available at no cost and are licensed under a Creative Commons Attribution-Noncommercial 3.0 Unported License. This means you.
LINKS Evaluation. Why evaluate? Evaluation of the LINKS Advising Program is particularly important in this pilot year. It gives participating staff, students.
Technology Integration Planning Guidelines for Development A Visual Guide.
Introduction Teaching and Assessment for Medical Educators is a programme designed to enhance teaching, learning, assessment, feedback and evaluation in.
Beyond the Basics Learning Management Systems (LMS) Michael Heumann, Distance Education Coordinator, Imperial Valley College Cindy Vinson, Distance Learning.
Developing an Effective Evaluation to Check for Understanding Part 2 Susan E. Schultz, Ph.D. Evaluation Consultant PARK Teachers.
1 An Evaluation Plan and Tool Kit for the Archibald Bush Innovative Teaching and Technology Strategies Grant Valerie Ruhe and J.D. Walker, Center for Teaching.
Agenda Debrief on past module development Tools for online content development Module development template Timeline Suggested guidelines for developing.
Monitor and Revise Teaching. ObjectivesObjectives Describe how to monitor teaching List ways to contribute to broader evaluations Explain how to review.
Collaborative Learning Community: Student Reflective Assessment: Part 1 Team Orange Tarica Miller Christina Mullikin,Michael Paekukui.
Introduction to SQL Server
Evaluating Student-Teachers Using Student Outcomes
What is a hybrid course and is it for you?
OVERVIEW OF The ALS A&E LEARNING PROCESS.
Facilitating Group Learning through Case-based Exercises in the Pharmacy Practice Curriculum Ryan S. Funk University of Kansas School of Pharmacy, Pharmacy.
Tasks & Grades for MET3.
Using SharePoint in a flipped classroom
Presentation transcript:

Streaming Video Tutorials for Complex Laboratory Techniques: Lessons Learned in Sophomore and Junior Biomechanics Courses Kristen L. Billiar, Ph.D. Dept of Biomedical Engineering, Worcester Polytechnic Institute Dept of Surgery, University of Massachusetts Medical School

Department of Biomedical Engineering Goals Laboratories in all BME courses Making and interpreting measurements Making and interpreting measurements Challenge-based, self-guided, self-paced Challenge-based, self-guided, self-paced Particular challenge Rapid growth of BME (40-50 per course) Rapid growth of BME (40-50 per course) Limited resources Limited resources Instructor time (and TA) Volume of sophisticated equipment Laboratory space (scheduling time) Funds Practical vs. theoretical Expanding access, not assessing educational theories or comparing methods Expanding access, not assessing educational theories or comparing methods Share approach to problem and assessment Discuss time and effort involved Discuss time and effort involved Describe assessment methods and findings Describe assessment methods and findings Initiate dialog – chance to get your feedback Initiate dialog – chance to get your feedback

Department of Biomedical Engineering Approach and goal of study Approach - teaching technology Web-based streaming video tutorials Web-based streaming video tutorials Provide the “toolbox” Provide the “toolbox” Economical, sustainable Economical, sustainable Allow students to perform labs Allow students to perform labs Self-paced, flexible schedule Without constant instructor or TA supervision or TA supervision Goal - formative study Assess student learning from the tutorials Assess student learning from the tutorials Gather student feedback on their usefulness and quality as a guide for future improvements Gather student feedback on their usefulness and quality as a guide for future improvements

Department of Biomedical Engineering Tutorials – web-based Tutorials How? rather than What and Why How? rather than What and Why Large number (>20), short ( 20), short (< 5 minutes) Easy to create and modify 1 Easy to create and modify 1 Format Format MS Powerpoint, Camtasia, video Slides, video, audio Design team Two professors Two professors Biomedical and Mechanical Engineering Academic Technology Center Staff Academic Technology Center Staff Video, editing, streaming servers Two sophomore-level students Two sophomore-level students 20 hrs/wk x 8wks x 2 = 320 hrs Funding Two small internal grants, paid for student time and provided access Two small internal grants, paid for student time and provided access 1 Billiar and Shonat, PEBEL II, 2004

Department of Biomedical Engineering Example tutorial - safety Posted on myWPI (Blackboard) PPT file complete (link) link 23 MB (w/o video clip) 23 MB (w/o video clip) PPS file 1.2 MB 1.2 MB Streaming audio Streaming audio Streaming video Streaming video Requires fast internet connection Requires fast internet connection X

Department of Biomedical Engineering Assessment Sophomore-level “Foundations of Biomechanics” large number (n=47), limited use, single laboratory large number (n=47), limited use, single laboratory Junior-level “Experimental Biomechanics” small number (n=17), extensive use as they were meant to be, challenge-based small number (n=17), extensive use as they were meant to be, challenge-based Questionnaires (sophomore-level only) Pre-tutorial Pre-tutorial Post-tutorial – with answers and explanation Post-tutorial – with answers and explanation Controlled environment – 2 one-hour sessions Controlled environment – 2 one-hour sessions Automation with Blackboard Automation with Blackboard Safety practicum minutes/group, Password given minutes/group, Password given Grade comparison (sophomore-level only) Quiz assessing knowledge of concept of stress-strain analysis Quiz assessing knowledge of concept of stress-strain analysis Feedback – usefulness and quality Likert-type Likert-type Written responses Written responses

Department of Biomedical Engineering Example questionnaire

Department of Biomedical Engineering Assessment of tutorials Questionnaires Pre-tutorial score34% ± 9% Pre-tutorial score34% ± 9% Post-tutorial score71% ± 12% Post-tutorial score71% ± 12% p < 0.05 paired t-test in all groups (except M5)

Department of Biomedical Engineering Assessment of tutorials Compliance with questionnaires Completed 100%: n = 27 of 47 (57% compliance) Completed 100%: n = 27 of 47 (57% compliance) Completed >90%: n = 36 of 47 (77% compliance) Completed >90%: n = 36 of 47 (77% compliance)

Department of Biomedical Engineering Feedback survey

Department of Biomedical Engineering Feedback survey What about the Tutorials would you change? What did you especially like about the Tutorials and your experience using them? Please identify aspects of particular Tutorials that were especially problematic.

Department of Biomedical Engineering Feedback – Likert scale SophomoreJunior completion of survey 74% (35/47) 94% (16/17) general quality either “good,” “very good,” or “excellent.” 70% to 90% 80% to 93% “easy” or “very easy” to use 60%100% “quite” or “extremely” useful (all but one) 54% to 72% 73% to 100% “as helpful,” “more helpful,” or “much more helpful” than written materials 80%100% tutorials alone were adequate (or better) in preparing them for their lab 60%75% “as helpful” or “more helpful” than one-on- one time with the professor 30%75%

Department of Biomedical Engineering Quiz grade comparison

Department of Biomedical EngineeringDiscussionMotivation Provide labs to students with resource savings in the long term Provide labs to students with resource savings in the long term Available tutorials (MTS, Microsoft) not well suited, much longer Available tutorials (MTS, Microsoft) not well suited, much longer General enough for multiple types of users at WPI and beyond General enough for multiple types of users at WPI and beyondAssessment Effectiveness of tutorials and aspects to improve Effectiveness of tutorials and aspects to improve Not video vs. written or professor Not video vs. written or professor Not lab vs. no lab Not lab vs. no lab Controls for summative evaluations not practical Controls for summative evaluations not practical Resource requirement High initial investment (team, time) High initial investment (team, time) Written materials require effort also Written materials require effort also Advantage - technical staff and students Advantage - technical staff and students

Department of Biomedical EngineeringDiscussion Overall success – short term Students passed practicum, completed laboratories Students passed practicum, completed laboratories Sophomore, junior, and grad as well Sophomore, junior, and grad as well Instructor time in lab minimal Instructor time in lab minimalQuestionnaires Controlled viewing, but lower scores than desired Controlled viewing, but lower scores than desired Too many (12 x 2), too much time commitment Too many (12 x 2), too much time commitmentFeedback Too broad for one lab in sophomore-level course Too broad for one lab in sophomore-level course Well received when used as designed Well received when used as designed Increased use of equipment - time logged Sophomore-level course > 50 hours; ~ 1hr/student Sophomore-level course > 50 hours; ~ 1hr/student Junior-level course >20 hours/student, relatively few scheduling conflicts Junior-level course >20 hours/student, relatively few scheduling conflicts Facilitated challenge-based laboratories True time and resource savings - future

Department of Biomedical Engineering Acknowledgements Allen Hoffman tutorial content tutorial content Megan Murphy and Dan Filipe sophomores sophomores tutorial creation tutorial creation Paula Quinn assessment consultant assessment consultant Adam Jacobi and David Taranto (WPI ATC) production support production support Elias Wilson (TA) questionnaire and practicum administration Ross Shonat (NIH) introduction to formal CBIFunding WPI Educational Development Council Grant WPI Teaching Technology Fellowship

Department of Biomedical Engineering Questions?

Educational framework Challenge-based learning (self-guided) Aid in the development of Aid in the development of critical thinking – authentic problems Building on HPL framework 1 Learner-, community-, knowledge-, and assessment-centered Learner-, community-, knowledge-, and assessment-centeredSelf-paced Allow for differences Allow for differences Allow greater number of student-hours in lab Allow greater number of student-hours in lab The “Challenge” & problem identification Generate ideas Literature & interview Testing & analysis Communication of findings Learning Cycle Research & revise 1 Bransford, Brown, and Cocking, 2000