1. Using Blackboard to support team- based learning: delivery and rollout Moira Sarsfield, Imperial College London

2. What is TBL? How can technology help to deliver TBL? What technology is suitable for you & your students? How can a TBL package be built and redeployed in Blackboard? Using Blackboard to support team-based learning (TBL): delivery and rollout

3. A structured teaching strategy, involving pre-study by students, quizzing to assess understanding, and peer-to-peer learning via team and class discussion Larry Michaelsen - University of Oklahoma Business School Dean Parmelee - promoted use in Medical Schools 3 Team-based Learning (TBL)

4. Elements of TBL Reading a paper, watching a video or a lecture Individual MCQs on pre-study material Marks count for grade No feedback, no mark until later Team answers same MCQs as iRAT – one entry per team Immediate feedback on answer Ability to answer again if incorrect Marks count for grade Lecturer reviews questions which caused problems for teams Pre-study iRATtRAT RAT review tAPP APP debate Appeals Peer review Pre-study iRAT tRAT RAT review 4

5. Team work together to answers questions, apply knowledge from RATs One entry per team; marks count for grade All members of team must be ready to justify the team answer Teams giving different answers called upon to justify their selection Debate between teams on which answer is correct Correct answer provided after debate Teams can appeal, e.g. if they disagree with the correct answer If successful the score for that team is adjusted Team members assess the contribution of peers, giving a mark and comments; marks count for grade tAPP APP debate Appeals Peer review 5 Elements of TBL Pre-study iRATtRAT RAT review tAPP APP debate Appeals Peer review

6. 6 StudentiRATtRATtAPP Peer Review Total Studious But Shy2722.520372.5 Team Player1822.5201070.5 Lazy Learner1222.520862.5

7. Teaching focus Large class data management – recording student responses Quick turnaround of results to feed into whole class discussion Learning technology focus Using tools that students are familiar with Making the session “reusable” 7 Technology and TBL

8. Blackboard Items in a Content Folder Deliver pre-study materials to students in a structured way Pre-study 8 Technology and TBL

9. 9 Pre-study

10. Blackboard Test – Adaptive Release by date/time, time limit, auto- submission, password, added time for students eligible for extra time in exams Hard copy of questions to record answers Deliver MCQs Apply a time limit Easy marking Reporting of results for each student iRAT 10 Technology and TBL

11. Blackboard Test – Adaptive Release by date/time, time limit, auto- submission, password, added time for students eligible for extra time in exams Hard copy of questions to record answers Deliver MCQs Apply a time limit Easy marking Reporting of results for each student 11

12. tRAT Deliver same (iRAT) MCQs Allow one entry per team Instant feedback Retry for reduced mark Correct answer revealed Easy marking Reporting of results for each team 12 Technology and TBL

13. Groups preloaded into Bb course and into Grade Centre Group Set Sign-up Sheet for scribes Smart View of Grade Centre shows scribes and tRAT scores only tRAT Deliver same (iRAT) MCQs Allow one entry per team Instant feedback Retry for reduced mark Correct answer revealed Easy marking Reporting of results for each team 13 Technology and TBL

14. Adaptive Release of tRAT quizzes to scribes only with password No time limit to allow discussion One quiz for each attempt of each question – two attempts allowed tRAT Deliver same (iRAT) MCQs Allow one entry per team Instant feedback Retry for reduced mark Correct answer revealed Easy marking Reporting of results for each team 14 Technology and TBL

15. Calculated column in Grade Centre shows sum of all tRAT scores (scribes) Hard copy of questions to record team answers Correct answer document manually released tRAT Deliver same (iRAT) MCQs Allow one entry per team Instant feedback Retry for reduced mark Correct answer revealed Easy marking Reporting of results for each team 15 Technology and TBL

16. Deliver MCQs Instant feedback Retry for reduced mark Correct answer revealed Easy marking Reporting of results for each team 16

17. Download Grades (current view) and paste into pre-prepared Excel spreadsheet, which highlights poorly answered questions Copy Attempt Statistics for difficult questions into spreadsheet to show which answers were chosen Calculate average and range of iRAT and tRAT test scores Rapid reporting of questions which caused problems RAT review 17 Technology and TBL

18. RAT review 18 Technology and TBL

19. Blackboard Test – Adaptive Release to scribes only, by date/time, time limit, auto-submission, password Hard copy of questions to record answers Deliver questions Gather answers simultaneously Apply a time limit tAPP 19

20. Download Results of tAPP quiz and paste into pre-prepared Excel spreadsheet, to show which team gave which answer Select teams to speak on each answer Rapid reporting of answers given by each team APP debate 20 Technology and TBL

21. APP debate 21 Technology and TBL

22. Excel spreadsheet to be downloaded and completed by scribe (up to 3 appeals, each <500 words) Adaptive Release to scribes only, with date/time restriction Submit to Turnitin Assignment Dropbox in Blackboard with timed deadline Gather appeals – one form per team – by a set deadline Optionally restrict number/length of appeals Appeals 22 Technology and TBL

23. Excel spreadsheet to be downloaded and completed by each student Adaptive Release – date/time Submit to Turnitin Assignment Dropbox in Blackboard with timed deadline Data processed and individual emails sent to students including marks and peer review comments Gather marks and comments from each student on their team members by a set deadline Optionally restrict how marks can be awarded Process for anonymous reporting of marks and comments to peers Peer review 23 Technology and TBL

24. Peer review 24 Technology and TBL

25. 25

26. Elements of TBL with Technology tAPP APP debate Peer review Appeals Pre-study iRAT tRAT RAT review 26 Blackboard Blackboard test Multiple Bb tests Bb and Excel Blackboard test(s) Bb and Excel Bb/TII and Excel Bb/TII, Excel, Perl, Outlook

27. 27 tAPP APP debate Peer review Appeals Pre-study iRAT tRAT RAT review Elements of TBL with Technology Blackboard Blackboard test Multiple Bb tests Bb and Excel Blackboard test(s) Bb and Excel Bb/TII and Excel Bb/TII, Excel, Perl, Outlook

28. Redeploying TBL in Blackboard 28 Make a template course including generic versions of all elements of the TBL session

29. Redeploying TBL in Blackboard Make a template course including generic versions of all elements of the TBL session 29

30. Redeploying TBL in Blackboard 30 Make a template course including generic versions of all elements of the TBL session

31. In template course, roll-over dates and times Course Tools > Date Management 31 Redeploying TBL in Blackboard

32. Export from template course: Packages and Utilities > Export/Archive Course Import into new course: Packages and Utilities > Import Package/View Logs 32 Redeploying TBL in Blackboard

33. 33 Redeploying TBL in Blackboard

34. New course contains the complete structure of the TBL session: RAT/APP quizzes, with generic questions ready to revise Adaptive release on all elements, including logic, dates/times, etc Dropboxes with correct dates All columns and smart views in the Grade Centre Documentation for staff to reuse 34 Redeploying TBL in Blackboard

35. What is TBL? How can technology help to deliver TBL? What technology is suitable for you & your students? How can a TBL package be built and redeployed in Blackboard? Any Questions? m.sarsfield@imperial.ac.uk 35 Using Blackboard to support team-based learning (TBL): delivery and rollout @msars