1. 1 Phillips Andover Academy 2/22/2006 - 11:30 – 1:00 Darek Sady Blackboard Learning System (Release 6.3) Assessments, Surveys, and Pools

2. 2 Introductions Darek Sady Education –Utica College of Syracuse University –University of North Carolina Greensboro Professional Experience –6 Years in Academia –Faculty Development Trainer –College instructor for 3 Years –Director of IT 2 Years with Blackboard

3. 3 Introductions and Expectations Please introduce yourself… Name, Position/Title, Courses that you teach Experience using Blackboard Planned use or current use of Blackboard Expectation(s) for this workshop Interesting tidbit about yourself or a local favorite restaurant

4. 4 Workshop Objectives and Agenda Test/Survey Managers –Understanding Creation Settings –Developing assessment questions –Deploying, retrieving, and grading assessments. Questions Pools –Building, categorizing, and searching for questions in a pool

5. 5 Assessments

6. 6 Assessment Lifecycle Creation –Using Pools or building from scratch Delivery –Options, feedback, and availability Completion by Student Grading - “!” in Gradebook –Automatic vs. Manual Item grading Student Review –Viewing feedback and grades

7. 7 Tests and Surveys Question types include: Multiple Choice (answers can be randomized) True/False Multiple Answer Ordering Matching Fill-in-the-Blank Essay Short Answer Calculated Formula Calculated Numeric Hotspot Opinion Scale/Likert File Upload Jumbled Sentence Either/Or 6.3

8. 8 Advanced Question Types Calculated Formula Calculated Numeric Either/Or File Response Fill in Multiple Blanks Hotspot Jumbled Sentence Opinion Scale/Likert Quiz Bowl Short Answer 6.3

9. 9 Advanced Assessment Questions Additional questions types within assessments. Calculated Formula – Include calculations within the question. The calculations can have changing values within them for each exam. Calculated Numeric – Answer is a number or within a certain range of numbers. Either/Or – Answer is Yes/No, Agree/Disagree, Right/Wrong. File Response – Student answers the question by uploading a file. Fill in Multiple Blanks – Type in free-form answers to multiple blanks within a sentence.

10. 10 Advanced Assessment Questions continued Hotspot – Student designates a “hotspot” on an image that was previously uploaded by the instructor. Jumbled Sentence – Select from a drop-down of answers to fill in multiple blanks within a sentence. Opinion Scale/Likert – Answer is selection based on a scale such as Strongly Agree, Agree, Disagree, etc. Quiz Bowl – Students must provide their answers in a question format. Short Answer – Answer is typed into a free-form text box with a set limit.

11. 11 Calculated Formula – Student Perspective

12. 12 Calculated Formula Create variable-based questions by using brackets [ ] Create an answer formula using the WebEQ tool – provide method for Blackboard to solve the problem Partial Credit and Unit requirements can be specified Instructor-defined variables can be used on both sides of the equation Answer formula is solved for missing variable Variable ranges and decimal places can be defined Blackboard will calculate variable answer results

13. 13 Calculated Formula – Instructor Perspective

14. 14 Calculated Formula – Instructor Perspective

15. 15 Calculated Numeric Accepts numeric answers in a blank field Answer range can be specified Does not allow for partial credit Student Perspective

16. 16 Calculated Numeric – Instructor Perspective

17. 17 Either/Or Similar to a True/False question Several answer choice options Can change answer orientation

18. 18 Either/Or – Student Perspective

19. 19 Either/Or – Instructor Perspective

20. 20 File Response Similar to an Assignment – allows instructor to collect file from students Students can upload file from local computer or Content System (if available)

21. 21 File Response – Perspectives Student View Instructor View

22. 22 Fill In Multiple Blanks Create variable-based fill in questions Students can be provided with a text based list of potential answers Instructor must devise potential student answers for each variable Similar to single fill in blank question Partial Credit Option

23. 23 Fill in Multiple Blanks –Perspectives Student View Instructor View

24. 24 Hot Spot Image is uploaded, and select portion of the image is marked as correct Student clicks on image to mark answer Automatically graded

25. 25 Hot Spot – Student Perspective

26. 26 Hot Spot – Instructor Perspective

27. 27 Jumbled Sentence Create variable-based questions by using brackets [ ] Create list of potential answers that will appear throughout the sentence Partial Credit can be specified

28. 28 Jumbled Sentence – Student Perspective

29. 29 Jumbled Sentence – Instructor Perspective

30. 30 Jumbled Sentence – Instructor Perspective

31. 31 Opinion Scale/Likert Similar to a multiple choice question Answer numbering, orientation, and partial credit can be configured Answers can be displayed in random order Often used for assessing opinions in a survey

32. 32 Opinion Scale/Likert – Student Perspective Similar to a multiple choice question Answer numbering, orientation, and partial credit can be configured Answers can be displayed in random order Often used for assessing opinions in a survey

33. 33 Opinion Scale/Likert – Instructor Perspective

34. 34 Quiz Bowl Jeopardy-like questions – answer presented first Partial credit can be partially based on included interrogatives Similar to a “fill in the blank” question

35. 35 Quiz Bowl – Student Perspective

36. 36 Quiz Bowl – Instructor Perspective

37. 37 Short Answer – Student Perspective

38. 38 Short Answer – Instructor Perspective

39. 39 Assessment Question Completion Status Students may skip questions that they may wish to come back to in a question-by-question assessment. This feature allows students to clearly identify which questions they have actually completed from the ones that they have skipped as they progress through the assessment. 6.3

40. 40 Test Manager Test Canvas –Build and edit assessments, and then deploy them anywhere, anytime –Use the Creation Settings feature to set default point values for questions –Attach images and links to questions and to feedback –Built-in math and science notation Test Manager –Change the properties for specific assessments –Choose the method for deploying assessments (e.g., question by question or all at once) –Edit deployed assessments without clearing existing grades

41. 41 Survey Manager Uses include polling, evaluations, and random checks of knowledge Surveys differ from Tests in the following ways: –Questions cannot be assigned points –Surveys cannot include Random Blocks of questions –Instructors cannot give students feedback –Surveys cannot be graded –Surveys questions cannot be categorized –Questions may be imported into a Survey; however, they cannot include correct and incorrect answers Survey results may be viewed on the Assessment Statistics page (by percentage)

42. 42 Assessment Survey Results Download Instructors can download the results from the attempts of a test or survey to an outside application such as MS Excel. Supported question types: True/False and Multiple Choice. This allows further statistical analysis of the test/survey results outside of Blackboard

43. 43 Question Pools

44. 44 Why Use Question Pools? Easily transfer questions from Course to Course by importing and exporting Question Pools Share and exchange Question Pools with colleagues Search Question Pools to locate questions quickly Randomize the order of questions presented to students in an Assessment

45. 45 From Question Pools to Deploying a Test After creating a Question Pool… You must create a Test using the Question Pool as a source of test questions. CONTROL PANEL > TEST MANAGER You must deploy the Test from a Content Area. CONTROL PANEL > CONTENT AREA You must make the Test link visible to make the Test available to students. CONTENT AREA > (Test Name) > MODIFY > MODIFY THE TEST OPTIONS

46. 46 Resources and Materials

47. 47 Tutorials http://www.blackboard.com/quicktutorials/

48. 48 The Blackboard Community Users Conference Client Advisory Boards Email Listserve Behind the Blackboard for Administrators Regional User Groups Developer Community