Creating and Managing Assessments Erin Shelley

Today’s Workshop Overview of Assessments Creating Questions Creating Assessments and Adding Questions Managing the Questions Database Editing Assessment Properties Grading and Viewing Assessments with Assessment Manager Generating Assessment Reports

Learning Outcomes After completing this workshop, you will be able to: identify the differences between the available assessment types. create a variety of question types. create assessments and add questions to them. edit assessment settings. add question sets and alternates. manage questions in the Question Database. grade assessments and view survey results. generate assessment reports to evaluate student performance and the effectiveness of assessments.

Overview of Assessments Types of Assessments You can create three unique types of assessments in WebCT. –Quiz –Self-test –Survey

Overview of Assessments Assessment Tools Assessments Tool Functions by Tab Build From the Build tab, using the Assessments tool, you can:  create and edit questions and assessments..  manage the Question Database Build Teach From both the Build and Teach tabs, you can edit assessment properties. Teach From the Teach tab, using the Assessment Manager tool, you can grade assessments and run reports.

Overview of Assessments Assessment Creation Process To create an assessment, you must complete the following tasks: –create questions. –create the assessment and add the questions. –apply assessment settings.

Activity: Logging In Log into Your Practice Course The URL is Use your NAU ID and password to log in.

Creating Questions True-False Questions Multiple Choice Questions Creating Other Question Types

Activity: Creating True/False and Multiple Choice Questions Create a true false question Create a simple multiple choice question with one correct answer. Create a multiple choice question with several correct answers.

Creating Assessments and Adding Questions Assigning Points to Questions Editing and Managing Questions within Assessments

Activity: Creating Assessments and Adding Questions Create a self test and add the questions. Edit the points assigned to each question so that the total points add up to 60. Create a quiz based on the self test. Create a survey. Create and add a true false and a multiple choice question while creating the survey.

Activity: Creating Other Question Types Combination multiple choice question Fill in the blank question Jumbled sentence question

Activity: Creating Other Question Types Matching question Paragraph question Short answer question Calculated question

Activity: Editing and Managing Questions within Assessments Divide your quiz into two parts and practice re-ordering questions within the parts. Add one of the new questions you created to your self test.

Activity: Editing and Managing Questions within Assessments Create a question set by adding two question alternates to the question. Ensure that WebCT will select two of the three questions from the set and assign points to the questions.

Editing Assessment Properties Available Assessment Properties Self Test  Title  Question titles  Question delivery  Dates Available SurveyAll of the settings above, plus:  Duration  Submission Settings  Security Settings QuizAll of the settings above, plus:  Attempts allowed  Attempts separation  Student score  Student score release  Results Settings

The Assessment Creation Process Quiz properties define how a quiz will be delivered to students and how results will be released to students. Properties are grouped into: Settings Dates Available Results Settings Submission Settings Security Settings.

Editing Assessment Properties Quiz Properties Quiz properties define how a quiz will be delivered to students and how results will be released to students. Properties are grouped into: Settings Dates Available Results Settings Submission Settings Security Settings.

Activity: Specifying How Questions are Delivered Edit your self-test settings: Re-title the test. Make it available starting today and for an unlimited duration.

Activity: Specifying How Questions are Delivered Edit your survey settings: submissions to your external address. Require students to enter a password in order to access the survey.

Activity: Specifying How Questions are Delivered Enter a message for students to receive when they submit their surveys. Edit your quiz settings: Do not display question titles to students.

Activity: Specifying How Questions are Delivered Deliver questions one at a time, without allowing students to revisit them. Allow students to attempt the quiz three times and use the highest attempt score for students’ grades. Ensure that students will receive any feedback and grader’s comments when they view their graded quizzes.

Managing the Question Database Creating Categories Switching Between Category and Question View Default Columns in the Question Database Creating Custom Columns

Managing the Question Database Creating Categories Use categories to help browse the database. For example, Create categories based on topics or themes that students are studying.

Managing the Question Database Switching Between Category and Question View

Managing the Question Database Default Columns in the Question Database ColumnDescription TitleThe title entered for the question when it was created. TypeThe type of question, e.g., Paragraph, Matching, Multiple choice, etc. Used ByThe assessments in which the question appears. Categor y The name of the category in which the question is grouped.

Managing the Question Database Creating Custom Columns You can create custom columns to include additional information about your questions. Once created, custom columns appear as fields in the question creation process.

Activity: Setting Up the Question Database Create a custom column that will allow you to enter descriptive information for your questions. Create several categories you might use to organize the questions you plan to create.

Grading and Viewing the Assessments with Assessment Manager With Assessment Manager, you can: –Grade Assessments by Student –Grade Assessments by Question –Regrade Questions –Modify Quiz Grades –Run Reports

Grading and Viewing the Assessments with Assessment Manager Grading Assessments Manually You will need to grade an assessment manually if: -the assessment includes a paragraph question -a student successfully defends an incorrect response on a question -a question was originally scored incorrectly. You can grade manually grade questions in two ways: -grade by student -grade by question

Grading and Viewing the Assessments with Assessment Manager Viewing Survey Submissions Although you can view whether students have or have not submitted a survey, survey submissions are anonymous.

Activity: Grading Quiz Submissions Grade the paragraph question in the Workshop Intro Quiz. Note how paragraph questions can be graded by student or question. Add five points to your student’s total score for the Diagnostic Quiz. Adjust your student’s score on question six of the Workshop Intro Quiz; give five points for the response.

Generating Assessment Reports There are four reports for quizzes: Performance Item Statistics Summary Statistics Class Statistics

Activity: Generating Reports Select different reports to view for the two quizzes. Run a Performance Report for the Workshop Intro Quiz. Display the statistics for several questions.

Learning More Online Help –Ask Dr. C ( –Support ( ) Campus Resources –Resource One –Resource Two

Looking Ahead Additional F2F Workshops Online Training Opportunities Brown-bag Sessions

Questions and Answers

Workshop Evaluation and Feedback