OIRA / IT November 2014 Instructor Course Evaluation (ICE) Instructors’ Manual

The Blue Experience Assesses the students’ evaluations of the instructor, the course, and learning outcomes. OIRA in collaboration with IT implemented a new ICE application (Blue Evaluations), acquired from “eXplorance is a leading provider of Learning Experience Management (LEM) solutions for higher education, corporate training and organization management” “eXplorance develops enterprise-Course web-based software that helps educational institutions achieve a competitive advantage through effective collection mechanisms of critical organizational information, flexible departmental processes, as well as enhanced enterprise communication” – source: eXplorance All AUB requirements, and in particular the Confidentiality, were respected

Blue Highlights Blue Highlights (source: eXplorance) Blue is: A web based information gathering, sharing and analysis software, and reporting tool for:   Blue/ Course Evaluations   Blue/360 Performance Appraisal   Blue/Surveys   Blue/Tests Blue is 100% Web-based, allowing:   Security. Ensure privacy and confidentiality of all data   Ease of access for every authorized user   (any browser, any input device)   Integration with existing data sources and IT infrastructure   Synchronization with authentication infrastructure (i.e. Login access via your existing employee/ student portal)   Branding needs (example: Logos, customized reports headers) 3

Blue Highlights Blue enables instructors to add a pool of optional questions ( restricting to a maximum of 3, now ) Supports team taught courses, cross listed courses, etc. Can be leveraged to power mid-term reviews, i.e. provide formative evaluation Provides live access to response rate information Text Analytics option for open-ended comments (to be implemented at a later stage) 4

Overview of Definitions - Overview of Definitions - (source: eXplorance) 5

Question Personalize (QPs) Instructor(s) are given the option of adding personalized evaluation questions (up to 3 for the time being) The personalized questions will be added by Instructors at the end of the standard ICE The evaluation scales will follow the ICE scales. For the time being no additional open ended (no comments) questions will be added by Instructors 6

Reports & Analysis Provides permanent report repository Report Types   Individual instructor report   Aggregate reports based on existing instructor demographics   Comparative reports at individual or aggregate levels Report Blocks   Analysis block on response   Frequency, Score, Aggregate frequency   Graphics, tables, statistics   Norms, averages   Summary, gap analysis, response rates.   Analysis block on demographics   Cross tabulation   Response to Demographic 7

Text Analytics Text Analytics report blocks are designed to produce a clear and concise visualization of freeform open ended feedback   Uses powerful algorithms that examine the content of freeform comments provided by raters and based upon the assigned dictionary it attempts to place the comments into predefined themes established in the dictionary   The themes with the highest number of comments are added to the report   Can be reported as frequencies, charts, clouds, and trends. 8

9

10

11

Timeline o o Faculty Presentation November 5. o o Faculty add items (max of 5), November o o Student Presentation, November 11. o o Go Live Date – Fall (November 17) o o User Manuals and Guidelines are available o o Access is through AUB NetDB, and fully secured o o System closed Midnight of December o o Grade Hold for students who have not completed their evaluations. o o Reports will be released early January,

Project Timeline 13

Initiating instructing Faculty Members to add additional questions 14 From: Blue Srvc Date: October 31, 2014 at 22:18:47 GMT+2 To: Karma El-Hassan Subject: Fall On-Line Instructor Course Evaluation (ICE) - Personalized Additional Questions Reply-To: Oira Oira Dear Faculty member, OIRA is in the process of launching the Fall on-line ICE evaluations, kindly review the ICE questionnaire and feel free to add up to three additional questions if you feel the need to do so. To add the additional questions you can go to the following link. and then follow the instructions. Kind regards, Dr. Karma El Hassan, Director Office of Institutional Research & Assessment (OIRA)the following link.

15 Form reviewing the Personalized Questions update

Click ‘Preview’ to view ICE Items and ‘Edit’ to add, edit, or review the personalized questions 16

17 Once Entered the Additional Items, Update

QP Deadline Expiry 18

Responses (and Reports) To access the Response Rates and Reports Access the Blue Application using AUB username and password Select Dash Board 19

User Sign-On User Sign-On ( 20

21

Select the required CRN (if multi courses for the term) 22

Response Rate Summary 23

Thank you F or Queries Contact Phone: Ext 3131/