Instructor Course Evaluation (ICE) Instructors’ Manual OIRA / IT November 2014

The Blue Experience Assesses the students’ evaluations of the instructor, the course, and learning outcomes. OIRA in collaboration with IT implemented a new ICE application (Blue Evaluations) , acquired from “eXplorance is a leading provider of Learning Experience Management (LEM) solutions for higher education, corporate training and organization management” “eXplorance develops enterprise-Course web-based software that helps educational institutions achieve a competitive advantage through effective collection mechanisms of critical organizational information, flexible departmental processes, as well as enhanced enterprise communication” – source: eXplorance All AUB requirements, and in particular the Confidentiality, were respected

Blue Highlights (source: eXplorance) Blue is: A web based information gathering, sharing and analysis software, and reporting tool for: Blue/ Course Evaluations Blue/360 Performance Appraisal Blue/Surveys Blue/Tests Blue is 100% Web-based, allowing: Security. Ensure privacy and confidentiality of all data Ease of access for every authorized user (any browser, any input device) Integration with existing data sources and IT infrastructure Synchronization with authentication infrastructure (i.e. Login access via your existing employee/ student portal) Branding needs (example: Logos, customized reports headers)

Blue Highlights Blue enables instructors to add a pool of optional questions (restricting to a maximum of 3, now) Supports team taught courses, cross listed courses, etc. Can be leveraged to power mid-term reviews, i.e. provide formative evaluation Provides live access to response rate information Text Analytics option for open-ended comments (to be implemented at a later stage)

Overview of Definitions - (source: eXplorance)

Question Personalize (QPs) Instructor(s) are given the option of adding personalized evaluation questions (up to 3 for the time being) The personalized questions will be added by Instructors at the end of the standard ICE The evaluation scales will follow the ICE scales. For the time being no additional open ended (no comments) questions will be added by Instructors https://oirablue.aub.edu.lb/Blue/sqvg-eng.aspx?lang=eng&pid=e820314b-44dc-44fa-bac3-3fc898c42767&tid=f07cbedb70a246d9f3f91795fd0650bb&uid=2cf216dda0201b2a8d5091d42ac8e74f&regl=en-us

Reports & Analysis Provides permanent report repository Report Types Individual instructor report Aggregate reports based on existing instructor demographics Comparative reports at individual or aggregate levels Report Blocks Analysis block on response Frequency, Score, Aggregate frequency Graphics, tables, statistics Norms, averages Summary, gap analysis, response rates. Analysis block on demographics Cross tabulation Response to Demographic

Text Analytics Text Analytics report blocks are designed to produce a clear and concise visualization of freeform open ended feedback Uses powerful algorithms that examine the content of freeform comments provided by raters and based upon the assigned dictionary it attempts to place the comments into predefined themes established in the dictionary The themes with the highest number of comments are added to the report Can be reported as frequencies, charts, clouds, and trends.

Timeline Faculty Presentation November 5. Faculty add items (max of 5), November 5-14. Student Presentation, November 11. Go Live Date – Fall 2014-15 (November 17) User Manuals and Guidelines are available Access is through AUB NetDB, and fully secured System closed Midnight of December 9-10. Grade Hold for students who have not completed their evaluations. Reports will be released early January, 2015.

Project Timeline

Initiating email instructing Faculty Members to add additional questions From: Blue Srvc <blue-srvc@aub.edu.lb> Date: October 31, 2014 at 22:18:47 GMT+2 To: Karma El-Hassan <kelhasan@aub.edu.lb> Subject: Fall 2014-15 On-Line Instructor Course Evaluation (ICE) - Personalized Additional Questions Reply-To: Oira Oira <oira@aub.edu.lb> Dear Faculty member, OIRA is in the process of launching the Fall 2014-15 on-line ICE evaluations, kindly review the ICE questionnaire and feel free to add up to three additional questions if you feel the need to do so. To add the additional questions you can go to the following link. and then follow the instructions. Kind regards, Dr. Karma El Hassan, Director Office of Institutional Research & Assessment (OIRA)

Form reviewing the Personalized Questions update

Click ‘Preview’ to view ICE Items and ‘Edit’ to add, edit, or review the personalized questions

Once Entered the Additional Items, Update

QP Deadline Expiry

Responses (and Reports) To access the Response Rates and Reports Access the Blue Application using AUB username and password http://oirablue.aub.edu.lb/blue Select Dash Board

User Sign-On (http://oirablue.aub.edu.lb/blue)

Select the required CRN (if multi courses for the term)

Response Rate Summary

Thank you For Queries Contact Email: OIRA@aub.edu.lb Phone: Ext 3131/3130