Online Peer Evaluation System Team Green Apple Team Members Ada Tse Amber Bahl Tom Nichols Matt Anderson Faculty Mentor Prof. M Lutz Project Sponsor Richard Fasse RIT Online Learning

Agenda Project Overview Current System Our Product Features Product Architectural and Design Software Process Risk Analysis and Mitigation Metrics Requirements Process Status & Future Goals Demo

Problem Statement The RIT Online Learning department is in need of an online peer evaluation system that can enhance the collaborative learning experience. Existing Tool: –Paper Alternative –Clipboard Survey System

**Importance Group work is an important aspect in today's education system –I would like to add some data here. We can Richard on this. The average SE graduate does about 16 group projects

Current System: Clipboard Create, Deploy and Analyze –Does provide different views for analysis but more effective for analyzing surveys then Peer Evaluations. –Very Hard to identify problem groups Not integrated with myCourses Survey System Can’t deploy evaluations per group Hard to setup Reporting does not show group weaknesses No control over who takes the survey

Current System: Reporting View View: Percentage/ Graph

Current System: Reporting View

Solution: Custom Application

Peer Evaluation System Integrated with myCourses –Login Pass-through –Course and Group Data Imported directly from myCourses Setup Workflow –Tailored for peer evaluations Question Templates –Reusable –Shared between Instructors

Application Workflow Instructor Main -Create Eval Student main -Take Eval Instructor Main -Reporting 1. Create Evaluation 2. Take Evaluation 3. Analyze Results WOW!!

**Instructor Main Instructor Main List of global and personal questions templates Evaluation Status Evaluations listed per course

Solution: Create Evaluation Select Template Eval Setup Info

Solution: Create Templates Global/ Personal

Solution: Students View Instructions

Solution: Reporting Reporting (Provided with the help of multiple views) –Multiple levels of detail By Group By Student –Sorted by groups or individuals –Quickly identify problem groups

**Solution: Reporting View

Product Architecture and Design

**Architectural Design Now looks at our products Architectural Design and quality attributes.

**High-level Design Key Classes/ Package Diagram –Tom

**Deployment Diagram

Software Process

Process: Scrum What is Scrum? –Scrum is an iterative, incremental process for developing any product or managing any work. It produces a potentially shippable set of functionality at the end of every iteration (Sprint).

Scrum: Sprint Delivers working software –Typically between 1-4 week iterations Cross-functional tasks per team member Total focus—no unwanted diversion –No interruptions/changes from the outside New work may be uncovered by the team during development

Our Methodology Flavor of Scrum Similarities: –The whole project was implemented in chunks (Sprints) depending on the requirements prioritization (Sprint Backlogs). Differences: –Upfront requirements –Extended the Sprint one delivery date

Requirements Process Mainly elicited by: –In Person Interviews Project Sponsors Subject Matter Experts Online Learning Technical Staff –UI Mockups –Evaluating RIT Clipboard Peer Evaluation Templates

Requirements Analysis Use Case Analysis Workflow Diagrams –Workflow Steps Constant user feedback at the end of each Sprint

Risk Analysis and Mitigation

Risk Analysis New Technologies –.NET Integration with myCourses –LDAP Authentication –XML Feeds –Testing

Risk Mitigation Software Process Methodology Task Planning Tooling

Risk Mitigation: Task Planning Specified tasks according to skill set New Technologies –Team members started off with small/simple programs –Experienced team members educated the team LDAP Authentication –Great help from the Online Learning

Risk Mitigation Plan: Software Process Use of Scrum *User Feedback (Allows for midcourse corrections) Deployable Deliverable (At the end of each Sprint) Increased Product Visibility Increased Progress Visibility –Sprint Planning Through many sprints the requirements were revised many times to ensure that clarity is achieved. Throughout every sprint, each decision will be evaluated to make sure that it aligns with the overall goals of the project. We conducted many team building events as deemed necessary by the team.

Risk Mitigation: Tooling Subversion for revision control –Include all project documents Trac provides web based management –View files and Changesets Automated synchronization of project documents to web site Provides an integrated bug tracking system

Date Collection

Metrics Backlogs –Product –Sprint Number of tasks completed for a particular sprit (Work effort distributed for each sprint) Number of bugs –By Feature –By Severity –Per Sprint Total effort (man hours) for all phases

Effort Metrics

Bugs Per Feature

Current Status Progress Key FeaturesProgress Requirements ElicitationDONE Requirements Analysis (SRS)DONE High Level ArchitectureDONE Initial Setup (DB, Environment)DONE Requirements PrioritizationDONE Sprint 1DONE Sprint 2DONE Sprint 3DONE Integration TestingIN PROGRESS About 95% of High Priority requirements addressed.

Future Enhancements More views for Reporting Better support for Answer type

**Reflections Great Team!!! –All team members were Free Agents (oops!) Software Process Model Delays in Sprint 1 –Unknown Technologies –.NET 2.0

**Demo LINK COMES HERE

Questions Thank you!

Supporting Data

Challenges Uniformity –Rating System –Question System Faculty View Different User Types Synchronization with myCourses