Online Peer Evaluation System Team Green Apple Team Members Ada Tse Amber Bahl Tom Nichols Matt Anderson Faculty Mentor Prof. M Lutz Project Sponsor Richard Fasse RIT Online Learning
Agenda Project Overview Current System Our Product Features Product Architectural and Design Software Process Risk Analysis and Mitigation Metrics Requirements Process Status & Future Goals Demo
Problem Statement The RIT Online Learning department is in need of an online peer evaluation system that can enhance the collaborative learning experience. Existing Tool: –Paper Alternative –Clipboard Survey System
**Importance Group work is an important aspect in today's education system –I would like to add some data here. We can Richard on this. The average SE graduate does about 16 group projects
Current System: Clipboard Create, Deploy and Analyze –Does provide different views for analysis but more effective for analyzing surveys then Peer Evaluations. –Very Hard to identify problem groups Not integrated with myCourses Survey System Can’t deploy evaluations per group Hard to setup Reporting does not show group weaknesses No control over who takes the survey
Current System: Reporting View View: Percentage/ Graph
Current System: Reporting View
Solution: Custom Application
Peer Evaluation System Integrated with myCourses –Login Pass-through –Course and Group Data Imported directly from myCourses Setup Workflow –Tailored for peer evaluations Question Templates –Reusable –Shared between Instructors
Application Workflow Instructor Main -Create Eval Student main -Take Eval Instructor Main -Reporting 1. Create Evaluation 2. Take Evaluation 3. Analyze Results WOW!!
**Instructor Main Instructor Main List of global and personal questions templates Evaluation Status Evaluations listed per course
Solution: Create Evaluation Select Template Eval Setup Info
Solution: Create Templates Global/ Personal
Solution: Students View Instructions
Solution: Reporting Reporting (Provided with the help of multiple views) –Multiple levels of detail By Group By Student –Sorted by groups or individuals –Quickly identify problem groups
**Solution: Reporting View
Product Architecture and Design
**Architectural Design Now looks at our products Architectural Design and quality attributes.
**High-level Design Key Classes/ Package Diagram –Tom
**Deployment Diagram
Software Process
Process: Scrum What is Scrum? –Scrum is an iterative, incremental process for developing any product or managing any work. It produces a potentially shippable set of functionality at the end of every iteration (Sprint).
Scrum: Sprint Delivers working software –Typically between 1-4 week iterations Cross-functional tasks per team member Total focus—no unwanted diversion –No interruptions/changes from the outside New work may be uncovered by the team during development
Our Methodology Flavor of Scrum Similarities: –The whole project was implemented in chunks (Sprints) depending on the requirements prioritization (Sprint Backlogs). Differences: –Upfront requirements –Extended the Sprint one delivery date
Requirements Process Mainly elicited by: –In Person Interviews Project Sponsors Subject Matter Experts Online Learning Technical Staff –UI Mockups –Evaluating RIT Clipboard Peer Evaluation Templates
Requirements Analysis Use Case Analysis Workflow Diagrams –Workflow Steps Constant user feedback at the end of each Sprint
Risk Analysis and Mitigation
Risk Analysis New Technologies –.NET Integration with myCourses –LDAP Authentication –XML Feeds –Testing
Risk Mitigation Software Process Methodology Task Planning Tooling
Risk Mitigation: Task Planning Specified tasks according to skill set New Technologies –Team members started off with small/simple programs –Experienced team members educated the team LDAP Authentication –Great help from the Online Learning
Risk Mitigation Plan: Software Process Use of Scrum *User Feedback (Allows for midcourse corrections) Deployable Deliverable (At the end of each Sprint) Increased Product Visibility Increased Progress Visibility –Sprint Planning Through many sprints the requirements were revised many times to ensure that clarity is achieved. Throughout every sprint, each decision will be evaluated to make sure that it aligns with the overall goals of the project. We conducted many team building events as deemed necessary by the team.
Risk Mitigation: Tooling Subversion for revision control –Include all project documents Trac provides web based management –View files and Changesets Automated synchronization of project documents to web site Provides an integrated bug tracking system
Date Collection
Metrics Backlogs –Product –Sprint Number of tasks completed for a particular sprit (Work effort distributed for each sprint) Number of bugs –By Feature –By Severity –Per Sprint Total effort (man hours) for all phases
Effort Metrics
Bugs Per Feature
Current Status Progress Key FeaturesProgress Requirements ElicitationDONE Requirements Analysis (SRS)DONE High Level ArchitectureDONE Initial Setup (DB, Environment)DONE Requirements PrioritizationDONE Sprint 1DONE Sprint 2DONE Sprint 3DONE Integration TestingIN PROGRESS About 95% of High Priority requirements addressed.
Future Enhancements More views for Reporting Better support for Answer type
**Reflections Great Team!!! –All team members were Free Agents (oops!) Software Process Model Delays in Sprint 1 –Unknown Technologies –.NET 2.0
**Demo LINK COMES HERE
Questions Thank you!
Supporting Data
Challenges Uniformity –Rating System –Question System Faculty View Different User Types Synchronization with myCourses