Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense1 OPRAM: An Online System for Assigning Capstone Course Students to Sponsored Projects.

Slides:



Advertisements
Similar presentations
CONCEPTUAL WEB-BASED FRAMEWORK IN AN INTERACTIVE VIRTUAL ENVIRONMENT FOR DISTANCE LEARNING Amal Oraifige, Graham Oakes, Anthony Felton, David Heesom, Kevin.
Advertisements

Slides by Peter van Beek Edited by Patrick Prosser.
Performance Testing - Kanwalpreet Singh.
1 Constraint Satisfaction Problems A Quick Overview (based on AIMA book slides)
1 CMSC 471 Fall 2002 Class #6 – Wednesday, September 18.
Constraint Optimization Presentation by Nathan Stender Chapter 13 of Constraint Processing by Rina Dechter 3/25/20131Constraint Optimization.
Best-First Search: Agendas
Constraint Processing Techniques for Improving Join Computation: A Proof of Concept Anagh Lal & Berthe Y. Choueiry Constraint Systems Laboratory Department.
Constraint Systems Laboratory Oct 21, 2004Guddeti: MS thesis defense1 An Improved Restart Strategy for Randomized Backtrack Search Venkata P. Guddeti Constraint.
Ryan Kinworthy 2/26/20031 Chapter 7- Local Search part 1 Ryan Kinworthy CSCE Advanced Constraint Processing.
Solvable problem Deviation from best known solution [%] Percentage of test runs ERA RDGR RGR LS Over-constrained.
Constraint Satisfaction Problems
Academic Advisor: Prof. Ronen Brafman Team Members: Ran Isenberg Mirit Markovich Noa Aharon Alon Furman.
A Constraint Satisfaction Problem (CSP) is a combinatorial decision problem defined by a set of variables, a set of domain values for these variables,
Project Group Assignment System CS616 Team 9 Kim Doyle, Susan Kroha, Arunima Palchowdhury, Wei Xu Client: Dr. Charles Tappert.
Quality is about testing early and testing often Joe Apuzzo, Ngozi Nwana, Sweety Varghese Student/Faculty Research Day CSIS Pace University May 6th, 2005.
Support: UCARE grant awarded to Chris Reeson & CAREER Award # from the National Science Foundation. To the public: –Illustrate the power of CP For.
Constraint Systems Laboratory March 26, 2007Reeson–Undergraduate Thesis1 Using Constraint Processing to Model, Solve, and Support Interactive Solving of.
A game of logic where the player must assign the numbers 1..9 to cells on a 9x9 grid. The placement of the numbers must be such that every number must.
General search strategies: Look-ahead Chapter 5 Chapter 5.
1 Bandwidth Allocation Planning in Communication Networks Christian Frei & Boi Faltings Globecom 1999 Ashok Janardhanan.
Chapter 5 Outline Formal definition of CSP CSP Examples
Jun Peng Stanford University – Department of Civil and Environmental Engineering Nov 17, 2000 DISSERTATION PROPOSAL A Software Framework for Collaborative.
Distributed Scheduling. What is Distributed Scheduling? Scheduling: –A resource allocation problem –Often very complex set of constraints –Tied directly.
Foundations of Constraint Processing, Fall 2004 November 18, 2004More on BT search1 Foundations of Constraint Processing CSCE421/821, Fall 2004:
Final Year Project Presentation E-PM: A N O NLINE P ROJECT M ANAGER By: Pankaj Goel.
OptReg Optimum Time Schedule Generator and Registration System for Courses in a College/Unviersity Along with an optimum Finals Examination Schedule Generator.
COMPARISON STUDY BETWEEN AGILEFANT AND XPLANNER PLUS Professor Daniel Amyot Ruijun Fan Badr Alsubaihi Submitted to Professor Daniel Amyot.
Team 20 Advisor Dr. John Keenan 2:30 pm – 3:00 pm 3:00 pm – 3:30 pm Abstract Course scheduling is an integral part of the college experience. At the University.
Katanosh Morovat.   This concept is a formal approach for identifying the rules that encapsulate the structure, constraint, and control of the operation.
CP Summer School Modelling for Constraint Programming Barbara Smith 1.Definitions, Viewpoints, Constraints 2.Implied Constraints, Optimization,
At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.
Feasibility Study.
ANTs PI Meeting, Nov. 29, 2000W. Zhang, Washington University1 Flexible Methods for Multi-agent distributed resource Allocation by Exploiting Phase Transitions.
Budget-based Control for Interactive Services with Partial Execution 1 Yuxiong He, Zihao Ye, Qiang Fu, Sameh Elnikety Microsoft Research.
Motivation & Goal SAT and Constraint Processing (CP) are fundamental areas of Computer Science that address the same computational questions. Compare SAT.
CP Summer School Modelling for Constraint Programming Barbara Smith 2. Implied Constraints, Optimization, Dominance Rules.
Constraint Satisfaction CPSC 386 Artificial Intelligence Ellen Walker Hiram College.
For: CS590 Intelligent Systems Related Subject Areas: Artificial Intelligence, Graphs, Epistemology, Knowledge Management and Information Filtering Application.
Framework for MDO Studies Amitay Isaacs Center for Aerospace System Design and Engineering IIT Bombay.
Efficient RDF Storage and Retrieval in Jena2 Written by: Kevin Wilkinson, Craig Sayers, Harumi Kuno, Dave Reynolds Presented by: Umer Fareed 파리드.
1 Admission Control and Request Scheduling in E-Commerce Web Sites Sameh Elnikety, EPFL Erich Nahum, IBM Watson John Tracey, IBM Watson Willy Zwaenepoel,
MROrder: Flexible Job Ordering Optimization for Online MapReduce Workloads School of Computer Engineering Nanyang Technological University 30 th Aug 2013.
Chapter 5 Constraint Satisfaction Problems
D R A T D R A T ABSTRACT Every semester each department at Iowa State University has to assign its faculty members and teaching assistants (TAs) to the.
Foundations of Constraint Processing, Fall 2004 October 3, 2004Interchangeability in CSPs1 Foundations of Constraint Processing CSCE421/821, Fall 2004:
At the beginning of each semester, CSE hires a number of Graduate Teaching Assistants (GTAs) as graders, lab supervisors, and instructors. The department.
03/02/20061 Evaluating Top-k Queries Over Web-Accessible Databases Amelie Marian Nicolas Bruno Luis Gravano Presented By: Archana and Muhammed.
EXAMPLE: MAP COLORING. Example: Map coloring Variables — WA, NT, Q, NSW, V, SA, T Domains — D i ={red,green,blue} Constraints — adjacent regions must.
Power Guru: Implementing Smart Power Management on the Android Platform Written by Raef Mchaymech.
Maintaining Consistency in Resource Allocation Trevor Janke & Berthe Y. Choueiry Goals  Study & refine the constraint model of the existing Graduate TAs.
Reliable Web Service Execution and Deployment in Dynamic Environments * Markus Keidl, Stefan Seltzsam, and Alfons Kemper Universität Passau Passau,
Shortcomings of Traditional Backtrack Search on Large, Tight CSPs: A Real-world Example Venkata Praveen Guddeti and Berthe Y. Choueiry The combination.
Roman Barták (Charles University in Prague, Czech Republic) ACAT 2010.
ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information Systems.
Scheduling for Trinity School at Meadow View
Sponsored by Portakal Technologies
Decision Support System for School Cricket in Sri Lanka (CricDSS)
CSPs: Search and Arc Consistency Computer Science cpsc322, Lecture 12
CSPs: Search and Arc Consistency Computer Science cpsc322, Lecture 12
Core Platform The base of EmpFinesse™ Suite.
Intelligent Backtracking Algorithms: A Theoretical Evaluation
Constraints and Search
Chapter 5: General search strategies: Look-ahead
Intelligent Backtracking Algorithms: A Theoretical Evaluation
Intelligent Backtracking Algorithms: A Theoretical Evaluation
Intelligent Backtracking Algorithms: A Theoretical Evaluation
Intelligent Backtracking Algorithms: A Theoretical Evaluation
Intelligent Backtracking Algorithms: A Theoretical Evaluation
Presentation transcript:

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense1 OPRAM: An Online System for Assigning Capstone Course Students to Sponsored Projects Juedong Zhang Acknowledgments: NSF Award RI

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense2 Outline  Introduction Background Motivations Contributions  Problem Modeling & Solving Methods  System Implementation & Features  Conclusions & Future Work

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense3 Background  CSE Capstone Course An integral part of the undergraduate curriculum Professional development opportunities  Participants Students, sponsors, CSE faculty, & iLab staff  Team formation

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense4 Motivations  Team assignment is challenging Large class (CS + CE) Various constraints Capacity limit for each project Students’ preferences Sponsors’ preferences  Constraint-based system for decision support Automatic solver generates solutions upon request Interactive solver maintains consistency for user Visual support guides user to make good assignments

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense5 Contributions  Modeled the task as a Constrained Optimization Problem (COP) with three optimization criteria  Designed a search algorithm that can generate the optimal solution in a reasonable amount of time  Developed an interactive solver that maintains consistency while the user explores the search space  Created a web GUI interface that encapsulates both solvers and provides an unified user experience  Co-built an MySQL database for data persistence

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense6 Outline  Introduction  Problem Modeling & Solving Methods Problem modeling Problem solving methods Evaluation of search performance  System Implementation & Features  Conclusions & Future Work

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense7 Modeling: COP  Given Variables: The students enrolled in the Capstone Course Domains: The projects applied to which a student applies Hard constraints: A project’s capacity limit A student does not choose a project or a sponsor does not choose a student Soft constraints: Students/sponsors preferences between 0…5 Objective function: Three criteria based on preferences  Query: find a value for each variable such that All hard constraints are satisfied and The objective function is optimized

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense8 Modeling: Soft Constraints  Students preferences “I am interested in working on this project.”  Sponsors preferences “I think this student is a good fit for my project.” Agreeableness of the statement a preference score

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense9 Modeling: Combining Preferences  Product of preferences is more sensitive

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense10 Modeling: Objective Function  Avg Maximize the average value over all preferences  Geo Avg Maximize the geometric average value over all preferences  Maxmin Maximize the minimum value over all preferences

Constraint Systems Laboratory Problem Solving Method  Backtrack search  Variable Ordering First choose the student with the least number of projects (i.e., least-domain first)  Value Ordering Assign to a student first the project with the highest preference (i.e., most promising value)  Constraint propagation by local consistency  Exhaustive, depth-first search  Branch-and-bound with a heuristic function 11/26/2015Zhang: MS Project Defense11

Constraint Systems Laboratory Local Consistency  Node consistency Apply to the zero preference constraint Remove the 0 value from the domain of every variable  Generalized arc consistency (GAC) Apply to the capacity constraint Remove the value (project) from the domain of all future variables when the load of that project is reached 11/26/2015Zhang: MS Project Defense12 GAC is the foundation of our interactive solver

Constraint Systems Laboratory Heuristic Function h  Given an assignment of i variables The cost of the partial solution The estimated cost of remaining assignments The total estimated cost  h(.) Choose the value with highest preferences, even if values are inconsistent with partial solution h(.) is admissible, it never underestimates the cost of the real solution 11/26/2015Zhang: MS Project Defense13

Constraint Systems Laboratory Search: FC-BnB search algorithm  Forward checking (FC) algorithm [Haralick and Elliott, 1980] A systematic search technique After a variable is instantiated, it looks ahead (executes GAC) When detecting a domain wipeout, it backtracks chronologically  Branch-and-Bound Finds a first solution quickly, the incumbent After a variable is instantiated, compares the quality of current solution to that of the incumbent, updates incumbent Exhaustive search, linear in space 11/26/2015Zhang: MS Project Defense14 FC- BnB is the foundation of our automatic solver

Constraint Systems Laboratory {(P 2,5), (P 1,3), (P 3,1)} {(P 3,5), (P 2,3), (P 1,3)} {(P 2,5)} {(P 2,5), (P 1,3)} {(P 3,3), (P 1,1)} VariableDomain Current Variable If Avg optimization criterion is used f ((V 1,5), (V 2,5), (V 3,3), (V 4,5), (V 5,5), (V 6,)) = g ((V 1,5), (V 2,5)) + h ((V 3,3), (V 4,5), (V 5,5), (V 6,3)) = ((5 + 5) + ( )) / 6 = 4.33 Estimated solution quality at V 2. Proceed to V 3 only if it is better than incumbent Future Variables V1V1 V2V2 V3V3 V4V4 V5V5 V6V6 (P 2,5) (P 3,3)(P 1,5)(P 3,5)(P 1,3) The h function ignores hard constraints Assignments made by FC V1V1 V2V2 V3V3 V4V4 V5V5 V6V6 Illustrating Search: Example {(P 1,5), (P 3,3)} Projects removed by FC to comply with the capacity constraints Six students V 1 ~ V 6 Three projects P 1 ~ P 3, each with a capacity of 2 11/26/2015Zhang: MS Project Defense15

Constraint Systems Laboratory Evaluating search: CPU  Data Sets Fall 2013: 45 students, 11 projects Spring 2014: 10 students, 3 projects  Impact of the h function 11/26/2015Zhang: MS Project Defense16

Constraint Systems Laboratory Evaluating Search: Solution Quality  Impact of the optimization criterion: comparing optimal solutions 11/26/2015Zhang: MS Project Defense17

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense18 Outline  Introduction  Problem Modeling & Solving Methods  System Implementation & Features System architecture iLab infrastructure OPRAM architecture OPRAM Functionalities Web GUI The Legend’s color map Interactive solver Automatic solver Solution comparison  Conclusions & Future Work

Constraint Systems Laboratory 11/26/2015Zhang: MS Project defense19 iLab Infrastructure A user’s view User Registration Information Exchange Project Assignment Students / Sponsors Progress Management Instructors / iLab Staff iLab Administrator Module we developed Module in progress

Constraint Systems Laboratory 11/26/2015Zhang: MS Project defense20 iLab Infrastructure A system view User Registration Information Exchange iLab DB Progress Management iLab Info Project OPRAM Project Assignment iLab X Project Module we developed Module we co-developed Module in progress

Constraint Systems Laboratory OPRAM Architecture  Google Web Toolkit 11/26/2015Zhang: MS Project Defense21 Server (Backend) Client (GUI) RPC Google Web Toolkit Application Java EEAJAX Runs in Browser Runs on Server

Constraint Systems Laboratory OPRAM Architecture  Remote Procedure Call (RPC) 11/26/2015Zhang: MS Project Defense22

Constraint Systems Laboratory OPRAM Architecture  Software design 11/26/2015Zhang: MS Project Defense23 RPC GUI Service Client Impl. Service Async. Service Service Server Impl. Client Server DB Access Auto Solver Interactive Solver Request Reply Interface Implementation Color legend :

Constraint Systems Laboratory Web GUI 11/26/2015Zhang: MS Project Defense24

Constraint Systems Laboratory Legend’s Color Map 11/26/2015Zhang: MS Project Defense25

Constraint Systems Laboratory Interactive Solver: Student View 11/26/2015Zhang: MS Project Defense26 Project not available Total number of students 1-semester or 2-semester student Preference

Constraint Systems Laboratory Interactive Solver: Project View 11/26/2015Zhang: MS Project Defense27 Project overview sub-panelIndividual project sub-panel Project not available Total number of projects How many more students can be assigned Average preference Individual project tab Preference Display the list of projects applied by the student when mouseover the preference Project the student currently assigned to is shown in bold

Constraint Systems Laboratory Automatic Solver 11/26/2015Zhang: MS Project Defense28 Three options: 10 seconds 1 minute 5 minutes

Constraint Systems Laboratory Solution Comparison 11/26/2015Zhang: MS Project Defense29 Only comparable solutions are displayed Three additional metrics for current solution listed

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense30 Outline  Introduction  Problem Modeling & Solving Methods  System Implementation & Features  Conclusions & Future Work

Constraint Systems Laboratory Conclusions  Designed & implemented a web-base system for Capstone Course project assignment decision support  OPRAM demonstrated significant improvements on time to solution as well as the quality of assignment found  CSE faculty and iLab staff are satisfied with OPRAM’s capabilities and have decided to take advantage of it in the upcoming semester 11/26/2015Zhang: MS Project Defense31

Constraint Systems Laboratory Future Work  A formal proof for NP-hardness of this assignment problem  Explore other optimization criteria such as “stable matching”  Explore whether or not ‘a minimum size per project’ is appropriate  Support further interoperability between our two solvers  Conduct longitudinal study of usefulness & flexibility 11/26/2015Zhang: MS Project Defense32

Constraint Systems Laboratory 11/26/2015Zhang: MS Project Defense33 Thank you I welcome your questions

Constraint Systems Laboratory Ordering Heuristics  Dynamic variable ordering heuristic First choose the student with the least number of projects (i.e., least-domain first) Choose the most constrained variable first (fail first principle) to reduce the branching factor  Dynamic value ordering heuristic For a student, first assign the project with the highest preference Choose the most promising value first to find the best solution more quickly 11/26/2015Zhang: MS Project Defense34