1. Matt York | Danny Swisher | Patrick Healy | Tim Crossley |
Design, salaries, webmaster
Search, auto-complete, homepages
Leaderboards & metrics, schedules, reviews
Classification, compare, publications
December 14, 2009
CSE 454, Autumn 09

2. Problem: Solution: Instructor data is useful and juicy
But, it’s also uber difficult to find
Courses taught, salaries, reviews, course evaluations, publications, etc.
Solution:
Aggregate data and make it accessible
Add super cool functionality

3. Data Sets Instructors, courses (number, title, description, etc.),
UW Time Schedule
Instructors, courses (number, title, description, etc.),
departments, course instances.

4. Easiness, Helpfulness, Clarity, Rater Interest.
Data Sets
RateMyProfessors.com
Easiness, Helpfulness, Clarity, Rater Interest.

5. Data Sets
lbloom.net
This is public data!

6. Data Sets
Awards
Only 149 matches.

7. Data Sets
BehindTheName
Lookup nicknames

8. Publications search engine
Data Sets
CiteSeer
Publications search engine

9. This information is difficult to find.
Data Sets
Course Evaluations
This information is difficult to find.

10. Course Evaluations

11. Course Evaluations

12. Course Evaluations

13. Course Evaluations

14. Course Evaluations

15. Course Evaluations

16. Find Rank Compare Interface Structure
Search For Courses
Compare Multiple Attributes At Once
Search For Departments
Compare All Between Types
Search For Instructors
Rank
Discover The Best And
The Worst
Discover
InterType Relationships

17. Find AutoComplete Throughout Interface Ranking Snippets
Our data is structured which facilitates autocomplete, Also while large our data set is still small enough to keep autocomplete pretty fast

18. Results
Separated Areas For Results Of Each Type

19. Rankings
Interesting Rankings

20. Usability Testing Results
High-level:
Cool idea, features useful
Site navigation smooth
“Rankings” not clear “Leaderboards” Tested Better
Low-level:
No option to remove item from compare list
No way to compare all teachers
From search results page, people tried to click compare
(no “Add to Compare” button)

21. Early Development

22. Demo

23. Problems we ran in to Time schedule has ugly HTML structure
XPath queries difficult

24. Problems & Surprises
Name conflicts

25. 42.6% 87.0% Evaluation Precision Recall
Classifying home pages is difficult!
Precision
Recall
42.6%
87.0%

26. Time schedule disagrees with evaluations
Time schedule vs. Course evaluations
Time schedule disagrees with evaluations
0.7%

27. Experiments & Validation
Instructors with salaries
Courses with evaluations
Avg. instructor publications
37%
26%
4.7

28. RateMyProfessors evaluation
Entries matching our crawled data
Instructors with reviews
65.29%
12.24%

29. Acquired Knowledge / Skills
Web crawling, recognizing relationships
Naïve Bayes shortcomings
Ruby on Rails, JS, etc.
Consistent data between team members

30. ?