SFnight SFnight 213 project Overview Special Challenges Heuristic Evaluation Results of the Pilot Study Formal Usability Study Demo of Current Design Last prototype Summary UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES our agenda ?

Overview  The 213 design team focus The customization aspects of SFnight for nightlife consumers.  Solutions 1. List to store venues/events & can be ed 2. Generic Newsletter 3. Customized Newsletter 4. Customized area in home page 5. MySFnight page - recommended calendar - user’s own calendar - user’s venue and event selections UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Special Challenges 1.Schedule Coordination 213 project and the SFnight Final Project schedules do not always match 2.Version control: Low-fi prototype = Old SFnight prototype simplified Heuristic = SFnight old pages + other mockup pages Usability = the full integration of Final project 3.Implementation: Site-wise integration necessary, most 213 members not familiar enough to be able to help efficiently UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Heuristic Evaluation I 1.BESS / BookMarket Team Great feedback and comments - Many thanks! 2.Issues addressed: - Registration - list - MySFnight Page 3.Issues not addressed: - parts not relevant to 213 part (search page) - Inconsistencies due to version control problems - Areas to be developed later: Help & Documentation 1 st Interactive Prototype Used for Heuristic Evaluation UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Heuristic Evaluation II Registration  Language issues (“light weight”?)  No Cancel button  ‘Thank you” shown before process is complete  Inappropriate use of check boxes (O.D’d designer)  Not enough feedback after finishing MySFnight Sign Up , MyList, thing?  Button labels did not accurately communicate their functions  Location of buttons confusing  Text field too small for multiple addresses + no explanation  Accomplishing different tasks by using one check box for each item is too confusing UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Heuristic Evaluation III MySFnight  Not a very straightforward calendar  The design/purpose of two calendars were not clear enough  Ambiguous button usage UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES Thanks again BESS/Book Market Team for your patience! Special thanks to Chan Jean also for evaluating SFnight.

UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES Pilot Usability Study The Test  1 hour each session  Three tasks: send options, sign up, use MySFnight  Post task and post test questionnaires Participants  closely resembled our personas  3 males: 1 is 25-30, 2 are  professionals  lots of internet experience  enjoy going out at night

Registration  Sign-up entrances (3) were not obvious  Users want a page to confirm registration, instead of going to MySfnight General results Results of the Usability Testing I UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES Did you say , My List, thing?  Still fighting with terminology: add + list + send +  One wants more information to send: directions  Storing of addresses: since there would be some drawbacks, we have analyzed this before

Results of the Usability Testing II MySFnight  The first time a user sees the MySFnight page, the d istinction of the two calendars is not clear. Only after some manipulation do users feel more comfortable with the interface  Need to address calendar monthly view and be able to see beyond four weeks.  MySFnight top button, be more like a button  Need to indicate when the minimized Editor’s Picks has events General results UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Formal Usability Study I Purpose How can our design accommodate different cognitive styles: visual v.s. text Independent variables - The Current MySFnight calendar (more visual-oriented) and a new text-oriented MySFnight calendar - Two groups of users with different cognitive style Hypothesis - Either Users will be more comfortable with the design that is geared towards their cognitive style - Or The two-calendar design is confusing regardless of whether the style is visual or text oriented UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Formal Usability Study II Methods - Determine cognitive styles of users (30 ea. group) - Between subject design: each user only test one design Dependent variable - Readability of the information [what is] - The manipulation of information objects [how to, affordance] - Information organization [intuitive location] - Information usefulness [help accomplish goals/satisfy needs] Measures - Time to complete various tasks - Satisfaction questionnaire [post task, post test] - Log indicating wrong clicks and style [ergoBrowser] - Observation UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Formal Usability Study III control sources of variance:  randomization of tasks: to statistically equalize the learning effect.  elimination of secondary sources of variance, such as choosing users who have no previous experience with the interfaces to reduce familiarity with the test site  statistic control: related to experience in using the Internet, nightlife events, and their cognitive style. UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

" MySFnight " UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Current Design  The First Interactive Prototype were static pages  The Third Interactive Prototype (current design) the pages are generated dynamically, using information from a database: perl/cgi scripts  Several designed changes were implemented and is on going Demo UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Registration  At the homepage, creating clearer text for Sign Up  Become more clear the benefits of signing up  Create a new feedback page , My List, thing  Change the name  Improve form MySFnight  Improve the button  Better differentiation between the calendars  Mock up of the month calendar (if time permits) Plans for the Last Interactive Prototype UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Summary  More usability testing in the future  A specific study of calendar presentations, and better address the manipulation of these kind of data  Find a better way of providing version control UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

Questions ? Thank you UC BERKELEY SIMS IS 213 MAY : 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES