Administrivia Final Exam Deliverable 3 Feedback on Heuristic Eval

Slides:



Advertisements
Similar presentations
Academic Quality How do you measure up? Rubrics. Levels Basic Effective Exemplary.
Advertisements

Go to Slide Master View to edit Footer 1 Introduction to the Online Help Desk Unit Liaison Meeting June 19, 2009.
IS214 Recap. IS214 Understanding Users and Their Work –User and task analysis –Ethnographic methods –Site visits: observation, interviews –Contextual.
Administrivia  Review Deliverable 2 –Overview (audience) –Excellent additions  User Goals  Usability Goals  User Group (who are you designing for?)
Heuristics  Basis  Evaluators –Qualifications –Training  Preparation –Scenario  Results –List of problems –Severity –Group synthesis.
Project Sharing  Team discussions –Share results of heuristic evaluations –Discuss your choice of methods and results  Class-level discussion –Each spokesperson.
Administrivia  Feedback on first Deliverable –Audience: Management –Requirements  Description of the system (what it is, how it works)  Define user.
Day 2 (Week 1, W) Wrap-up Introductory Materials –Formation of Teams –General comments on the survey –Grading – Solution, Design Rationale –E-portfolio.
Administrivia EPost and Portfolio EPost and Portfolio Analysis of Design process Analysis of Design process.
Syllabus – Weekly schedule. Project Deliverable 1 Required elements –Product statement –One use case –Redesign justification Format-specific additional.
Analysis of Design Process Lewis/Gould 1981 Study TC518 W ’06 Students Early Focus on Users 62%58% Empirical Measurement 40%69% Iterative Design 20%62%
Usability 2004 J T Burns1 Usability & Usability Engineering.
10th Workshop "Software Engineering Education and Reverse Engineering" Ivanjica, Serbia, 5-12 September 2010 First experience in teaching HCI course Dusanka.
Feedback from Mid-term Evaluation  What could better help you learn –Assignments  Assignments are too vague (expectations are not clear)  Unsure about.
Elicitation Methods Information types Information types Information Information Internal Perspectives Internal Perspectives Behavior Behavior Facts Facts.
UK HealthCare’s New Learning Management System (LMS)
Usability 2009 J T Burns1 Usability & Usability Engineering.
Usability Testing Your Circulation FAQ Access Services Conference November 10, 2011 Melissa Feiden, Annex Services and User Experience Librarian Cassandra.
Y ASER G HANAM Heuristic Evaluation. Roadmap Introduction How it works Advantages Shortcomings Conclusion Exercise.
Usability 1 Usability evaluation Without users - analytical techniques With users - survey and observational techniques.
Project Sharing  Team discussions (15 minutes) –Share results of your work on the Project Scope Proposal –Discuss your choice of methods and results –Prepare.
Administrivia  Final Exam –Due Date – Thursday, March 17 –Q & A  Deliverable 2 –Q & A.
Mid-Term Evaluation  Course and Instructor evaluation  Jennie Dorman.
Administrivia  Feedback from the mid-term evaluation  Insights from project proposal.
ANGEL Penn State’s Course Management System Created by PSY Office of C&IS.
BUS 591 Slingshot Academy / Tutorialrank.com Tutorialrank.com For More Tutorials
BUS 591 PAPERS Enthusiastic study BUS 591 Entire Course (Ash) FOR MORE CLASSES VISIT BUS 591 Week 1 DQ 1 Generally Accepted Accounting.
Starfish Training Minot State University
Performance Evaluations
HRM 498 ASSIST Experience Tradition/hrm498assist.com
Articulating Your Practice C3 - Session #3
Introduction to the Online Help Desk
“It was years after we had taken usability to guide us that it was said by some other companies that they could not afford to employ a usability specialist.
System Design Ashima Wadhwa.
Site Update Action Teams
MessageWiz Final Presentation
Recording Blackboard Collaborate Sessions
Katherine Prentice, MSIS Richard Usatine, MD
Articulating Your Practice C3 - Session #3
A Way to Approach the Research Design Criteria
BUS 591 Competitive Success/snaptutorial.com
HCS 325 Competitive Success/snaptutorial.com
ACCT 540 Competitive Success-- snaptutorial.com
EDU 675Competitive Success/snaptutorial.com
ACCT 540 Education for Service-- snaptutorial.com
ACCT 540 Education for Service/tutorialrank.com
BUS 591 Education for Service/snaptutorial.com
HCS 325 Education for Service/snaptutorial.com
EDU 675 Education for Service-- snaptutorial.com
ACCT 540 Teaching Effectively-- snaptutorial.com
BUS 591 Teaching Effectively-- snaptutorial.com
Effective Writing Where and how to start?
EDU 675 Teaching Effectively-- snaptutorial.com
HCS 325 Teaching Effectively-- snaptutorial.com
Terminal Learning Objective
Distance Learning Facilitator Skills
SY DE 542 User Testing March 7, 2005 R. Chow
AP Research The second course in College Board’s Capstone Program
Administrivia Issues – EPost and Portfolio
Jennifer Stoneking David Conley Byung Lee Vijay Hattiangadi
The Educator Development Solution
TC 310 The Computer in Technical Communication
Blackboard Tutorial (Student)
Communications for Business
Blackboard Tutorial (Student)
A Fundamental Challenge
AP Research The second course in College Board’s Capstone Program
TC 310 The Computer in Technical Communication
Periodic Accounting Review Periodic Revenue Reconciliation
Presentation transcript:

Administrivia Final Exam Deliverable 3 Feedback on Heuristic Eval Due Date – Thursday, March 16 Q & A Deliverable 3 Feedback on Heuristic Eval

Grading Criteria Professional-level communication The document is appropriate for distribution to upper management 20% Fulfills baseline requirements Product Statement, Motivation for the Redesign, Recommended Solution, Further Work Exemplifies user-centric rationale Describe the rationale for your redesign decisions based on UCD principles and data gathered from observing actual users 40% Presents strong evidence for moving the redesign forward Demonstrates the value of the redesign and provides a clear argument for moving forward Example of framing the problem: Golf Story: golfer is threatening to win the tournament and hits a shot that lands up near the green, but a fan in the grandstands dropped their lunch bag and the ball rolled into it. The rules state that if the ball moves, it will count as a stroke. How can the golfer get the ball out of the bag without moving the ball and incurring a penalty? The answer: light the lunch bag on fire, which will burn it away. The alternate framing of the problem is: how do I get the bag out from around the ball, rather than how do I get the ball out of the bag. Jennifer’s comments: Why these tasks? Why this approach? etc.

Critical Thinking Situation: Framing the problem Why? Think critically May seem obvious May be thinking it, but not writing it Example of framing the problem: Golf Story: golfer is threatening to win the tournament and hits a shot that lands up near the green, but a fan in the grandstands dropped their lunch bag and the ball rolled into it. The rules state that if the ball moves, it will count as a stroke. How can the golfer get the ball out of the bag without moving the ball and incurring a penalty? The answer: light the lunch bag on fire, which will burn it away. The alternate framing of the problem is: how do I get the bag out from around the ball, rather than how do I get the ball out of the bag. Jennifer’s comments: Why these tasks? Why this approach? etc.

Design Activity User Information Problems with any of the different systems operating behind the scenes are perceived as problems with the primary application 25% of feedback received was not categorized by the user and another 26% was categorized as “Other Problem” Feedback does not always pertain to the page that the user is on when they click the Feedback link Some people enter sensitive information

Design Activity Requirements Keep it simple to provide feedback Provide acknowledgement and confirmation The system is working properly at the time they submit feedback A message containing the text of their feedback Preserve the ability to remain anonymous Offer a means of providing candid feedback without fear of repercussion Commitment of 2 business days for a response Urgent matters should be directed to the help desk People can change their e-mail address

Design Activity Redesign the Feedback page Document Think on your own Pair up with someone not on your team Share with the class Document Rationale to support design decisions (explicit) Trade-offs

Project Sharing Team discussions Class-level discussion Share results of heuristic evaluations Discuss your choice of methods and results Class-level discussion Volunteers to share especially challenging or surprising insights Lessons learned Paper Prototyping in the Street Note: Ken & Elisabeth circulate, distribute exercises, and answer questions

Cost-Justifying Usability Reluctance – even with low-cost methods Costs 100 times more to make a change in the next release (Nielsen) How much is lost when employees can’t use products efficiently and effectively? Search button Enter key to invoke Search Web-based tab menus Expense reporting Cost of frustration and dissatisfaction??? Search button – MVP: 80 second delay to recover * 3 times per rater list * 50% of 15,000 managers = 500 hours lost = $50,000 per year. Enter key – MVP: 3 second delay to grab mouse and click Search * 300,000 searches for raters = 250 hours lost = $25,000 per year. Tab Menus – Plumtree: “mistake” of clicking on the tab, then navigating back, 50% of users (75,000) affected 3 times per day, everyday = 125,000 hours lost = $12 million. Expense Reporting – Travel Manager: $11 million per year if each travel expense report takes twice as long.

Cost-Justifying Usability Measures Training time Task time/Workload capacity Error rate Time to recover Help desk/Tech support Helping coworkers (OJT) Revenue Projections Cost of NOT testing Benefits of testing Decisions How many test participants? Variations Remote testing Open vs. Closed tasks Complexities Keeping your mouth shut. Factors for success Observe and record REAL users Measures

Discussion of Readings Insights from supplemental readings. Facilitate class discussion of topics / ideas / themes garnered from the online discussion, related to assigned readings. Discussion Leaders 1. Jaana Linsenmayer 2. Kris Anderson 3. Carol Taylor All supplemental readings for week 9 are “revisited” from a previous week.

Discussion What challenges and complexities are associated with UCD in the “real” world? What similarities? What differences? What surprises? What implications? What makes it hard? What constitutes success of UCD? Where can you be flexible? Where do you have to stand firm? What options do you have for applying and adapting UCD methods? Note: Hackos & Redish, pp 112-114, for good examples of the benefits of site visits Success? 1. Improving the product 2. Improving the process (of development)

Project Deliverable 3 Solution Recommendation In this report, students will present their final solution along with their justification for that solution. Project deliverables are due at the beginning of class. Bring copies of the deliverable to class (one copy for the instructor) and also post it to your design portfolio. Due next Thursday

Looking back / Looking ahead Where we’ve been Topics – Readings and discussion What is UCD? Collecting and summarizing info about users, tasks and context Problem definition Design Evaluations Project Insights about users, tasks, and contextual issues Actual data from observing real users Proposal Evaluation (heuristic & usability) Where we’re going Revisiting UCD: Challenges What supports UCD? Readings: Usability vs. Testing vs. UCD UCD processes & ISO 13407 (Supp) Key principles of UCD Upcoming Work: Solution Recommendation Final Exam Issue Statement: A reminder 1. Gülay Birand 2. Thea Lehming 3. Ben Turner