Faults can be corrected as they are discovered during use Users do not actively look for problems Users are benevolent in their judgements of interfaces.

Slides:



Advertisements
Similar presentations
Chapter 15: Analytical evaluation
Advertisements

Testing Relational Database
The Relationship between Cost & Quality Submitted by: Haya A. El-Agha Submitted to: Eng. Hani Abu Amr.
Writing winning proposals. Why write proposals? Work in industry and business is done through proposals The process: ▫Requests for Proposals (RFPs) identify.
ICASAS305A Provide Advice to Clients
ERP Implementation Strategies
Testing: Who 3, What 4, Why 1, When 2, How 5 Lian Yu, Peking U. Michal Young, U. Oregon.
Web Site Design: Learn from Observing Your Customers Web Site Design Panel Web Site Strategy and Tactics Workshop Yaffe Center, University of Michigan.
Usability Inspection n Usability inspection is a generic name for a set of methods based on having evaluators inspect or examine usability-related issues.
Inspection Methods. Inspection methods Heuristic evaluation Guidelines review Consistency inspections Standards inspections Features inspection Cognitive.
Principles and Methods
Lecture 7 Evaluation. Purpose Assessment of the result Against requirements Qualitative Quantitative User trials Etc Assessment of and Reflection on process.
Evaluation: Inspections, Analytics & Models
Marketing Research Unit 7.
Part A - QUALITY AS (3.1): Demonstrate understanding of how internal factors interact within a business that operates in a global context.
Review an existing website Usability in Design. to begin with.. Meeting Organization’s objectives and your Usability goals Meeting User’s Needs Complying.
Marketing CH. 4 Notes.
Customer Relationship Management
1. Learning Outcomes At the end of this lecture, you should be able to: –Define the term “Usability Engineering” –Describe the various steps involved.
©2011 1www.id-book.com Analytical evaluation Chapter 15.
HBK Contracting Website Rebuild Proposal. This is a list of the weaknesses that we compiled after our analysis Current Website Weaknesses SEO Website.
Introduction to Usability By : Sumathie Sundaresan.
S/W Project Management
4.04 Understand marketing- research activities to show command of their nature and scope.
Chapter 3: Marketing Intelligence Copyright © 2010 Pearson Education Canada1.
University of Palestine software engineering department Testing of Software Systems Fundamentals of testing instructor: Tasneem Darwish.
Usability By: Sharett Wooten and Gwen Payne. What is Usability Usability addresses the relationship between tools and their users. In order for a tool.
Quality Attributes of Web Software Applications – Jeff Offutt By Julia Erdman SE 510 October 8, 2003.
System Design: Designing the User Interface Dr. Dania Bilal IS582 Spring 2009.
CS 360 Lecture 3.  The software process is a structured set of activities required to develop a software system.  Fundamental Assumption:  Good software.
Feasibility Analysis What is feasibility and when should feasibility checkpoints occur? What are the four types of feasibility and what is the description.
Object-Oriented Software Engineering Practical Software Development using UML and Java Chapter 7: Focusing on Users and Their Tasks.
Heuristic evaluation Functionality: Visual Design: Efficiency:
Testing -- Part II. Testing The role of testing is to: w Locate errors that can then be fixed to produce a more reliable product w Design tests that systematically.
Usability Testing & Web Design by Alex Andujar. What is Usability? Usability measures the quality of a user's experience when interacting with a Web site,
SEG3120 User Interfaces Design and Implementation
Testing Vs. Inspection Research Paper Diala T. Gammoh, Ph.D. Student Dr. Damla Turgut, Ph.D. University of Central Florida, Orlando Florida
SE: CHAPTER 7 Writing The Program
WEEK TWO, Session 2 Information Gathering. Helpdesk metrics must be reprioritized from measuring internal efficiencies to evaluating customer retention.
Ethics of Software Testing Thomas LaToza CS 210 Final Presentation 12 / 2 / 2002.
Building a Learning Organization
Post Implementation Review The Post Implementation Review is carried out once the system is fully operational. The Post Implementation Review is carried.
Quality and Quality Assurance IB Business and Management.
MARKET RESEARCH. What do you think Marketing Research is?
Evaluating a UI Design Expert inspection methods Cognitive Walkthrough
© ABSL Power Solutions 2007 © STM Quality Limited STM Quality Limited Poka-Yoke TOTAL QUALITY MANAGEMENT Poka-Yoke.
Human Computer Interaction CITB 243 Chapter 1 What is HCI
Mr C Johnston ICT Teacher
Introduction to Usability By : Sumathie Sundaresan.
Chapter 1: Fundamental of Testing Systems Testing & Evaluation (MNN1063)
WATERFALL DEVELOPMENT MODEL. Waterfall model is LINEAR development lifecycle. This means each phase must be completed before moving onto the next!!! WHAT.
Usability Engineering Dr. Dania Bilal IS 592 Spring 2005.
IB Business and Management 5.4 Quality Assurance.
CS5714 Usability Engineering Usability Inspection Copyright © 2003 H. Rex Hartson and Deborah Hix.
By Godwin Alemoh. What is usability testing Usability testing: is the process of carrying out experiments to find out specific information about a design.
Definitions of GIS Works with geographic information Performs data input, management, manipulation/analysis, and output functions Composed of hardware,
Introduction to Evaluation without Users. Where are you at with readings? Should have read –TCUID, Chapter 4 For Next Week –Two Papers on Heuristics from.
Object-Oriented Software Engineering Practical Software Development using UML and Java Chapter 7: Focusing on Users and Their Tasks.
Evaluating Requirements
Usability Heuristics Avoid common design pitfalls by following principles of good design Nielsen proposes 10 heuristics, others propose more or less. Inspect.
Usability study Saranya Rukmangadhan. What is a good user experience?
1 Usability evaluation and testing User interfaces Jaana Holvikivi Metropolia.
Software Development Process CS 360 Lecture 3. Software Process The software process is a structured set of activities required to develop a software.
Mahindra Satyam Confidential Quality Management System Software Defect Prevention.
Misconception: Price is the same thing as cost. What is a pricing strategy?
Human Computer Interaction Lecture 15 Usability Evaluation
Chapter 18 Maintaining Information Systems
Systems Analysis and Design
Client Needs Analysis & Competitors
Evaluation: Inspections, Analytics, and Models
Presentation transcript:

Faults can be corrected as they are discovered during use Users do not actively look for problems Users are benevolent in their judgements of interfaces Many users blame themselves for being incompetent rather than the interface. Leaving problems for customers to find creates poor customer relations A commercial websites revenue is proportional to the number of visitors and how often they visit Problems at websites discourage users from returning Users cannot define what interface they want Users are not knowledgeable about interface design Often users do not report faults Users need to be studied interacting with the website under controlled conditions Good PR is about associating positive feelings with your company not negative ones The easier the web site is to use the more people will successfully use it, return to it and recommend it

Our designers are so experienced that they do not create usability problems Our web site works just as we want it to We have satisfied customers so we do not need user testing Dissatisfied users seldom complain if there is a competitor with better services, they just defect Competitors who provide an interface with fewer problems will be preferable Users have needs that designers cannot foresee Customers would appreciate improved service Our design is based on a needs assessment and years of customer knowledge What users require of a web interface to your services is different from their service requirements and traditional customer relations Users may not want what you want The view of one manager is not representative of users The project manager is not trained in usability Developers cannot see the development project as a whole and therefore will miss usability issues An evaluation methodology forces developers to look at the interface from new perspectives that are relevant to the user The project manager sees the whole, and that will prevent interface problems Usability is just about using common sense Designers are user themselves so they can foresee users problems Methods that involve designers checking their own work are pointless because they are continually monitoring their results as they work Designers cannot discover their own mistakes Users accept problems as a normal part of usage Problems that are tolerated will still effect use negatively Competitors who provide an interface with fewer problems will be preferable We know from application software that users stick with a product once they have learnt how to use it Web users are fickle Websites have a low learning threshold so the knowledge investment is very low unlike dedicated applications Websites are usually free so, users assess cost in goal achievement time

If a masked problem is worse than the problem that masked it, then rectifying the masking problem makes the interface worse Rectifying any current problems will just lead to new ones If you know about a problem it is irresponsible not to rectify it Finding one problem can reveal a masked problem that was already there and may be more serious. It is better not to tamper with the interface if it is functional

Development will be delayed by a pre-release usability evaluation Problems should be sought after the interface is finished Is better to discover problems before implementation It is cheaper if mistakes are found early Creating and changing a mock-up is cheaper and than implementing and changing code. You cannot see problems clearly until the interface is finished It is clearly more efficient to fix all the problems in one go than to keep going back and delay releasing the web site Nearly all methods can be applied at early stages in development before implementation Problems can be found more easily later and fixed then Early testing will delay development and release Problems can only be found once the web pages are public There are many methods will uncover problems before users see the interface The earlier problems are found the less it costs to fix them Competitors who get to market first gain an advantage It is not an advantage to launch a product ahead of a a competitor who follows with a better product The gain in quality outweighs the loss due to delays in development release

We have a tested design standard that we follow so we don’t need to test the interface again. A design standard is ensures good practices that will prevent usability problems Usability problems can occur even if good standard i used a standard is general and will not address specific requirements the interface must solve Usability is not relevant to the the prime purpose of my website If your purpose requires people to visit your site and gain benefit from their visit then usability is an issue

A test of templates and the most frequently accessed pages is sufficient Only the new part of the web site will need testing because existing parts have been operational for long time Interface solutions that work for a small site may not work for a larger site Consistency across the entire web site is important and will not be detected when only a part of the site is scrutinised Evaluation should also cover the website as a whole or as large units as possible Not all pages contain the same errors Templates regulate consistency with layout problems but do not detect inconsistency of content, textual style, of problems in the relationship between pages The may well be problems in the old part of the web site that will propagate into the design of the new part User’s tasks tend to take them across the system boundaries perceived by developers Users will see a task scenario as a criterion for unity, whereas developers will see database dependency or server residence as a criterion for unity The view of a subset of the interface is not the same for designers as it is for users Frequency of use is not synonymous with the importance of content to the user The problem of useful pages being difficult to find will exclude them from evaluation if frequency criteria are used. If part of your website is of poor quality, it reflects on the whole company

Lists of guide lines are freely available If we use guidelines in development we do not need to do usability evaluation Lists of guide lines are most cost effective because they do not require experts to carry out In order to be fully effective without experts, guide lines need to be specific to the domain. Customer needs change over time Usability should be evaluated by various methods throughout development and after Developing a domain specific set of guidelines is expensive and time consuming and does require an expert It is better to do one method well than several things half- heartedly The developers already have too many aspects to keep track of. Usability will detract them from what they are supposed to be doing There are resources to use one method thoroughly once Using more methods will confuse the developers The method offer different perspectives all of which developers should have in mind when they are working

Boss cannot justify usability costs to his superior Our company is only small and so an evaluation would not be profitable Long term gains are of no interest because changing customer needs and web content/services will have to be revised before the benefit of previous improvements will take effect. The cost of an evaluation cannot be justified There is no guarantee that an evaluation will lead to financial gain. Quality gains are a competitive advantage even if they are not directly profitable Experience from similar companies can be offered as a motivation Where sales or internal operational efficiency are involved, a cost/benefit assessment can be made There are cheaper methods suitable for small companies with small websites Expert can offer to meet the superior or provide written arguments. The benefits of a good interface are long-term improved PR and/or long-term financial gain. These gains outweigh the disadvantages

The problems that users have depend on their not being good at using computers If users can’t use our website that is their problem There are resources to use one method thoroughly once Using more methods will confuse the developers The customer is always right the potential importance to your company of a visitor to your website or is not determined by that customers ability to use an interface Money or publicity from hindered users has the same value as money from unhindered users If the user is hindered by the interface it is the interface that is inadequate not the user The interface should make the users goals as easy as possible to accomplish

Website content is more important than usability If the user cannot find the content then it has no value Users will not appreciate a good interface because they won’t notice it. A good interface should be invisible to the user.

The fad with heuristic evaluation will soon be over because Nielsen’s method was published over 7 years ago. Usability is just the latest methodology fad. It has nothing knew to say or new to offer 7 years is the normal lifetime of a development fad Nielsen is inventor of HE, it is risky to rely on the work of one researcher The method has been adopted by many others and well studied in relation to other methods regarding the efficiency and quality of problem identification in relation to cost, time, other methods, resource, level of expertise etc. The tenets of usability are well researched in studies within cognitive and behavioural psychology

User testing is more expensive than heuristic evaluation Contra The result from heuristic evaluation are not representative of users Pro In user testing, real users test the interface with characteristic use cases User testing finds more of the serious errors than heuristic evaluation User testing is the most efficient evaluation method to validate the interface