1. Conducting Usability Tests 4 Step Process

2. Step 1 – Plan and Prep Step 2 – Find Participants Step 3 – Conduct the Session Step 4 – Analyze Data and Make Recommendations

3. Plan and Prep A written plan that gives the overview and testing procedure: 1.Overall goals/objectives for the test/site 2.Methodology (testing procedure, equipment, facility, etc.) 3.Target audience profile (whom you will be testing) 4.Testing outline (orientation, check-off lists, test questions) 5.Specific task list 6.Final evaluation (analysis of data) 7.Reporting structure (how you plan to submit results and recommendations)

4. Overall Goals Overall goal: to provide specific feedback on search, login, e-commerce features. To determine performance on the current site and identify serious problems prior to the next phase of production: Specific questions: 1.Are the basic search features intuitive for a new user? 2.Are the advanced search features intuitive to use and learnable? 3.Is the purchasing process clear?

5. Let’s write Your Overall Goals Overall Goal: To provide specific feedback and determine performance on the proposed site(s) and identify serious problems prior to the next phase of production: 1.the ease of navigation, 2.the visual appeal, 3.the understanding of what a Friend’s Group means, 4.how easily the donation/membership process is to achieve, 5.how easily participants can find event information and, 6.How easy it is to get info on and sign up for volunteerism 7.How useful and easy it is to find information on the Education Programs.

6. User Profile Participants will fit the target profile (if possible) of being ….. Caveat - if the client is unable to recruit personas fitting the user profiles, then we will accept any respondent the client is willing/able to provide. If client can not provide the required number of respondents then we will attempt to recruit students from The Art Institute to fill the spots.

7. Methodology Method: Usability testing is a qualitative method of research (not projectable or valid) designed to identify glaring problems such as: navigation issues, difficulty in performing assigned tasks, and determine which design fits best with the organization’s brand values.

8. Test Specs Testing will take place at: The Art Institute of Charleston on June 2, 2010 beginning at: – 6 p.m. ending at 8 p.m. Each interview will take approximately 1 hour and will consist of three participants per session. There will be two sessions conducted: – Session 1 at 6:00 p.m. (participants 1-3) – Session 2 at 7:00 p.m. (participants 4-6) – Very short topline debrief

9. Participants Screeners – Phone interview to solicit participants – Invitation to participate in the group/session – Create grid to keep up of who is coming and their demographics (see page 225) – Re-screen night of test to verify identity

10. Respondents Target respondents: – Incentive (i.e. money paid to respondents) will be the sole responsibility of the client. – For this test there will be no incentive provided – Respondents will consist of: Board members (if possible) Members of the organization (if possible) Staff of the organization Visitors to the Sewee Center Students at The Art Institute

11. Testing Outline 1.Orientation 2.Background: Testing Site 3.Begin Task List 4.Fill Out Post-Test Survey 5.Debrief Client

12. Task List Choose straight forward tasks to test potential problems: – Donation with pay pal – External links (Facebook, Blogger, partners) – Forward and backward navigation – Photo galleries – Volunteerism

13. Sample Test Script The Moderator and the moderator’s guide (i.e. test script). Choose the person who is comfortable speaking in front of people, but can control the urge to get “chatty” with the respondents. Write out the order of the questions to check flow of conversation and determine if the time allotted will allow completion of all tasks.

14. Night of the Test Have NDA ready for all to sign Make sure sites are up on the computers so no time is wasted getting set up. If video tapping make sure all equipment is set up and running prior to session. Have print outs of each page of the site to take notes on. Have someone other than moderator taking copious notes, but not talking to participants Have post survey form ready for post-testing

15. Data Collection Each member of the team will be assigned to a participant to take the following information: – Could the test subject complete the task? – Did s/he need help? Did the task fail or succeed – How much time did it take to complete each task? – What stumbling block did he encounter? Describe problems and obstacles – Note overall observations. Add commentary. Did the test subject mutter in frustration, Did he say things such as: this is great, this is difficult, this is cool!

16. Post Session Survey See the Wikispace for this survey and customize it to your session.

17. Analyze Data and Make Recommendations Gather data as you go along. Compile and summarize this data while the test is still fresh in your mind. Put all your findings into a final report with screen shots and callouts to id problem areas. Include all the recommendations.

18. Final Report Executive Summary – a brief synopsis of major findings, recommendations and suggested areas of improvement. Overview what is working and what is not. Methodology – a description of the nature of the research, participant profiles (who showed up), how it was set up, where, data collection method. Results – a clear comprehensive display of all test results, survey feedback, etc. Finding and Recommendations – A presentation of general and specific information, short and long-term changes recommended, and the type of changes suggested. Appendices – Raw data, notes, samples of test materials, background data (no names) for participants, etc.