1. Pilot test Group 6

2. Pilot test We conducted 2 tests with the same person. Test 1: Blindfolded Test 2: User A (one of 4 users in our protocol) Data collecting: Webcam SNAGIT Notes Timing

3. Test 1: Tasks performed Our aim was to do a full test with different product selection and completion of process tasks on both sites. Too difficult for the user to use the screen reader, i.e. problems with controls.

4. Test 1: Data collected Unable to complete the tasks: Inexperience with controls. The reader’s voice too low. We skipped testing of site 1. Conclusion: We want to test the websites with a blind person, who is familiar with using a screen reader + supply an acceptable sound level.

5. Test 2: Tasks performed Site 1: Task 1-4: Different selection/ completion tasks. Task 5: Describe each page. Site 2: Task 1-4: Different selection/ completion tasks. Task 5: Describe each page.

6. Test 2: Data, Site 1 What did the user think? Positive: Easy selection/delivery information/confirmation process Negative: Can’t navigate through the process line. Needs a final ”Thank you” page to confirm, that the data has been sent successfully.

7. Test 2: Data, Site 2 What did the user think? Positive: Easy selection/delivery information/confirmation process Can navigate through the process line. The ”Thank you”-page Conclusion: The user liked Site 2 better.

8. Test 2: Overall problems Besides the problems on Site 1: The user didn’t get the purpose of the website – thought it was the company’s main website. The user misses pictures of the products + categories. The categories are not completely self-explanatory. Design: Looks unfinished, amateur-like, does not look like a regular supermarket (Welcome page). Buttons: Don’t look like buttons, look like ”marked text”.

10. What is good on the website? The process is simple and easy. The navigation is easy. Text on buttons – no doubt about where they take you.

11. What will we change in the protocol? For task 1-4 we asked the user to think-aloud + we were timing the tasks: wasn’t thought through: thinking-aloud slowed the process down. Briefing/ debriefing: We are considering making specific answer options/ scales, so that the data will be easier to compare. Data collecting: Maybe use dictaphone instead?

12. What will we change on the website? Work on the design/text on ”Welcome page”: The purpose must be obvious + the website must seem professional. Redesign buttons – must look more clickable. Try to make the categories more self-explanatory. Add pictures. Correct the HTML: Some HTML was read by the screen reader.