Ulab Part C – Evaluation testing of the three sites given by other ULAB Team Preparation of ULAB EVAL part C Before Tuesday, Nov 1 – decide and state the roles of your team members: One Breifer/Debriefer for each eval One User for each eval Rest of members are Loggers for each eval B/D responsibilities Read, practice, and if necessary, edit the eval you will lead Loggers responsibilities Decide on the metrics you will uncover to assess the design stance of the site. Document this with justifications. Users Responsibilities Practice the “think out loud” method by documenting your Web D site task 2 again. Ulab

On Tuesday, Nov 1 your ULAB team will be given 3 Evals to perform on their design stance. Need: Day/Time, members present, setting, environment & location To start each of the Evals – need: Demographics of the User Validation that your have a “True User” - Assurance that you have representative users.  Let’s look at an example of the start of an eval: Ulab

Thanks for coming to help us evaluate this web site. Did you have any problems finding our location? Please tell us the following: Your age ____ Profession _______________ Amount of free time per week ________ Have you played the game “Reversi” or “Othello”? Yes No Do you like to play games? Yes No If yes, Go to the next page. __________________________ If no, please answer: 5. Would you play a game when you had free time. Yes No If no, Thanks for you time! Here is your $50 payment. Ulab

Eval Scenario You are a person that likes to play games when you have free time. You have lots of free time today. Is this true right now?______________ A friend has given you the URL for a fun game. http://www.gamesforthebrain.com/ga me/reversi/ You decide to try it out on the computer.. Remember to think out loud Ulab

Task 1- Tell us what you see. You have found the online Reversi game site and have decided to get started to be able play computer opponent. Do this now but don’t start playing yet. Please remember to think out loud. Please speak out loud the following information: What do you see? Give your initial reactions and comments about what you see. What will you do? Give your thoughts about what you will do. Can you explain why you will do your first action and exactly how will you do the action (give all movements, key strokes, etc.) When you have explain all that you see and what will you do and why will you do what you decided on, you have completed Task 1 - please raise your hand. Ulab

Examples of Data Gathered in each TASK Recorded Time started Facial Expressions - Initial reactions-  Comments Items clicked on the interface:   Positive reactions: Negative reactions: Time Ended for task (raised hand). Ulab

Task 2 – play your first move At this time we would like you to play your first move of the game. Please remember to think out loud. Slowly do your first move and give us everything that you see and hear. What do you see after the first move? What will you do for your second move? Give your thoughts about what you will do. Can you explain why you will do your second action and exactly how will you do the action (give all movements, key strokes, etc.) When you have explain all that you see and what will you do and why will you do what you decided on, you have completed Task 2 - please raise your hand. Ulab

Task 3 – play your second move At this time we would like you to play your second move of the game. Please remember to think out loud. Slowly do your second move and give us everything that you see and hear. What do you see after the second move? What will you do for your third move? Give your thoughts about what you will do. Are you winning the game? When you have explain all that you see and what will you do and why will you do what you decided on, you have completed Task 3 - please raise your hand. Ulab

Task 4 – This is your last task. Please remember to think out loud Take a few minutes to look at the game. Please remember to think out loud. Tell us: What do you think of the game? Describe what you see. What can you do in the game? You can do any movements to discover the game. (Tell us your thoughts as you explore) What would you do to find help for the game? Do you see anything that would be your score? Please give us any other comments you have about what you see. When you feel you have given us all your impressions, you have completed Task 4 - please raise your hand. Ulab

Final Questionnaire Did you enjoy yourself? What was the hardest? What was the easiest? What needs to improve? Any other comments you would like to give us? Ulab

Ulab Part C is due Wednesday, 11/9 in D2L Each Breifer/Debriefer hands into D2L a separate file of the documentation for their eval with the data, metrics, results, etc.. Ulab