COMP5047 – Design Focus groups – brainstorming for design Judy Kay CHAI: Computer human adapted interaction research group School of Information Technologies

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Postconditions for this week (incl studio)‏ Describe the uses of Focus Groups Describe the processes for conducting one Describe advantages and limitations Ability to use Focus Group if relevant for your project Justify the use of Focus Groups in the overall process of designing a pervasive computing application (...links to evaluation)‏

The Focus Group as an example of a user study.... relevant for evaluation as well

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Postcondition for study aspects Be able to prepare a user study –Identify goals –Recruit participants Conduct a user study –Ethics –Effectiveness of data capture –Rigor Be able to analyse results of a user study –Analysing questionnaires, qualitative data –Drawing valid conclusions

What is a Focus Group? What are its purposes? Advantages? Limitations?

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Overview of Focus Group Group of people –Invited to discuss issues of relevance to designers –Designer observes, listens –An ethnographic approach Means to –learn more about potential users –learn about context of use of a system –brainstorm new ideas for a way to tackle a problem –arguably a form of participatory design –[also used in evaluation, walk-through prototypes] –[and in marketing]

Class activity Based on readings so far: What are likely advantages? What are likely limitations?

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Benefits/limitations Benefits –Brainstorming new ideas –Learning more about user groups and differing viewpoints –Quick Limitations –Group think and intimidation and domination –Relies on what people say rather than what they do [Nielsen, Tog]

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Class activity Formulate 1-3 research questions –related to your project and –where a Focus Group should help answer it

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Preparing the study Identify the goals –Criticial to define these carefully –These drive design of study elements eg questionnaire, open questions, closed questions Participants –Recruiting, informing, consent Timeline - script Materials – for use in the study Trial with fresh eyes and refine materials Analysis – plan ahead

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Focus Group - people Group of participants (commonly 5-10)‏ –Should be representative of relevant groups –Links to CATWOE Should conduct more than one Focus Group session –Why? People needed to conduct the Focus Group –Moderator –Note-taker (alt: video[s], additional observers)‏

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Focus group – location and timing No interruptions Relaxed Perhaps provide coffee etc at start to relax people Around 1 – 2 hours

HAI2008. Lifelong ambient companions: challenges and steps to overcome them What is the Focus Group – materials 1 Recruitment document Document explaining process and goals Consent form for participants to sign on, the process, their role and use of data and results Questionnaire about background (may be used for selection of suitable participants)‏ Script for running the session –for facilitator, observer Checklist for your preparation

HAI2008. Lifelong ambient companions: challenges and steps to overcome them What is the Focus Group – materials 2 Name tags (for participants and facilitator++)‏ Materials to help participants think about the problem Materials for them to create prototype designs –Paper and pen –Post-its –Screen size depictions on paper Questionnaire collecting individual data at end

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Moderator role – is key Have a clear script and keep to it –Keep to times planned –But do not be too obtrusive –Be very well prepared –Be aware you should not waste participants' time Be polite and encourage participation by all participants –Turn taking around table –Encourage quieter participants Do not become a participant

HAI2008. Lifelong ambient companions: challenges and steps to overcome them Lab activities on Focus Groups Studio will be a practice with supplied materials – study conducted by Carolin Plate –to inform directions for Locator as part of Smart Building project for School of IT. Also provided are analyses and how they were done Highly relevant for user evaluations as well as Focus Groups