Collecting Basic Evaluation Information Chapter Six cont…

Focus Groups  In-depth feedback from many people simultaneously  Client surveys give numerical data but not WHY?  Need to know WHY to create satisfaction  Don’t need to be a professional to do focus groups  12 steps outlined in this section

Step 1-purpose  Purpose is to obtain perceptions on a defined area of interest  Participants share characteristics  Avoid power struggles  Facilitator keeps conversation on track  If no agenda then no focus  Get both positive and negative perceptions

Step 2-group composition  12 to 15 participants  60 to 90 minutes  At least two groups for each eval project  Representativeness of participants  Each group should be homogeneous  Do not mix users with drop-outs  People should not know one another

Step 3-planning and budget  Personnel  Facilitator runs meeting, neutral and non-biased  Space  Quiet, sit in circle and a tape recorder  Advertising  Posters with eligibility, location and incentives  Incentives  Refreshments, t-shirts or certificates

Step 4-book rooms  Secure a room and tape recorder  Schedule before or after classes to save a trip  Have attendees pre sign up  Allow 30 minutes on each side of time limit  Give volunteers a choice of times and dates

Step 5-develop protocol  Outlines each step of the program  Standardization  Have a break if longer than 90 minutes  Have questions in hand  Introductory questions  General to key questions  Summary questions  6.1 & 6.2 page

Step 6-consent forms  Consent for audio taping  Consent for questioning  Consent for follow-up

Step 7-recruit  Use sign up sheets for times and dates  Give attendees pre information for review  Give a reminder hours prior to meeting

Step 8-prepare  Confirm with facilitators  Confirm room  Have adequate copies printed  Have script prepared  Have tape recorder in working condition  Have refreshments on hand

Step 9-conduct session  Recorder makes detailed seating plan  Recorder takes notes  Facilitator poses each question  Field notes are notes in meeting  Write down impressions soon after meeting

Step 10-debrief  Facilitator and recorder get together  Discuss impressions of meeting  Did everyone contribute  Did anyone stand out  What were agreements and disagreements  Were people emotional about any issues

Step 11-revise  Reexamine the protocol and modify  May schedule more or less time  Use additional prompts to get people talking  Make sure to have same questions for next session  Compare results across sessions

Step 12-analyze  Field notes and recorder are your data  May have a background questionnaire too  6.9 page 111

Client Outcomes  Which clients improved the most  Pre and post assessments  At 1 and 12 weeks  Fitness and health take 12 to 16 weeks to improve  Sample from all classes to get representation  Compare one group with another