1. Active Capture Design Space Ana Ramírez Chang BiD Seminar 3 November 2005

2. 2 Active Capture Systems that direct human action SIMS Faces

3. 3 Active Capture Interaction Capture Processing Active Capture Computer Vision / Audition Human Computer Interaction Direction / Cinematography

4. 4 Active Capture Interaction Capture Processing Active Capture Computer Vision / Audition Human Computer Interaction Direction / Cinematography context

5. 5 Active Capture Feedback DirectionCaptureAnalysis Goal-Directed Interactive Loop

6. 6 Active Capture Feedback DirectionCaptureAnalysis Directs human action. The system and the user have a common goal, and the system directs the user to help her reach the common goal. Action recognizer uses context from interaction script. The action recognizer uses context from the interaction with the user, or the interaction script along with data from the multimedia parsers to create a more complex recognizer. Feedback loop. The interaction script uses data from the action recognizer to affect how it directs the human action. InteractionCapture Processing Active Capture Computer Vision / Audition Human Computer Interaction Direction / Cinematography context System monitors directed action. The system uses multimedia parsers and sensors to monitor the directed action.

7. 7 Constraint Space Time To Task User Satisfaction with the process and the product Variability In Product is product discrete (often binary) or continuous in its satisfaction of the common goal Cost Of Failure for false positives and false negatives

8. 8 Alarm Clock Example Desired Action – The alarm clock directs the user to wake up. Multimedia Parsers –The alarm on/off button. Action Recognizer – The “awake” recognizer would describe the user as being awake if she turned off the alarm after it rang.

9. 9 Alarm Clock Directs human action - The alarm clock directs the user to wake up. System monitors directed action - The alarm keeps ringing until the user is awake enough to turn the alarm off. Action recognizer uses context from interaction script – If the button is pressed while the alarm is not going off, the user may be turning the alarm off in her sleep, the alarm may have fallen off the counter, causing the button to be hit, or maybe even a cat has pressed the button. If the button is pressed when the alarm is not buzzing, we can not be very sure the person whom we are directing to wake up is awake. If the button is hit while the alarm is going off, there is a very good chance the person is awake and pushed the button. Feedback loop - If the user does not press the button, the alarm keeps buzzing, and if she does press the button, the alarm stops buzzing, so the interaction script uses data from the action recognizer.

10. 10 Alarm Clock Time to task: How long should it take for the alarm clock to wake the person up? User satisfaction: The alarm clock could wake the person up so that she is annoyed at the alarm clock, or it could wake her up so she is refreshed and not annoyed with the alarm. Variability in outcome: The system could wake everyone up the same way, say abruptly, or slowly, or it could wake each person up differently, depending on their reaction to the alarm.

11. 11 Redesigned Alarm Clock Time To Task: User Satisfaction: Process: Product: Variability in Outcome:

12. 12 Redesigned Alarm Clock Time To Task: 15 minutes User Satisfaction: Process: high, so the user is not annoyed at the system and will be willing to wake up to it the next day. Product: high success rate of waking the person up. Variability in Outcome: high, allowing each person to wake up a different way, maybe in a few minutes, or using all 15 minutes, maybe just by noticing the brighter light, or maybe with a loud buzz.

13. 13 Redesigned Alarm Clock Different types of alarms Different tones Change modality – e.g. lights, sounds, water Change methods – e.g. tell user to wake up, make user wake up Freshness Method shift Modality shift

14. 14 Next Steps Find existing Active Capture applications Place applications in constraint space Re-evaluate design strategies with respect to constraint space Re-design some existing AC applications by moving them within design space (constraint space + design strategies)

15. 15 Redesigned Alarm Clock Time To Task: User Satisfaction: Process: Product: Variability in Outcome:

16. 16 Redesigned Alarm Clock Time To Task: User Satisfaction: Process: Product: Variability in Outcome: