MP Office Activity Awareness Ian Li Machine Perception Spring 2005

MP Activity awareness can be good Awareness of how one uses time in the office can be useful Manage activities, coordinate interaction with others, and assess your own productivity But, too much to remember and recording can be tedious

MP Computers can help Delegate recording of activity to computers Can monitor daily Can store activity for months and years User can focus on analyzing the information at the end of the day or week

MP What did I do? System for office activity detection Applied system for productivity assessment

MP What is the result? System can reliably detect activity in the office environment (87%-93%) System can somewhat match the users measurements of their own productivity (up to 74%)

MP The rest of the talk… System: activity detection Application: productivity assessment Future work

MP Sensors for detecting activity Walking Sitting/standing Sitting & talking Not in space Activities detected Amount of motion Extracted Features Sensors Using mouse Pressing keys Not using computer Using mouse or keyboard? Talking Not talking Sound level

MP Data collection tool

MP Ground truth for activity detection Took snapshot every half minute not in spacewalking sitting & talking sitting & talking? sitting

MP Activity can be detected accurately Using microphone and camera features

MP Applying to productivity awareness Can we measure productivity by looking at activities? How aware are people of their own productivity?

MP Recording productivity Measurement of productivity What percentage of the past 15 minutes did you spend actively engaged in a work-related task? Experience sampling technique Every 15 minutes the timer plays a bird sound Bird sound

MP Using knowledge of activity is okay for detecting productivity

MP Using raw features is slightly better for detecting productivity!

MP Future work Longer deployment of the system How many features are sufficient to predict productivity? Use temporal model (e.g., HMMs) Activity-oriented vs. task-oriented measurement of productivity Other applications of activity awareness Setting goals and monitoring completion of goals

MP Office Activity Awareness Ian Li Machine Perception Spring will be up by March 13th for more details or contact me at

MP Acknowledgements Software development help from Bilge Mutlu and James Fogarty System deployment participants: Anind Dey, Jason Hong, Bilge Mutlu, and Pedram Keyani