An Embedded Activity Recognition System Intel Research, University of Washington, Stanford University

Content 1.Introduction 2. Structure of Address 3. Procedure of Zigbee 2

Introduction  The MSP is a small wearable device designed for embedded activity recognition with the aim of broadly supporting context- aware ubiquitous computing applications. 3

Main Concept _Activity recognition sys 4 A low-level sensing module that continuously gathers relevant information about activities using sensors A feature processing and selection module that processes the raw sensor data into features that help discriminate between activities A classification module that uses the features to infer what activity an individual or group of individuals is engaged in—for example, walking, cooking, or having a conversation.

Main Concept  Multimodal Sensing  Many recent wearable systems for activity recognition place a single type of sensor, typically accelerometers, in multiple locations (anywhere from two to 12) on the body  To better understand the usefulness of different sensor modalities in inferring human activities, we designed and built a multimodal sensor board that simultaneously captured data from seven different sensors 5

Multimodal Sensing 6

Sensor  센서란  대상물이 어떠한 정보를 가지고 있는가를 검지하는 기기 7

Hardware platform v1.0 _Concept  Hardware platform v1.0 : Wireless multimodal sensing  packages multimodal sensors into a single small device,  avoids using physiological sensors or sensors that require direct contact with the skin, and  either integrates into a mobile device, such as a cell phone, or wirelessly transmits data to an external device. 8

Hardware platform v1.0 _H/W ComponentMSP hardware 1.0 ProcessorATMega128 microcontroller on sensor board ARM7 Processor on iMote StorageNo onboard storage CommunicationBluetooth radio Rfcomm Battery life200 mAH Li-Polymer battery: Basic data handling: 37mA Stream data: 50mA RFcomm 논리적 링크 제어 및 적응 프로토콜 (L2CAP) 상에서 RS 232 시리얼 포트 모방 기 능을 제공하는 프로토콜. 9

Hardware platform v1.0 _Problem  Communication  The Bluetooth Connectivity wasn’t reliable.  Battery life  Working time 4 hour  Local storage  MSP ver1.0 don’t have local storage. 10

Hardware platform v2.0 _concept  Hardware platform v2.0: Local storage, better processor and battery life  Data processing and inference (416MHz Xscale processor)  The sensor board includes a removable miniSD card, which bounds the storage size.  The board also includes a Bluetooth radio that can communicate in personal-area-network (PAN) profiles.  Hardware platform v2.0 runs on an 1800-mAh battery. 11

Hardware platform v2.0 _Inference 센서 값 로그 센서 값의 특징 추출 센서 값의 특징 추출 행동 인식 12

Hardware platform v2.0 _H/W 13 ComponentMSP hardware v2.0 ProcessorAtmega128 microcontroller on sensor board PXA271 Xscale Processor on iMote StorageminiSD card slot (current storage 2Gbyte) CommunicationBluetooth radio(both Rfcomm and Pan), plus Zigbee radio Battery life1800 mAH Li-Polymer battery: Basic data handling: 103mA Log data: 127mA Stream features: 118mA Stream inference: 113mA InferenceEmbedded inference software version 1.0

MSP application 14  Application  Fitness monitoring  Eldercare support  Chronic care  Cognitive assistance

Conclusion 15