A Wearable Wireless Sensor Platform for Interactive Dance Performances PERCOM 2006 PERCOM 2006 Chulsung Park and Pai H. Chou Center for Embedded Computer Systems University of California, Irvine Irvine, CA USA Yicun Sun Department of Arts-Dance University of California, Irvine Irvine, CA USA KAIST GSCT 김환철

Context 1.Statement of the Problem 2.Solution Approach 3.Platform Design 4.Application Example 5.Conclusion 6.Strong, Weak Point

One-line Comment This paper designed a wearable wireless sensor platform which is truly wearable, scalable, able to support to high – level interactivity in forming wireless networks for interactive dance performance.

Statement of the Problem How to develop a wearable wireless sensor platform for Interactive dance performance? KEY WORD: Wearable, Scalable, able to support high-level interactivity Aspect of Sensor device SIZE How to make the smallest wireless sensor node in operation? Wearable Aspect of Networking Capability How to network large numbers of wireless sensor nodes while maintaining a high level of network performance? Scalable Aspect of Sensing capability How to collect data from multiple types of sensing devices? High level interactivity

Solution approach Why dance? Art based on human body movement. KEY WORD: Wearable, Scalable, able to support high-level interactivity This platform consists of an ultra-compact and low power wireless sensor n ode, named Eco and its variants. Wearable The second contribution is in making multiple Eco nodes form a scalabl e wireless network. Scalable Another novelty of this work is multi-modal sensing: It can collect data not only motion tracking but also physiological signs such as heartbeat High level interactivity

This paper present design details of wearable wireless sensor platform and applied to an actual interactive dance performance, titled Dreams in the Forbidden City.

Platform Design Wearable wireless sensor platform consists of three parts: 3 Parts: wearable wireless sensor nodes, wireless data aggregators,wireless interface boards

The activities and physical conditions of a dancer are first sensed and digitized Wearable wireless sensor nodes Then, each sensor node wirelessly transmits its data to the data aggregator Wireless data aggregators The data aggregator collects and packetizes these data and send them to the wirele ss interface board Wireless interface boards

Wearable Wireless Sensor Node- Eco 1.An ultra-compact low-power wireless sensor node for real-time motion monitoring 2. Currently the world’s smallest wireless sensor node in operation it measures 12 × 12 mm2 in surface area, ×4.5mm thick (or 648mm3 in volume) and weighs 1.3 grams without the battery the original design of Eco has only one two-axial accelerometer (ADXL202E) and a 125mAh Li-Coin battery (CR1632 [17]) Modified the hardware: a three-axial accelerometer, temperature sensor, image sensor, light sensor, gyroscope, joint angle sensor, and heartbeat detector Changed the Li-Coin battery to a 40mAh Li-Polymer battery (12 × 10× 3 mm3), which is able to power Eco for more than one hour

Wireless transmitter unit (WT), Acceleration, temperature, and light sensing unit (ATLS), Image and gyro sensing unit (IGS)

Wireless Data Aggregator, Interface Board

Collects data from all the sensor nodes through the 2.4GHz Transceiver and forms a TCP/IP packet to be sent to interface board via an bWi-Fi network Wireless Data Aggregator Receives TCP/IP packets Outputs digital/analog output signals fed to the MIDI I/O board When Max/MPS/JITTER output signals, it takes these signa ls and makes a TCP/IP packet That contains a proper destination address and control mess age Interface Board Wireless Data Aggregator, Interface Board

The heterogeneous network architecture Enables platform to simultaneously monitor the activitie s multiple dancers, without degradation as the number o f dancers increases. 2.4GHz ISM band radio and TDMA-based MAC protocol, power level are 250Kbps Body Network linked to the access point of the interface board using b CF wireless card 256 data aggregators can be connected, but in practice, 10–16 is more like the proper number Data aggregators on dancers and theater equipment Platform Design – Scalability

Application Example How this platform can be applied to an actual interactive dance performance? ‘Dreams in the Forbidden City ‘ at UC Irvine in May 2005

Conclusion 1.This platform consists of wearable wireless sensor nodes, data aggregators, and wireless interface boards. 2.The distinguishing features of our platform are truly wear able, highly scalable, multi-modal sensing, and seamless interface capabilities. Choreographing interactive dance performances that take full advantage of our platform. Future work 1.At least tens of dancers will be performing together 2. The dancers’ heartbeats and body temperatures will be monitored and beats to reflect the dancers’ conditions on the stage equipment.

Strong Point 1.The effectiveness of this platform by showing improvements to an actual interactive dance performance. (Great: good application about Interactive) 2.Potential to related human body or any movement. 3.Entertainment Technology: Night Club ! Stage Technology: Musical, Concert and so on.

Weak Point 1.Problem- Solution: Focused Wearable Not sure solution: Scalable, High interactivity 2. A fundamental limitation is to associate the motion data with the dancers’ identities. 3. Its support for interactivity is also limited, thereby impeding the choreographer’s creativity 4. Too much exercise for Dancer 5. No originality