1. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 1/25 Indicon2013, Mumbai, 13-15 December 2013, Paper ID 1084 Track 4.1 Signal Processing & VLSI (Biomedical Systems & Signal Processing ) Sunday, 15-12-2013, 1540 – 1710 IIT Bombay Praveen Kumar Prem C. Pandey erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in A Wearable Inertial Sensing Device for Fall Detection and Motion Tracking

2. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 2/25 1.Introduction 2.Hardware Design 3.Data Acquisition & Testing 4.Real-Time Fall Detection 5.Summary & Conclusion Outline

3. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 3/25 Posture & Motion Monitoring Aids for assisted living  Fall detection & alarm device to be worn by elderly persons and patients with risk of losing balance.  Monitoring of limb movement for analysis of gait disorders in patients suffering from neuromuscular diseases. Actigraphy Logging of orientation & movement of limbs and torso for analysis & treatment of sleep disorders. Techniques ▫ Optical ▫ Image based ▫ Acoustic ▫ Magnetic ▫ Inertial sensing 1. INTRODUCTION

4. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 4/25 MEMS inertial sensors: accelerometer (linear acceleration) & gyroscope (angular velocity) Low-cost, compact, & free from interference problems. No restrictions on the movement space. Observations based on the literature Only accelerometer or only gyroscope: good results for restricted movement in specific directions. Multiple sensors: recognition of a larger types of activities, better accuracy. System with sensors on multiple body parts for tracking relative movement of different body parts. System for fall detection: head, waist, trunk, and thigh found to be good sensor placement locations, wrist found to be unsuitable. Multiple signal fusion & fuzzy inference systems: enhanced accuracy but not well suited for real-time applications. Threshold based fall detection: well suited for real-time fall detection but lower accuracy.

5. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 5/25 Objective Development of a wearable inertial sensing device with wireless connectivity Real-time fall detection & alarm Recording for gait analysis Logging for actigraphy Hardware: Tri-axial integrated accelerometer & gyroscope, microcontroller, nonvolatile memory, Bluetooth. Signal processing for fall detection: Multiple decomposition and thresholding of tri-axial accelerometer outputs. Software: interfacing, recording, signal processing.

6. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 6/25 2. HARDWARE DESIGN Design objective Continuous acquisition of acceleration & angular velocity data: settable sampling frequency: 100 Hz or higher for gait monitoring and fall detection, < 20 hz for actigtraphy. Processing capacity for real-time fall detection. Wireless connectivity : operation control, data transfer, fusion of data from multiple devices Internal memory: data recording Compact & wearable: single supply operation with low power consumption, no switches & connectors. Components MEMS-based sensor with integrated tri-axial accelerometer & gyroscope; Microcontroller; Flash memory; Serially interfaced Bluetooth module; Regulator

7. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 7/25 Sensor MEMS-based sensor with integrated tri-axial accelerometer & gyroscope: InvenSense MPU 6000  Acc. range: ±2 g, ±4 g, ±8 g, ±16 g; Gyro. range: ±250 °/s, ±500 °/s, ±1000 °/s, ±2000 °/s  Sampling frequency: 4 Hz – 8 kHz  16-bit ADCs, clock, temp. sensor, interrupts  Digital output: I2C, SPI  FIFO: 1024 bytes (85 samples)  Vdd: 2.375 – 3.46 V, Idd: 3.9 mA

8. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 8/25 Microcontroller 16-bit microcontroller: Microchip PIC24F64GB004 (44 pin)  35 I/O pins, Two SPI, two I2C, two UART, one USB  64 KB program memory, 8 KB RAM,.  Internal clock of 8 MHz FRC with f CY of 4 MHz  Vdd: 2 – 3.6 V, Idd: 2.9 mA (at 4 MIPS) Memory 64-Mb serial dual I/O flash memory: Microchip SST25VF064C  Nonvolatile memory for recording more than 12 hours of data for actigraphy; Burst mode data transfer to save processor time for real-time fall detection and data transfer from multiple modules in a time multiplexed manner  Vdd: 2.7 – 3.6 V, Idd: 25 mA

9. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 9/25 Bluetooth Module Serially interfaced Bluetooth module: Roving Networks RN-42 Range: 20 m range Data rate: 240 kbps in slave mode Vdd: 3.3 V, Idd: 3 mA (connected) & 30 mA (data transfer) Power MCP 1802 LDO regulator: 3.3 V output for 3.5 – 12 V input, with max current of 300 mA.

10. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 10/25 Block diagram

11. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 11/25 Micro-controller pin connections

12. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 12/25 Sensor inter- facing

13. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 13/25 Memory inter- facing

14. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 14/25 Serial communication & Bluetooth interface

15. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 15/25 Circuit assembly 2-layer 36 mm x 29 mm PCB, No switches & connectors

16. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 16/25 3. DATA ACQUISITION & TESTING Sample-by-sample data acquisition Read the 6-axis sensor data at each sampling interval; save the data in internal 252 bytes buffer. If internal buffer is full, write 252 byte- data to the memory using page program Burst mode data acquisition Read 1024 bytes from FIFO at each interrupt; write to flash using page program; check for IRQ from UART and service it if needed.

17. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 17/25 Testing & calibration PC based GUI for operation control & data transfer through Bluetooth Test setup: Control Moment Gyroscope Model 750 (Educational Control Products)  Central platform with two outer rings  Encoders to record the angles of rotation using a PC  Brakes for fixing angular positions Testing  Device mounted on central platform  Movements of platform or the rings  Simultaneous recording of the sensor outputs by the device & encoder outputs using PC

18. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 18/25 Results Accelerometer outputs: Max deviations of 0.06, 0.01, 0.09 g in x, y, z Gyroscope outputs: Close match to CMG encoder outputs Example: device output for x-axis (solid), CMG output (broken)

19. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 19/25 Accelerometer outputs during simulated falls

20. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 20/25 4. REAL-TIME FALL DETECTION Observations from the accelerometer recordings Fall: Large variation from the mean value for a certain duration and in a certain direction. Multiple direction decomposition of accelerometer output and thresholding can help in improving sensitivity & specificity of the detection, without using gyroscope outputs. Real-time fall detection method: Thresholding & duration window on 7 directional components Components: Three axial components of the acceleration, magnitudes of the acceleration in three orthogonal planes, and the magnitude in the three- dimensional space v 1 (n) = x(n), v 2 (n) = y(n), v 3 (n) = z(n) v 4 (n) = √(x(n) 2 + y(n) 2 ), v 5 (n) = √(y(n) 2 + z(n) 2 ), v 6 (n) = √(x(n) 2 + z(n) 2 ) v 7 (n) = √(x(n) 2 + y(n) 2 + z(n) 2 )

21. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 21/25 Variation function for each component 100-point moving avg. m i (n) = m i (n − 1) + [v i (n) − v i (n − 100)]/100 d i (n) = │v i (n) − m i (n) │ Thresholding & duration window on each variation function If d i (n) > θ for duration less than t 1., reset. If d i (n) > θ for duration greater than t 1 but less than t 2, declare fall. If d i (n) > θ for duration greater than t 2, wait for d i (n) < θ and then reset.

22. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 22/25 Tests with falls & activities of daily life (ADL) Simulated fallReal fall & ADL Falls: forward, backward, sideways. ADL: walking, sitting, getting up, stair climbing, jogging, skipping. No of trials: 5 of each type.

23. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 23/25 Test results 100% sensitivity and specificity, with θ = 2g, t 1 = 250 ms, t 2 = 850 ms. Variation functions crossed threshold (for less than t 1 = 250 ms) during skipping, jogging, and fast sitting, but not during other ADLs. Fall successfully detected with any orientation of the device. Current drain of 40 mA during wireless transmission and 3 mA during sleep mode. Data recording for approx. 2 hours at sampling freq. of 100 Hz.

24. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 24/25 5. SUMMARY & CONCLUSION A wearable inertial sensing device for Continuously sensing and recording of the motion related variables, & transmitting the data wirelessly Real-time fall detection and wireless alert to a base station A low complexity fall detection algorithm for separation of activities of daily life from the fall using the acceleration data with any orientation of the waist-worn device. Further work Extensive testing on a large number of subjects. Fusion of accelerometer and gyroscope data and fusion of data from multiple devices.

25. erpraveen @ iitb.ac.in, pcpandey @ ee.iitb.ac.in 25/25 Thank You