1. 9/7/2018 5:58 PM
A Smartphone-Centric Platform for Personal Health Monitoring Using Wireless Wearable Biosensors
Wai Ho MOW
Wireless IC System Design Center,
Guangzhou HKUST Fok Ying Tung Research Institute
and Dept. of ECE, HKUST
Supported by the Nansha Science & Technology Bureau Fund & based on the joint work:
Stephen Chiu Kwok LAM, Kai Lap WONG, Kwok On WONG, Wenxiu WONG, Wai Ho MOW, “A Smartphone-Centric Platform for Personal Health monitoring Using Wireless Wearable Biosensors”, Proceedings of the Seventh International Conference on Information, Communications and Signal Processing, Macau, December 8-10, 2009.

2. Outline Introduction Motivation Smartphone-centric Platform Case Study
9/7/2018 5:58 PM
Outline
Introduction
Motivation
Smartphone-centric Platform
Case Study
COTS Finger Pulse (PPG) Sensor + Bluetooth module + Smartphone
Estimation of Heartrate, Blood Oxigen Saturation rate (SpO2) & Breathing rate
Concluding Remarks

3. Introduction Trends for personal health monitoring
9/7/2018 5:58 PM
Introduction
Trends for personal health monitoring
Personal Electronic Medical Record has become a reality supported by government policies in several countries
Use of ICT to improve healthcare services has become a trend
The increasing % of aging population incurs expensive medical and healthcare costs (e.g. China)
Remote healthcare service becomes an essential means to complement hospitalization service and to lower medical cost, improve quality and efficiency of healthcare services
Body area sensor network is widely regarded as a key technology that holds the promise of enabling low-cost personalized healthcare service.
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4. Short range communication Long range communication
9/7/2018 5:58 PM
Introduction
Personal health monitoring not only can allow remote diagnosis and patient care, but also can facilitate management of one’s healthy lifestyle.
Wireless communications makes it realistic for continuous or round-the-clock monitoring:
Patients and users
Mobile phone
(control unit)
Short range communication
Remote doctor or computer
Long range communication
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5. Motivation Key observations: Desirable features:
9/7/2018 5:58 PM
Motivation
Key observations:
Billions of smartphones equiped with Bluetooth and mobile OS as well as good processing power already exist in the market.
A smartphone-centric platform based on COTS biosensors is an ideal way to build a low-cost fast-time-to-market personal health monitoring system
Desirable features:
Ability to support different types of wearable sensors.
Portable to different mobile phone operating systems, such as Linux and Symbian.
Intelligent closed loop control of the wearable devices.
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. Smartphone-centric Platform
9/7/2018 5:58 PM
Smartphone-centric Platform
Overall Architecture

7. Smartphone-centric Platform
9/7/2018 5:58 PM
Smartphone-centric Platform
Challenge 1: Limited battery life
Solution: Intelligent closed loop control
Perform health data extraction and measurements at the smartphone.
Intelligently control the duty cycle of the operation of the device and the sensors.

8. Smartphone-centric Platform
9/7/2018 5:58 PM
Smartphone-centric Platform
Challenge 2: Portability
Solution: Portable mobile phone Java software
Top layer: User interface
Middle layer: Signal processing and intelligent control (key layer)
Bottom layer: Wireless interface

9. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Case study: A finger pulse PPG based monitoring system

10. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Key elements of the system
Health data measurement features
Other key user features
A wearable PPG biosensor with Bluetooth communication capability
Pulse rate
Supports multiple mobile phones with two different operating systems (Symbian and Linux)
Mobile phone
Breathing rate
Supports two different pulse oximeter systems
Java based mobile phone software
Oxygen saturation (SpO2)
Ability to send SMS warning to other mobile phone users
Obstructive sleep apnea (OSA) prediction
Closed loop control of device ON/OFF duty cycle
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
User interface operation
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

12. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
PPG signal processing
Efficient Algorithm: Fast Fourier Transform (FFT)
Pulse rate measurement: the running average method is chosen
Breathing rate measurement: the low frequency spectrum of the PPG signal
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

13. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
PPG signal processing
Oxygen saturation (SpO2) measurement: by analyzing the AC and DC component of the red light and the infra-red
OSA estimation: the frequency spectra of oxygen saturation rate and heartbeat rate
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

14. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Closed loop control of device ON/OFF duty cycle
Objective: To reduce the power consumption of the sensing device by controlling the duty cycle.
Closed loop approaches:
Put to standby part or whole of the device when measurements are not required.
Implementation: added a timer on the hardware design
Set the biosensor to lower power mode of active operation.
Implementation: by sending commands from the mobile phone to the device
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Hardware block diagram
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

16. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Test results
Hardware testing
Software testing
Integration testing
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

17. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Hardware testing
Tests: standalone operation of the system
Output
The biosensor
The BT communication link
Extra circuitry of the timer control function
Waveform of 74HC123
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

18. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Software testing
Tests: multiple phones
Output
Nokia N79: S60 3rd edition FP2
Sony Ericsson K550i and G900: UIQ based Symbian
Motorola E6: Linux
Screenshots of user interface
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Integration testing
Tests: all the key features
Pulse rate
Breathing rate
Oxygen saturation (SpO2)
Obstructive sleep apnea (OSA)
Warming SMS
The closed loop control of the Duty Cycle of wearable device
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

20. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Integration testing
Key results: PPG waveform with health data and Simple Mode displaying rates
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

21. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Integration testing
Key results: OSA monitor and SMS warming function
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

22. Case Study Based on Biosensors & Mobile Phones
9/7/2018 5:58 PM
Case Study Based on Biosensors & Mobile Phones
Integration testing
Key test: The closed loop control of the wearable device
PPG sensor LED waveform when set to 300Hz by mobile phone
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.