9/7/2018 5:58 PM A Smartphone-Centric Platform for Personal Health Monitoring Using Wireless Wearable Biosensors Wai Ho MOW Wireless IC System Design Center, Guangzhou HKUST Fok Ying Tung Research Institute and Dept. of ECE, HKUST Supported by the Nansha Science & Technology Bureau Fund & based on the joint work: Stephen Chiu Kwok LAM, Kai Lap WONG, Kwok On WONG, Wenxiu WONG, Wai Ho MOW, “A Smartphone-Centric Platform for Personal Health monitoring Using Wireless Wearable Biosensors”, Proceedings of the Seventh International Conference on Information, Communications and Signal Processing, Macau, December 8-10, 2009.

Outline Introduction Motivation Smartphone-centric Platform Case Study 9/7/2018 5:58 PM Outline Introduction Motivation Smartphone-centric Platform Case Study COTS Finger Pulse (PPG) Sensor + Bluetooth module + Smartphone Estimation of Heartrate, Blood Oxigen Saturation rate (SpO2) & Breathing rate Concluding Remarks

Introduction Trends for personal health monitoring 9/7/2018 5:58 PM Introduction Trends for personal health monitoring Personal Electronic Medical Record has become a reality supported by government policies in several countries Use of ICT to improve healthcare services has become a trend The increasing % of aging population incurs expensive medical and healthcare costs (e.g. China) Remote healthcare service becomes an essential means to complement hospitalization service and to lower medical cost, improve quality and efficiency of healthcare services Body area sensor network is widely regarded as a key technology that holds the promise of enabling low-cost personalized healthcare service. © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Short range communication Long range communication 9/7/2018 5:58 PM Introduction Personal health monitoring not only can allow remote diagnosis and patient care, but also can facilitate management of one’s healthy lifestyle. Wireless communications makes it realistic for continuous or round-the-clock monitoring: Patients and users Mobile phone (control unit) Short range communication Remote doctor or computer Long range communication © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Motivation Key observations: Desirable features: 9/7/2018 5:58 PM Motivation Key observations: Billions of smartphones equiped with Bluetooth and mobile OS as well as good processing power already exist in the market. A smartphone-centric platform based on COTS biosensors is an ideal way to build a low-cost fast-time-to-market personal health monitoring system Desirable features: Ability to support different types of wearable sensors. Portable to different mobile phone operating systems, such as Linux and Symbian. Intelligent closed loop control of the wearable devices. © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Smartphone-centric Platform 9/7/2018 5:58 PM Smartphone-centric Platform Overall Architecture

Smartphone-centric Platform 9/7/2018 5:58 PM Smartphone-centric Platform Challenge 1: Limited battery life Solution: Intelligent closed loop control Perform health data extraction and measurements at the smartphone. Intelligently control the duty cycle of the operation of the device and the sensors.

Smartphone-centric Platform 9/7/2018 5:58 PM Smartphone-centric Platform Challenge 2: Portability Solution: Portable mobile phone Java software Top layer: User interface Middle layer: Signal processing and intelligent control (key layer) Bottom layer: Wireless interface

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Case study: A finger pulse PPG based monitoring system

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Key elements of the system Health data measurement features Other key user features A wearable PPG biosensor with Bluetooth communication capability Pulse rate Supports multiple mobile phones with two different operating systems (Symbian and Linux) Mobile phone Breathing rate Supports two different pulse oximeter systems Java based mobile phone software Oxygen saturation (SpO2) Ability to send SMS warning to other mobile phone users Obstructive sleep apnea (OSA) prediction Closed loop control of device ON/OFF duty cycle © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones User interface operation © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones PPG signal processing Efficient Algorithm: Fast Fourier Transform (FFT) Pulse rate measurement: the running average method is chosen Breathing rate measurement: the low frequency spectrum of the PPG signal © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones PPG signal processing Oxygen saturation (SpO2) measurement: by analyzing the AC and DC component of the red light and the infra-red OSA estimation: the frequency spectra of oxygen saturation rate and heartbeat rate © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Closed loop control of device ON/OFF duty cycle Objective: To reduce the power consumption of the sensing device by controlling the duty cycle. Closed loop approaches: Put to standby part or whole of the device when measurements are not required. Implementation: added a timer on the hardware design Set the biosensor to lower power mode of active operation. Implementation: by sending commands from the mobile phone to the device © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Hardware block diagram © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Test results Hardware testing Software testing Integration testing © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Hardware testing Tests: standalone operation of the system Output The biosensor The BT communication link Extra circuitry of the timer control function Waveform of 74HC123 © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Software testing Tests: multiple phones Output Nokia N79: S60 3rd edition FP2 Sony Ericsson K550i and G900: UIQ based Symbian Motorola E6: Linux Screenshots of user interface © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Integration testing Tests: all the key features Pulse rate Breathing rate Oxygen saturation (SpO2) Obstructive sleep apnea (OSA) Warming SMS The closed loop control of the Duty Cycle of wearable device © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Integration testing Key results: PPG waveform with health data and Simple Mode displaying rates © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Integration testing Key results: OSA monitor and SMS warming function © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Case Study Based on Biosensors & Mobile Phones 9/7/2018 5:58 PM Case Study Based on Biosensors & Mobile Phones Integration testing Key test: The closed loop control of the wearable device PPG sensor LED waveform when set to 300Hz by mobile phone © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.