Jane W. S. Liu Institute of Information Science Academia Sinica, Taiwan Ubiquitous Devices and Applications for Disaster Prepared Smart Homes and Environment International Summer School on Trends in Computing, Tarragona Spain, July 2013

Jane W. S. Liu Institute of Information Science Academia Sinica, Taiwan iGaDs (intelligent Guards against Disasters) International Summer School on Trends in Computing, Tarragona Spain, July 2013

Outline  Enabling technologies, standards & ICT infrastructures for disaster preparedness and response  Future scenarios and sample iGaDs  Examples of on-going work  General structures and key components  Enhancement for battery operated iGaDs  Alert message delivery over the Internet  Opportunities and challenges

Disaster Prediction & Detection From Weather Underground From Minnesota Public Radio Org. Tsunami warning, landslide warning, debris flow monitoring systems

Earthquake Detection $ 29  Affordable detectors based on that  P (primary/pressure) wave travels faster than S (secondary/shear) waves, and generate only shock  Slower S waves are destructive  Early earthquake warning systems consisting of seismic motion sensors networked with computer(s)  Issue warning based on likely strength and progression of seismic events and  Can allow warning 20 seconds or more before ground motion.

Earthquake Detection in Taiwan BATS: Broadband Array in Taiwan for Seismology 650 strong motion seismic stations Auto-location in seconds by taking advantage of Central Weather Bureau seismic network RF connections to TEC Data Center Capable of inverting BATS waveforms to obtain focal mechanisms for felt earthquakes in seconds Felt earthquakes 08/2011

Open SensorNet & DMIS Infrastructures in US E911 & E911-IPDM-OPEN, IPAWS, CAP

Standard-Based Alert Delivery Integrated Public Alert and Warning System Authenticated message senders

Common Alert Protocol ITU-T Recommendation X 1303 (07/2007) A common format that supports  Broadcast of messages of all types to all public alert systems  Message exchange between emergency information systems  Aggregation and correlation of warnings from multiple sources  End-to-end authentication and validation  Automatic reports by sensor systems to analysis centers  Automatic processing by smart devices and applications

*

 Guide for CAP-EAS implementation published by EAS industry  Weekly testing in USA since December 2011 CMAS Happenings Now  iPAWS-CAP-EAS/CMAS  Google Now Alerts

Google Now Alerts

A Tornado Emergency Scenario...THIS IS A TORNADO EMERGENCY FOR THE WARNED AREA... AT 703 PM CDT...NATIONAL WEATHER SERVICE METEOROLOGISTS AND STORM SPOTTERS WERE TRACKING A LARGE AND EXTREMELY DANGEROUS TORNADO. THIS TORNADO WAS LOCATED 6 MILES SOUTHWEST OF SAVOY MOVING NORTHEAST AT 45 MPH. THE TORNADO WILL BE NEAR... CHAMPAIGN BY 720 PM CDT... RANTOUL BY 729 PM CDT… PAXTON BY … A TORNADO WARNING MEANS THAT A TORNADO IS OCCURRING OR IMMINENT. YOU SHOULD ACTIVATE YOUR TORNADO ACTION PLAN AND TAKE PROTECTIVE ACTION NOW. SIGNIFICANT DAMAGE HAS OCCURRED WITH THIS SIGNIFICANT TORNADO! THIS IS AN EXTREMELY DANGEROUS AND SERIOUS LIFE THREATENING SITUATION..  Sound tornado sirens  Unlock shelter doors  Turn on spot lights on shelters  Adjust traffic signals on routes to shelters  Enable outside doors in homes to open when the storm hits.

Alert xmlns: … Sender: Central Weather Bureau Status: Actual MsgType: Alert Scope: Public Info Category: Geo Event: Earthquake Urgency: Immediate Severity: Strong Certainty: Observed Description: A strong earthquake measuring 7.8 occurred in … Parameters: Magnitude, depth, … Areas: Polygons specifying affected areas Resources: … … A Future Scenario

?xmlns version = “1.0” <alert xmlns = … … Earthquake Immediate Strong Observed … Magnitude 7.2 … … ?xmlns version = “1.0” alert xmlns = … … Earthquake Immediate Strong Observed Alert extraction Action activation rule evaluation Device interface Elevator controller Alert extraction Action activation rule evaluation Device interfaces Earthquake. Slow down, pull over Vehicle safety system iGaDsiGaDs

Smart Home and Smart Building CAP messages X-10, Universal Powerline Bus (UPB)

iGad CAP-aware elevator controller CAP-aware building management system CAP-aware entry access controller iGaD iGaDs in Smart Homes and Buildings (AlertType == Earthquake) AND (Magnitude>= 7.5) OR (AlertType == Tornado) AND (Severity >= 4) (AlertType == Earthquake) AND (Magnitude >= 6) OR (AlertType == Tornado) AND (Severity >= 3) AND (OutsideAirPressure * THRESHOLD_RATIO < InsideAirPressure)

General Structure and Major Components  Standard-based alarm delivery and message exchanges as parts of DM infrastructure  Standard interfaces for processing & responding to standard-based alarms  Dependable, low-cost, customizable smart devices for enhanced disaster readiness CAP Message Processor Alert type & information Alert records Affected areas Alert message buffer Modem Signature validation XML parser Location filter Device Controller Device interfaces Configuration files Device location Resources Local data Rule processor Rule engine Activation parameters and rules “Cyber-physical elements of enhanced disaster prepared smart environment,” by Liu, Chu and Shih, in IEEE Computer “Ubiquitous smart devices and applications for disaster preparedness,” by Liao, et al, in Proceedings of UFirst, UIC 2012

iGaD demo Prototypes CAP Message Processor Alert type & information Alert records Affected areas Alert message buffer Modem Signature validation XML parser Location filter Device Controller Device interfaces Configuration files Device location Resources Local data Rule processor Rule engine Activation parameters and rules

iGad CAP Message Publisher CAP_PUBLISHER 1.capMsg ← Read a CAP file 2.capMsg ← Remove ‘\n’ in capMsg 3.Connect to PubNub cloud 4.Call publish() to push capMsg END PubNub cloud service: push alert messages to millions of unique IP addresses Alert Publisher

iGaDs (Embedded Linux) CAP messages FirendlyARM Mini6410

XML Parsers Document Object Model (DOM) Simple API for XML (SAX) CAP specific XML parsers, including CAP Library (Java) and RCAP (Ruby)

 PHP  SimpleXML, PHP Business Rules iGaDs (Embedded Linux) IGADS_LINUX 1.Connect to PubNub cloud and wait for message 2.capMsg ← Receive a CAP message from PubNub 3.Fork a process to run IGADS_LINUX 4.capDOM ← Call SimpleXML, convert capMsg to a DOM object 5.capDOM ← Extract Event, Parameters from capDOM 6.capDOM ← Load and add sensor data (local data) 7.Call FUNCTION RULE_ENGINE(capDOM) 8.Go back to 1. END FUNCTION RULE_ENGINE( capDOM ) 1.RE ← Create PHP Business Rule Engine Object 2.RE reads and parses rules from file 3.Insert capDOM to RE 4.Call RE->fireAll() to start rule matching END

 jQuery Mobile and JavaScript (PhoneGap)  XML.ObjTree, JSRulez iGaDs (Smartphone App) IGADS_SMARTPHONE 1.Connect to PubNub cloud and wait for message 2.capMsg ← Receive a CAP message from PubNub 3.capJS ← Call XML.ObjTree convert capMsg to a JavaScript object 4.capJS ← Extract Event, Parameter from capJS 5.Call RULE_ENGINE(capDOM) 6.Go back to 1. END FUNCTION RULE_ENGINE( capJS ) 1.RE ← Create JSRulez Rule Engine Object 2.RE reads and parses rules from file 3.Insert capJS to RE 4.Call RE->runAll() to start rule matching END

Rule Format priority: 1, condition: function(cap){ return cap.event === “Earthquake” && cap.valueName === “Magnitude” && cap.value >=6 } action: function() { window.alert(“Huge earthquake coming!”); } rule “Earthquake” priority=1 context Parameter $param if $param->event == ‘Earthquake’ && $param->valueName == ‘Magnitude’ && $param->value >= 6 then $action[‘LED_Earthquake’]- >do_action(); end PHP Business Rule JSRulez

Challenges  Minimizing energy consumption of iGaDs on battery powered platforms  Prioritized asynchronous message delivery to diverse iGaDs over the Internet  Interfaces and standards, including  With sensors, actuators, location devices and services, etc.  With information sources (e.g., BIM, store layouts, building management information system, etc.)  Creating dual (everyday and emergency) use applications

Alert publishers Encoders Decoders WAP Gateway Encoded Request Encoded Content Request Response (Content) WAE User Agent WAP (Wireless Application Protocol) Architecture and model

WAP Wakeup on Windows Mobile EQAlert.exe WDP handler WAP gateway In registry, register on WDPort1 WAE user agent WDP datagram (WDPort1) Find no app registered with WDP layer on WDPort1 -Find EQAlert in registry registered on WDPort1 -Load and launch EQAlert.exe -Send EQAlert WDPort1 Open ListernerWind -Register with WDP layer on WDPort1 -Get & process datagram

Blue tooth, WIFI, GPS transceiver baseband Multi-cellular modem RF front end Transceiver baseband Capture buffer CAP message screener Memories UIUI EMMCEMMC Power Management Application processor Display Camera

CAP message buffer(s) Basic Info extractor From Modem Event type LowScale Msg Type HighScale Certainty Configuration registers Temp Control & decision 3 8 ALU CLR Basic info registers Message screening rule processor Alert host (e.g., SMI) 8 MUXMUX SEL MUXMUX ASIC CAP Message Screener Event type Scale Msg Type Certainty Urgency......

Pushing Alert Messages Happening now:  Guide for CAP-EAS implementation published by EAS industry  Weekly testing since December 2011 CMAS

Elevator controller IP Network Authorized alert sender PuSH Broadcast pathways ?xmlns version = “1.0” <alert xmlns = … … Earthquake Immediate Strong Observed … Magnitude 8.1 … … Message processor (alert extraction) Action activation rule evaluation Device interface iGad PuSH iGaDiGaD

TRIPS Communication infrastructure Heterogeneous And Plug-n-Play Network Store sensor data in persistent cloud Receive/report alerts Review data after disaster Publish/subscribe disaster data TRIPS Exchanger TRIPS Agent TRIPS App TRIPS Exchanger TRIPS App TRIPS Exchanger TRIPS App Points Of Services OIGY

Hub Exchange Priority Queues Decreasing Priority data Bindings Incoming Data Monitor (IDM) Data Retrieval Service (DRS) Data Update Monitor (DUM) Data Transfer Service (DTS) Cached data Data Bridge

Hub Data Bridge DTS Work Queues DTS work dispatcher Thread pool Qpid Topic exchange Priority Queues Debris Flow Tsunami Earth- quake Notification events Data buffer Call DataBridgeNotifyDataUpdate ( Topic, RelativeDeadline,...); Data buffer DUM DTS Dec. priorities Thread pool

Hub Data Bridge IDMonitor Qpid Priority Queues Debris Flow Tsunami Earth- quake Data buffer Incoming data events DRS IDM QpidLongPollAll (QueueIdentifiers) call Data buffer HTTP interface DRS work Queues

Message size End-to-end delay of highest priority message = 2 x residence time + 5 x network delay/traversal < 1 sec.

An Example of CAP-Aware Application ?xmlns version = “1.0” <alert xmlns = … … Earthquake Immediate Strong Observed … Magnitude 7.2 … …

Strong earthquake CAP alert … Earthquake, Stay calm, Move to Checkout counters Follow directions as indicated by either arrows to a safer place

Challenges  Minimizing energy consumption for iGaDs on battery powered platforms  Pushing alert messages to iGaDs and people  Interfaces and standards, including  With information sources (e.g., BIM, store layouts, building management information system, etc.)  With sensors, actuators, location devices and services, etc.  Creating dual (everyday and emergency) use applications

Selected References Y. Z. Ou, et al., “An asynchronous message delivery service for iGaDs,” in Proceedings of International Workshop on Extending Seamlessly to the Internet of Things, July J. W. S. Liu, E. T.-H. Chu and C. S. Shih, “Cyber-physical elements of disaster prepared smart environments,” IEEE Computer, February W. P. Liao, Y. Z. Ou, E. T. H. Chu, C. S. Shih, and J. W. S. Liu, “Ubiquitous Smart Devices and Applications for Disaster Preparedness,” Proceedings of The 2012 International Symposium on UbiCom Frontiers - Innovative Research, Systems and Technologies, September 2012 Common Alert Protocol (CAP), Wireless Application Protocol (WAP), Bradfitz, Bslatkin, Andyster and Bradfitzgoog, “pubsubhubbub,” 11/27/ The Apache Software Foundation, “Apache QpidTM Open Source AMQP Messaging,” 11/27/2012.

Thank You!