Jane W. S. Liu Institute of Information Science Academia Sinica, Taiwan Ubiquitous Devices and Applications for Disaster Prepared Smart Homes and Environment ISET 2013, Korea, May 2013

Jane W. S. Liu Institute of Information Science Academia Sinica, Taiwan ISET 2013, Korea, May 2013 iGaDs (intelligent Guards against Disasters)

Outline  Enabling technologies, standards & ICT infrastructures for disaster preparedness and response  Future scenarios and sample iGaDs  Examples of on-going work  General structures and key components  Enhancement for battery operated iGaDs  Alert message delivery over the Internet  Opportunities and challenges

0% 100% 024h48h 72h Availability Impact On Power of Information “Information can save lives, livelihoods and resources.” – World Disasters Report, 2005 “Today, even mobile phones could be used as an effective medium to provide early warnings and thus save lives and property” – R. K. Pachauri, 2009 “Small advances in emergency informatics could significantly reduce deaths, accelerate damage assessment, and minimize economic downtime” – R. R. Murphy, 2010

Disaster Prediction & Detection From Weather Underground From Minnesota Public Radio Org. Tsunami warning, landslide warning, debris flow monitoring systems

Earthquake Detection $ 29  Affordable detectors based on that  P (primary/pressure) wave travels faster than S (secondary/shear) waves, and generate only shock  Slower S waves are destructive  Early earthquake warning systems consisting of seismic motion sensors networked with computer(s)  Issue warning based on likely strength and progression of seismic events and  Can allow warning 20 seconds or more before ground motion.

Earthquake Detection in Taiwan BATS: Broadband Array in Taiwan for Seismology 650 strong motion seismic stations Auto-location in seconds by taking advantage of Central Weather Bureau seismic network RF connections to TEC Data Center Capable of inverting BATS waveforms to obtain focal mechanisms for felt earthquakes in seconds Felt earthquakes 08/2011

SANY in Europe User information systems Operational services System services Sensor services Sensor Systems Generic  Display  Sensor tasking  Sensor Monitoring  Sensor man.  Proc./storage  Web mapping  Dataflow man.  Alarm service  Discovery  Access  Alert  Tasking.  Interface adaptor

Disaster Management for Typhoon Hazards in Taiwan

中央災害應變中 心分析研判組 災害防救應用服務平台 中央災害應變中 心分析研判組 資訊綜整共享運作機制 10 交通部 中央氣象局 交通部 中央氣象局 經濟部 水利署 經濟部 水利署 行政院農委會 水保局 行政院農委會 水保局 內政部營建署 內政部消防署 交通部 公路總局 交通部 公路總局 國家災害防救 科技中心 國家災害防救 科技中心 XML, KML 地方政府 民眾，記者 XML, KML 基本圖資 監測圖資 災情資訊 設施操作 … 基本圖資 監測圖資 災情資訊 設施操作 … 基本圖資 監測圖資 中央災害應變中心 指揮官 XML KML 災情資訊 設施操作

Server Augmented reality Smart phone Apps 聚落調查資料庫 保全對象 土石流 山崩地滑 避難處所 河岸侵蝕 Disaster historical records Hazard database: Investigation photos

Open SensorNet & DMIS Infrastructures in US E911 & E911-IPDM-OPEN, IPAWS, CAP

Standard-Based Alert Delivery Integrated Public Alert and Warning System Authenticated message senders

Common Alert Protocol ITU-T Recommendation X 1303 (07/2007) A common format that supports  Broadcast of messages of all types to all public alert systems  Message exchange between emergency information systems  Aggregation and correlation of warnings from multiple sources  End-to-end authentication and validation  Automatic reports by sensor systems to analysis centers  Automatic processing by smart devices and applications

*

A Tornado Emergency Scenario...THIS IS A TORNADO EMERGENCY FOR THE WARNED AREA... AT 703 PM CDT...NATIONAL WEATHER SERVICE METEOROLOGISTS AND STORM SPOTTERS WERE TRACKING A LARGE AND EXTREMELY DANGEROUS TORNADO. THIS TORNADO WAS LOCATED 6 MILES SOUTHWEST OF SAVOY MOVING NORTHEAST AT 45 MPH. THE TORNADO WILL BE NEAR... CHAMPAIGN BY 720 PM CDT... RANTOUL BY 729 PM CDT… PAXTON BY … A TORNADO WARNING MEANS THAT A TORNADO IS OCCURRING OR IMMINENT. YOU SHOULD ACTIVATE YOUR TORNADO ACTION PLAN AND TAKE PROTECTIVE ACTION NOW. SIGNIFICANT DAMAGE HAS OCCURRED WITH THIS SIGNIFICANT TORNADO! THIS IS AN EXTREMELY DANGEROUS AND SERIOUS LIFE THREATENING SITUATION..  Sound tornado sirens  Unlock shelter doors  Turn on spot lights on shelters  Adjust traffic signals on routes to shelters  Enable outside doors in homes to open when the storm hits.

Alert xmlns: … Sender: Central Weather Bureau Status: Actual MsgType: Alert Scope: Public Info Category: Geo Event: Earthquake Urgency: Immediate Severity: Strong Certainty: Observed Description: A strong earthquake measuring 7.8 occurred in … Parameters: Magnitude, depth, … Areas: Polygons specifying affected areas Resources: … … A Future Scenario

?xmlns version = “1.0” <alert xmlns = … … Earthquake Immediate Strong Observed … Magnitude 7.2 … … ?xmlns version = “1.0” alert xmlns = … … Earthquake Immediate Strong Observed Alert extraction Action activation rule evaluation Device interface Elevator controller Alert extraction Action activation rule evaluation Device interfaces Earthquake. Slow down, pull over Vehicle safety system iGaDsiGaDs

iGad CAP-aware elevator controller CAP-aware building management system CAP-aware entry access controller iGaD iGaDs in Smart Homes and Buildings (AlertType == Earthquake) AND (Magnitude>= 7.5) OR (AlertType == Tornado) AND (Severity >= 4) (AlertType == Earthquake) AND (Magnitude >= 6) OR (AlertType == Tornado) AND (Severity >= 3) AND (OutsideAirPressure * THRESHOLD_RATIO < InsideAirPressure)

General Structure and Major Components  Standard-based alarm delivery and message exchanges as parts of DM infrastructure  Standard interfaces for processing & responding to standard-based alarms  Dependable, low-cost, customizable smart devices for enhanced disaster readiness CAP Message Processor Alert type & information Alert records Affected areas Alert message buffer Modem Signature validation XML parser Location filter Device Controller Device interfaces Configuration files Device location Resources Local data Rule processor Rule engine Activation parameters and rules “cyber-physical elements of enhanced disaster prepared smart environment,” by Liu, Chu and Shih, to appear in IEEE Computer “Ubiquitous smart devices and applications for disaster preparedness,” by Liao, et al, Report TR-IIS

iGaD demo Prototypes CAP Message Processor Alert type & information Alert records Affected areas Alert message buffer Modem Signature validation XML parser Location filter Device Controller Device interfaces Configuration files Device location Resources Local data Rule processor Rule engine Activation parameters and rules

iGaDs (Embedded Linux) CAP messages FirendlyARM Mini

XML Parsers Document Object Model (DOM) Simple API for XML (SAX) CAP specific XML parsers, including CAP Library (Java) and RCAP (Ruby)

iGad CAP Message Publisher CAP_PUBLISHER 1.capMsg ← Read a CAP file 2.capMsg ← Remove ‘\n’ in capMsg 3.Connect to PubNub cloud 4.Call publish() to push capMsg END PubNub cloud service: push alert messages to millions of unique IP addresses Alert Publisher

Challenges  Minimizing energy consumption of iGaDs on battery powered platforms  Prioritized asynchronous message delivery to diverse iGaDs over the Internet  Interfaces and standards, including  With sensors, actuators, location devices and services, etc.  With information sources (e.g., BIM, store layouts, building management information system, etc.)  Creating dual (everyday and emergency) use applications

Alert publishers Encoders Decoders WAP Gateway Encoded Request Encoded Content Request Response (Content) WAE User Agent WAP (Wireless Application Protocol) Architecture and model

WAP Wakeup on Windows Mobile EQAlert.exe WDP handler WAP gateway In registry, register on WDPort1 WAE user agent WDP datagram (WDPort1) Find no app registered with WDP layer on WDPort1 -Find EQAlert in registry registered on WDPort1 -Load and launch EQAlert.exe -Send EQAlert WDPort1 Open ListernerWind -Register with WDP layer on WDPort1 -Get & process datagram

Blue tooth, WIFI, GPS transceiver baseband Multi-cellular modem RF front end Transceiver baseband Capture buffer CAP message screener Memories Display Camera UIUI EMMCEMMC Power Management Application processor

CAP message buffer(s) Basic Info extractor From Modem Event type LowScale Msg Type HighScale Certainty Configuration registers Temp Control & decision 3 8 ALU CLR Basic info registers Message screening rule processor Alert host (e.g., SMI) 8 MUXMUX SEL MUXMUX ASIC CAP Message Screener Event type Scale Msg Type Certainty Urgency......

Pushing Alert Messages Happening now:  Guide for CAP-EAS implementation published by EAS industry  Weekly testing since December 2011 CMAS

Elevator controller IP Network Authorized alert sender PuSH Broadcast pathways ?xmlns version = “1.0” <alert xmlns = … … Earthquake Immediate Strong Observed … Magnitude 8.1 … … Message processor (alert extraction) Action activation rule evaluation Device interface iGad PuSH iGaDiGaD

TRIPS Communication infrastructure Heterogeneous And Plug-n-Play Network Store sensor data in persistent cloud Receive/report alerts Review data after disaster Publish/subscribe disaster data TRIPS Exchanger TRIPS Agent TRIPS App TRIPS Exchanger TRIPS App TRIPS Exchanger TRIPS App Points Of Services OIGY

Hub Exchange Priority Queues Decreasing Priority data Bindings Incoming Data Monitor (IDM) Data Retrieval Service (DRS) Data Update Monitor (DUM) Data Transfer Service (DTS) Cached data Data Bridge

Hub Data Bridge DTS Work Queues DTS work dispatcher Thread pool Qpid Topic exchange Priority Queues Debris Flow Tsunami Earth- quake Notification events Data buffer Call DataBridgeNotifyDataUpdate ( Topic, RelativeDeadline,...); Data buffer DUM DTS Dec. priorities Thread pool

Hub Data Bridge IDMonitor Qpid Priority Queues Debris Flow Tsunami Earth- quake Data buffer Incoming data events DRS IDM QpidLongPollAll (QueueIdentifiers) call Data buffer HTTP interface DRS work Queues

An Example of CAP-Aware Application ?xmlns version = “1.0” <alert xmlns = … … Earthquake Immediate Strong Observed … Magnitude 7.2 … …

Strong earthquake CAP alert … Earthquake, Stay calm, Move to Checkout counters Follow directions as indicated by either arrows to a safer place

Challenges  Minimizing energy consumption for iGaDs on battery powered platforms  Pushing alert messages to iGaDs and people  Interfaces and standards, including  With information sources (e.g., BIM, store layouts, building management information system, etc.)  With sensors, actuators, location devices and services, etc.  Creating dual (everyday and emergency) use applications

Thank You!

PHP SimpleXML, PHP Business Rules iGaDs (Embedded Linux) IGADS_LINUX 1.Connect to PubNub cloud and wait for message 2.capMsg ← Receive a CAP message from PubNub 3.Fork a process to run IGADS_LINUX 4.capDOM ← Call SimpleXML, convert capMsg to a DOM object 5.capDOM ← Extract Event, Parameters from capDOM 6.capDOM ← Load and add sensor data (local data) 7.Call FUNCTION RULE_ENGINE(capDOM) 8.Go back to 1. END FUNCTION RULE_ENGINE( capDOM ) 1.RE ← Create PHP Business Rule Engine Object 2.RE reads and parses rules from file 3.Insert capDOM to RE 4.Call RE->fireAll() to start rule matching END 41

iGaDs (Smartphone App) 42

jQuery Mobile and JavaScript (PhoneGap) XML.ObjTree, JSRulez iGaDs (Smartphone App) IGADS_SMARTPHONE 1.Connect to PubNub cloud and wait for message 2.capMsg ← Receive a CAP message from PubNub 3.capJS ← Call XML.ObjTree convert capMsg to a JavaScript object 4.capJS ← Extract Event, Parameter from capJS 5.Call RULE_ENGINE(capDOM) 6.Go back to 1. END FUNCTION RULE_ENGINE( capJS ) 1.RE ← Create JSRulez Rule Engine Object 2.RE reads and parses rules from file 3.Insert capJS to RE 4.Call RE->runAll() to start rule matching END 43

Rule Format priority: 1, condition: function(cap){ return cap.event === “Earthquake” && cap.valueName === “Magnitude” && cap.value >=6 } action: function() { window.alert(“Huge earthquake coming!”); } rule “Earthquake” priority=1 context Parameter $param if $param->event == ‘Earthquake’ && $param->valueName == ‘Magnitude’ && $param->value >= 6 then $action[‘LED_Earthquake’]- >do_action(); end PHP Business Rule JSRulez 44