1. 1 Geographic Information Infrastructures for Ubiquitous Computing Spring 2007 Ki-Joune Li

2. STEMPNU 2 Cyber Space vs. Ubiquitous Space VS.

3. STEMPNU 3 Ubiquitous Space vs. Internet Space Internet Space Real World user Gates to Dive into Internet Space

4. STEMPNU 4 Ubiquitous Space and Augmented Reality Cyber Space Real World user Ubiquitous Space Augmented Reality Bridge to connect Cyber space and real world

5. STEMPNU 5 Example of Augmented Reality Case 1: Multi-Projector [Bauhaus Institute]

6. STEMPNU 6 Example of Augmented Reality Case 2: Surgery [INRIA] [Univ. Rochester]

7. STEMPNU 7 Example of Augmented Reality Case 3: Pedestrian

8. STEMPNU 8 Example of Augmented Reality Case 3: Pedestrian Drishti: Indoor/Outdoor Blind Navigation System - Sumi Helal, Steve Moore at Univ. Florida, USA Orientation Coordinates Geographic Context and

9. STEMPNU 9 Types of Augmented Reality ? User Types Mobility Personalization General Users Our Concern CASE 1 Stationary Objects General Users CASE 2 Stationary Objects Individual Users CASE 3 Mobile Objects Individual Users

10. STEMPNU 10 Scenario Detection by Sensor Retrieve Context Information Provide Augmented Reality Geographic Context

11. STEMPNU 11 Context-Awareness Context Internal Context Static Context (Information-Driven) Dynamic Context (Sensor-Driven)

12. STEMPNU 12 Context-Awareness without Information Provider Context Internal Context Static Context (Information-Driven) Dynamic Context (Sensor-Driven) We need a map ! What can we do with this compass ? Map: Static Information Relatively Large to fit in a small device

13. STEMPNU 13 Indoor Space Road Network Space Euclidean Space Spatial Context-Awareness (Geographic Awareness) Spatial Context My Status + Location, Speed, Orientation Geographic Information Static Context Geo-Sensor Dynamic Context Internal Context Seamless Space

14. STEMPNU 14 Geo-Labeling: Identification of Geographic Object Context My Status + Location, Speed, Orientation Geographic Information Static Context Geo-Sensor Dynamic Context Internal Context How to Identify and Retrieve Geographic Information in Mobile Environment ? Object Identifier or Foreign Key like DB ? We need a Mechanism to Identify a Geographic Object (Feature) and Retrieve its information Geo-Labeling

15. STEMPNU 15 Geo-Label Real World User RFID 2-D Barcode Feature Geo-Labels Geographic Databases 2. Complex Geographic Context Information 1. Simple Geographic Context Information UFID iPointer Geo- Label

16. STEMPNU 16 Context-Aware Mapping Context My Status + Location, Speed, Orientation Geographic Information Static Context Geo-Sensor Dynamic Context Internal Context How to cook GI, stream data from sensors, and internal states ? Requirements - Geographic Awareness, - Real-Time, - Scalability, and - Mobility Approaches - Wireless Communication, - In-Network Approach like USN, P2P, or DMB

17. STEMPNU 17 Two Viewpoints Geographic Context Real World 1. How to get Geographic Context ? 2. How to handle Geographic Context ? Application Systems 2-1. How to provide Geographic Context ? 2-2. How to search Geographic Context ? 2-3. How to analyze Geographic Context ? 1-1. How to collect Sensor Data ? 1-2. How to identify Geographic Features ?

18. STEMPNU 18 Challenges To get geographic contextTo handle geographic context Identification of geographic features Geographic context in Heterogeneous Spaces Providing geographic context Analysis of geographic context Scalability problem Geo-Label IndoorUnderground3-D In-Network Processing Distributed Middleware Egocentric Mapping

19. STEMPNU 19 How to Implement Geo-Labels Geo-Label: A label for recognizing geographic feature Implementation  Physical Device 2-D Bar Code RFID  Virtual Geo-Label Dynamic Computation from Viewpoint Contents of Geo-Labels  UFID  u-Location  Other Information

20. STEMPNU 20 2-D Bar Codes Home Page URL, UFID, u-Location, and Other Information

21. STEMPNU 21 Virtual Geo-Labels No Physical Devices Dynamic Computation of Geo-Labels  Position  View Direction  Velocity Real World Augmented Reality on a screen

22. STEMPNU 22 Implementation of Virtual Geo-Label in 3-D Server of 3-D GIS Databases Server of Application DB Geo-Label Mobile Client Position Velocity Interest View Point Geo-Label Dynamic Computation Presentation of Useful Information Progressive Transfer

23. STEMPNU 23 Heterogeneous Space Euclidean Space  No obstacle to movement or placement Constraint Space  Many obstacles in reality  Indoor space, Road Network space, and Terrain space  Representation of Constraints

24. STEMPNU 24 Example: Indoor Space No more Euclidian Space  Different coordinate systems and different properties. We should rebuild Spatial DBMS for Indoor Space Emergency Bell A 401 W.C. 404 405 406 Elevator Stairs Emergency Bell B p (F4, 401, 15, 18) 4 th Floor

25. STEMPNU 25 Should be processed in Real-Time Large Number of Nodes e.g. 1 Million Nodes → 1  sec/ node Scalability and Real-Time Constraint Geographic Context Mobile Node Mobile Node Dynamic Updates of Position Context Request Mobile Node Mobile Node Mobile Node Mobile Node Mobile Node Mobile Node GIS DB Location DB stationary and mobile nodes

26. STEMPNU 26 Server Geographic Context-Awareness by In-Network Processing Scalability Problem Each node has a small fraction of geographic Information. Each node exchanges geographic information by P2PSensor NetworkBroadcasting

27. STEMPNU 27 In-Network Processing: P2P Peer-to-Peer No Centralized ServerOriginally for File Sharing Services Each node has an IPv6 addressDatabases are scattered into mobile nodes (x1,y1,t1), IPAddr1 (x2,y2,t2), IPAddr2 (x3,y4,t4), IPAddr3 (x4,y4,t4), IPAddr4

28. STEMPNU 28 Example of P2P

29. STEMPNU 29 In-Network Processing: Sensor Network Sensor Network Database No Centralized ServerMobile Ad-Hoc Network MANETDatabases are scattered into mobile node Coverage Area

30. STEMPNU 30 Data on Air Broadcasting ServerBroadcasting like DMB Databases are periodically broadcasted Broadcasting Geographic Context Broadcasting Server

31. STEMPNU 31 Ubiquitous Computing Architecture Heterogeneity and Distributed Middleware Mobile Node Middleware Mobile Node Middleware 3-Tiers Architecture Server Middleware Client Massively Distributed Environment Binding Client and Server Binding Mobile Nodes

32. STEMPNU 32 Performance Bottleneck Heterogeneity and Distributed Middleware Middleware Binding Objects Geographic Binding Location Data Server (GIS) Mobile Node Middleware Mobile Node LDS Standard e.g. SensorML

33. STEMPNU 33 Egocentric Mapping: Evolution of the Map Paper Maps Digital Maps Mobile Maps Intelligent Maps

34. STEMPNU 34 Paper Maps Only for Visualization Static Map  Information should be preprocessed with respect to the purpose  Example Signage, Immovable Maps Problems  No consideration for a specific user No Sign on the Location or Orientation of User on the Map  Limited Attributes  No Mapping Operations

35. STEMPNU 35 Digital Maps A progress from paper maps  Several types of operations and analysis becomes possible Visualization such as zooming, panning and rotating Spatial analysis No consideration about mobile users  No Information about “Where I am” User’s status Limited mapping operations are possible  Zooming, Panning  Layer Selection

36. STEMPNU 36 Mobile Maps Digital Map with some considerations about  “Where I am” and  Hardware constraints such as Size of screen Memory size No consideration about user’s state Mapping operation concerning mobility such as  Orientation

37. STEMPNU 37 Intelligent Mobile Map Mobile Map Consideration of user’s state Dynamic Mapping Mobility Information - Location - Direction - Speed User State and Demand Egocentric Mapping

38. STEMPNU 38 Egocentric Mapping Traditional Map user A user B user I user D user C user F user G user H Egocentric Map user A Egocentric Map user B Egocentric Map user C Egocentric Map user D What you see is What you wantWhat you want is What you see

39. STEMPNU 39 Example of Egocentric Mapping Multiple LOD

40. STEMPNU 40 Example of Egocentric Mapping Varying LOD Space Contradiction

41. STEMPNU 41 Example of Egocentric Mapping Information in Real-Time Augmented Focus

42. STEMPNU 42 Summary Ubiquitous Computing  Location Awareness  Geographic Awareness Several Challenges to Realize Geographic Awareness  Geo-Label  Seamless Space Integration of Indoor and Outdoor Spaces  Heterogeneity and Scalability Issues  Egocentric Mapping Context-Aware Mapping

43. STEMPNU 43 But NOT LIKE THIS