S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego GEON Visualization Workshop: Augmented Reality (AR) Matt Clothier San Diego Supercomputer Center University of California, San Diego

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego AR can be useful for navigation purposes (Image courtesy: AR can also be used to help people communicate (Image courtesy: Popular Science, Feb ‘02 )

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Entertainment: The “Magic” Yellow Line  While watching football games, a “magic” yellow line indicates the first down line  Simple form of Augmented Reality

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Yellow Line in Action (Courtesy: NFL and FOX)

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Geoscience Augmented Reality Primarily, we want the following goals:  Outdoor environments  Ability to deal with changes in the environment  Data in context with the environment  Allow data to scale appropriately (granularity of data)

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Outdoor Augmented Reality  Our preliminary application focused on a way to use AR outdoors, like for buildings  Data about the structure is overlaid on top of the structure itself via Augmented Reality  Example: Firefighters benefit by seeing a building’s interior before going into a burning building

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego AR Hardware Inspiron 8200 laptop Sony Glasstron LDI-D100B HMD Garmin eTrex Vista Orange Micro iBOT2 (USB 2.0) Logitech Cordless Gamepad

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Results

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Lighting Condition Difficulties  With video-based AR, we also need to deal with the limitations of the camera  Many cameras cannot adjust lighting exposure fast enough to compensate for a rapid change in light  When the lighting drastically changes, tracking unique features are usually lost

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Final Results Final tracked result Final AR result (Brass Ring)

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego How about Augmented Reality for the geosciences?  Want geoscientists to be able to visualize data in context with their environment SHP data

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Early AR Development  Start simple, find a practical application for geoscientists  Using any existing map, overlay SHP data to provide additional context  Demo soon!

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego What’s Next?  Outdoor environments are extremely diverse such as deserts and forests  Tracking in such environments is very difficult  Thus, for AR to work, new techniques are needed (such as computer vision)

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Using AR out in the field?  PDAs, cell phones, or “computer backpacks” could be the main way to utilize AR  PDAs and cell phones could be you “window into the virtual world”

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Final Goals “Helicopter View” “Ground View”

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Demo time!  Augmented Reality Geoscience Map

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego Thank You!  Question/Comments?

S AN D IEGO S UPERCOMPUTER C ENTER University of California, San Diego