1. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 1 Frank Allan Hansen, fah@daimi.au.dk HyCon Contextual Hypermedia on the Move Frank Allan Hansen Ph.D. Student Department of Computer Science, University of Aarhus Center for Interactive Spaces, ISIS Katrinebjerg fah@daimi.au.dk

2. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 2 Frank Allan Hansen, fah@daimi.au.dk Hypermedia and Context Hypermedia Concepts Context and Context Awareness The HyCon Architecture The HyConExplorer –Hypermedia on the move Use Scenarios Related Efforts Conclusion

3. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 3 Frank Allan Hansen, fah@daimi.au.dk Hypermedia

4. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 4 Frank Allan Hansen, fah@daimi.au.dk World Wide Web – The World’s Most Successful Hypermedia System First Web browser: “WorldWideWeb” Tim Berners-Lee (1990) Links: –Embedded in HTML documents –Uni-directional –Untyped The Web comprises: –URL –HTTP –HTML

5. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 5 Frank Allan Hansen, fah@daimi.au.dk Open Hypermedia Is Hypermedia just the Web? (not quite) The general idea behind hypermedia is to support organization, structuring, and acces to diferent types of (digital) media: –Text, audio, video The most common structuring mechanism is links (Bush 1945) Open Hypermedia (~1989): –Systems integrating with and providing general hypermedia functionality to systems without built-in hypermedia functionality (word proc., CAD system, Web browsers, etc)

6. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 6 Frank Allan Hansen, fah@daimi.au.dk Open Hypermedia Structures Open hypermedia structures are not embedded in the linked resources! –Externally defined, out-of-line links –Write acces to the resources are not required –Support multiple sets of structures on the same corpus of documents Hypermedia structures: –Links multiheaded (n-ary) bi-directional typed generic –Annotations (user created comments and footnotes) –Guided tours and information trails –...

7. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 7 Frank Allan Hansen, fah@daimi.au.dk Xspect: XLink as Open Hypermedia

8. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 8 Frank Allan Hansen, fah@daimi.au.dk Context and Context Awareness

9. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 9 Frank Allan Hansen, fah@daimi.au.dk Defining Context DEY (2001), Understanding and using context: “Context is any information that can be used to characterize the situation of an entity. An entity is a person, place, or object that is considered relevant to the interaction between a user and an application, including the user and applications themselves.” “A system is context-aware if it uses context to provide relevant information and/or services to the user, where relevancy depends on the user’s task.”

10. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 10 Frank Allan Hansen, fah@daimi.au.dk Context

11. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 11 Frank Allan Hansen, fah@daimi.au.dk Context Dimensions DimensionIncludes Physical context Physical location, physical objects, physical interaction, absolute time/space Digital context Computer model, data, structures, infrastructure, protocol, relative time/space Conceptual context Attention, activity, intention, understanding, communication

12. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 12 Frank Allan Hansen, fah@daimi.au.dk HyCon: Contextual Hypermedia

13. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 13 Frank Allan Hansen, fah@daimi.au.dk Interaction in the City Location based browsing and search relative to the users context (time, place, activity,...) –Geo-tagged information –Unstructured Web information (GBS/Google) Digital graffiti –Annotations: The user as producer of information (Photo, video, speak, text notes) –Leaving trails of information ”Social computing” Digital graffiti: augmenting the environment without spoiling it

14. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 14 Frank Allan Hansen, fah@daimi.au.dk The HyCon Platform Tablet PC Smart Phone

15. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 15 Frank Allan Hansen, fah@daimi.au.dk Context Based Browsing Navigating resources by browsing Context based browsing –Browsing the digital context… –by changing parameters in the physical context Direct Physical Navigation –Browsing with your feet –Physically walking or driving from one location to another affects the time and location parameters –User may “bump into” information –Used by tourist guide systems, navigation systems, etc. Indirect Representational Navigation –It’s not always desirable nor feasible to have to physically move around to browse information. –Allows users to investigate information structures in the system even though they are not actually in the physical context associated with the structures.

16. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 16 Frank Allan Hansen, fah@daimi.au.dk Browsing Pattern

17. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 17 Frank Allan Hansen, fah@daimi.au.dk Browsing - Example

18. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 18 Frank Allan Hansen, fah@daimi.au.dk Context Based Search (GBS) Search for information associated with the user’s context Geo Based Search: Web searches are augmented with context information or information derived from sensor data –Searching for shops or restaurants nearby which are open now –Requires information about the user’s (and shops) location and the time of day The benefit of adding criteria based on context information is of course highly dependent on the search engine used and how the context data can be formulated as an appropriate criteria…

19. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 19 Frank Allan Hansen, fah@daimi.au.dk Context Based Search (GBS) The user’s position can be acquired from GPS –Search engines are not indexing pages by GPS coordinates  (geo-tagging is not very popular) –Derive GPS coordinates to postal addresses! Businesses often provide their postal addresses on their Web sites GBS: user supplied search terms are augmented with computed postal addresses => The matching Web pages presumably covers the topic of interest and are associated to the given geographical area

20. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 20 Frank Allan Hansen, fah@daimi.au.dk Search Patterns

21. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 21 Frank Allan Hansen, fah@daimi.au.dk Searching - Example

22. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 22 Frank Allan Hansen, fah@daimi.au.dk Context Based Annotations Going beyond the classical context-aware browsing and navigation systems Support users as active information producers –documenting or commenting on objects or situations Combining context sensors with mobile devices equipped with built-in cameras and microphones –supports creation of video, audio, photo, and text annotations and automatic tagging with context information –Using browsing and searching the information can later be retrieved by the user, friends, or colleagues

23. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 23 Frank Allan Hansen, fah@daimi.au.dk Annotation Pattern

24. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 24 Frank Allan Hansen, fah@daimi.au.dk Producing Annotations - Example

25. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 25 Frank Allan Hansen, fah@daimi.au.dk Context Based Trails Creating structure! Organizing information as you go Leaving (user created) guided tours through collections of “points of interest” –No requirement for pre-defined tourist guides “Social computing” –Combined with the annotation facilities trails may serve as personalized impressions of a given area and even allow users to share their impressions through discussions linked to points of interests along the trail.

26. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 26 Frank Allan Hansen, fah@daimi.au.dk Browsing and Creating Trail - Example

27. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 27 Frank Allan Hansen, fah@daimi.au.dk Use Scenarios

28. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 28 Frank Allan Hansen, fah@daimi.au.dk School Children in the Field Project evaluated with children from three public schools in Aarhus Project work in the city of Aarhus: –Life in Vestergade a hundred years ago –Bruun’s Galleri (Shopping center) –Åboulevarden (Activities on a main street) Four phases: 1.Teachers’ planning the field work 2.Pupils are introduced to equipment and assignment 3.Field trip 4.Pupils’ presentation Video link

29. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 29 Frank Allan Hansen, fah@daimi.au.dk Construction and Repair Work Reporting damages on a given location (on the spot) –Photos and comments –May be used to establish patterns of wear and damage over time Repair Documentation: –Document the damage –Document the repair –Document time of the repair –Automatically tagged with time and location information

30. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 30 Frank Allan Hansen, fah@daimi.au.dk Fleet Management Monitoring transportation of goods Monitoring many units Rapid location tracking Easy logging of routes with time stamping Cheap equipment!

31. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 31 Frank Allan Hansen, fah@daimi.au.dk Related Efforts

32. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 32 Frank Allan Hansen, fah@daimi.au.dk TagandScan http://www.tagandscan.com/ Commercially available system combining location, annotation, and mobile phones –Built-in billing: Location Credits Users can annotate a location (determined from their current (mobile phone) cell) with text, image, and a category… and publish this annotation to the general public or just share it with their friends (public/private grid). Requires no GPS receiver –on the other hand, it is not supported by all telephone companies and is much less precise (~100m radius in urban areas, ~1-2km else where)

33. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 33 Frank Allan Hansen, fah@daimi.au.dk TagandScan - Tagging – Web demo

34. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 34 Frank Allan Hansen, fah@daimi.au.dk TagandScan – Scanning – Web demo

35. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 35 Frank Allan Hansen, fah@daimi.au.dk Tourist and Navigation Systems Cheap systems supporting GPS and map based interfaces Way-finding and navigation support May include way-point support for route planning May include some pre-defined content and points of interest (hard to keep up to date) These systems are however largely concerned with situated browsing of information rather than situated authoring

36. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 36 Frank Allan Hansen, fah@daimi.au.dk Moblogs Blogs (Web logs) are the widespread phenomena of online journals The combination of mobile phones and blogs yields the moblog The moblog maintainer can add content from a mobile phone, so impressions and pictures can be added while on the move, and thus creating situated content No automatic addition of location –Has to be done manually No context aware browsing support –One way linking Example: Nokia LifeBlog

37. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 37 Frank Allan Hansen, fah@daimi.au.dk World-Wide Media eXchange Microsoft Research: WWMX World-Wide Media eXchange (http://wwmx.org/) Coupling of online material with location information Users can tag images with metadata such as: –geographical location, time, and owner The location tagging can be automated, providing the user is using a (special) GPS receiver The images can then later be shared with others and browsed based on location (Indirect Representational Navigation) No support for situated authoring No support for situated browsing

38. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 38 Frank Allan Hansen, fah@daimi.au.dk World-Wide Media eXchange

39. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 39 Frank Allan Hansen, fah@daimi.au.dk Conclusion

40. ISIS Katrinebjerg i n t e r a c t i v e s p a c e s. n e t 40 Frank Allan Hansen, fah@daimi.au.dk Conclusion A computer scientist’s view on augmenting the physical world with digital structures Techniques for linking objects in physical and digital space –Creating associations between the physical world, digital, and supporting interaction through heterogeniuos devices Situated authoring and browsing –Annotating and structuring in context –Browsing and information search in context