The Pipeline of Enrichment Don Cruickshank (sotonoid) 15 th August 2001 The 7th International Workshop on Open Hypermedia Systems
HyStream Open Hypermedia applied to Continuous Metadata Streams Open Hypermedia applied to Continuous Metadata Streams Archived / Near-live / Live scenarios Archived / Near-live / Live scenarios Media delivery Media delivery Local media (hard disc, video recorder) Local media (hard disc, video recorder) TCP streaming (play during download, TV) TCP streaming (play during download, TV) UDP streaming (real-time streaming, e.g. RTP) UDP streaming (real-time streaming, e.g. RTP) Branching Media Branching Media
Seminar application
Open Hypermedia Media and Metadata arrive via different network streams Media and Metadata arrive via different network streams Links are stored separately from the media Links are stored separately from the media Generic Links supplied by the Fundamental Open Hypertext Model (FOHM) Generic Links supplied by the Fundamental Open Hypertext Model (FOHM) Multiple startpoints used to represent multiple video formats Multiple startpoints used to represent multiple video formats
Temporal Metadata Startpoint – a video Startpoint – a video Endpoint – a video, slide or person Endpoint – a video, slide or person Time – media clock value Time – media clock value Resource – the resource (e.g. projector) Resource – the resource (e.g. projector) Type – “appear” or “disappear” Type – “appear” or “disappear” Label – human readable label Label – human readable label
HyStream Architecture
HyStream Implementations Temporal Linking Service Temporal Linking Service HTTP-alike protocol HTTP-alike protocol Client software ‘downloads’ a dynamically created linkbase over time Client software ‘downloads’ a dynamically created linkbase over time SoFAR (Agent based) SoFAR (Agent based) Matchmaking service Matchmaking service Subscription mechanism Subscription mechanism Ontological representation of temporal events Ontological representation of temporal events Web Agent Web Agent
Smart Spaces The Meeting Room Scenario The Meeting Room Scenario RDF representation RDF representation Automated metadata capture Automated metadata capture RFID tags RFID tags b b Smartboard Smartboard
Recording Sheet
Authoring and playback Simultaneous authoring and playback Simultaneous authoring and playback Client -> Server Client -> Server Temporal metadata used to describe events Temporal metadata used to describe events “Slide 2 appeared at 80 seconds into the seminar.” “Slide 2 appeared at 80 seconds into the seminar.” Server -> Client Server -> Client Temporal links streamed to client Temporal links streamed to client No requirement for backchannel communication during normal playback No requirement for backchannel communication during normal playback
Summary Open Hypermedia Open Hypermedia Temporal Metadata Streams Temporal Metadata Streams Ontological Representation Ontological Representation Smart Spaces Smart Spaces