1. HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY © 2005 Jörg Ott ∙ Dirk Kutscher 1 Networked Multimedia with Internet Media Guides 2005-06-08TNC 2005, Poznań, Poland Jörg Ottjo@netlab.hut.fi Dirk Kutscherdku@tzi.org

2. © 2005 Jörg Ott ∙ Dirk Kutscher 2 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Overview  Motivation Service Announcements for Networked Multimedia in the Internet Platform/Network Independent content provision  Introduction to Internet Media Guides Concepts Implementations  Applications Networked Multimedia Service descriptions  Conclusions

3. © 2005 Jörg Ott ∙ Dirk Kutscher 3 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Remember the Mbone? Broadcasting in the Internet  Mbone sessions Multicast media sessions Announced with SAP/SDP (multicast) Push distribution model Single, well-defined type of service  Session Announcement Protocol (SAP) One-to-many distribution (IP-Multicast) Soft-State: Periodic multicast messages Notion of scopes (for announcements and media sessions)  TTL scoping  Administratively scoped multicast Independent of description format  But mainly used with SDP

4. © 2005 Jörg Ott ∙ Dirk Kutscher 4 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Mbone Session Descriptions v=0 o=llynch 3117798688 3117798739 IN IP4 128.223.214.23 s=UO Presents KWAX Classical Radio i=University of Oregon sponsored classical radio station KWAX-FM u=http://darkwing.uoregon.edu/~uocomm/ e=UO Multicasters multicast@lists.uoregon.edu p=Lucy Lynch (University of Oregon) (541) 346-1774 t=0 0 a=tool:sdr v2.4a6 a=type:test m=audio 30554 RTP/AVP 0 c=IN IP4 224.2.246.13/127 a=ptime:40  Session Descriptions Idempotent descriptions of a single session Media session information (technical) Meta-Information  Author  Subject  Scheduling… Designed for SAP-based announcements in the Internet  Assumptions Can be received by all potential viewers Same network and distribution scope for announcement and actual session

5. © 2005 Jörg Ott ∙ Dirk Kutscher 5 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Observations  SAP/SDP tied to IP-Multicast-based session model  Only one distribution scheme: announcement  Only one type of service: convey multimedia session information  (Global) IP-Multicast has not prevailed as a distribution platform  SAP rather experimental  Was often used for debugging Mbone connectivity  Summary SAP/SDP too limited Not appropriate as a general solution for distributing session information Traditionally linked to IP-only (and Multicast-only)

6. © 2005 Jörg Ott ∙ Dirk Kutscher 6 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Trend: Ubiquitous Information Access Cellular Networks Internet + IP Networks Broadcasting Networks TV set / radio Workstation Laptop / tablet PC PDA Cellphones … … Live Broadcast Canned Program Studio File Server Ticker Server Web Server … Will be IP-based in the future

7. © 2005 Jörg Ott ∙ Dirk Kutscher 7 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY “Classic” Broadcasting & Internet Multimedia  Broadcasting still a different world today (including customer expectations, philosophy) Encodings  Audio/Video largely compatible (but different quality expectations)  Image/text formats/HTML vs.Videotex, MHP, specific markups, tables Data transmission  IP + UDP/TCP + RTP/… vs.MPEG multiplex (or even analog) Addressing  IP addresses + ports vs.frequency/channel, PID, satellite position, pol., … Interaction & control  RTSP, HTTP, SIP, … vs.MHP, …  But there is a migration towards IP in various areas Content providers, transmission technologies, consumer equipment

8. © 2005 Jörg Ott ∙ Dirk Kutscher 8 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Platform/Network-Independent Content Provision  The same content shall be available via different networks Preferably without repeated authoring  “Content” used in a broad sense Original media: Audio / video broadcasts, web pages, files, news feeds, … Supplementary information: background, statistics, subtitles, ads, …  Content needs to be globally (or regionally) identifiable  Content needs to be found Descriptive metadata Availability (scheduling) metadata  Alternate access methods must be possible Network + network-specific address Application areas: Digital Video Broadcasting (incl. DVB-T/H) 3G / 4G wireless communication systems Wireless LAN Hot-Spots Regular Internet Content is a special case of “services”…! Internet access File distribution “e/m-Commerce”

9. © 2005 Jörg Ott ∙ Dirk Kutscher 9 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Internet Media Guides (IMG) Definition of an IMG (from MMUSIC Charter) Content:  A collection of multimedia session descriptions  Expressed using SDP, SDPng or other metadata formats  It is used to describe a collection of multimedia sessions (e.g. television programme schedules). Distribution:  The IMG must be delivered to a potentially large audience (push or pull), who use it to join a subset of the sessions described, and who may need to be notified of changes to the IMG.

10. © 2005 Jörg Ott ∙ Dirk Kutscher 10 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG  EPG  Generalized for arbitrary... Types of media Types of sessions and interactions: services! Classes of devices  Plurality of access methods Physical delivery (Reliable) Broadcast / multicast (push) Interactive retrieval (pull) Provision of full IMGs and of deltas Notification about changes  Network-independent For the delivery of IMGs For the (request and) transmission of actual media in sessions The same IMGs should be usable everywhere.

11. © 2005 Jörg Ott ∙ Dirk Kutscher 11 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG Elements IMG Metadata: SDP(ng), MPEG-7,... IMG Source IMG receiver IMG transceiver Processing IMG Metadata: SDP(ng), MPEG-7,... IMG Metadata: SDP(ng), MPEG-7, TVA IMG Source IMG sender IMG receiver IMG receiver IMG sender IMG receiver IMG Transport IMG Metadata Envelope

12. © 2005 Jörg Ott ∙ Dirk Kutscher 12 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG Delivery Models / Operations IMG announcer IMG ANNOUNCE Broadcast / Multicast IMG Source IMG listener IMG resolver IMG querier IMG QUERY (Pull) IMG RESOLVE IMG notifier IMG NOTIFY (w/ content) IMG Source IMG subscriber IMG SUBSCRIBE IMG receiver IMG QUERY IMG NOTIFY (w/o content, w/ pointer) IMG RESOLVE Full IMG     *p

13. © 2005 Jörg Ott ∙ Dirk Kutscher 13 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG Architecture Point-to-MultipointPoint-to-Point IMG Transport IMG ANNOUNCE IMG SUBSCRIBE IMG NOTIFY IMG QUERY IMG RESOLVE IMG Operations IMG Envelope IMG Data Types Complete Description, Delta Description, Pointer #1#2…#n Metadata Formats

14. © 2005 Jörg Ott ∙ Dirk Kutscher 14 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG Transports  Need to provide mechanisms for IMG Operations  ANNOUNCE Reliable multicast transport protocol: FLUTE + MUPPET  SUBSCRIBE / NOTIFY Session Initiation Protocol (SIP): Extensions for Subscription/Notification  QUERY / RESOLVE HTTP  Identify IMGs properly across protocols: IMG URI Mappings to individual protocols for actual processing

15. © 2005 Jörg Ott ∙ Dirk Kutscher 15 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG Envelope  Container for metadata Complete, delta, pointers Independent of metadata Can be viewed as some kind of wrapper mechanism Metadata itself defined by other bodies  Generic management information Identification + version + validity information Content-Type: to identify metadata format Support for security?  authentication + integrity information  Privacy of content

16. © 2005 Jörg Ott ∙ Dirk Kutscher 16 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY TZI IMG Implementations  Papageno: Multi-channel distribution platform Application-independent object distribution system FLUTE, HTTP, (SIP work in progress) Open Source: ftp://ftp.informatik.uni-bremen.de/home/logic/flute/ftp://ftp.informatik.uni-bremen.de/home/logic/flute/  IMG implementation Leverages Papageno distribution platform IMG sender/receiver/proxy Full IMG and delta distribution Extending the IMG-Envelope specification  Maintain authenticity of IMGs processed by transceivers Clear separation of of distribution platform from IMG semantics  Flexible support for different meta data formats

17. © 2005 Jörg Ott ∙ Dirk Kutscher 17 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG Applications  Scalable software distribution Update announcement with IMGs File distribution with FLUTE  SAP/SDP-gateway  TV-EPG distribution  Network service descriptions  Home entertainment and personal multimedia environments

18. © 2005 Jörg Ott ∙ Dirk Kutscher 18 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY TV-EPG Distribution TV Network Website XMLTV IMG Sender HTTP HTML Web Scraping Tool Freevo HTPC IMG Envelope XMLTV IMG Receiver IMG Transport

19. © 2005 Jörg Ott ∙ Dirk Kutscher 19 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY IMG Experiences  EPGs: mostly static content Difficult to find dynamically changing service descriptions Periodic multicast seems to be the right strategy  Operational considerations for bootstrapping and multiplexing How to best split up service guides into multicast groups?  By provider?  By service type?  IMG compared to SAP-based service guide distribution IMGs can leverage Mbone (or other multicast) infrastructure Still workable without multicast Probably an interesting driver for last-mile point-to-multipoint multicast

20. © 2005 Jörg Ott ∙ Dirk Kutscher 20 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY New Applications for IMG  Past focus on traditional contents Conveying plain TV-schedules Streaming in 3GPP Release 6  Broadening the scope Cover services in a more general fashion Provide region/location information Support personalized inquiries Address issues of cost  Make offers automatically comparable  Technical level: enable service discovery (and location)  Business level: support adequate service selection

21. © 2005 Jörg Ott ∙ Dirk Kutscher 21 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Regionalization & Personalization with IMGs IMG Sender IMG Metadata IMG Metadata IMG Metadata IMG Metadata IMG Metadata IMG Metadata IMG Metadata IMG Metadata IMG Metadata IMG Sender IMG Transceiver Local contents Global contents Creation of IMGs IMG Transceiver Content Broker Aggregation IMG Metadata Filtering + Augmenting IMG Transceiver Service provider Filtering IMG receiver Set-top Box Consumption

22. © 2005 Jörg Ott ∙ Dirk Kutscher 22 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Network Service Descriptions  Background: Automatic service location and enrollment in access networks Different services: Internet access, telephony services, local content etc. Different service providers Different access methods (for Internet access)  Today Multiples access methods, manual user interaction required No information about other networks, e.g., in mobile scenarios  Approach: Service description and distribution with IMGs Users receive descriptions over arbitrary interfaces (wide area broadcast, WLAN) Local descriptions may refine and override larger scope descriptions Descriptions provide concept of geographic service location Receivers build maps of regions

23. © 2005 Jörg Ott ∙ Dirk Kutscher 23 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Example: Services in Hotspots  Dynamic choice of ISPs Considering user accounts, access methods, tariff models, utilization  Dynamic choice of other services  Dynamic choice of ITSP Least-cost service provisioning Provider selection (detailed tariff information)  Local services Local web content, real-time multimedia

24. © 2005 Jörg Ott ∙ Dirk Kutscher 24 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Service Announcements for Hotspots

25. © 2005 Jörg Ott ∙ Dirk Kutscher 25 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Conclusions  Networked Multimedia today a heterogeneous environment Need service guides beyond SAP/SDP  IMG framework addresses diversity in today’s distribution networks A useful tool for promoting new networked multimedia applications Can leverage multicast infrastructure, but workable without  General approach for arbitrary applications, access methods and networks  Concept for delta distribution and aggregation/filtering through content brokers  Content description can be generalized as service description IMGs for distributing meta-information about services Notion of refinement of scoped service descriptions

26. © 2005 Jörg Ott ∙ Dirk Kutscher 26 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Thank you! http://www.dmn.tzi.org/research/img.html Dirk Kutscher dku@tzi.org

27. © 2005 Jörg Ott ∙ Dirk Kutscher 27 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY

28. © 2005 Jörg Ott ∙ Dirk Kutscher 28 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Bibliography  Y. Nomura, R. Walsh, J.-P. Luoma, J. Ott, H. Schulzrinne; Requirements for Internet Media Guides; Internet Draft draft-ietf-mmusic-img-req-07.txt; Work in Progress; June 2004  Y. Nomura, R. Walsh, J.-P. Luoma, H. Asaeda, H. Schulzrinne; A Framework for the Usage of Internet Media Guides; Internet Draft draft-ietf-mmusic-img-framework-08.txt; Work in Progress; July 2004  Rod Walsh, J.-P. Luoma, J. Peltotalo, S. Peltotalo, J. Greifenberg; The IMG Envelope; Internet Draft draft-ietf-mmusic-img-envelope-03.txt; Work in Progress; June 2005  J. Luoma; MUPPET: Internet Media Guide Unidirectional Point-to-Multipoint Transport; Internet Draft draft-luoma-mmusic-img-muppet-03.txt; Work in Progress; October 2003  D. Kutscher, J. Ott, C. Bormann; Session Description and Capability Negotiation; Internet Draft draft-ietf-mmusic-sdpng-08.txt; Work in Progress; February 2005  T. Paila, M. Luby, R. Lehtonen, V. Roca, R. Walsh, FLUTE - File Delivery over Unidirectional Transport; RFC 3926; October 2004  M. Luby, J. Gemmell, L. Vicisano, L. Rizzo, J. Crowcroft; Asynchronous Layered Coding (ALC) Protocol Instantiation; RFC 3450; December 2002

29. © 2005 Jörg Ott ∙ Dirk Kutscher 29 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY Regional Service Announcements DVB-T IMG ANNOUNCE DVB-T IMG Service Description Available services in a region Type of service Geo-position Basic Attributes Regional scope Selected services Low level of detail

30. © 2005 Jörg Ott ∙ Dirk Kutscher 30 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY DVB-T IMG Service Description Available services in a region 3G IMG QUERY/ RESOLVE IMG ANNOUNCE IMG Service Description Available services in a specific geographic area Update/augment general service description Regional Service Announcements

31. © 2005 Jörg Ott ∙ Dirk Kutscher 31 HELSINKI UNIVERSITY OF TECHNOLOGY NETWORKING LABORATORY DVB-T 3G Hotspot IMG Service Description Specialized description about a specific service Update/augment general service description Higher level of detail Include local services IMG ANNOUNCE Regional Service Announcements