1. 1 Platform and terminal aspects IP-Networking and Mediacom 2004 Workshop Session MM3/MM4: Convergence / Interactive Broadcast Simão F. Campos Neto Vice-Chair, SG16 (Brazil); Chair WP 3/16 (Media Coding) Lockheed Martin Global Telecommunications LMGT LOGO

2. 2 Objective Present an overview of ITU-T perspective on provisioning Multimedia Services (MM)

3. 3 MM Applications Development Factors: Users needs Market Trend System Design Architecture Interoperable Common Multimedia Parts, e.g., Coding (G,H,T-series), Security (X-series), Directory (X-series) Integration or Assembling of Multimedia Parts (Terminal Design; J,H-Series) Users Media (CS, PS, Cable) Wired/Wireless (ITU and non-ITU) Recommendations for Applications & Services (F,T series) Interoperability Numbering, Charging Specs. (E-series)

4. 4 MM Element Interdependence User perspective Equipment/protocol perspective

5. 5 Services

6. 6 MM Service Descriptions Several MM tasks: –Conferencing (multipoint, bi-directional, real-time) –Conversation (point-to-point, bi-directional, real-time) –Distribution (point-to-multipoint, unidirectional) –Sending (point-to-point distribution, Tx controlled, UD; info pushing) –Receiving (point-to-point distribution, Rx controlled, UD; info retrieval) –Collecting (multipoint-to-point distrib., UD, Rx controlled; info polling) Media components: audio, video, text, graphics, still- pictures, and data Quality level for media components: {-1, 0, 1, 2, 3, 4} Service definition and requirements are available in the F-series. F.700 contains the umbrella definitions: Integration of media components from the user’s point-of-view

7. 7 MM Service Descriptions (2) F.70x: network-independent definitions F.702 (F.MCV)-Multimedia conference services F.703 (F.MCS)-MM conversational services Network-specific definitions F.731- N-ISDN MM conference services F.732- B-ISDN MM conference services

8. 8 Terminals

9. 9 Multimedia terminals H.320: Communications over N-ISDN H.310: Communications over B-ISDN H.323: Communications over packet networks (mainly IP) H.324: Communications using circuit-switched services (fixed and mobile, including 3GPP) H.246: Terminal Interworking Integration of media components from the equipment/protocol point-of-view

10. 10 Multimedia terminals (2) Example: Functional model for H.320 N-ISDN Terminal Network Interface Video Coding (H.261) Audio Coding (G.711) System Control (H.242) Call Control (Q.931) MM Mux & Sync (H.221) Data Coding (T.120) User Interface

11. 11 Multimedia terminals (3) Example: Functional model for H.323 Terminal Network Interface Audio Coding (e.g. G.711, G.729) Video Coding (e.g. H.261, H.263) User Data Coding (T.120) System Control (H.245) Call Control (H.225.0, Q.931) MM Mux & Sync (H.225.0) User Interface

12. 12 Multimedia terminals (4) Example: Functional model for H.324 Terminal Network Interface Audio Coding (e.g. G.723.1) Video Coding (e.g. H.261, H.263) Data Coding (T.120; V.14, LAPM) System Control (H.245,SRP/LAPM) Call Control (National standards; V.250) MM Mux & Sync (Fixed network: H.223; Mobile: H.223 Annexes A-D) User Interface

13. 13 MM terminals (5): Interoperability H.324H.310 H.320H.323 Audio/Video User data Audio/Video Mux QoS RTP/ Non-QoS H.223 H.225.0 H.222.0 H.222.1 H.221 Call Control (H.245) Call Control (H.242/H.243) Call Control (H.245) Call Control (H.245) H.223 Anx.A-D Fixed Mobile Scope for H.246

14. 14 Media components

15. 15 Data T.120-T.140,T.17x provide definitions for data exchange and control in MM conferencing applications. For example: –T.120 defines data protocols for multipoint multimedia conferencing (Annex C describes a light version of T.120). E.g. White-board applications. –T.140 adds text conversation (“chat” e.g. for hearing-impaired people) –T.17x: MHEG for information retrieval

16. 16 Media Coding Four aspects: Audio Video Still-image Other media coding

17. 17 Media Coding: Audio Three “classic” quality tiers: audio, wideband speech, and telephony speech. ITU-T focus on interactive communications, hence mainly produced wideband and telephony speech compression standards (F.700’s A0 and A1 Quality Levels).

18. 18 Media Coding: A2/A3 Audio A2 coding for broadcast applications J.41 (logarithmic PCM compression, 15kHz, 384kb/s) 1988 A2&A3 Audio coding: ISO MPEG –MPEG2/Audio (e.g. MP3) –MPEG4/Audio

19. 19 Media Coding: A1 Audio A1: Wideband speech coders (50-7000Hz) J.42 11-bit logarithmic PCM compression (192 kbit/s) 1988 G.722 Split-band ADPCM Coding of 7 kHz speech (64,56&48 kbit/s) 1988 G.722.1 Transform coding (32&24 kbit/s) 1999 G.16kWB Coding of 7 kHz speech at around 16 kbit/s (planned mid 2001)

20. 20 Media Coding: A0 Audio A0: Telephony speech coders (300-3400 Hz) G.711 PCM coding (64 kbit/s) late 60’s G.726 ADPCM coding (32; 40, 24 & 16 kbit/s) 1988 G.727 Embedded ADPCM coding (40-16 kbit/s) 1990 G.728 LD-CELP coding (16; 40, 11.8 &9.6 kbit/s) 1992 G.723.1 Dual-rate coding (5.3 & 6.3 kbit/s) 1995 G.729 CS-ACELP coding (8; 12.8 & 6.4 kbit/s) 1996-98 G.4kbit/s Coding of speech at 4 kbit/s G.VBR Variable bitrate speech coding New Ongoing

21. 21 Media Coding: Video ITU standards: –H.261  Video Codec for N-ISDN –H.262 = MPEG2/Video (“Common text”) –H.263 and Annexes  IP, wireless, and N-ISDN –H.26L: successor to H.263 Ongoing

22. 22 Media Coding: Still Image Still image (B/W & color) is used in facsimile services, in Internet applications, digital photography, etc. Standards work performed by a “Collaborative ITU|ISO/IEC Team” working under ISO/IEC SC29 rules and organization ITU has “common-text” for JPEG/JBIG (T.80 series); soon-to-be JPEG2000 (T.800 series)

23. 23 Other media coding Currently not performed in ITU-T: Character coding (ISO/IEC SC2 activity) Speech synthesis (text-to-speech) Speech recognition (new developments)

24. 24 Conclusion Service definitions provide the user perspective for MM communication Terminals & protocols integrate different media components for specific applications Interoperability adaptations are necessary Existing terminals are network-specific, however there is a trend towards more flexible specifications.

25. 25 Media Coding Supplemental Slides

26. 26 Telephony-band Speech Coding Families

27. 27 Telephony-band Speech Coding Families

28. 28 A2/A3 Non-ITU Standards MPEG2/Audio: audio coding > 64 kbit/s (1992) MPEG4/Audio: audio + speech coding at bit rates between 64 and 2 kbit/s (1998)

29. 29 A0-A1 Non-ITU Standards ETSI/3GPP: –13 kbit/s RPE-LTP (Full rate GSM, 1988) –6.5 kbit/s VSELP (Half-rate GSM, 1993) –12.2 kbit/s EFR (Enhanced full-rate GSM, 1996) –12.2 - 4.75 kbit/s AMR (Adaptive Multi Rate, 1999) –6.6 - 23.85 kbit/s AMR-WB (Wideband AMR, 2001) ARIB (Japan) –Full-rate PDC (Personal Digital Communication) 6.7 kbit/s VSELP –Half-rate PDC 3.45 kbit/s Pitch Synchronous Innovation CELP

30. 30 A0-A1 Non-ITU Standards (cont’d) US TIA (ANSI) –CDMA IS96 8,4,2 kbit/s QCELP (Qualcomm CELP, 1992) IS127 8.55, 4, 0.8 kbit/s EVRC (Enhanced Var. Rate Codec, 1996) IS733 13.3, 6.2, 2.7, 1 kbit/s VRC (Variable Rate Codec, 1998) CDMA2000 9.6,4,2.4,0.8 kbit/s SMV (Selec.Mode Vocoder, ?2002) –TDMA IS54 7.95 kbit/s VSELP (Vector-Sum Excitation Lin.Pred., 1990) IS641 7.4 kbit/s ACELP (Algebraic CELP, 1997) –PCS1800 (GSM upbanded to 1800 MHz) IS136-410 12.2 kbit/s US1 (1999)

31. 31 Still Image Coding Summary (1) Umbrella: T.80 [1992] JPEG: T.81 (Part I), lossy and loss-less [1992]; T.83 (Compliance testing) [1994]; T.85 (Extensions, defs & testing) [1996]; T.85 Corr.1 [1999]; T.86 Registration of JPEG Profiles [1998]; T.87 (Baseline) Lossless and near-lossless compression of continuous-tone still images [1998] JBIG: T.82, loss-less [1993]; T.82 Corr.1 [1995]; T.85 JBIG for fax terminals; T.85 Amd.1 [1996], 2 [1997]; T.85 Corr.1 [1997]; T.88 Lossy/lossless coding of bi-level images [2000]; T.89 Application profiles for Recommendation T.88 [2000]

32. 32 Still Image Coding Summary (2) Planned new common texts: T.800: Part 1, JPEG 2000 Image Coding System: Core Coding System T.801: Part 2, JPEG 2000 Image Coding System: Extensions T.802: Part 3, Motion JPEG 2000 T.803: Part 4, Conformance Testing T.804: Part 5, Reference Software T.805: Part 6, Compound Image File Format T.806: Part 7, Technical Report: Guideline of minimum support function of Part-1

33. 33 ITU-T Video Coding H.261: Video Codec for A/V services at p x 64 kbit/s –The first practical video coding standard (1990) –Used today in (ISDN) video conferencing systems –Bit rates commonly 40 kbit/s to 2 Mbit/s H.262: Same as MPEG-2/Video (ISO/IEC 13818-2) –Commonly used for entertainment-quality video applications –The first practical standard for interlaced video –Used in digital cable, digital broadcast, satellite, DVD, etc. –Bit rates commonly 4-20 Mbit/s

34. 34 ITU-T Video Coding (continued) H.263: Video Coding for Low Bit Rate Communication –Significantly improved video coding compression performance (especially at very low rates, but also at higher rates as well) –The first error and packet loss resilient video coding standard –Used in Internet protocol, wireless, and ISDN video conferencing terminals (H.323, H.324, 3GPP, etc.) –“Baseline” core mode interoperable with MPEG-4/Video –Rich set of features for many applications –Very wide range of bit rates and possible applications

35. 35 Non-ITU-T Video Coding MPEG-1/Video (ISO/IEC 11172-2) –The first video coding standard using half-pel motion compensation –Typical bit rates 1-2 Mbits/s MPEG-4/Visual (ISO/IEC 14496-2) –The first video coding standard defining arbitrary object shapes –Many creative features for synthetic and synthetic-natural hybrid content –Contains essentially all features of all prior standard codec designs –Interoperable with ITU-T H.263 “baseline” –Very wide range of bit rates and possible applications