OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4 Conferencing Window MPEG-4 Player Decoders & Buffers DMIF QoS Data Conferencing Chat Shared App Doc Transfer Transfer MPEG-4 Conferencing COM-Interfaces Shared Apps Windows MPEG4 Player Window Browser Window DMIF QoS MPEG-4 player Java based playback of complete MPEG-4 scenes including 3D/Video material MPEG-4 SL-1, Flex-Demux, DMIF modules (real-time) optimized rendering for walkthrough applications involving complex 3D scenes MPEG-4 conferencing module C++ MPEG-4 conferencing module offers video and audio conferencing in a 3D virtual meeting space RT MPEG ‑ 4 video encoder of arbitrarily shaped video images and RT segmentation of the silhouette of person in front of a video camera QoS support for the conferencing application Integration of collaboration tools

Architecture of the OPENISE Terminal 2 nd IST E3 Concertation Meeting Bruxelles, May 2000 Marco Di Concetto Central Labs – Networks and Services Siemens Information and Communication Networks SpA

DAI SL -1 Layer BifsDecoder OD Decoder Compositor ApplicationExecutive A Decoder IOD Decoder ) ) = SL_PDUs ESI AUs Time stamps management MpegJ V Decoder Renderer OPENISE MPEG-4 Player Architecture Current Features  BIFS-Command and BIFS-Anim decoder  JPEG/GIF decoder  MPEG-4 Video decoder  AAC decoder (sound)  Script and MPEG-J interpretors  2D/3D renderer reading either textual format or mp4 files DMIF Filter DMIF Filter FlexDeMux Signalling PlaneData Plane DNI TCPUDP RTP IP IP RTSP RTCP RTCP

VR-Conference Terminal Architecture Conference Control Call Signaling IP Unicast & Multicast VR-Conference Executive A/V Receiver H.245 T.120 A/V Sender Data Conferencing Web-Browser Events GUI

A/V Receiver part of the VR-Conference Terminal BIFS/OD & Texture Decoder MP4-Video Decoder... G Decoder... HTTPRTP/RTCP... RTP... DS Buffer... Texture Buffer... Scene Graph Sound Node MovieTexture Node DirectSound Primary Sound Buffer Video FrameBuffer Graphics Rendering & Navigation Module IP Unicast & Multicast

A/V Sender part of the VR-Conference Terminal G Encoder Datarate Controller RTP/RTCP Delivery Statistics IP Multicast Video Segmentation MP4-Video Encoder Audio Capture Video Capture GUI Windows Sockets 2 API RSVP SP ToS Marking