Presentation is loading. Please wait.

Presentation is loading. Please wait.

©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Network Level Framing in INSTANCE Pål Halvorsen, Thomas Plagemann, and Vera Goebel University of Oslo,

Published byJulissa Towse Modified over 10 years ago

Similar presentations

Presentation on theme: "©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Network Level Framing in INSTANCE Pål Halvorsen, Thomas Plagemann, and Vera Goebel University of Oslo,"— Presentation transcript:

1 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Network Level Framing in INSTANCE Pål Halvorsen, Thomas Plagemann, and Vera Goebel University of Oslo, UniK- Center for Technology at Kjeller Norway Overview: Application Scenario The INSTANCE project: –Zero-Copy-One-Copy Memory Architecture –Integrated Error Management –Network Level Framing Conclusions

2 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Media-on-Demand server: Applicable in applications like News- or Video-on-Demand provided by city-wide cable or pay-per-view companies Application Scenario Network Multimedia Storage Server Project goals: Optimize performance within a single server: Reduce resource requirements Maximize number of clients Retrieval is the bottleneck: Some important factors: Memory management Error management Communication protocol processing

3 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Zero-Copy-One-Copy I Zero-CopyDelay-Minimized Broadcast

4 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Zero-Copy-One-Copy II Integrated Zero-Copy and Delay-Minimized Broadcasting Zero-CopyDelay-Minimized Broadcast

5 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Traditional Error Management Encoder Decoder

6 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Integrated Error Management Encoder Decoder

7 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Traditional Storage TRANSPORT NETWORK LINK TRANSPORT NETWORK LINK TRANSPORT NETWORK LINK TRANSPORT NETWORK LINK Upload to server Frequency: low (1) Download from server Frequency: very high

8 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Network Level Framing (NLF) TRANSPORT NETWORK LINK TRANSPORT NETWORK LINK NETWORK LINK NETWORK LINK TRANSPORT Upload to server Frequency: low (1) Download from server Frequency: very high

9 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 NLF: When to Store Packets IP Transport Layer Network Layer Link Layer IP UDP IP TCP IP TCP IP UDP IP

10 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 NLF: Splitting the UDP Protocol UDP IP UDP Prepend UDP and IP headers Prepare pseudo header for checksum Calculate checksum Fill in some other IP header fields Hand over datagram to IP udp_output() Temporarily connect Disconnect connected socket udp_output() Prepend UDP and IP headers Prepare pseudo header for checksum, clear unknown fields Prealculate checksum udp_PreOut() Update UDP and IP headers Update checksum, i.e., only add checksum of prior unknown fields Fill in other IP header fields Hand over datagram to IP udp_QuickOut() UDP IP UDP IP UDP IP UDP IP UDP

11 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 NLF: Checksum Operations I The UDP checksum covers three fields: –A 12 byte pseudo header containg fields from the IP header –The 8 byte UDP header –The UDP data Checksum calculation function ( in_cksum ): u_16int_t *w; for each mbuf in packet { w = mbuf->m_data; while data in mbuf { checksum += w; w++; }

12 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 NLF: Checksum Operations II Traditional checksum operation:

13 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 NLF: Checksum Operations III NLF checksum operation:

14 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 FEC Integrated Error Management and NLF UDP - PreOut Network UDP - QuickOut UDP - Input

15 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Expected Performance Gain Traditionally, 60% of the UDP/IP processing is spent on checksum calculation [Kay et al. 93] Performance gain using NLF (packet size dependent): –The checksum operation is greatly reduced E.g., 4KB packet size  checksum operation on only 0.2% of data Speed-up factor of about 2 –Throughput gain of about 10%

16 ©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Conclusion The INSTANCE project aims at optimizing the data retrieval in an MoD server: –Zero-Copy-One-Copy memory architecture –Integrated Error Management –Network Level Framing  Saving time for checksum calculation where expected performance gain is: –About 99% reduction of the checksum calculation time (UDP/IP processing speed-up of 2) –About 10% increase in throughput –Future work

Download ppt "©2000 Pål HalvorsenMIS 2000, Chicago, October 2000 Network Level Framing in INSTANCE Pål Halvorsen, Thomas Plagemann, and Vera Goebel University of Oslo,"

Similar presentations

Streaming Video over the Internet

Streaming Video over the Internet
Assessment of Data Path Implementations for Download and Streaming Pål Halvorsen 1,2, Tom Anders Dalseng 1 and Carsten Griwodz 1,2 1 Department of Informatics,

Assessment of Data Path Implementations for Download and Streaming Pål Halvorsen 1,2, Tom Anders Dalseng 1 and Carsten Griwodz 1,2 1 Department of Informatics,
Ch. 2 Protocol Architecture. 2.1 The Need for a Protocol Architecture Same set of layered functions need to exist in the two communicating systems. Key.

Ch. 2 Protocol Architecture. 2.1 The Need for a Protocol Architecture Same set of layered functions need to exist in the two communicating systems. Key.
Transport Layer3-1 Transport Overview and UDP. Transport Layer3-2 Goals r Understand transport services m Multiplexing and Demultiplexing m Reliable data.

Transport Layer3-1 Transport Overview and UDP. Transport Layer3-2 Goals r Understand transport services m Multiplexing and Demultiplexing m Reliable data.
Network Layer – IPv4 Dr. Sanjay P. Ahuja, Ph.D.

Network Layer – IPv4 Dr. Sanjay P. Ahuja, Ph.D.
Umut Girit 200535027.  One of the core members of the Internet Protocol Suite, the set of network protocols used for the Internet. With UDP, computer.

Umut Girit  One of the core members of the Internet Protocol Suite, the set of network protocols used for the Internet. With UDP, computer.
Improving Communication Quality with Reed Solomon Code in Internet Voice Broadcasting System Shingo Kashima Kyushu University, Japan Asia-Pacific Advanced.

Improving Communication Quality with Reed Solomon Code in Internet Voice Broadcasting System Shingo Kashima Kyushu University, Japan Asia-Pacific Advanced.
1 Chapter 6 Datagram Delivery by UDP Just as the Internet Protocol uses the services of subnetworks, transport protocols build upon the services of IP.

1 Chapter 6 Datagram Delivery by UDP Just as the Internet Protocol uses the services of subnetworks, transport protocols build upon the services of IP.
UDP - User Datagram Protocol UDP – User Datagram Protocol Author : Nir Shafrir Reference The TCP/IP Guide - (http://www.TCPIPGuide.com) Version 3.0 - Version.

UDP - User Datagram Protocol UDP – User Datagram Protocol Author : Nir Shafrir Reference The TCP/IP Guide - ( Version Version.
TCP/IP: the transport layer Skills: none IT concepts: layered protocols, transport layer functions, TCP and UDP protocols, isochronous applications This.

TCP/IP: the transport layer Skills: none IT concepts: layered protocols, transport layer functions, TCP and UDP protocols, isochronous applications This.
TCP/IP summary Skills: none IT concepts: review This work is licensed under a Creative Commons Attribution-Noncommercial- Share Alike 3.0 License.

TCP/IP summary Skills: none IT concepts: review This work is licensed under a Creative Commons Attribution-Noncommercial- Share Alike 3.0 License.
ECE Department: University of Massachusetts, Amherst ECE 354 Spring 2009 Lab 3: Transmitting and Receiving Ethernet Packets.

ECE Department: University of Massachusetts, Amherst ECE 354 Spring 2009 Lab 3: Transmitting and Receiving Ethernet Packets.
McGraw-Hill©The McGraw-Hill Companies, Inc., 2004 Application Layer PART VI.

McGraw-Hill©The McGraw-Hill Companies, Inc., 2004 Application Layer PART VI.
Understanding Networks. Objectives Compare client and network operating systems Learn about local area network technologies, including Ethernet, Token.

Understanding Networks. Objectives Compare client and network operating systems Learn about local area network technologies, including Ethernet, Token.
Modularity and Costs Greg Busby Computer Science 614 March 26, 2002.

Modularity and Costs Greg Busby Computer Science 614 March 26, 2002.
UDP© Dr. Ayman Abdel-Hamid, CS4254 Spring 20061 CS4254 Computer Network Architecture and Programming Dr. Ayman A. Abdel-Hamid Computer Science Department.

UDP© Dr. Ayman Abdel-Hamid, CS4254 Spring CS4254 Computer Network Architecture and Programming Dr. Ayman A. Abdel-Hamid Computer Science Department.
Process-to-Process Delivery:

Process-to-Process Delivery:
Module 1: Reviewing the Suite of TCP/IP Protocols.

Module 1: Reviewing the Suite of TCP/IP Protocols.
CS 218 F 2003 Nov 3 lecture:  Streaming video/audio  Adaptive encoding (eg, layered encoding)  TCP friendliness References: r J. Padhye, V.Firoiu, D.

CS 218 F 2003 Nov 3 lecture:  Streaming video/audio  Adaptive encoding (eg, layered encoding)  TCP friendliness References: r J. Padhye, V.Firoiu, D.
TRANSPORT LAYER T.Najah Al-Subaie Kingdom of Saudi Arabia Prince Norah bint Abdul Rahman University College of Computer Since and Information System NET331.

TRANSPORT LAYER T.Najah Al-Subaie Kingdom of Saudi Arabia Prince Norah bint Abdul Rahman University College of Computer Since and Information System NET331.

Similar presentations

Ads by Google