DPDK API and Virtual Infrastructure

Slides:



Advertisements
Similar presentations
Getting Traffic to your Cluster. Where to Tap WAN or Internal – WAN Detect intrusion attempts and out-bound misbehavior – Internal Detect internal-internal.
Advertisements

Virtual Machine Technology Dr. Gregor von Laszewski Dr. Lizhe Wang.
Virtualization and Cloud Computing
Keith Wiles DPACC vNF Overview and Proposed methods Keith Wiles – v0.5.
Accelerating the Path to the Guest
Network Implementation for Xen and KVM Class project for E : Network System Design and Implantation 12 Apr 2010 Kangkook Jee (kj2181)
Virtualization for Cloud Computing
Making the Virtualization Decision. Agenda The Virtualization Umbrella Server Virtualization Architectures The Players Getting Started.
Benefits: Increased server utilization Reduced IT TCO Improved IT agility.
Improving Network I/O Virtualization for Cloud Computing.
VIRTUAL SWITCH/ROUTER BENCHMARKING Muhammad Durrani Ramki Krishnan Brocade Communications Sarah Banks Akamai 1 © 2013 Brocade Communications Systems, Inc.
 Virtual machine systems: simulators for multiple copies of a machine on itself.  Virtual machine (VM): the simulated machine.  Virtual machine monitor.
High Performance Network Virtualization with SR-IOV By Yaozu Dong et al. Published in HPCA 2010.
Hyper-V Performance, Scale & Architecture Changes Benjamin Armstrong Senior Program Manager Lead Microsoft Corporation VIR413.
SECURING SELF-VIRTUALIZING ETHERNET DEVICES IGOR SMOLYAR, MULI BEN-YEHUDA, AND DAN TSAFRIR PRESENTED BY LUREN WANG.
Full and Para Virtualization
DPACC Management Aspects
Network Virtualization Sandip Chakraborty. In routing table we keep both the next hop IP (gateway) as well as the default interface. Why do we require.
Cloud Computing – UNIT - II. VIRTUALIZATION Virtualization Hiding the reality The mantra of smart computing is to intelligently hide the reality Binary->
| Basel Fabric Management with Virtual Machine Manager Philipp Witschi – Cloud Architect & Microsoft vTSP Thomas Maurer – Cloud Architect & Microsoft MVP.
Figure A: From Openstack Nomad. Figure B: From Gap on OpenStack ① ① ④ ④.
E Virtual Machines Lecture 5 Network Virtualization Scott Devine VMware, Inc.
Unit 2 VIRTUALISATION. Unit 2 - Syllabus Basics of Virtualization Types of Virtualization Implementation Levels of Virtualization Virtualization Structures.
Atrium Router Project Proposal Subhas Mondal, Manoj Nair, Subhash Singh.
Opnfv Summit 2016 (Berlin) DPACC and DPDK solving NFV acceleration
Virtualization Overview Date: 8/7/2012 SCF-FEF-SSS Author: Tyler Parsons.
Lecture 15: IO Virtualization
Instructor Materials Chapter 7: Network Evolution
Virtualization for Cloud Computing
New Approach to OVS Datapath Performance
Virtualization D. J. Foreman 2009.
BESS: A Virtual Switch Tailored for NFV
Is Virtualization ready for End-to-End Application Performance?
SR-IOV Hands-on Lab Rahul Shah Clayne Robison.
Why VT-d Direct memory access (DMA) is a method that allows an input/output (I/O) device to send or receive data directly to or from the main memory, bypassing.
L2- Virtualization Technology
Current Generation Hypervisor Type 1 Type 2.
Virtualization Dr. Michael L. Collard
Legal Notices and Disclaimers
Chapter 4: Routing Concepts
Java Win32 native Java VM Linux OS ARM VM Runtime Windows OS
Are You Insured Against Your Noisy Neighbor - A VSPERF Use Case
Virtualization overview
Multi-PCIe socket network device
Networking overview Sujata
ONOS Drake Release September 2015.
OS Virtualization.
Virtio Inline Accelerator
DPACC Management Aspects
Virtualization Layer Virtual Hardware Virtual Networking
Virtualization Techniques
Virtio Keith Wiles July 11, 2016.
vDPA for Vhost Acceleration
Open vSwitch HW offload over DPDK
Virtio/Vhost Status Quo and Near-term Plan
Accelerate Vhost with vDPA
Multiple vDPI Functions using DPDK and Hyperscan on OVS-DPDK Platform
Reprogrammable packet processing pipeline
All or Nothing The Challenge of Hardware Offload
Virtual machines benefits
CSE 451: Operating Systems Autumn Module 24 Virtual Machine Monitors
Enrich your NIC's capabilities with DPDK Soft NIC
CSE 451: Operating Systems Autumn Module 24 Virtual Machine Monitors
Flow Processing for Fast Path & Inline Acceleration
Platform Performance Acceleration
Latest Update DPACC Use-cases
Interrupt Message Store
Figure 3-2 VIM-NFVI acceleration management architecture
Openstack Summit November 2017
Presentation transcript:

DPDK API and Virtual Infrastructure Rashmin Patel

API Package Drivers for Virtual Machine Enhancements Poll Mode Drivers (PMD) for Emulated, Para-virtual, HW Virtualized NIC interfaces Drivers for Virtual Machine Monitor Enhancements Poll Mode Drivers (PMD) for Multi Vendor NICs Vhost Lib for Virtio Backend API/HW to monitor/allocate platform resources Intel® RDT – CMT, CAT, MBM API/Driver for Crypto devices Intel® QAT, AESNI

VMM / Hypervisor Support * driver patch available

Examples using APIs DPDK App Examples useful depending on the Platform SW Architecture VM App with Physical Device VM App with Virtual Device (SRIOV) VM App with Emulated Device VM App with Para-virtual Device VM App with Shared Memory Device VMM/Host App with Physical/ SRIOV-VF (for PV devices) and Backend (for EPS devices) PV – All SRIOV/non-SRIOV PCI Function for real NIC (e.g. igb, ixgbe, i40e, fm10k, mlx4, mlx5,…) EPS – All SW interfaces for virtual devices (e.g. Emulated e1000, Virtio, Vmxnet3, ENI…) Bond QoS Sched Link Status Interrupt L3fwd Load Balancer KNI IPv4 Multicast L2fwd Keep Alive Packet Distrib IP Pipeline Hello World Exception Path L2fwd Jobstats L2fwd IVSHMEM Timer IP Reass VMDq DCB PTP Client Packet Ordering CLI DPDK Multi Process Ethtool L3fwd VF IP Frag QoS Meter L2fwd Perf Thread L2fwd Crypto RxTx Callbacks Quota & W’mark Skeleton TEP Term Vhost VM Power Manager VMDq L3fwd Power L3fwd ACL Netmap Vhost Xen QAT L2fwd CAT IPsec Sec GW

Usage with HW Switch/Distributor Single Root I/O Virtualization (SRIOV) enabled – Split NIC resources into equal portions Each portion can be exposed to a VM in the form of a PCI Function for separate programming – Virtual Function (VF) Global NIC resources, VEB and L2 Filters programmed by a special PCI Function – Physical Function (PF) in control of VMM/Host-OS Virtual Function provides near Native I/O performance in VM using Intel® VT-d Network Traffic sorted out to multiple VFs/VMs at the NIC-VEB in the first place

compatible with Containers/VMs DPDK Virtualization Driver suite compatible with various compute instances from Containers to Clear Containers to VMs Depending Public/Private deployment choices, various viable use-cases possible SRIOV VF Devices as well as Virtio Devices support/ patches exist for developers to hack around a truly open source NFVi platform Advanced NICs with various modes of filters available/ planned for advanced packet processing on IA

Usage with SW Switch/Distributor Software Switch running in Host receives all the NICs’ traffic Flow Table or Simple Filtering Rules programmed in SW for packet forwarding Depending on the complexity and feature set support, the aggregate packet forwarding performance varies Packets forwarded to VMs using various Emulated, Para-virtual or Shared memory devices available in mainstream Hypervisors and Emulators For accelerated performance in VM, DPDK offers Poll Mode Drivers for the Virtual Interfaces available to VM Network Traffic sorted out to multiple VIFs/VMs at the SW Switch/OVS in the first place

Questions..!? Sessions coming up… OVS-DPDK as a usage of DPDK with SW Switch/Distributor SRIOV-VF as a usage of DPDK with HW Switch/Distributor DPDK Performance Analysis with VTune Amplifier DPDK Performance Benchmarking DPDK Hashing Algo. Support