OFA OpenFabrics Interfaces Project Data Storage/Data Access subgroup October 2015 Summarizing NVM Usage Models for DS/DA.

Slides:



Advertisements
Similar presentations
Solid-state storage & DBMS CIDR 2013 Manos Athanassoulis 1.
Advertisements

Wrapping up the 10 th OFA Workshop #OFADevWorkshop.
Welcome to the 10 th OFA Workshop #OFADevWorkshop.
Manajemen Basis Data Pertemuan 2 Matakuliah: M0264/Manajemen Basis Data Tahun: 2008.
The SNIA NVM Programming Model
External Devices I/O Modules Programmed I/O Interrupt Driven I/O Direct Memory Access I/O Channels and Processors.
\\fs\share File Server SMB Direct Client Application NIC RDMA NIC TCP/ IP SMB Direct Ethernet and/or InfiniBand TCP/ IP Unchanged.
NVM Programming Model. 2 Emerging Persistent Memory Technologies Phase change memory Heat changes memory cells between crystalline and amorphous states.
New Direction Proposal: An OpenFabrics Framework for high-performance I/O apps OFA TAC, Key drivers: Sean Hefty, Paul Grun.
Discussing an I/O Framework SC13 - Denver. #OFADevWorkshop 2 The OpenFabrics Alliance has recently undertaken an effort to review the dominant paradigm.
Cloud based storage. Cloud Storage Storage accessed by a web service API It is a block storage, it exposes its storage to clients as Raw storage that.
Block I/O. 2 Definition Any I/O operation in which the unit of data is several words, not just one word or byte.
NVMe & Modern PC and CPU Architecture 1. Typical PC Layout (Intel) Northbridge ◦Memory controller hub ◦Obsolete in Sandy Bridge Southbridge ◦I/O controller.
Chapter 2 Introduction to OS Chien-Chung Shen CIS, UD
Compliance and Interoperability Discussion 11/25/2014 Paul Grun.
OpenFabrics Interface WG A brief introduction Paul Grun – co chair OFI WG Cray, Inc.
Local and Remote byte-addressable NVDIMM High-level Use Cases
OFA OpenFabrics Interfaces Project Data Storage/Data Access subgroup November 2015 Summarizing NVM Usage Models for DS/DA.
Tackling I/O Issues 1 David Race 16 March 2010.
Stan Smith Intel SSG/DPD June, 2015 Kernel Fabric Interface Kfabric Framework.
Packet processed storage in a software defined world Ash Young fd.io Foundation1.
OFA OpenFabrics Interfaces Project Data Storage/Data Access subgroup October 2015 Summarizing NVM Usage Models for DS/DA.
Canadian Bioinformatics Workshops
Advisor: Hung Shi-Hao Presenter: Chen Yu-Jen
CSE 451: Operating Systems Spring 2010 Module 12.5 Secondary Storage John Zahorjan Allen Center 534.
Welcome to Intro to Operating Systems Course Website:
Direct memory access Direct memory access (DMA) is a process in which an external device takes over the control of system bus from the CPU. DMA is for.
CHAPTER 1: Computers and Systems
Data Center Infrastructure
Cache Memory and Performance
Chapter 11: File System Implementation
Application Access to Persistent Memory – The State of the Nation(s)!
Database Management Systems (CS 564)
Using non-volatile memory (NVDIMM-N) as block storage in Windows Server 2016 Tobias Klima Program Manager.
Secondary Storage Data Retrieval.
Persistent Memory over Fabrics An Application-centric view
Persistent Memory over Fabrics
Chapter 2 Processes and Threads Today 2.1 Processes 2.2 Threads
Linux Pipes and FIFOs David Ferry, Chris Gill
HPE Persistent Memory Microsoft Ignite 2017
Input/Output 1 1.
Microsoft Build /12/2018 5:05 AM Using non-volatile memory (NVDIMM-N) as byte-addressable storage in Windows Server 2016 Tobias Klima Program Manager.
Ping-Sung Yeh, Te-Hao Hsu Conclusions Results Introduction
CS703 - Advanced Operating Systems
Local secondary storage (local disks)
GGF15 – Grids and Network Virtualization
SCSI over PCI Express (SOP) use cases
OPERATING SYSTEM OVERVIEW
Lecture 11: DMBS Internals
Enabling the NVMe™ CMB and PMR Ecosystem
T10/11-119r0 by Robert Elliott, HP 7 March 2011
PASTE: A Networking API for Non-Volatile Main Memory
OpenFabrics Alliance An Update for SSSI
CSE 451: Operating Systems Autumn 2003 Lecture 12 Secondary Storage
Integrating DPDK/SPDK with storage application
CSE 451: Operating Systems Spring 2006 Module 13 Secondary Storage
Outline Motivation and background Read Write
SOP: Tags, Size and scope
Figure 14.1 The modern integrated computer environment
CSE 451: Operating Systems Winter 2003 Lecture 12 Secondary Storage
CSE 451: Operating Systems Autumn 2004 Secondary Storage
CSE 451: Operating Systems Winter 2004 Module 13 Secondary Storage
АВЛИГАТАЙ ТЭМЦЭХ ҮНДЭСНИЙ ХӨТӨЛБӨР /танилцуулга/
Year 10 Computer Science Hardware - CPU and RAM.
Accelerating Applications with NVM Express™ Computational Storage 2019 NVMe™ Annual Members Meeting and Developer Day March 19, 2019 Prepared by Stephen.
NVMe.
Cache Memory and Performance
CS 295: Modern Systems Storage Technologies Introduction
Efficient Migration of Large-memory VMs Using Private Virtual Memory
Presentation transcript:

OFA OpenFabrics Interfaces Project Data Storage/Data Access subgroup October 2015 Summarizing NVM Usage Models for DS/DA

Objective 2 Objective of this slide deck is to dig down into these two

Motivation –NVM is seen as an important emerging technology of great importance to OFA members and the consumers of OFS –It is sufficiently unlike existing memory models to warrant a discussion of an API to access it –It will have a significant enough impact on how storage is architected, deployed, and accessed to warrant a discussion of NVM for storage, and an API to access it –Both ‘Data Storage’ and ‘Data Access’ are therefore potentially impacted by the emergence of NVM Hence, the initial look at NVM is being taken by the DS/DA subgroup A broader discussion with the main OFI WG is anticipated 3

Scope NVM as persistent memory NVM as storage Local access Remote access 4

Use cases summarized 5 Case 1local memory access 2local storage 3remote byte access 4remote block access 5remote file access 6remote object access 7remote memory access Does this one exist??

Cases 1,2 – typical local use cases 6 DIMMDIMM DIMMDIMM DIMMDIMM DIMMDIMM DIMMDIMM DIMMDIMM NVDIMMNVDIMM NVDIMMNVDIMM MCMC MCMC fs SSD block access* via e.g. NVMe memory MCMC MCMC NV DIMMNV DIMM NV DIMMNV DIMM NV DIMMNV DIMM NV DIMMNV DIMM NV DIMM NV DIMM NV DIMM NV DIMM NVDIMMNVDIMM NVDIMMNVDIMM I/O *f/s storage today is block storage, but in the future it may be some other access paradigm, e.g. byte level, object I/O

Cases 3,4,5,6 – typical remote I/O access 7 CPU SSD NIC CPU I/O device exports an object, file, block, or byte-addressable interface: LNET, iSER/NVMef/SRP SSD shared remote access I/O device NV DIMMNV DIMM NV DIMMNV DIMM NV DIMMNV DIMM NV DIMMNV DIMM NV DIMM NV DIMM NV DIMM NV DIMM NVDIMMNVDIMM NVDIMMNVDIMM client