Forward-Looking Statements

Slides:



Advertisements
Similar presentations
Virtualisation From the Bottom Up From storage to application.
Advertisements

Snapshots in a Flash with ioSnap TM Sriram Subramanian, Swami Sundararaman, Nisha Talagala, Andrea Arpaci-Dusseau, Remzi Arpaci-Dusseau Copyright © 2014.
Myoungsoo Jung (UT Dallas) Mahmut Kandemir (PSU)
Priority Research Direction (I/O Models, Abstractions and Software) Key challenges What will you do to address the challenges? – Develop newer I/O models.
Intel’s Solid-State Drives Knut Grimsrud Intel Fellow, Director of Storage Architecture.
File Management Chapter 12. File Management A file is a named entity used to save results from a program or provide data to a program. Access control.
Challenges for NOAA in Integrating Earth Observations Vice Admiral Conrad C. Lautenbacher, Jr., U.S. Navy (Ret.) Under Secretary of Commerce for Oceans.
Changing the Economics of Innovation
Application Models for utility computing Ulrich (Uli) Homann Chief Architect Microsoft Enterprise Services.
Chapter 13 Embedded Systems
CS4315A. Berrached:CMS:UHD1 Operating System Structures Chapter 3.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Hystor : Making the Best Use of Solid State Drivers in High Performance Storage Systems Presenter : Dong Chang.
Solid State Drive Feb 15. NAND Flash Memory Main storage component of Solid State Drive (SSD) USB Drive, cell phone, touch pad…
1© Copyright 2013 EMC Corporation. All rights reserved. EMC and Microsoft SharePoint Server Performance Name Title Date.
Private Cloud: Application Transformation Business Priorities Presentation.
COnvergence of fixed and Mobile BrOadband access/aggregation networks Work programme topic: ICT Future Networks Type of project: Large scale integrating.
Module 10 Configuring and Managing Storage Technologies.
Logging in Flash-based Database Systems Lu Zeping
Title Slide – Option 1. Title Slide – Option 2 Insert Text.
Firmware Storage : Technical Overview Copyright © Intel Corporation Intel Corporation Software and Services Group.
UNIX File and Directory Caching How UNIX Optimizes File System Performance and Presents Data to User Processes Using a Virtual File System.
During the course of this meeting, we may make projections or other forward- looking statements regarding future events or the future financial performance.
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
File management and Performance. File Systems Architecture device drivers physical I/O (PIOCS) logical I/O (LIOCS) access methods File organization and.
연세대학교 Yonsei University Data Processing Systems for Solid State Drive Yonsei University Mincheol Shin
A Lightweight Transactional Design in Flash-based SSDs to Support Flexible Transactions Youyou Lu 1, Jiwu Shu 1, Jia Guo 1, Shuai Li 1, Onur Mutlu 2 LightTx:
XIP – eXecute In Place Jiyong Park. 2 Contents Flash Memory How to Use Flash Memory Flash Translation Layers (Traditional) JFFS JFFS2 eXecute.
Under the Hood with NVMe over Fabrics
Copyright © 2010 Hitachi Data Systems. All rights reserved. Confidential – NDA Strictly Required Hitachi Storage Solutions Hitachi HDD Directions HDD Actual.
This courseware is copyrighted © 2016 gtslearning. No part of this courseware or any training material supplied by gtslearning International Limited to.
© 2009 Autodesk Autodesk Corporate Overview May 2009.
IDC Says, "Don't Move To The Cloud" Richard Whitehead Director, Intelligent Workload Management August, 2010 Ben Goodman Principal.
Internal Parallelism of Flash Memory-Based Solid-State Drives
CASTOR: possible evolution into the LHC era
COS 518: Advanced Computer Systems Lecture 8 Michael Freedman
CS 540 Database Management Systems
Organizations Are Embracing New Opportunities
CS427 Multicore Architecture and Parallel Computing
Database Management Systems (CS 564)
Using non-volatile memory (NVDIMM-N) as block storage in Windows Server 2016 Tobias Klima Program Manager.
HPE Persistent Memory Microsoft Ignite 2017
Ping-Sung Yeh, Te-Hao Hsu Conclusions Results Introduction
Operating Systems ECE344 Lecture 11: SSD Ding Yuan
Jiang Zhou, Wei Xie, Dong Dai, and Yong Chen
Real IBM C exam questions and answers
Repairing Write Performance on Flash Devices
Rob Davis, Mellanox Ilker Cebeli, Samsung
COS 518: Advanced Computer Systems Lecture 8 Michael Freedman
Btrfs Filesystem Chris Mason.
Corporate Overview Presentation Center:
Chap. 12 Memory Organization
PARAMETER-AWARE I/O MANAGEMENT FOR SOLID STATE DISKS
Specialized Cloud Architectures
Parallel Garbage Collection in Solid State Drives (SSDs)
Infosys Investor Relations © Infosys Technologies Limited
Device Mgmt © 2004, D. J. Foreman.
4Q 2018 Earnings Presentation
Device Mgmt © 2004, D. J. Foreman.
Open Source Activity Showcase Computational Storage SNIA SwordfishTM
NVMe.
COS 518: Advanced Computer Systems Lecture 9 Michael Freedman
Microsoft Virtual Academy
© 2016 Global Market Insights, Inc. USA. All Rights Reserved Ethernet Storage Market Size Growth During Forecast Period.
Factors Driving Enterprise NVMeTM Growth
Standardizing Zones Across the Storage Ecosystem
Endurance Group Management: Host control of SSD Media Organization
Introduction to Operating Systems
Mario open Ethernet drive architecture Introducing a new technology from HGST Mario Blandini
Efficient Migration of Large-memory VMs Using Private Virtual Memory
Presentation transcript:

From Open-Channel SSDs to Zoned Namespaces Matias Bjørling, Director, Western Digital

Forward-Looking Statements Safe Harbor | Disclaimers This presentation contains forward-looking statements that involve risks and uncertainties, including, but not limited to, statements regarding our solid-state technologies, product development efforts, software development and potential contributions, growth opportunities, and demand and market trends. Forward-looking statements should not be read as a guarantee of future performance or results, and will not necessarily be accurate indications of the times at, or by, which such performance or results will be achieved, if at all. Forward-looking statements are subject to risks and uncertainties that could cause actual performance or results to differ materially from those expressed in or suggested by the forward-looking statements. Key risks and uncertainties include volatility in global economic conditions, business conditions and growth in the storage ecosystem, impact of competitive products and pricing, market acceptance and cost of commodity materials and specialized product components, actions by competitors, unexpected advances in competing technologies, difficulties or delays in manufacturing, and other risks and uncertainties listed in the company’s filings with the Securities and Exchange Commission (the “SEC”) and available on the SEC’s website at www.sec.gov, including our most recently filed periodic report, to which your attention is directed. We do not undertake any obligation to publicly update or revise any forward-looking statement, whether as a result of new information, future developments or otherwise, except as required by law.

Open-Channel SSDs I/O Isolation Predictable Latency Data Placement & I/O Scheduling I/O Isolation - Provide isolation between tenants by allocating independent parallel units I/O Predictability - I/Os are synchronous. Host-assisted GC and Wear-leveling Host-controlled data placement and I/O scheduling Manage the non-volatile memory as a block device, through a file-system or inside your application.

Ubiquitous Workloads Efficiency of the Cloud requires many different workloads to a single SSD Databases Sensors Analytics Virtualization Video Main point. All these types of workloads goes into the same SSD Solid-State Drive

Open-Channel Concepts Chunks Write sequentially within an LBA range Requires reset for rewrites Borrows from HDD’s SMR specification (ZAC/ZBC) Optimized for SSD physical constraints Align writes to media layout Parallel Units Host can direct workloads to separate parallel units Stripes across single or multiple dies. The parallel units inherits the throughput and latency characteristics of the underlying media Served by I/O determinism (NVMeTM Next) Disk LBA range divided in chunks Chunk 0 Chunk 1 Chunk 2 Chunk 3 Chunk X

Key concepts to be introduced into the NVMeTM specification Industry Adoption Hyper-scalers, all-flash array vendors, and large storage system vendors that have been considering or uses Open-Channel SSD architectures can now benefit from standardization and a broader eco-system. Key concepts to be introduced into the NVMeTM specification

Zoned Namespaces (ZNS) Under Standardization Zoned Namespaces (ZNS) Technical Proposal in the NVMeTM working group Standardizes zone interface as an approach to: Reduce device-side write amplification Reduce over-provisioning “Note that excessive over-provisioning is similar to early replacement -- in both cases you buy more devices.” - Mark Callaghan, Facebook Reduce DRAM in SSDs Highest cost after NAND itself Improve latency outliers and throughput Less device-side data movement Tail at scale Enable software eco-system. Everyone benefits from improvements!

Zoned Namespaces similar to ZBC/ZAC for SMR HDDs Disk LBA range divided in zones Storage capacity is divided into zones Each zone is written sequentially Interface optimized for SSDs Align with media characteristics Zone 0 Zone 1 Zone 2 Zone 3 Zone X Write commands advance the write pointer Write pointer position Reset write pointer commands rewind the write pointer

Zone Information Zone State Zone Reset Zone Size & Zone Capacity Empty, Implicitly Opened, Explicitly Opened, Closed, Full, Read Only, Offline Empty -> Open -> Full -> Empty -> …. Zone Reset Full -> Empty Zone Size & Zone Capacity Zone Size is fixed Zone Capacity is the writeable area within a zone Zone Size (e.g., 512MB) Zone X - 1 Zone X Zone X + 1 Zone Start LBA Zone Capacity (E.g., 500MB)

Zone Append Low scalability on multiple writers to a zone Write Queue Depth per Zone = 1 IOPS: 80K vs 880K on Qemu and 300K vs 1400K on bare metal ZAC/ZBC requires strict write ordering Limits write performance and increases host overhead Big challenge with software eco-system, HBAs, etc. Introducing Zone Append Append data to a zone without defining offset Drive returns where data was written in the zone Zone Lock Contention

Zone Write Example Host takes on the overhead of serializing I/Os. 3x Writes (4K, 8K, 16K) – Queue Depth = 1 4K Write0 16K Write2 8K Write1 Host takes on the overhead of serializing I/Os. Insignificant when using HDDs Significant when using SSDs Zone WP WP WP WP Zone Queue Depth = 1 Only one Write outstanding per zone

Zone Append Example Zone Zone 3x Writes (4K, 8K, 16K) – Queue Depth = 3 4K Write0 8K Write0 16K Write2 16K Write2 Drive takes on the overhead of serializing I/Os. Scalable for both HDDs and SSDs. 8K Write1 4K Write1 Zone Zone WP WP WP WP WP WP WP WP Zone Queue Depth >= 1 Multiple writes outstanding per zone

ZNS: Synergy w/ ZAC/ZBC software ecosystem Reuse existing work from SMR Existing ZAC/ZBC-aware file systems & device mappers “just work” Few changes to support to ZNS Tight integration with file-systems/applications No host-side FTL No 1GB DRAM per 1TB Media requirement Code for ZAC/ZBC is in production at technology adopters and broadly available in the Linux® eco-system. User Space Applications util-linux fio libzbc blktests Linux Kernel Regular File-Systems (xfs) File-System with SMR Support (f2fs, btrfs) Logical Block Device (dm-zoned) Block Layer SCSI/ATA NVMe SMR HDD ZBC/ZAC ZNS SSD *= Enhanced data paths for SMR drives

ZNS Support in Linux Zone Size = 1GB Shows up as a host-managed Zoned Block Device Zone Size = 1GB 2097152 (512B Logical Block) Zone Size = 1GB 0x200000/2097152 (512B Logical block size)

Zone Information List of zones including metadata

File-system Integration The File-System is the “FTL” – Manages mapping table, OP, and GC strategy. ZNS SSD Applications File-System with Zone Support (f2fs) User Space Linux Kernel Block Layer NVMe Device Driver util-linux fio blktests

Format f2fs file-system

Read and Write with from f2fs with an ZNS drive

Western Digital and the Western Digital log are registered trademarks or trademarks of Western Digital Corporation or its affiliates in the US and/or other countries. Linux® is the registered trademark of Linus Torvalds in the U.S. and other countries. All other marks are the property of their respective owners.