Lustre at Dell Overview Jeffrey B. Layton, Ph.D. Dell HPC Solutions |

Slides:



Advertisements
Similar presentations
automated single login access to Novell storage resources
Advertisements

Intel® Manager for Lustre* Lustre Installation & Configuration
Planning Server Deployments
Windows Deployment Services WDS for Large Scale Enterprises and Small IT Shops Presented By: Ryan Drown Systems Administrator for Krannert.
VOCAL System Requirements and Scalability. System Recommendations The recommended hardware system to support the VOCAL system is: 700 MHz, Pentium III.
1© Copyright 2011 EMC Corporation. All rights reserved. EMC SQL Server Data Warehouse Fast Track Solutions Nov 30, 2011 Ling Wu, EMC.
Scale-out Central Store. Conventional Storage Verses Scale Out Clustered Storage Conventional Storage Scale Out Clustered Storage Faster……………………………………………….
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS PRIMERGY Servers and Windows Server® 2008 R2 Benefit from an efficient, high performance and flexible platform.
NWfs A ubiquitous, scalable content management system with grid enabled cross site data replication and active storage. R. Scott Studham.
Lesson 5-Accessing Networks. Overview Introduction to Windows XP Professional. Introduction to Novell Client. Introduction to Red Hat Linux workstation.
Technology Partner Nexenta and Dell #1 Software-Defined Storage and the #1 Server Platform combine to Power your Cloud Lower TCO. SSD/HDD/Hybrid. Any Protocol.
Oracle Database Administration. Rana Almurshed 2 course objective After completing this course you should be able to: install, create and administrate.
0 AdvOSS is a Canadian company and a developer and vendor of different high technology solutions for Communications Service Providers. 0 Target Markets.
Intel  modular server building blocks ( built on Intel  Multi-Flex Technology ) Intel  modular server building blocks ( built on Intel  Multi-Flex.
Upgrading the Platform - How to Get There!
IBM Storwize v3700 More performance. More efficiency. No compromises.
Grid Computing Veronique Anxolabehere Senior Director of Product Marketing Mike Margulies Senior Director, Grid Platform Solutions.
Understand what’s new for Windows File Server Understand considerations for building Windows NAS appliances Understand how to build a customized NAS experience.
© Copyright 2010 Hewlett-Packard Development Company, L.P. 1 HP + DDN = A WINNING PARTNERSHIP Systems architected by HP and DDN Full storage hardware and.
© 2009 IBM Corporation IBM Systems & Technology Group System x and BladeCenter® Why BladeCenter S SAN is the Right Choice Lowest cost, lowest complexity,
CLOUD COMPUTING 2.0 Finally, the promise of the cloud has arrived v 1.8.
Randy Diddel A+ Certified Technician Apple Certified Associate-Mac Integration OS X ITIL Foundations v3 Mac Team Technical Support Analyst II UNM IT Workstation.
Small File File Systems USC Jim Pepin. Level Setting  Small files are ‘normal’ for lots of people Metadata substitute (lots of image data are done this.
Module 1: Installing and Upgrading to Exchange Server 2003.
SIMPLE DOES NOT MEAN SLOW: PERFORMANCE BY WHAT MEASURE? 1 Customer experience & profit drive growth First flight: June, minute turn at the gate.
Corral: A Texas-scale repository for digital research data Chris Jordan Data Management and Collections Group Texas Advanced Computing Center.
Business Intelligence Appliance Powerful pay as you grow BI solutions with Engineered Systems.
An Introduction to Progress Arcade ™ June 12, 2013 Rob Straight Senior Manager, OpenEdge Product Management.
Copyright © Yokogawa Electric Corporation Release 2.10 Functionality Overview September 2004.
Cisco Confidential © 2010 Cisco and/or its affiliates. All rights reserved. 1 MSE Virtual Appliance Presenter Name: Patrick Nicholson.
JLab Scientific Computing: Theory HPC & Experimental Physics Thomas Jefferson National Accelerator Facility Newport News, VA Sandy Philpott.
SAN DIEGO SUPERCOMPUTER CENTER SDSC's Data Oasis Balanced performance and cost-effective Lustre file systems. Lustre User Group 2013 (LUG13) Rick Wagner.
P. Kuipers Nikhef Amsterdam Computer- Technology Nikhef Site Report Paul Kuipers
Bosch DSA Storage (based on NetApp E2700)
111 © 2003, Cisco Systems, Inc. All rights reserved. AttendantConsole_IP Launch_ © 2002, Cisco Systems, Inc. All rights reserved.
1 Panda Perimetral Management Console. 2 Panda Perimetral Management Console Centralized management from the cloud The Perimetral Console, short for Panda.
Terascala – Lustre for the Rest of Us  Delivering high performance, Lustre-based parallel storage appliances  Simplifies deployment, management and tuning.
High Performance Storage Solutions April 2010 Larry Jones VP, Product Marketing.
Dell Confidential Dell Database Solutions: SQL Server 2005 APR 2006.
Scientific Storage at FNAL Gerard Bernabeu Altayo Dmitry Litvintsev Gene Oleynik 14/10/2015.
“Big Storage, Little Budget” Kyle Hutson Adam Tygart Dan Andresen.
BlueWaters Storage Solution Michelle Butler NCSA January 19, 2016.
RMM / MDM Cloud Partner Training Series September 2015.
© Copyright 2015 EMC Corporation. All rights reserved. EMC Isilon Scale-out NAS For Syncplicity.
#SummitNow Alfresco Deployments on AWS Cost-Effective, Scalable & Secure Michael Waldrop Director, Solutions Engineering .
Planning Server Deployments Chapter 1. Server Deployment When planning a server deployment for a large enterprise network, the operating system edition.
IHEP Computing Center Site Report Gang Chen Computing Center Institute of High Energy Physics 2011 Spring Meeting.
Introduction to Data Analysis with R on HPC Texas Advanced Computing Center Feb
Bernd Panzer-Steindel CERN/IT/ADC1 Medium Term Issues for the Data Challenges.
Ravalli County, Montana Dell FluidF File Video & Archive Solution December 4, 2015.
Extreme Scale Infrastructure
E2800 Marco Deveronico All Flash or Hybrid system
Compute and Storage For the Farm at Jlab
Cloud readiness assessment
Lenovo – DataCore Deployment Ready Offerings
DSS-G Configuration Bill Luken – April 10th , 2017
The demonstration of Lustre in EAST data system
NEW Dell PowerEdge Tower Servers Dell PowerEdge Tower Servers
5X growth over 5 years Flash leadership Entry to Enterprise
CERN Lustre Evaluation and Storage Outlook
Installation and database instance essentials
USF Health Informatics Institute (HII)
HII Technical Infrastructure
PowerEdge Servers Our powerful, affordable network engines
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
NEW Dell PowerEdge Tower Servers Dell PowerEdge Tower Servers
PowerEdge Servers SPECIAL PROMO
Dana Kaufman SQL Server Appliance Engineering
Storage & Backup Solution Update
Dell PowerEdge Servers
Presentation transcript:

Lustre at Dell Overview Jeffrey B. Layton, Ph.D. Dell HPC Solutions | Confidential

Dell HPC Dell’s Approach to HPC Storage Flexibility – Flexibility in performance, scalability, price, and availability Dell is delivering solutions using two approaches: – Complete solutions - Fully vetted, tested, supported › Come with end-to-end support from Dell and partners › Detailed documentation including best practices, performance and sizing guidance › Deployment services if necessary – Roll-it-your-own › Dell creates technical whitepapers containing: – Recommended configurations – Details on configuration – Best practices and sizing guidance › Customer buys hardware and uses whitepapers as a reference guide › Limited or no Dell support or deployment services Confidential 2

Dell HPC Dell HPC Storage Solutions Positioning by Size and Workload 3 Confidential Scale Local data, Home directories Workstation Workgroup Department Super Computer NFS: Dell NSS Custom Solutions Application Data and Scratch Space * Conceptual, not to scale ~1 GB/s Division NFS: Dell NSS Scratch-Space: Dell | Terascala HSS Throughput Data Archiving

Dell HPC The DELL | Terascala HPC Storage Solution (DT-HSS3) Full Lustre solution, fully configured, tested, tuned, and deployed – On-site installation with client deployment and training included – Standard 3 years of support Redundant, highly available solution Simple, linear scalability – 3+ GB/s of throughput per base object solution (redundant), linearly scalable – Pre-defined configurations from 48TB to 336 TB in a single rack – (building blocks) – Configurations serve as building blocks for larger and faster solutions. Full management system with easy to use GUI including monitoring – Based on Dell iDRAC – Software/Firmware upgrade from tool Confidential 4 MetaData Server (MDS) Base OSS

Dell HPC DT-HSS3 Management Console Java based GUI console – Downloadable demo at Why a GUI? – Reduced complexity – Provides all file system administration interaction needed via button clicks – Commands issued to Lustre in the correct order – Single pane of glass to provide system overview and status updates for all components of the appliance – “At a glance” monitoring Confidential 5 Redundant Metadata Redundant Object 2 Controllers w/ 48TB 2 Expansions w/ 48TB

Dell HPC DT-HSS3: Pre-defined configurations 6 S M L Capacity (TB) XL (MDS) (OSS) Total U 16U20U24U32U40U30U38UCustom Raw Capacity 48TB96TB144TB240TB336TB192TB288TBCustom (PB+) Estimated Peak Performance 3+ GB/s 6+ GB/s Custom 3+ GB/s Redundant (HA) MDS and OSS! XS Professional Services for upgrades: Performance Capacity S-EP M-EP

Dell HPC DT-HSS3 Summary Full Redundancy (HA) in a Lustre Appliance Model – MDS and OSS Modular configurations – Scales in terms of capacity and performance – From 48TB’s to PB’s! – This includes 3 years of support and installation! Seven pre-defined configurations: – 4 of the 7 offerings are at or under $1/GB at capacity Confidential 7

Dell HPC 8 Confidential The Dell | Terascala HPC Storage Solution (DT-HSS3) Roll-it-Your-Own

Dell HPC Dell/Cambridge HPC Centre Run by Dr. Paul Caleja at Cambridge Lots of projects. For example: – Developing Lustre configurations/solutions along with whitepapers with all of the details. Lustre on Dell MD3000 storage – Active/Passive MDS › DRBD between two servers – Active/Active OSS with shared storage Confidential 9

Dell HPC Upcoming Dell/Cambridge Lustre Paper Update to paper Same basic configuration as before with some changes: – 6 Gbps SAS storage – More recent Dell servers with Intel processors – QDR InfiniBand Currently available as a technical bullentin Confidential 10

Dell HPC 11 Confidential Summary

Dell HPC Summary Flexibility – Flexibility in performance, scalability, price, and availability Dell follows two paths to HPC storage: – Complete solutions – Roll-it-your-own We have a range of storage solutions – NSS (NFS based storage) – HSS (fast-scratch) – HSM For Lustre based solutions: – Complete Solutions: DT|HSS-3 – Roll-it-your-own: Dell/Cambridge Solution Centre papers Confidential 12