© 2007 DataDirect Networks, Inc. All Rights Reserved. Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space.

Slides:



Advertisements
Similar presentations
MARCO TECHNOLOGY SEMINAR Sponsored By:. 2:15-2:30 p.m. Registration and Welcome 2:30-4:30 p.m.Cisco Networking, Video and Data Center 4:30-5:15 p.m. EMC.
Advertisements

1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.
JBOD storage Server Message Block (SMB) PowerShell & SCVMM 2012 R2 Management Scale-out file server clusters Storage Space Hyper-V clusters.
IDC HPC User Forum Conference Appro Product Update Anthony Kenisky, VP of Sales.
Improving Networks Worldwide. UNH InterOperability Lab Serial Advanced Technology Attachment (SATA) Use Cases.
NWfs A ubiquitous, scalable content management system with grid enabled cross site data replication and active storage. R. Scott Studham.
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice HP StorageWorks LeftHand update Marcus.
Emerging Storage Options for Server Blade Architectures Server Blade Summit 2005.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Product Manager Networking Infrastructure Choices for Storage.
“Better together” PowerVault virtualization solutions
UNH InterOperability Lab Serial Advanced Technology Attachment (SATA) Use Cases.
© Hitachi Data Systems Corporation All rights reserved. 1 1 Det går pænt stærkt! Tony Franck Senior Solution Manager.
IBM Storwize v3700 More performance. More efficiency. No compromises.
IBM TotalStorage ® IBM logo must not be moved, added to, or altered in any way. © 2007 IBM Corporation Break through with IBM TotalStorage Business Continuity.
1© Copyright 2011 EMC Corporation. All rights reserved. EMC Data Domain and F5 Networks Seamlessly Integrating Deduplicated Storage into a Tiered Storage.
1 © Copyright 2009 EMC Corporation. All rights reserved. Agenda Storing More Efficiently  Storage Consolidation  Tiered Storage  Storing More Intelligently.
© 2013 Mellanox Technologies 1 NoSQL DB Benchmarking with high performance Networking solutions WBDB, Xian, July 2013.
Object-based Storage Long Liu Outline Why do we need object based storage? What is object based storage? How to take advantage of it? What's.
Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.
© Copyright 2010 Hewlett-Packard Development Company, L.P. 1 HP + DDN = A WINNING PARTNERSHIP Systems architected by HP and DDN Full storage hardware and.
Challenges of Storage in an Elastic Infrastructure. May 9, 2014 Farid Yavari, Storage Solutions Architect and Technologist.
SGI Proprietary SGI Update IDC HPC User Forum September, 2008.
ISDMR:BEIT VIII: CHAP2:MADHU N 1 ISM - Course Organization.
The Industry’s only Unified Flash + Flash Hybrid Storage with Inline De-Duplication Hard Disk at the Speed of Flash.
Small File File Systems USC Jim Pepin. Level Setting  Small files are ‘normal’ for lots of people Metadata substitute (lots of image data are done this.
1 © 2010 Overland Storage, Inc. © 2012 Overland Storage, Inc. Overland Storage The Storage Conundrum Neil Cogger Pre-Sales Manager.
Storage Systems Market Analysis Dec 04. Storage Market & Technologies.
Tag line, tag line NetApp HPC Update 28 th HPC User Forum April 2008 Norfolk, Virginia.
Taking the Complexity out of Cluster Computing Vendor Update HPC User Forum Arend Dittmer Director Product Management HPC April,
Storage Tank in Data Grid Shin, SangYong(syshin, #6468) IBM Grid Computing August 23, 2003.
Hosted by Disk Cost Busters “How to Leverage Low Cost Disk Solutions” Ron Lovell, Practice Director, Storage Greenwich Technology Partners.
Switched Storage Architecture Benefits Computer Measurements Group November 14 th, 2002 Yves Coderre.
Large Scale Parallel File System and Cluster Management ICT, CAS.
Introducing ULTAMUS TM RAID. The Need for Storage Immediate Accessibility Limited IT Staff Budget Constraints Data Growth Security Levels Retention Characteristics.
1 © Copyright 2011 EMC Corporation. All rights reserved. BIG DATA & Storage Automation George Kokkinakis Enterprise Account Manager.
Chapter 12 – Mass Storage Structures (Pgs )
© 2010 DataDirect Networks. Confidential Information D D N D E L I V E R S DataDirect Networks Update Mike Barry, HPC Sales April IDC HPC User Forum.
Next Generation Operating Systems Zeljko Susnjar, Cisco CTG June 2015.
Bosch DSA Storage (based on NetApp E2700)
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Implementation of a reliable and expandable on-line storage for compute clusters Jos van Wezel.
High Performance Storage Solutions April 2010 Larry Jones VP, Product Marketing.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Update IDC HPC Forum.
Rick Claus Sr. Technical Evangelist,
IBM Systems and Technology Group © 2009 IBM Corporation IBM System Storage – Tape Part 1 This document is for IBM and IBM Business Partner use only. It.
STORAGE ARCHITECTURE/ MASTER): Disk Storage: What Are Your Options? Randy Kerns Senior Partner The Evaluator Group.
SATA In Enterprise Storage Ron Engelbrecht Vice President and General Manager Engineering and Manufacturing Operations September 21, 2004.
Tackling I/O Issues 1 David Race 16 March 2010.
Pathway to Petaflops A vendor contribution Philippe Trautmann Business Development Manager HPC & Grid Global Education, Government & Healthcare.
© 2011 DataDirect Networks. All rights reserved. | NDA Confidential Information. DataDirect Networks Lustre User Group 2011 Update.
Copyright © 2010 Hitachi Data Systems. All rights reserved. Confidential – NDA Strictly Required Hitachi Storage Solutions Hitachi HDD Directions HDD Actual.
Architecture of a platform for innovation and research Erik Deumens – University of Florida SC15 – Austin – Nov 17, 2015.
IBM Systems and Technology Group © 2009 IBM Corporation IBM System Storage Product Overview Part 1 This document is for IBM and IBM Business Partner use.
FusionCube At-a-Glance. 1 Application Scenarios Enterprise Cloud Data Centers Desktop Cloud Database Application Acceleration Midrange Computer Substitution.
Indexing strategies and good physical designs for performance tuning Kenneth Ureña /SpanishPASSVC.
High Performance Storage System (HPSS) Jason Hick Mass Storage Group HEPiX October 26-30, 2009.
System Storage TM © 2007 IBM Corporation IBM System Storage™ DS3000 Series Jüri Joonsaar Tartu.
Extreme Scale Infrastructure
E2800 Marco Deveronico All Flash or Hybrid system
DSS-G Configuration Bill Luken – April 10th , 2017
Appro Xtreme-X Supercomputers
CERN Lustre Evaluation and Storage Outlook
Large Scale Test of a storage solution based on an Industry Standard
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
CloneManager® Helps Users Harness the Power of Microsoft Azure to Clone and Migrate Systems into the Cloud Cost-Effectively and Securely MICROSOFT AZURE.
Dell Data Protection | Rapid Recovery: Simple, Quick, Configurable, and Affordable Cloud-Based Backup, Retention, and Archiving Powered by Microsoft Azure.
Midhet Dizdar IST Spring 2005
Microsoft Virtual Academy
Presentation transcript:

© 2007 DataDirect Networks, Inc. All Rights Reserved. Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space Efficiency S2A Technology Update A Tradition of HPC Data Leadership 2008 HPC User Forum Spring Meeting Jeff Denworth: Director of Platform Solutions

DataDirect Networks Target Applications Total Worldwide Digital Archive Capacity: Source: Enterprise Strategy Group Servicing performance and capacity-bound applications experiencing compounding storage management issues These application profiles collide in the HPC data center 2 Sample Data Points –Defensive I/O: Multi-Core = More Memory = More data to Checkpoint Scalable, High-Performance WRITE-INTENSIVE storage is required Low-Cost, High Density RAM (eg. MetaRAM) will only compound this problem –Productive I/O: Data Volume is Exploding CERN LHC will produce 27TB per day! That data needs to be distributed to 7000 researchers worldwide

© 2007 DataDirect Networks, Inc. All Rights Reserved. SATA Usage & Capacity Increases Vulnerability Implications The Appeal of SATA Technology: –Lower price per GB –Larger capacity –Lower power consumption –Less heat than Enterprise drives FeatureEnterprise-ClassSATA Rotational Speed15,000 RPM7,200 RPM Capacity400GB1TB (1,000 GB) Drive Defect ListIn hardwareOn media # of CPUs 2 – one for I/O, one for mgmt 1 for everything Prone to silent data corruption NoYes Duty CycleContinuousNon-continuous Average Failure Rate LowHigh The Trade-Off: Performance is 1/2 - 1/3 of SCSI SATA exacerbates storage issues –Lower seek performance –Less reliability controls (mechanically) –Less robust electronically Rebuild Times Grow w/ Capacity –Not Complimentary to Reliability –Many Drives not even dead –Sick/Slow Drives are Common The Physics of a Spindle: Rebuild TimeHoursHours-Days DataDirect Networks 4 th Largest Linux TB Shipped ‘06 The Experience from a leader: “No Trouble Found” RMAs InfrequentOver 80%

© 2007 DataDirect Networks, Inc. All Rights Reserved. High Performance Computing Traditional Storage Issues  We believe that traditional storage technologies are incapable of responding to the growing data challenge.  Issues with traditional storage in HPC  Systems deliver substantially lower write performance than read performance – often ½ less  Systems are not designed to provide predictable I/O and handle failures  Striped storage environments realize degrading performance as the cluster grows – Amdahl’s Law Degraded shared file performance as systems encounter sluggish / failed drives Capacity SystemPerformance Peak System Performance Not delivered in clustered environments

© 2007 DataDirect Networks, Inc. All Rights Reserved. DataDirect Networks S2A9900 6GB/s Read & Write Performance: 24GB/s Internal Bandwidth 8 x Active/Active Host Ports: FC4, FC8, 4xDDR-Infiniband Scales to Support 1,200 Hard Drives Up to 40,000 IOPS to disk Mix SAS + SATA For Storage Tiering 600 Drives per Rack; 1.2PB in Two Racks Zero-Compromise SATA Latency No-Impact Drive Rebuilds Journaled Fast Drive Rebuild Sleep Mode for Optimum Power Efficiency Real-Time Read Parity Checking Non-Disruptive Drive Power Cycling  reduces SATA drive maintenance by up to 90% - no more No Trouble Found RMAs!  combined with Journaled Rebuilding - dramatically increases reliability 8th Generation S2A Technology Resolving Performance & Reliability Within the Box 2008 Winner Visionary Product

© 2007 DataDirect Networks, Inc. All Rights Reserved. DataDirect Networks Product Family S2A9900 6GB/s Write & Read Sequential I/O Optimized 1,200 SAS and/or SATA Drives 1.2PB in Two Racks Optional Solutions: S2A Clustered NAS S2A HPC Storage Solution S2A Shared SAN File System S2A VTL Solution S2A9700 3GB/s Read & Write Sequential I/O Optimized 1,200 SAS and/or SATA Drives 1.2PB in Two Racks S2A9550 3GB/s Read & Write Sequential I/O Optimized 960 Fibre-Channel or SATA Drives 960TB in Two Racks Introducing: S2A6620 Modularity + Density Optimized for IOPS Applications & Superior Density 30,000 IOPS (to disk) Supports up to 120 SAS or SATA drives Up to 120TB in 8U Active/Active Storage Managers Announce d Today!!

© 2007 DataDirect Networks, Inc. All Rights Reserved. S2A Storage = The Gold Standard in HPC I/O –Common Platform: Processing, Backup and Archiving –OPEN storage application & file system flexibility –DirectRAID Algorithms optimized for large data transfer Writes as fast as reads; Unrivaled real-world performance – with SATA –Green Storage: SleepMode and up to 660 drives/rack –The Performance & Capacity Storage Leader 40 of the top 100 supercomputers choose S2A Technology –Tight Integration with Parallel and Archival File Systems Lustre, GPFS, pVFS, Quantum StorNext, CXFS + DMF, HPSS, etc. Case Study: LLNL Requirements: Multi-Cluster, Massively Scalable Site-Wide Lustre Platform Includes world’s fastest BlueGene/L 130GB/s GPFS System for Capability System (Purple) Maximum SATA data integrity Solution: 150GB/s+ S2A Systems providing scalable I/O and Data Availability Case Study: LLNL Requirements: Multi-Cluster, Massively Scalable Site-Wide Lustre Platform Includes world’s fastest BlueGene/L 130GB/s GPFS System for Capability System (Purple) Maximum SATA data integrity Solution: 150GB/s+ S2A Systems providing scalable I/O and Data Availability Sample Customers: Variety of Applications Sample Customers: Variety of Applications Worldwide HPC Experience Partners:

© 2007 DataDirect Networks, Inc. All Rights Reserved. Thank You. Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space Efficiency