+ Thriving at Petabyte scale & beyond

Slides:



Advertisements
Similar presentations
Thanks to Microsoft Azure’s Scalability, BA Minds Delivers a Cost-Effective CRM Solution to Small and Medium-Sized Enterprises in Latin America MICROSOFT.
Advertisements

Agile Infrastructure built on OpenStack Building The Next Generation Data Center with OpenStack John Griffith, Senior Software Engineer,
DataCore Software Proprietary Information Virtualize Your Storage! DataCore and Citrix Simple & Affordable Virtualization Unmatched Agility, Productivity.
Scale-out Central Store. Conventional Storage Verses Scale Out Clustered Storage Conventional Storage Scale Out Clustered Storage Faster……………………………………………….
Caringo Swarm Petabyte+ software-defined storage for the post RAID era.
11© 2011 Hitachi Data Systems. All rights reserved. HITACHI DATA DISCOVERY FOR MICROSOFT® SHAREPOINT ® SOLUTION SCALING YOUR SHAREPOINT ENVIRONMENT PRESENTER.
Seagate Hybrid Systems & Solutions
Microsoft Virtual Server 2005 Product Overview Mikael Nyström – TrueSec AB MVP Windows Server – Setup/Deployment Mikael Nyström – TrueSec AB MVP Windows.
DatacenterMicrosoft Azure Consistency Connectivity Code.
VIRTUALIZATION AND YOUR BUSINESS November 18, 2010 | Worksighted.
Module – 7 network-attached storage (NAS)
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP 3PAR StoreServ 7000.
“Better together” PowerVault virtualization solutions
© Hitachi Data Systems Corporation All rights reserved. 1 1 Det går pænt stærkt! Tony Franck Senior Solution Manager.
Reducing Risk with Cloud Storage. Dell Storage Forum 2011 Storage 2 Dells’ Definition of Cloud Demand driven scalability: up or down, just happens Metered:
Opensource for Cloud Deployments – Risk – Reward – Reality
Barracuda Load Balancer Server Availability and Scalability.
COMPANY AND PRODUCT OVERVIEW Russ Taddiken Director of Principal Storage Architecture.
STEALTH Content Store for SharePoint using Caringo CAStor  Boosting your SharePoint to the MAX! "Optimizing your Business behind the scenes"
VSolution Playbook VIRTUALIZED SAN SOLUTION FOR VMWARE SMB.
Ceph Storage in OpenStack Part 2 openstack-ch,
Protect Your Business-Critical Data in the Cloud with SoftNAS, a Full-Featured, Highly Available Solution for the Agile Microsoft Azure Platform MICROSOFT.
Microsoft Azure and DataStax: Start Anywhere and Scale to Any Size in the Cloud, On- Premises, or Both with a Leading Distributed Database MICROSOFT AZURE.
Data Evolution: 101. Parallel Filesystem vs Object Stores Amazon S3 CIFS NFS.
© Copyright 2015 EMC Corporation. All rights reserved. EMC Isilon Scale-out NAS For Syncplicity.
Extending Auto-Tiering to the Cloud For additional, on-demand, offsite storage resources 1.
DDN Web Object Scalar for Big Data Management Shaun de Witt, Roger Downing (STFC) Glenn Wright (DDN)
St. Petersburg, 2016 Openstack Disk Storage vs Amazon Disk Storage Computing Clusters, Grids and Cloud Erasmus Mundus Master Program in PERCCOM Author:
© 2010 Hitachi Data Systems. All rights reserved. Hitachi Data Systems Cloud Strategy and Solutions Francois Zimmermann UK CTO.
Commvault and Nutanix October Changing IT landscape Today’s Challenges Datacenter Complexity Building for Scale Managing disparate solutions.
DISCUSSION LEADERS PRAVINA KOTA, KEVAN ESSMYER, NAVEEN KARDURI
+ Thriving at Petabyte scale & beyond
AuraPortal Cloud Helps Empower Organizations to Organize and Control Their Business Processes via Applications on the Microsoft Azure Cloud Platform MICROSOFT.
Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.
Remaking Secondary Storage
Organizations Are Embracing New Opportunities
Reducing Risk with Cloud Storage
Vidcoding Introduces Scalable Video and TV Encoding in the Cloud at an Affordable Price by Utilizing the Processing Power of Azure Batch MICROSOFT AZURE.
Free Cloud Management Portal for Microsoft Azure Empowers Enterprise Users to Govern Their Cloud Spending and Optimize Cloud Usage and Planning MICROSOFT.
Cherwell Service Management is an IT Service Management Solution that Makes it Easier for Users to Capitalize on Power of Microsoft Azure MICROSOFT AZURE.
Agenda Backup Storage Choices Backup Rule
SMS+ on Microsoft Azure Provides Enhanced and Secure Text Messaging, with Audit Trail, Scalability, End-to-End Encryption, and Special Certifications MICROSOFT.
Couchbase Server is a NoSQL Database with a SQL-Based Query Language
Stylelabs Develops the Marketing Content Hub to Offer Enterprises a High-End Marketing Content Management Platform Based on Microsoft Azure MICROSOFT AZURE.
Hosted on Azure, LoginRadius’ Customer Identity
Nimble Streamer Helps Media Content Providers Create Streaming Networks Cost-Effectively and Easily by Utilizing Azure’s Worldwide Scalability MICROSOFT.
Geographically distributed storage over multiple universities
Veeam Backup Repository
OpenNebula Offers an Enterprise-Ready, Fully Open Management Solution for Private and Public Clouds – Try It Easily with an Azure Marketplace Sandbox MICROSOFT.
Built on the Powerful Microsoft Azure Platform, Lievestro Delivers Care Information, Capacity Management Solutions to Hospitals, Medical Field MICROSOFT.
MyHealthDirect’s Enterprise Scheduling Platform, Based on Microsoft Azure, Improves the Patient Experience and Reduces Patient Readmissions MICROSOFT AZURE.
Designed for Big Data Visual Analytics, Zoomdata Allows Business Users to Quickly Connect, Stream, and Visualize Data in the Microsoft Azure Platform MICROSOFT.
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
Logsign All-In-One Security Information and Event Management (SIEM) Solution Built on Azure Improves Security & Business Continuity MICROSOFT AZURE APP.
On-Premises, or Deployed in a Hybrid Environment
Auth0 Is Identity Made Simple for Developers, Built by Developers and Supported by the High Availability and Performance of Microsoft Azure MICROSOFT AZURE.
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Data Security for Microsoft Azure
Unitrends Enterprise Backup Solution Offers Backup and Recovery of Data in the Microsoft Azure Cloud for Better Protection of Virtual and Physical Systems.
CloneManager® Helps Users Harness the Power of Microsoft Azure to Clone and Migrate Systems into the Cloud Cost-Effectively and Securely MICROSOFT AZURE.
AllDigital Brevity on Microsoft Azure Cloud Platform Supercharges Media Workloads by Encoding During High-Speed File Transmission MICROSOFT AZURE ISV PROFILE:
MyCloudIT Enables Partners to Drive Their Cloud Profitability Using CSP-Enabled Desktop Hosting Automation with Microsoft Azure and Office 365 MICROSOFT.
Outline Virtualization Cloud Computing Microsoft Azure Platform
Dell Data Protection | Rapid Recovery: Simple, Quick, Configurable, and Affordable Cloud-Based Backup, Retention, and Archiving Powered by Microsoft Azure.
Media365 Portal by Ctrl365 is Powered by Azure and Enables Easy and Seamless Dissemination of Video for Enhanced B2C and B2B Communication MICROSOFT AZURE.
FileFacets Information Governance Solution Performs High-Quality Automated Enterprise Content Management Migration, Built on Azure MICROSOFT AZURE APP.
Quasardb Is a Fast, Reliable, and Highly Scalable Application Database, Built on Microsoft Azure and Designed Not to Buckle Under Demand MICROSOFT AZURE.
PRESENTER GUIDANCE: These charts provide data points on how IBM BaaS mid-market benefits a client with the ability to utilize a variety of backup software.
Nuvolex and Microsoft Azure Combine to Deliver a Multitenant Office 365 Management Platform that Ranks Among Most Advanced in the Industry MICROSOFT AZURE.
Andy Puckett – Sales Engineer
Presentation transcript:

+ Thriving at Petabyte scale & beyond Software-Defined Object Storage for the POST-RAID era

Expansion & Extensibility Legacy file storage technology is limiting the ability for entities to thrive @ “scale” Constrained Expansion & Extensibility Rigid & Brittle Durability Restricted Accessibility Web servers and load balancers needed SMB and NFS are not web protocols Limited query and analysis Max out at PB level Data Silos Tedious management Service downtime for upgrades Specialized staff RAID rebuild times too long Backup costs too high Not all data should be treated the same, anyway Traditional storage limits the growth of cloud. File systems max out at a petabyte levels or even less. They require time and attention to backup, maintain, restore, rebuild, expand and they require specialized staff to work on them. The traditional file system method of recovery, RAID, does not scale. It takes the same amount of time to rebuild a 10 TB RAID volume in a 100 TB cluster as it does in a 500 TB Cluster and this is just not practical in real world use. Finally, SMB (CIFS) and NFS are simply not web protocols and require web servers, balancers and many other systems to support the use of their data in the cloud. Why not go to a simpler and more direct model for cloud storage?

Multi-protocol ingest support (http, file, S3, Swift, block) The Need... Multi-protocol ingest support (http, file, S3, Swift, block) Internet accessible, web-scale Ability to run on standard commodity hardware Simple to deploy, manage, scale & evolve Ability to continuously protect any amount of data, natively Secure and Compliant Future-proof (durable & extensible) Our clients are requesting straight forward requirements. Storage that supports object, file and block. Storage that runs on standard hardware and automatically protects data – no matter how much there is. A product that is easy to deploy , simple to scale and evolves with hardware so a forklift upgrade is never required. A software defined storage product that supports existing workloads and enables new data services for the future. We call it, scalable software that works so you can focus on your business.

The Solution – Caringo SWARM CAStor Overview Caringo’s Swarm object storage software: Aggregates the disk capacity across heterogeneous clusters of commodity servers to… Create massively & dynamically scalable multi- tenant storage systems that are… Self-managing, self-healing, high-performance, and durable through time, where Files and their descriptive metadata (i.e. objects) are accessible whenever and wherever they are needed by users, administrators and by data services

How We Do It – Efficient Software Swarm Runs from RAM on any x86 hardware with Linux Tune to any workload Boots from bare metal in minutes works on raw disk level RAM HTTP SNMP CPU No file system, no software install leaves 98% drive capacity for data 98% available NIC A node to Caringo is simply an x86 server with RAM, CPU, NIC and Disk. No exotic hardware is required. You can use 1 Gig E or 10 Gig E. Sata, Sas, Flash - any kind of media. No Caringo code is ever installed on your disks. This leaves up to 98% of the disk for data storage. Isn’t your data what a storage system should have on its disks? Swarm boots from bare metal and there is no file system or OS installation and the only way in or out is via HTTP or SNMP. That’s what we call a node and we’ll call it Node 1.

How We Do It – Resource Virtualization Swarm RAM Node 1 CPU NIC

How We Do It – Resource Virtualization Swarm RAM Node 1 CPU NIC RAM RAM CPU CPU Node 2 can be the same or different. You can use newer hardware or mix and match. The flexibility of Caringo Swarm allows you to configure for your use cases. In this example, there is more of everything (there are reasons to have different configurations which we can help tune to your use case for you). Let’s call this node 2. NIC

How We Do It – Resource Virtualization Swarm RAM Node 1 CPU NIC RAM RAM Node 2 CPU CPU NIC

How We Do It – Resource Virtualization Swarm Node 1 Node 2 Node 3 Node … Add another – node 3, node 4…

How We Do It – Emergent Behavior No single points of failure SWARM follows simple rules to manage a complex system Nodes cooperate to perform processes And you get a swarm. The swarm provides growth and scalability, there are no single points of failure and the nodes cooperate to perform processes. In this manner, the system can create a complex system while based on simple rules. Simplicity means fewer things break, better performance, more robustness and great responsiveness. Improves with size!

How We Do It – Encapsulated Data Metadata stored with data No metadata databases to manage data + metadata Simplicity is key at Caringo and we use it right down to the data level. Remember, simplicity empowers performance, fast recovery and robustness – but it all starts with the data model. Caringo believes in the pure object model. Data plus metadata (information about the data) is encapsulated in an object. There are no metadata databases to manage and the metadata is stored with the object. Simple, consistent and powerful.

How We Do It – Encapsulated Data Object is encapsulated Includes all system, policy and custom metadata The metadata includes system metadata, policy information that you set and custom metadata that you model and design. All this information is encapsulated inside the object. This means when you go to get an object, everything is there.

How We Do It – Encapsulated Data Object is portable & dynamic Decoupled from hardware, location and apps Freeing data to be accessed in multiple ways This gives your objects pure portability and makes data dynamic. Your data is decoupled from location, from hardware, from applications. Anyone with the right authentication and authorization (which is included in the metadata) can get to the data no matter where they are or where the data may be. You never have to know the location of the data or the application that wrote it and you can access it remotely from a mobile device or another computer. Think about this for a moment. Data freed from hardware, location and application means you can use that data in more ways than ever before. There are no multiple places to go to get the metadata, the data, the authentication… everything is inside a Caringo Object. Since Caringo Swarm is based on HTTP, the lingua franca of the internet, where there is internet access, there is access to your data and everything about it. This simple model is the basis for incredible power. This is the power of the Caringo Swarm.

Swarm Adapts Swarm lets you grow at the pace you choose and adapts to your requirements or workload Plug in new servers for more capacity & performance - address needs in real time New resources available in minutes Right resources to the right locations Local and geo-distribution Easily retire old hardware site 2 site 1 Swarm site 3 Swarm does not dictate how you grow a cluster. Your business needs do. Multiple clusters can be different configurations. In fact, you can store data differently in different clusters. If you have 2 replicas of an object in your primary cluster, you can store that object as an erasure coded object in the DR cluster. One push of a button on the console lets you retire a node while the system is up and running. That node will distribute its data into the rest of the cluster, wait until all the data has been protected and then shut itself down and wait to be taken out at a time of your choosing. Data can be distributed locally or in a geo-distributed manner. A configuration can be made with 3 different data centers that can lose an entire data center and you can still recover all your data. Caringo brings great flexibilty in the way systems can be configured and of course we are available to assist in planning and implementation.

Swarm Protects Swarm automatically manages the data protection you choose Protection per cluster, bucket or at the object level Seamlessly move between replication and erasure coding Store objects with different protection levels on the same server Auto-managed through Lifepoints Protect data based on value Erasure encoding Any SLA Replication Data protection can be done in 2 basic methods: replication and erasure coding. Replication produces an identical replica of your object and stores it on another node. If you lose one node or one disk, you always have a replica to use. The system will quickly re-replicate any lost data. Erasure coding (EC) is a way of splitting up an object into data and parity segments. Similar to a software version of RAID, EC is more flexible, faster and is scalable. In Caringo Swarm, you can choose any EC method. If you choose 5,2 that means there are 5 data segments and 2 parity segments. You can lose any 2 segments (or nodes or disks) and still recover your object. 16,9 means you can lose any 9 segments and still recover your data. There is no single best way to protect data. Caringo provides the flexibility to use the best method for each use case and you can set that down to the object level. With this flexibility, you can support multiple SLAs for multiple customers or clients inside a single cluster. Any object can have any protection associated with it at any time. You can set a default for the cluster or for a tenant or you can set protection down to the object level. You can even change the protection over time through Lifepoints and the system will manage this for you automatically. Caringo is the only vendor that supports the use of replication and erasure coding in the same cluster, in the same nodes with no special purpose nodes or single points of failure.

Swarm Repairs Swarm watches for issues and repairs them automatically so you don’t have to Health Processor proactively checks integrity, availability and cardinality Fast Volume Recovery, content aware, repairs only damaged objects Assurance of data quality for the entire enterprise Provides business continuity + + + + + Proactive integrity checking means assurance of data quality for the entire enterprise. Business continuity is dependent on the viability of a company’s data. Caringo assures data quality and thus provides business continuity. Data is an organization’s lifeblood and Caringo takes Assurance of Data Quality seriously.

Select the interface and hardware for your workload and use case. Portfolio Overview Scalable storage software for unified object, file and block CloudScaler HTTP 1.1, Amazon S3 FileScaler SMB, NFS BlockScaler iSCSI (Beta) Adaptable performance for unified storage under a single namespace. Swarm Caringo Select the interface and hardware for your workload and use case. Big Data/Hadoop Archive Enterprise Apps Cloud

Add Caringo CSN Software License and annual support/maintenance It’s Simple…Really! CAStor Overview Mix and Match HW w/ any drive size Grow from one form factor to another, at runtime, incrementally Never forklift upgrade again Ethernet Switches 1Gb or 10Gb Small Medium, Large R420 R720xd or +JBOD Add Caringo Software Capacity Licenses, per TB, and annual support/maintenance Caringo SWARM Object Storage Cluster Small, Medium, Large R420 or VM Add Caringo CSN Software License and annual support/maintenance Caringo Cluster Services Node (Physical or Virtual)

Simple…But Powerful! Remote Sites Ingest from many sources* CAStor Overview Search & Discovery Multi-Tenant STaaS Hadoop Analytics Add Storage Services HTTP S3 Application Gateway File Ingest from many sources* Remote Sites Distribute, Consolidate, Share automatically increment @ runtime Scale in any Automate Retention, Protection & Durability down to the object level

Object storage - its all about use cases Video Surveillance (2.5 PBS) File Retention DOD Medical Health Systems (16 PBS) PACS Archiving M2M and analytics (4 PBS) Consumer/enterprise backup-to-cloud service (2+ PBS) S3-like cloud storage services via Swarm & CloudScaler Web content delivery plus hundreds more…

Next Steps – Where/How to get Started? Identify your Target use case(s): See Use Case Slide. If in doubt: “Drain your Filer Swamps” – File System Optimization Tier! Contact your Dell Account Representative for pre-sales support – All Caringo Software & Services are available through Dell OR, Contact brandon.canaday@caringo.com Our clients are requesting straight forward requirements. Storage that supports object, file and block. Storage that runs on standard hardware and automatically protects data – no matter how much there is. A product that is easy to deploy , simple to scale and evolves with hardware so a forklift upgrade is never required. A software defined storage product that supports existing workloads and enables new data services for the future. We call it, scalable software that works so you can focus on your business.

Software-Defined Object Storage for the POST-RAID era Thank You Software-Defined Object Storage for the POST-RAID era