+ Thriving at Petabyte scale & beyond

Slides:



Advertisements
Similar presentations
Thanks to Microsoft Azure’s Scalability, BA Minds Delivers a Cost-Effective CRM Solution to Small and Medium-Sized Enterprises in Latin America MICROSOFT.
Advertisements

+ Thriving at Petabyte scale & beyond
Caringo Swarm Petabyte+ software-defined storage for the post RAID era.
“Better together” PowerVault virtualization solutions
Protect Your Business-Critical Data in the Cloud with SoftNAS, a Full-Featured, Highly Available Solution for the Agile Microsoft Azure Platform MICROSOFT.
St. Petersburg, 2016 Openstack Disk Storage vs Amazon Disk Storage Computing Clusters, Grids and Cloud Erasmus Mundus Master Program in PERCCOM Author:
The Derivitec Risk Portal Provides Powerful, Cost-Effective Risk Management Solutions, Powered by Azure, that Deploy in Minutes MICROSOFT AZURE ISV PROFILE:
Commvault and Nutanix October Changing IT landscape Today’s Challenges Datacenter Complexity Building for Scale Managing disparate solutions.
Course: Cluster, grid and cloud computing systems Course author: Prof
AuraPortal Cloud Helps Empower Organizations to Organize and Control Their Business Processes via Applications on the Microsoft Azure Cloud Platform MICROSOFT.
Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.
MICROSOFT AZURE ISV PROFILE: BMC SOFTWARE
TOPdesk Service Management Software on Azure
Organizations Are Embracing New Opportunities
BLoyal Version 4: Real-Time, Omnichannel Loyalty and Engagement Solution Has Been Redesigned and Rebuilt on the Microsoft Azure Cloud Platform MICROSOFT.
Reducing Risk with Cloud Storage
Meemim's Microsoft Azure-Hosted Knowledge Management Platform Simplifies the Sharing of Information with Colleagues, Clients or the Public MICROSOFT AZURE.
Vidcoding Introduces Scalable Video and TV Encoding in the Cloud at an Affordable Price by Utilizing the Processing Power of Azure Batch MICROSOFT AZURE.
Free Cloud Management Portal for Microsoft Azure Empowers Enterprise Users to Govern Their Cloud Spending and Optimize Cloud Usage and Planning MICROSOFT.
Trial.iO Makes it Easy to Provision Software Trials, Demos and Training Environments in the Azure Cloud in One Click, Without Any IT Involvement MICROSOFT.
Keyhub Identity and Access Management App is Powered by Azure and Offers Customers Easy Authentication, Authorization for Mobile Devices MICROSOFT AZURE.
Cherwell Service Management is an IT Service Management Solution that Makes it Easier for Users to Capitalize on Power of Microsoft Azure MICROSOFT AZURE.
Agenda Backup Storage Choices Backup Rule
SMS+ on Microsoft Azure Provides Enhanced and Secure Text Messaging, with Audit Trail, Scalability, End-to-End Encryption, and Special Certifications MICROSOFT.
Couchbase Server is a NoSQL Database with a SQL-Based Query Language
Wonderware Online Cost-Effective SaaS Solution Powered by the Microsoft Azure Cloud Platform Delivers Industrial Insights to Users and OEMs MICROSOFT AZURE.
Stylelabs Develops the Marketing Content Hub to Offer Enterprises a High-End Marketing Content Management Platform Based on Microsoft Azure MICROSOFT AZURE.
Hosted on Azure, LoginRadius’ Customer Identity
Veeam Backup Repository
Storage Virtualization
Get Real Value and Insights from Your Data: Biin Solutions Provides Predictive Analytics, IoT, and Business Intelligence with Microsoft Azure Power MICROSOFT.
OpenNebula Offers an Enterprise-Ready, Fully Open Management Solution for Private and Public Clouds – Try It Easily with an Azure Marketplace Sandbox MICROSOFT.
Built on the Powerful Microsoft Azure Platform, Lievestro Delivers Care Information, Capacity Management Solutions to Hospitals, Medical Field MICROSOFT.
MyHealthDirect’s Enterprise Scheduling Platform, Based on Microsoft Azure, Improves the Patient Experience and Reduces Patient Readmissions MICROSOFT AZURE.
Microsoft Azure Platform Powers New Elements Constellation Software Suite to Deliver Invaluable Insights From Your Data for Marketing and Sales MICROSOFT.
Replace with Application Image
Running on the Powerful Microsoft Azure Platform,
Be Better: Achieve Customer Service Excellence and Create a Lean RMA and Returns Process with Renewity RMA and the Power of Microsoft Azure MICROSOFT AZURE.
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
Logsign All-In-One Security Information and Event Management (SIEM) Solution Built on Azure Improves Security & Business Continuity MICROSOFT AZURE APP.
Voice Analytics on Microsoft Azure Allows Various Customers to Get the Most Out of Conversations with Clients Through Efficient Content Analysis MICROSOFT.
ResourceFirst Puts Emphasis on Communication, Uses Power of Azure to Bring Successful Resource and Portfolio Management to Companies Globally MICROSOFT.
Through the Microsoft Azure Platform, TARGIT Decision Suite Enables Organizations to Analyze Critical Data, Giving Them the Courage to Act MICROSOFT AZURE.
On-Premises, or Deployed in a Hybrid Environment
Big Red Cloud Offers a Simple Online Accounts Solution for Business Owners and Bookkeepers Hosted on the Powerful Microsoft Azure Platform MICROSOFT AZURE.
Auth0 Is Identity Made Simple for Developers, Built by Developers and Supported by the High Availability and Performance of Microsoft Azure MICROSOFT AZURE.
I-POWER JAPAN Gives Small Businesses the Ability to Get Their Work Done from Anywhere, Even a Construction Site, by Using Microsoft Azure MICROSOFT AZURE.
The Only Digital Asset Management System on Microsoft Azure, MediaValet Is Uniquely Equipped to Meet Any Company’s Needs MICROSOFT AZURE ISV PROFILE: MEDIAVALET.
Data Security for Microsoft Azure
Meeting Rooms Management Empowers Organizations and Their Employees to Become Mobile, and to Save Meeting Space and Time MICROSOFT AZURE APP BUILDER PROFILE:
Unitrends Enterprise Backup Solution Offers Backup and Recovery of Data in the Microsoft Azure Cloud for Better Protection of Virtual and Physical Systems.
CloneManager® Helps Users Harness the Power of Microsoft Azure to Clone and Migrate Systems into the Cloud Cost-Effectively and Securely MICROSOFT AZURE.
AllDigital Brevity on Microsoft Azure Cloud Platform Supercharges Media Workloads by Encoding During High-Speed File Transmission MICROSOFT AZURE ISV PROFILE:
MyCloudIT Enables Partners to Drive Their Cloud Profitability Using CSP-Enabled Desktop Hosting Automation with Microsoft Azure and Office 365 MICROSOFT.
Druva inSync: A 360° Endpoint and Cloud App Data Protection and Information Management Solution Powered by Azure for the Modern Mobile Workforce MICROSOFT.
Crypteron is a Developer-Friendly Data Breach Solution that Allows Organizations to Secure Applications on Microsoft Azure in Just Minutes MICROSOFT AZURE.
Dell Data Protection | Rapid Recovery: Simple, Quick, Configurable, and Affordable Cloud-Based Backup, Retention, and Archiving Powered by Microsoft Azure.
Adra ACCOUNTS: Transaction Matching Software Powered by the Microsoft Azure Cloud That Helps Optimize the Accounting and Finance Processes MICROSOFT AZURE.
Keep Your Digital Media Assets Safe and Save Time by Choosing ImageVault to be Your Digital Asset Management Solution, Hosted in Microsoft Azure Partner.
One-Stop Shop Manages All Technical Vendor Data and Documentation and is Globally Deployed Using Microsoft Azure to Support Asset Owners/Operators MICROSOFT.
Appcelerator Arrow: Build APIs in Minutes. Connect to Any Data Source
Cloud Analytics for Microsoft Azure
Media365 Portal by Ctrl365 is Powered by Azure and Enables Easy and Seamless Dissemination of Video for Enhanced B2C and B2B Communication MICROSOFT AZURE.
Abiquo’s Hybrid Cloud Management Solution Helps Enterprises Maximise the Full Potential of the Microsoft Azure Platform MICROSOFT AZURE ISV PROFILE: ABIQUO.
AIMS for BizTalk, Built on the Microsoft Azure Platform, Empowers Enterprises to Automate Insight and Analytics and Boost Value Creation MICROSOFT AZURE.
Quasardb Is a Fast, Reliable, and Highly Scalable Application Database, Built on Microsoft Azure and Designed Not to Buckle Under Demand MICROSOFT AZURE.
Single Cell’s Progenitor Powered by Microsoft Azure Improves Organisational Efficiency with Strategic Procurement, Contract Management, and Analytics MICROSOFT.
Nuvolex and Microsoft Azure Combine to Deliver a Multitenant Office 365 Management Platform that Ranks Among Most Advanced in the Industry MICROSOFT AZURE.
Andy Puckett – Sales Engineer
Zendos Tecnologia Utilizes the Powerful, Scalable
Presentation transcript:

+ Thriving at Petabyte scale & beyond Software-Defined Object Storage for the POST-RAID era

Expansion & Extensibility Legacy file storage technology is limiting the ability for entities to thrive @ “scale” Constrained Expansion & Extensibility Rigid & Brittle Durability Restricted Accessibility Web servers and load balancers needed SMB and NFS are not web protocols Limited query and analysis Max out at PB level Data Silos Tedious management Service downtime for upgrades Specialized staff RAID rebuild times too long Backup costs too high Not all data should be treated the same, anyway Traditional storage limits the growth of cloud. File systems max out at a petabyte levels or even less. They require time and attention to backup, maintain, restore, rebuild, expand and they require specialized staff to work on them. The traditional file system method of recovery, RAID, does not scale. It takes the same amount of time to rebuild a 10 TB RAID volume in a 100 TB cluster as it does in a 500 TB Cluster and this is just not practical in real world use. Finally, SMB (CIFS) and NFS are simply not web protocols and require web servers, balancers and many other systems to support the use of their data in the cloud. Why not go to a simpler and more direct model for cloud storage?

Multi-protocol ingest support (http, file, S3, Swift, block) The Need... Multi-protocol ingest support (http, file, S3, Swift, block) Internet accessible, web-scale Ability to run on standard commodity hardware Simple to deploy, manage, scale & evolve Ability to continuously protect any amount of data, natively Secure and Compliant Future-proof (durable & extensible) Our clients are requesting straight forward requirements. Storage that supports object, file and block. Storage that runs on standard hardware and automatically protects data – no matter how much there is. A product that is easy to deploy , simple to scale and evolves with hardware so a forklift upgrade is never required. A software defined storage product that supports existing workloads and enables new data services for the future. We call it, scalable software that works so you can focus on your business.

The Solution – Caringo SWARM CAStor Overview Caringo’s Swarm object storage software: Aggregates the disk capacity across heterogeneous clusters of commodity servers to… Create massively & dynamically scalable multi- tenant storage systems that are… Self-managing, self-healing, high-performance, and durable through time, where Files and their descriptive metadata (i.e. objects) are accessible whenever and wherever they are needed by users, administrators and by data services

How We Do It – Efficient Software Swarm Runs from RAM on any x86 hardware with Linux Tune to any workload Boots from bare metal in minutes works on raw disk level RAM HTTP SNMP CPU No file system, no software install leaves 98% drive capacity for data 98% available NIC A node to Caringo is simply an x86 server with RAM, CPU, NIC and Disk. No exotic hardware is required. You can use 1 Gig E or 10 Gig E. Sata, Sas, Flash - any kind of media. No Caringo code is ever installed on your disks. This leaves up to 98% of the disk for data storage. Isn’t your data what a storage system should have on its disks? Swarm boots from bare metal and there is no file system or OS installation and the only way in or out is via HTTP or SNMP. That’s what we call a node and we’ll call it Node 1.

How We Do It – Resource Virtualization Swarm RAM Node 1 CPU NIC

How We Do It – Resource Virtualization Swarm RAM Node 1 CPU NIC RAM RAM CPU CPU Node 2 can be the same or different. You can use newer hardware or mix and match. The flexibility of Caringo Swarm allows you to configure for your use cases. In this example, there is more of everything (there are reasons to have different configurations which we can help tune to your use case for you). Let’s call this node 2. NIC

How We Do It – Resource Virtualization Swarm RAM Node 1 CPU NIC RAM RAM Node 2 CPU CPU NIC

How We Do It – Resource Virtualization Swarm Node 1 Node 2 Node 3 Node … Add another – node 3, node 4…

How We Do It – Emergent Behavior No single points of failure SWARM follows simple rules to manage a complex system Nodes cooperate to perform processes And you get a swarm. The swarm provides growth and scalability, there are no single points of failure and the nodes cooperate to perform processes. In this manner, the system can create a complex system while based on simple rules. Simplicity means fewer things break, better performance, more robustness and great responsiveness. Improves with size!

How We Do It – Encapsulated Data Metadata stored with data No metadata databases to manage data + metadata Simplicity is key at Caringo and we use it right down to the data level. Remember, simplicity empowers performance, fast recovery and robustness – but it all starts with the data model. Caringo believes in the pure object model. Data plus metadata (information about the data) is encapsulated in an object. There are no metadata databases to manage and the metadata is stored with the object. Simple, consistent and powerful.

How We Do It – Encapsulated Data Object is encapsulated Includes all system, policy and custom metadata The metadata includes system metadata, policy information that you set and custom metadata that you model and design. All this information is encapsulated inside the object. This means when you go to get an object, everything is there.

How We Do It – Encapsulated Data Object is portable & dynamic Decoupled from hardware, location and apps Freeing data to be accessed in multiple ways This gives your objects pure portability and makes data dynamic. Your data is decoupled from location, from hardware, from applications. Anyone with the right authentication and authorization (which is included in the metadata) can get to the data no matter where they are or where the data may be. You never have to know the location of the data or the application that wrote it and you can access it remotely from a mobile device or another computer. Think about this for a moment. Data freed from hardware, location and application means you can use that data in more ways than ever before. There are no multiple places to go to get the metadata, the data, the authentication… everything is inside a Caringo Object. Since Caringo Swarm is based on HTTP, the lingua franca of the internet, where there is internet access, there is access to your data and everything about it. This simple model is the basis for incredible power. This is the power of the Caringo Swarm.

Swarm Adapts Swarm lets you grow at the pace you choose and adapts to your requirements or workload Plug in new servers for more capacity & performance - address needs in real time New resources available in minutes Right resources to the right locations Local and geo-distribution Easily retire old hardware site 2 site 1 Swarm site 3 Swarm does not dictate how you grow a cluster. Your business needs do. Multiple clusters can be different configurations. In fact, you can store data differently in different clusters. If you have 2 replicas of an object in your primary cluster, you can store that object as an erasure coded object in the DR cluster. One push of a button on the console lets you retire a node while the system is up and running. That node will distribute its data into the rest of the cluster, wait until all the data has been protected and then shut itself down and wait to be taken out at a time of your choosing. Data can be distributed locally or in a geo-distributed manner. A configuration can be made with 3 different data centers that can lose an entire data center and you can still recover all your data. Caringo brings great flexibilty in the way systems can be configured and of course we are available to assist in planning and implementation.

Swarm Protects Swarm automatically manages the data protection you choose Protection per cluster, bucket or at the object level Seamlessly move between replication and erasure coding Store objects with different protection levels on the same server Auto-managed through Lifepoints Protect data based on value Erasure encoding Any SLA Replication Data protection can be done in 2 basic methods: replication and erasure coding. Replication produces an identical replica of your object and stores it on another node. If you lose one node or one disk, you always have a replica to use. The system will quickly re-replicate any lost data. Erasure coding (EC) is a way of splitting up an object into data and parity segments. Similar to a software version of RAID, EC is more flexible, faster and is scalable. In Caringo Swarm, you can choose any EC method. If you choose 5,2 that means there are 5 data segments and 2 parity segments. You can lose any 2 segments (or nodes or disks) and still recover your object. 16,9 means you can lose any 9 segments and still recover your data. There is no single best way to protect data. Caringo provides the flexibility to use the best method for each use case and you can set that down to the object level. With this flexibility, you can support multiple SLAs for multiple customers or clients inside a single cluster. Any object can have any protection associated with it at any time. You can set a default for the cluster or for a tenant or you can set protection down to the object level. You can even change the protection over time through Lifepoints and the system will manage this for you automatically. Caringo is the only vendor that supports the use of replication and erasure coding in the same cluster, in the same nodes with no special purpose nodes or single points of failure.

Swarm Repairs Swarm watches for issues and repairs them automatically so you don’t have to Health Processor proactively checks integrity, availability and cardinality Fast Volume Recovery, content aware, repairs only damaged objects Assurance of data quality for the entire enterprise Provides business continuity + + + + + Proactive integrity checking means assurance of data quality for the entire enterprise. Business continuity is dependent on the viability of a company’s data. Caringo assures data quality and thus provides business continuity. Data is an organization’s lifeblood and Caringo takes Assurance of Data Quality seriously.

Select the interface and hardware for your workload and use case. Portfolio Overview Scalable storage software for unified object, file and block CloudScaler HTTP 1.1, Amazon S3 FileScaler SMB, NFS BlockScaler iSCSI (Beta) Adaptable performance for unified storage under a single namespace. Swarm Caringo Select the interface and hardware for your workload and use case. Big Data/Hadoop Archive Enterprise Apps Cloud

Add Caringo CSN Software License and annual support/maintenance It’s Simple…Really! CAStor Overview Mix and Match HW w/ any drive size Grow from one form factor to another, at runtime, incrementally Never forklift upgrade again Ethernet Switches 1Gb or 10Gb Small Medium, Large R420 R720xd or +JBOD Add Caringo Software Capacity Licenses, per TB, and annual support/maintenance Caringo SWARM Object Storage Cluster Small, Medium, Large R420 or VM Add Caringo CSN Software License and annual support/maintenance Caringo Cluster Services Node (Physical or Virtual)

Simple…But Powerful! Remote Sites Ingest from many sources* CAStor Overview Search & Discovery Multi-Tenant STaaS Hadoop Analytics Add Storage Services HTTP S3 Application Gateway File Ingest from many sources* Remote Sites Distribute, Consolidate, Share automatically increment @ runtime Scale in any Automate Retention, Protection & Durability down to the object level

Object storage - its all about use cases Video Surveillance (2.5 PBS) File Retention DOD Medical Health Systems (16 PBS) PACS Archiving M2M and analytics (4 PBS) Consumer/enterprise backup-to-cloud service (2+ PBS) S3-like cloud storage services via Swarm & CloudScaler Web content delivery plus hundreds more…

Next Steps – Where/How to get Started? Identify your Target use case(s): See Use Case Slide. If in doubt: “Drain your Filer Swamps” – File System Optimization Tier! Contact your Dell Account Representative for pre-sales support – All Caringo Software & Services are available through Dell OR, Contact brandon.canaday@caringo.com Our clients are requesting straight forward requirements. Storage that supports object, file and block. Storage that runs on standard hardware and automatically protects data – no matter how much there is. A product that is easy to deploy , simple to scale and evolves with hardware so a forklift upgrade is never required. A software defined storage product that supports existing workloads and enables new data services for the future. We call it, scalable software that works so you can focus on your business.

Software-Defined Object Storage for the POST-RAID era Thank You Software-Defined Object Storage for the POST-RAID era