Download presentation
Published byVerity Horn Modified over 7 years ago
1
Big Data from Microsoft Azure Robert Turnage Data Solutions Architect
(Introductions and set expectations that this presentation is designed to discuss the role of Azure as the cloud computing platform for a business’s digital transformation.)
2
Big Data as a cornerstone of Cortana Intelligence
Data Sources People Cortana Intelligence Apps Web Mobile Bots Apps Sensors and devices Automated Systems Data Intelligence Action
3
Big Data as a cornerstone of Cortana Intelligence
Data Sources Apps Sensors and devices Data Information Management Event Hubs Data Catalog Data Factory Big Data Stores SQL Data Warehouse Data Lake Store Machine Learning and Analytics HDInsight (Hadoop and Spark) Stream Analytics Data Lake Analytics Machine Learning Intelligence Cortana Bot Framework Cognitive Services Action People Automated Systems Apps Web Mobile Bots Dashboards & Visualizations Power BI Intelligence
4
Azure Data Lake Analytics
Bringing Big Data to everybody Accelerate the pace of innovation through a state-of-the-art cloud platform CONTROL EASE OF USE Hadoop technology Workload optimized, managed clusters Specific apps in a multi-tenant form factor Azure Marketplace HDP Azure Data Lake Analytics IaaS Hadoop Managed Hadoop Big Data as-a-service Azure HDInsight User Adoption BIG DATA ANALYTICS Azure Data Lake Analytics Azure Data Lake Store Azure Storage BIG DATA STORAGE
5
Azure HDInsight Hadoop and Spark as a Service on Azure
Fully-managed Hadoop for the cloud with services like Spark, Storm, Hbase, Hive, Tez, Pig, MapReduce (Python, Java, C#) … 100% Open Source Hortonworks data platform Clusters up and running in minutes Managed, monitored and supported by Microsoft with the industry’s best SLA Familiar BI tools for analysis, or open source notebooks for interactive data science 63% lower TCO than deploy your own Hadoop on-premises* Azure HDInsight Hadoop and Spark as a Service on Azure *IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight”
6
Azure Data Lake Store A hyper-scale repository for Big Data analytics workloads Hadoop File System (HDFS) for the cloud No limits to scale Store any data in its native format Enterprise-grade access control, encryption at rest Optimized for analytic workload performance
7
Azure Data Lake Analytics
Distributed analytics service built on Apache YARN Elastic scale per query lets you focus on business goals—not configuring hardware Includes U-SQL—a language that unifies the benefits of SQL with the expressive power of C# Integrates with Visual Studio to develop, debug, and tune code faster Federated query across Azure data sources Enterprise-grade role based access control Azure Data Lake Analytics A new distributed analytics service
8
Azure Data Lake Store and analyze data of any kind and size
Develop faster, debug and optimize smarter Interactively explore patterns in your data No learning curve Managed and supported Dynamically scales to match your business priorities Enterprise-grade security Built on YARN, designed for the cloud YARN U-SQL Analytics HDInsight Hive R Server HDFS Store
9
Azure Data Lake Big Data made easy
Analytics on any data, any size Easier and more productive for all users Enterprise-ready
10
Azure Data Lake Big Data made easy
Analytics on any data, any size Easier and more productive for all users Enterprise-ready
11
Store any size of data and optimize for high-performance
Store data in it’s native format No fixed limits on file sizes— PB sized files Ultra-fast read/write access Optimized for large analytic systems with massive throughput Optimized for IoT with high availability Store EBs No code rewrite as you increase size of stored data TBs
12
Any type of analytics Batch, interactive, streaming, machine learning
Allows for exploratory analytics over data Analyze with Hadoop and Microsoft solutions YARN U-SQL Analytics HDInsight Hive R Server HDFS Store Cortana Intelligence Suite
13
Analytics that dynamically scale to match your needs
Architected for cloud scale and performance Provision any amount of resources with a few clicks Dynamically provisions and winds down resources Frees you up to focus only on your business logic
14
Azure Data Lake Big Data made easy
Analytics on any data, any size Easier and more productive for all users Enterprise-ready
15
Easy for administrators to spin up quickly
Deploy big data projects in minutes No hardware to install, tune, configure or deploy No infrastructure or software to manage Scale to tens to thousands of machines instantly
16
Easy for developers—from novice to expert
Deep integrations with IntelliJ and Visual Studio Easy for novices to write simple queries Robust environment for experts Integrated with U-SQL, Hive, and Storm Playback visually displays performance to identify bottlenecks and areas for optimization
17
Easy for developers with familiar language
Leverages U-SQL: a simple and powerful language that’s familiar to SQL and/or .NET developers and easily extensible Unifies the declarative nature of SQL with expressive power of C# Familiar syntax to millions of developers
18
Easy notebook experience for data scientists
Most popular notebook, Jupyter out-of-the-box Combine code, statistical equations and visualizations Worked w/ Jupyter community to enhance kernel to allow Spark execution through REST endpoint
19
Easy for data scientists with familiar R language
R Server for HDInsight Largest R-compatible parallel analytics library Terabyte-scale machine learning—1,000x larger than in open source R Up to 100x faster performance using Spark and optimized vector/math libraries Enterprise-grade security and support *Applies to HDInsight only
20
Easy for business analysts with interactive reports over big data
Interactive BI with big data Spark integration with Power BI, Tableau, SAP Lumira and Qlik Power BI offers a streaming connector with Spark Stream
21
Azure Data Lake Big Data made easy
Analytics on any data, any size Easier and more productive for all users Enterprise-ready
22
Highest availability guarantee in the industry for peace of mind
Managed, monitored and supported by Microsoft Enterprise-leading SLA— 99.9% uptime No IT resources needed for upgrades and patching Microsoft monitors your deployment so you don’t have to 99.9% SLA *Applies to HDInsight only
23
Runs in the most datacenters worldwide
North Central US Illinois West Europe Netherlands Central US Iowa China North* Beijing Japan East Tokyo, Saitama North Europe Ireland China South* Shanghai West US California East US Virginia Japan West Osaka India Central Pune East US 2 Virginia South Central US Texas East Asia Hong Kong SE Asia Singapore Australia East New South Wales Azure doubling compute and storage every 6 months *Applies to HDInsight only Brazil South Sao Paulo State Australia South East Victoria
24
Manage and secure your data by leveraging existing IT investments
Auditing, alerting, access control—all from within a single web-based portal Azure Active Directory integration for identity and access management Leverage existing investment in Active Directory on- premises
25
Lower total cost of ownership
No hardware Hadoop support included with Azure support Pay only for what you use Independently scale storage and compute No need to hire specialized operations team 63% lower total cost of ownership than on-premises* *IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight”
26
Recognized by top analysts
Forrester Wave for Big Data Hadoop Cloud Named industry leader by Forrester with the most comprehensive, scalable, and integrated platforms* Recognized for its cloud-first strategy that is paying off* Get it at //aka.ms/forresterwave *The Forrester WaveTM: Big Data Hadoop Cloud Solutions, Q
27
Get started now Learn more on the Data Lake website: Watch videos on Azure Data Lake: Take courses and read documentation on Azure Data Lake: Cortana Intelligence is available as a simple monthly subscription, which gives you a predictable monthly cost for building a comprehensive Big Data and advanced analytics solution. Learn more about Cortana Intelligence through our website, by scheduling a workshop to determine where our solution may help, or by speaking with your Microsoft contact about licensing options and trained partners in your area that can help you get the most out of the solution. T: Thanks for your time.
28
© 2016 Microsoft Corporation. All rights reserved.
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.