Roger Breu SQL Server PDW Solution Sales Microsoft Western Europe Microsoft Solutions for Big Data | Oct 17th 2013 From Numbers And Data To Insights And Value

The world of data has changed Consumerization of IT 10x increase every five years 85% from new data types Data explosion 4.3 connected devices per adult 27% using social media input

The Large Hadron Collider produces 1 PB/sec

But, my customer isn’t CERN and doesn’t have a Large Hadron Collider…

But your customers do have… SensorsClicksLogs Transactional records Call centersImages Documents Signals from social media Simulations

Big Data is All This and More: volume, variety, velocity (and volatility & variability) Traditional Data is Highly Structured traditional databases are organized around planned queries A Definition

Web app optimization Smart meter monitoring Equipment monitoring Advertising analysis Life sciences research Fraud detection Healthcare outcomes Weather forecasting Social network analysis Churn analysis Traffic flow optimization IT infrastructure optimization Legal discovery Natural resource exploration GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN THEIR INDUSTRY Common Big Data Customer Scenarios

Demo Twitter Analytics Demo with Microsoft Excel

Is this Big Data? Is this Enterprise Ready?

Big Data is more than just new BI! Big Data is more than just Hadoop!

Fast Load Source Systems Historical Data (Beyond Active Window) Summarize & Load Big Data Sources (Raw, Unstructured) Alerts, Notifications Data & Compute Intensive Application ERPCRMLOB APPS Integrate/Enrich SQL Server StreamInsight Enterprise ETL with SSIS, DQS, MDS HDInsight on Windows Azure HDInsight on Windows Server SQL Server FTDW Data Marts SQL Server Reporting Services SQL Server Analysis Server Business Insights Interactive Reports Performance Scorecards Crawlers Bots Devices Sensors SQL Server Parallel Data Warehouse Azure Market Place The Big (Data) Picture, 4 main topics:

The Traditional Data Warehouse 14 … data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. – Gartner, “The State of Data Warehousing in 2012” Data sources

The Traditional Data Warehouse 15 Data sources Increasing data volumes 1 Real- time data 2 Non-Relational Data New data sources & types 3 Cloud-born data 4

Data sources Non-Relational Data The Modern Data Warehouse

Demo Combining Structured and Semistructured Data with SQL Server PDW and Polybase

Demo Combining Structured and Semistructured Data with SQL Server PDW and Polybase And remember, it’s not just working with Twitter data

SQL Server PDW APPLICATIONS DATA SYSTEMS Microsoft Applications DATA SOURCES Traditional Sources (RDBMS, OLTP, OLAP) New Sources (web logs, , sensor data, social media) HDInsight Polybase Feature in SQL PDW CREATE TABLE Customers ([user_id] INT, name NVARCHAR(50)… CREATE EXTERNAL TABLE ClickEvent ( url varchar(50 ), event_date date, user_ID varchar(50 ) ) WITH LOCATION = ‘hdfs://MyHadoop:5000/clickstream/click.txt’; SELECT COUNT(*) FROM Customers c JOIN ClickEvent e ON c.[user_ID] = e.[user_ID] WHERE c.Name = 'Jones'; Socket for Big Data: Hadoop Access Made Simple

Simplicity & Manageability Broaden accessibility of Big Data Analytics to all users Combine internal and external data Develop once, deploy on- premises or in the cloud Pillars of Microsoft’s Big Data Strategy

Data Platform market is estimated to grow 9% YoY Business Intelligence market growing 16.4% YoY Data Warehousing growing 13.5% YoY Big Data market estimated to grow 39.4% YoY Source: IDC Whats in it for you as Partner?

Leverage pre-engineered Data Warehouse and Hadoop Appliance solutions from Microsoft (and it’s hardware partners) De-risk your projects Streamline deployments Modernize your customers Data Warehouse/BI Environments >> Make them Big Data Ready! Leverage and connect the cloud Streamline deployments Decommission fast if smaller hadoop (HDInsight) cluster is sufficient Whats in it for you as Partner?

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentations. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Thank you

SQL Server Parallel Data Warehouse (PDW) Landing Page: Microsoft Big Data Landing Page: Introduction to Polybase: warehousing/polybase.aspx warehousing/polybase.aspx Twitter Analytics for Excel: Additional Resources