ETL: To Cloud or Not to Cloud

Slides:

Advertisements

Similar presentations

Big Data Training Course for IT Professionals Name of course : Big Data Developer Course Duration : 3 days full time including practical sessions Dates.

Advertisements

Senior Project Manager & Architect Love Your Data.

Running Hadoop-as-a-Service in the Cloud

Transform + analyze Visualize + decide Capture + manage Dat a.

Platinum Sponsors Titanium Sponsors. ETL Tool (SSIS, etc) EDW (SQL Svr, Teradata, etc) Extract Original Data Load Transformed Data Transform BI Tools.

Analytics Map Reduce Query Insight Hive Pig Hadoop SQL Map Reduce Business Intelligence Predictive Operational Interactive Visualization Exploratory.

NoSQL for the SQL Server Pro

Server Files Server RUNTIME Code.

fs.azure.account.key.accountname enterthekeyvaluehere.

Information managers are seeking innovative DBMS’s which are able to handle large data volumes in new ways or to optimize existing products and processes.

Windows Azure Fundamentals Services Storage. Table of contents Overview Cloud service basics Managing cloud services Cloud storage basics Table storage.

Server & Tools Business

AZURE DISTRIBUTED DATA Storage, HDInsight Hadoop, Azure Data Lake.

Big Data Analytics with Excel Peter Myers Bitwise Solutions.

Azure SQL DW – Elastic Data Analytics in the cloud Josh Sivey | Microsoft TSP #492 | Phoenix.

Big Data Yuan Xue CS 292 Special topics on.

Azure HDInsight And Excel Analyze unstructured data at scale, then visualize! George Walters Sr. Technical Solutions Professional, Data Platform Microsoft.

Harnessing Big Data with Hadoop Dipti Sangani; Madhu Reddy DBI210.

MSBIC Hadoop Series Hadoop & Microsoft BI Bryan Smith

Andy Roberts Data Architect

An Introduction To Big Data For The SQL Server DBA.

What’s new in SSIS 2016 CTP 2.3 (, announced and rumors)

Microsoft Ignite /28/2017 6:07 PM

1 Gaurav Kohli Xebia Breaking with DBMS and Dating with Relational Hbase.

Big Data & Test Automation

Everything you've ever wanted to know about using Control-M to integrate any application workload September 9, 2016 David Fernandez Senior Presales Consultant.

Pipe Engineering.

Connected Infrastructure

Leveraging a Hadoop Cluster from SQL Server Integration Services

Azure Data Lake Store & Analytics

Microsoft’s shiny dashboard-tool

5/7/ :44 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.

PROTECT | OPTIMIZE | TRANSFORM

Agile BI with SQL Server 2014 & TFS 2013

Why Is My SQL DW Query Slow?

Incrementally Moving to the Cloud Using Biml

Data Warehouse in the Cloud – Marketing or Reality?

Connected Infrastructure

Azure SQL Datawarehouse - Datawarehouse on Cloud

Cloudy with a Chance of Data

HDInsight makes Hadoop Easy

A developers guide to Azure SQL Data Warehouse

Dimodelo Solutions.

07 | Analyzing Big Data with Excel

Analytics for Apps: Landing and Loading Data into SQL Data Warehouse

Database migrated to Azure SQL DB. Checked.

What is the Azure SQL Datawarehouse?

SQL Server Analysis Services Fundamentals

SQL Server Analysis Services Fundamentals

Building ETL/ELT Workloads with Azure Data Factory V2

Massively Parallel Processing in Azure Comparing Hadoop and SQL based MPP architectures in the cloud Josh Sivey SQL Saturday #597 | Phoenix.

A developers guide to Azure SQL Data Warehouse

Populating a Data Warehouse

Orchestration and data movement with Azure Data Factory v2

SSIS in the Cloud Integration Runtime in Azure Data Factory V2

Managing batch processing Transient Azure SQL Warehouse Resource

Data analytics with Hadoop In the Microsoft Azure cloud

Azure Data Lake for First Time Swimmers

THR1171 Azure Data Integration: Choosing between SSIS, Azure Data Factory, and Azure Databricks Cathrine Wilhelmsen, | cathrinew.net.

Context about the Data Warehouse

Hybrid data warehousing

Building ETL/ELT Workloads with Azure Data Factory V2

Orchestration and data movement with Azure Data Factory v2

Understanding Azure Data Engineering Options Finding Clarity in a Vast & Changing Landscape Cameron Snapp.

ETL Patterns in the Cloud with Azure Data Factory

Big-Data Analytics with Azure HDInsight

Azure Data Factory V2: SSIS in the Cloud or Not?

Beyond orchestration with Azure Data Factory

Microsoft Azure Services Platform

SQL Server 2019 Bringing Apache Spark to SQL Server

Presentation transcript:

ETL: To Cloud or Not to Cloud Darryl Wolfaardt | Mettle Consulting #479 SQL Saturday South Island

Why should we care? Elasticity! Ease of Configuration Compute vs Storage Data at Rest vs Data in Use Ease of Configuration Return to command line Buyer beware! $$$$ SQL SATURDAY | #479 | South Island 2016

Everything’s different Everything’s the same Data Storage Movement Query New(ish) Concepts Schemaless (NoSQL) Blobs Streams

Data Landscape Languages SQL Hive Data Integration Pig ADF Hbase SSIS Polybase Data Integration ADF SSIS REST OLE ODBC AZCopy PS Data Movement Services Sqoop OR Azure Data Factory

Its all about bandwidth Considerations Choice of tools Architecture and Patterns Location of SSIS engine Compression Source destination locations

Questions Please make sure you visit our fantastic sponsors: SQL SATURDAY | #479 | South Island 2016

Darryl Wolfaardt | Mettle Consulting SQL SATURDAY | #479 | South Island 2016