1. Server & Tools Business
4/27/2017
Big Data Analytics Module 3 – Using SQOOP and Windows Azure Reporting Services
Saptak Sen, Microsoft
Bill Ramos, Advaiya
Hello, this is Saptak Sen again.
In this presentation, you’ll learn how to use the reporting capabilities of SQL Server against Hadoop data.
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. Server & Tools Business
4/27/2017
Agenda
Working with Sqoop in Microsoft HDInsight
Windows Azure Reporting Services
Demo
Here’s what we’re going to cover today. First, I’ll show you how to use Sqoop to move data between a relational database like Window Azure SQL Database and Hadoop. Then, we’ll talk about how to use SQL Server Reporting Services to create a report from the data you got from Hadoop.
From there, we’ll jump into Windows Azure SQL Reporting Services technology and learn how to host reports on Windows Azure.
Finally, we’ll wrap things up with a demo for each of the technologies we covered.
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. Server & Tools Business
4/27/2017
SQOOP
Lets first talk about SQOOP
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4. Using Sqoop to Move Data
A tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases
Command
Enterprise Data Warehouse
Document Based Systems
Relational Database
Hadoop
Talk Track: Let’s start with Sqoop, Sqoop is an open-source connectivity framework that facilitates transfer between multiple relational database management systems (that is, RDBMS) and HDFS. Sqoop uses MapReduce programs to import and export data. The imports and exports are performed in parallel with fault tolerance. The source or target files being used by SQOOP can be delimited text files (for example, with commas or tabs separating each field), or binary SequenceFiles containing serialized record data.
Key Points:
SQOOP
Map Tasks
References:
NEXT SLIDE
Specifics items to be covered:
SQOOP Import/Export Commands
Reference/Source:
Sqoop
Map Task
HDFS/HBase/ Hive

5. Demo 1: Using SQOOP to Copy Data
Server & Tools Business
4/27/2017
Demo 1: Using SQOOP to Copy Data
Batch Layer
Speed Layer
Serving Layer
Windows Server HDInsight
Azure Blob storage
Hive and Sqoop
Windows Azure SQL Database
HDInsight Console
Talk Track: In this demo, we’re going to see how Sqoop is used to move data from a Hive table into a Windows Azure SQL database.
|----Click----|
SQOOP Export command is provided on the Hadoop command line tool.
The Export command sends request to the HDFS/Hive/HBase cluster to export the data.
Once the request is processed, it starts performing MapReduce and start exporting the data to SQL Database.
Similarly, the same process can be applied for data import. Data import can be performed using SQOOP Import command which will import the data from SQL Database to the HDFS cluster.
HDFS/Hive/HBase
Sqoop Export command
on Hadoop command line
Sqoop Command
Export
SQL Database
Sqoop Command
Import
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. Server & Tools Business
4/27/2017
Windows Azure Reporting Services
Let’s now look at Windows Azure Reporting Services
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Windows Azure SQL Reporting Scenarios
Server & Tools Business
4/27/2017
Windows Azure SQL Reporting Scenarios
Operational reports over Windows Azure SQL database
Customers can report over their Windows Azure SQL database, not necessarily with the intent to embed them into an application.
Embedding reports into the Windows or Azure application
Developers can use the same patterns and tools they use today to embed reports into their applications in connected mode against the SQL Reporting service.
Talk Track: Apart from SQL Server Reporting, another Reporting tool is Windows Azure SQL Reporting. Lets first start with different scenarios related to Windows Azure SQL Reporting that stand out and then we will understand what it is and how it works. The first scenario focuses on operational reports where the data is in the cloud and you can view the reports with your browser. The second scenario is where your application embeds the reporting services web control so that the reports can be shown as if they were part of your web application.
Key points:
Windows Azure SQL Reporting scenarios
References:
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8. Windows Azure SQL Reporting
A cloud-based reporting service for the Windows Azure Platform
SQL Reporting provides many benefits, including rapid provisioning, cost-effective scalability, high availability, reduced management overhead, and secure access for viewing and managing reports
RS GPM
Tenant Data
Load Balancer
Gateway
Gateway
Gateway
Directory Services
Allocation + Service
RS Instance
Talk Track: Windows Azure SQL Reporting is a cloud-based reporting service for the Windows Azure Platform built on SQL Server Reporting Services technologies. It gives you a whole bunch of benefits, including rapid provisioning, cost-effective scalability, high availability, reduced management overhead, and secure access for viewing and managing reports.
Let’s see how it all works.
First, you need to reference a web service endpoint pointing to report.rdl. Then, a request comes through the load balancer and hits a few application tiers, like the intelligent metadata routing tier. Not so different from how the SQL Database was implemented. With smart routing, a request is processed and sent to the best rs instance to increase control and security or the availability of the system. If a particular report takes down a node, it quickly stops routing requests to that node.
There’s multitenancy at work here too. Each tenant gets its own catalog and TempDB database.
What’s really great is that Windows Azure SQL Reporting is built on top of the SQL Database. The data tier used for SQL Reporting is SQL database. And the application tier is built on Windows Azure for scalability.
When it comes to security the authentication mechanism, it is the basic auth because reporting is built on SQL Database, so it inherits a lot of its security mechanisms.
Key Points:
Windows Azure SQL Reporting – Basic architecture and How it works
References: Presentations_SQLReporting_SQLReporting.pptx
RS Instance
Monitor/Comm
[SLA & Usage]
[Performance]
[Traces & Logs]
RS Instance
SLA Conformation
Monitor/Comm
[SLA & Usage]
[Performance]
[Traces & Logs]
Monitor/Comm
[SLA & Usage]
[Performance]
Load Balancing
Operations
RS Engine
Monitoring
[Alerting]
[Performance]
[Traces & Logs]
RS Engine
RS Engine
Customer Service
Billing/Usage
Windows Azure SQL Database

9. Demo 2: Windows Azure SQL Reporting
Server & Tools Business
4/27/2017
Demo 2: Windows Azure SQL Reporting
Batch Layer
Speed Layer
Serving Layer
Windows Azure SQL Database
Reporting Services
Talk Track: In the final demo for this session, we’re going to take a look at how to deploy the report to Windows Azure Reporting Services.
|----Click----|
Windows Azure SQL Reporting, using SQL Server Data Tools, send request to the Windows Azure SQL Database.
In return, Windows Azure SQL Database respond back to the Reporting Services and provide the desired data for generating reports.
Windows Azure SQL DB
Reporting Services (SSDT)
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

10. Server & Tools Business
4/27/2017
Learn more
Windows Azure SQL Reporting
Hadoop on Windows Azure - Working With Data
Check out these links for more information on the topics we covered in this module.
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11. Questions?