1. Getting to know U-SQL Azhagappan Arunachalam

2.  Sr Database Architect  az@sqlaz.com az@sqlaz.com  @sqlaz

3. Agenda  What is U-SQL?  Where does it fit in?  A brief history of U-SQL  Getting started with U-SQL  Demo  … and some more demo

4. What is U-SQL?  It’s a new processing language that leverages T-SQL with.net (C#)  Aligns U-SQL metadata system, syntax and language semantics with T-SQL/ANSI SQL  Uses C# data types and expression language  Integrates features available in Hive and other big data languages to identify patterns and data processing requirements

5. Brief History of U-SQL  Came out of Microsoft internal development – SCOPE (Structured Computations Optimized for Parallel Execution)  Currently being used for Big Data analytics at Microsoft, for their Bing, XBox, and Office 365 product lines  Supposedly 100,000 of jobs are being run based on U-SQL  Introduced to the public at Build 2015 alongside Azure Data Lake Services  Still in public preview…

6. https://azure.microsoft.com/en-us/solutions/data-lake/

7. Connected World...  World is moving towards a weightless economy  Purchasing is being replaced by subscription based services  We have lots of data points with IP address (IoT devices)  Collect everything  Analyze anything  & Predict the foreseeable future

8. https://azure.microsoft.com/en-us/solutions/data-lake/

18. Getting Started with ADL/U-SQL  What you need to get started?  An azure data lake analytics account (along with an azure data lake storage account)  Works with Visual Studio 2012, 2013 & 2015 – even Community Edition  Install the Azure SDK (pre-requisite to installing the ADL components/plug-ins)  Install ADL Tools for Visual Studio plug-in (http://aka.ms/adltoolsvs )http://aka.ms/adltoolsvs  Heard of the Microsoft Dev Essentials program?  https://www.visualstudio.com/en-us/products/visual-studio-dev-essentials-vs.aspx https://www.visualstudio.com/en-us/products/visual-studio-dev-essentials-vs.aspx  Some of the benefits:  6-months of pluralsight training free  VSTS team services – basic level  Visual Studio Community & Visual Studio Code (Mac/Linux anyone?)  Microsoft R Server – developer edition  $25 monthly Azure credit  Xamarin University free training etc.,

19. Demo  Signing up for Azure Data Lake service accounts  Data Lake Analytics Account  Data Lake Storage Account

32. Demo  U-SQL scripting

33. Summary We saw…  What is U-SQL?  Where does it fit in?  A brief history of U-SQL  Getting started with U-SQL  Demo  … and addl demos  And remember to save ~$500 by signing up for the Dev Essentials program

34. References  Lay of the land - https://azure.microsoft.com/en-us/documentation/learning- paths/data-lake-analytics-self-guided-training/https://azure.microsoft.com/en-us/documentation/learning- paths/data-lake-analytics-self-guided-training/  U-SQL on MSDN (https://msdn.microsoft.com/en-us/magazine/mt614251.aspx)https://msdn.microsoft.com/en-us/magazine/mt614251.aspx  ADL Public Preview (https://azure.microsoft.com/en-us/solutions/data-lake/)https://azure.microsoft.com/en-us/solutions/data-lake/  http://usql.io/ http://usql.io/  http://aka.ms/adltoolsvs - to download the latest azure data lake tools for visual studio http://aka.ms/adltoolsvs

35. Thank You Sponsors