1. Microsoft 2016
4/26/ :56 AM
BRK2232
Combine SQL Server, R, and Cortana Intelligence for advanced analytics in the real world
Rafal Lukawiecki
Data Scientist
Project Botticelli Ltd
@rafaldotnet
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. Objectives Why combine SQL+R+Cortana?
Real-world advanced analytics, data science, AI
The information herein is for informational purposes only and represents the opinions and views of Project Botticelli and/or Rafal Lukawiecki. The material presented is not certain and may vary based on several factors. Project Botticelli Ltd and Microsoft make no warranties, express, implied or statutory, as to the information in this presentation.
Copyright © 2016 Project Botticelli Ltd unless noted otherwise. Some slides contain quotations from copyrighted materials by other authors, as individually attributed or as already covered by Project Botticelli Ltd or Microsoft Copyright ownerships. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Project Botticelli Ltd as of the date of this presentation. Because Project Botticelli & Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft and Project Botticelli cannot guarantee the accuracy of any information provided after the date of this presentation. Project Botticelli makes no warranties, express, implied or statutory, as to the information in this presentation. E&OE.

3. Study with projectbotticelli.com Online training PPTs Offer
Data Science Data Mining
Introduction to BI & Big Data
Power BI DAX
Cube Design MDX
Excel BI
PPTs
projectbotticelli.com/ppt
Offer
$50 off annual memberships (exp 31 Oct 2016): 50IGNITE2016

4. Learn with me!
Hands-on 5-day Practical Data Science (SQL+R+Cortana) class:
London 24 Oct technitrain.com/coursedetail.php?c=68
Chicago 7 Nov sqlskills.com/rafal
Zurich 14 Nov ch.atosconsulting.com/rafal
Oslo 21 Nov glasspaper.no/rafal
Stockholm 28 Nov cornerstone.se/rafal
More info: projectbotticelli.com/courses

5. Why do my customers need advanced analytics?

6. 4/26/2018
Why?
Discover reason behind success, failure
Understand customers, products, patterns
Accurately plan future
Experiment before making decisions
Experiment with autonomous decision making (AI)
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Advanced analytics, or data science, or artificial intelligence?

8. Prepare
Explore, visualise
Data science
Acquire
Advanced analytics

9. Data science more than data engineering
Scientific method of reasoning applied to data and analytics
Hypothesis, experiments, facts, logical reasoning
+ data engineering

10. Data science Data wrangling (munging), retrieval + storage
Data mining & machine learning
Statistics
Big data
Data science

11. AI in practice Machine learning models Business change
Autonomous, “intelligent” decisions
Business change
AI in practice
Artificial Intelligence
System that perceives its environment and takes actions to maximize its chance of success.
Russell & Norvig, 2003

12. Real-world team for advanced analytics
Data expert
Data scientist
Domain expert
Real-world team for advanced analytics

13. Example: hospital readmissions
Does enough data show examples of readmission?
Are the predictable patterns of readmitting?
Can we reduce readmissions? What is readmission?
Example: hospital readmissions

14. 4/26/ :56 AM
Tools we use
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15. Chart from "2015 Data Science Salary Survey” used with permission.
© 2016 O'Reilly Media
For more info, and great titles on data science, visit oreilly.com

16. Chart from "2015 Data Science Salary Survey” used with permission.
© 2016 O'Reilly Media
For more info, and great titles on data science, visit oreilly.com

17. My recommended approach
SQL Server 2016 Data Mining
SQL Server 2016 R Services
Cortana Intelligence Suite: ML
Easy, visual, intuitive, Excel,
just works!
Statistics, packages, enterprise scalable
Advanced algorithms, ready-to-use, web services

18. Data in my practice: on-prem
4/26/2018
Data in my practice: on-prem
SQL Server 2016
SQL Operational Data Store (ODS)
SQL Data Warehouse
R and Microsoft R Server
Hortonworks Data Platform (HDP)
Hadoop Distributed File System and Hadoop compute
Open source: Redis, Cassandra, MongoDB
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19. SQL Server 2016 PolyBase Combining relational & big data
4/26/2018
SQL Server 2016 PolyBase Combining relational & big data
SQL Server
Hadoop
Predicted premium:
************************
**********************
*********************
***********************
$658.39
T-SQL query
Name
DOB
State
Denny Usher
11/13/58 WA
Gina Burch
04/29/76
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

20. Data in my practice: cloud
4/26/2018
Data in my practice: cloud
Azure SQL Database
Replication and SQL Server Stretch Database
Azure BLOB, Table
Azure Data Warehouse
HDInsight & Azure Data Lake
DocumentDB
Redis
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

21. SQL Server Analysis Services Data Mining
SQL Server: much more than a database
SSAS DM: Machine learning and visualisation
Older technology but still very useful
Relatively easy to use and deploy
Good visualisations especially for cluster analysis and debugging, decision trees, association rules and sequence clustering

22. Demo 1. Finding pivotal products (MBA) 2
Demo 1. Finding pivotal products (MBA) 2. Customer lifetime value Microsoft SQL Server 2016 Analysis Services

23. Microsoft R Microsoft R Open Microsoft R Client Microsoft R Server…
…for Hadoop, …for Teradata, …for Linux (SUSE, Red Hat/CentOS)
Microsoft SQL Server 2016 R Services
Microsoft R Open in Azure ML
Formerly Revolution Analytics

24. Why R? Add statistical strength and elegance to your analysis
7000+ packages that answer your complex questions

25. Demo Do elderly with dementia stay longer in hospitals
Demo Do elderly with dementia stay longer in hospitals? Microsoft R, RStudio

26. R and big (complex) data
Traditional R cannot cope with larger datasets or high-performance computations, but…
Microsoft R Server can
Parallelism, performance, scale
No need to move data (in-database)
Enterprise deployment ready

27. Demo Mortgage default risk factor modelling Microsoft SQL Server 2016 R Services, R Tools for Visual Studio

28. Cortana Intelligence Suite
4/26/2018
Cortana Intelligence Suite
Suite (like Office) of Microsoft advanced analytics and intelligence services
Simpler to buy
Service integration
One team
Joseph Sirosh, CVP
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

29. Cortana Intelligence Suite
4/26/2018
Cortana Intelligence Suite
Azure
SQL
Data Warehouse
Data Lake
Machine Learning, R, Python
HDInsight, Spark
Stream Analytics
Data Factory
Event Hubs
Data Catalog
Power BI
NoSQL
HBase, DocumentDB, MongoDB, Azure Table, MemcacheDB, Redis, HDP, CDP
Intelligence Gallery
Models: mfg, finance, retail, health…
Cognitive Services: vision, emotion, video, face, speech, speaker, text, language, knowledge, search APIs
Bot Framework
Cortana Assistant Integration
Bing Predicts
Storage
Analytics
Flow & discovery
Exploration, visualisation
Includes consulting
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

30. Demo Customer lifetime value Cortana Intelligence Suite: Azure Machine Learning + SQL Azure

31. In my practice: hybrid analytics
It all works together very well
On-prem starts all projects
Cloud is collaborative
Hybrid is powerful—and easy!

32. Demo Financial forecasting Microsoft SQL Server 2016, SQL Server 2016 R Services, SQL Azure, Azure ML and Power BI

33. Summary Now: advanced analytics with data science
4/26/2018
Summary
Now: advanced analytics with data science
Get ready for artificial intelligence tomorrow
Microsoft SQL Server 2016 Microsoft R
Cortana Intelligence Suite
Chicago: 7 Nov sqlskills.com/rafal
projectbotticelli.com
BI video tutorials, PPTs, and articles $50 off annual: 50IGNITE2016
projectbotticelli.com/courses
Discover: rafal.net
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

34. Free IT Pro resources To advance your career in cloud technology
Microsoft Ignite 2016
4/26/ :56 AM
Free IT Pro resources To advance your career in cloud technology
Plan your career path
Microsoft IT Pro Career Center
Cloud role mapping
Expert advice on skills needed
Self-paced curriculum by cloud role
$300 Azure credits and extended trials
Pluralsight 3 month subscription (10 courses)
Phone support incident
Weekly short videos and insights from Microsoft’s leaders and engineers
Connect with community of peers and Microsoft experts
Get started with Azure
Microsoft IT Pro Cloud Essentials
Demos and how-to videos
Microsoft Mechanics
Connect with peers and experts
Microsoft Tech Community
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

35. Please evaluate this session
4/26/ :56 AM
Please evaluate this session
Your feedback is important to us!
From your PC or Tablet visit MyIgnite at
From your phone download and use the Ignite Mobile App by scanning the QR code above or visiting
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

36. 4/26/ :56 AM
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.