5. Intelligent apps Powered by Advanced Analytics

6. 6 SQL Server enables data mining using SSAS Computers work on users behalf, filtering junk email Microsoft search engine built with machine learning Bing Maps ships with ML traffic- prediction service 1999200820042005 Microsoft Kinect can watch users gestures Microsoft launches Azure Machine Learning Successful, real-time, speech-to- speech translation 201220142010 Microsoft launches R server for scalable, enterprise grade analytics SQL ‘16 supports advanced analytics in- DB using R 20152016 I believe over the next decade computing will become even more ubiquitous and intelligence will become ambient. This will be made possible by an ever-growing network of connected devices, incredible computing capacity from the cloud, insights from big data, and intelligence from machine learning. Machine learning is pervasive throughout Microsoft products.

7. Value Data ActionDecisions Advanced Analytics Predictive & Prescriptive Analytics Business Intelligence Descriptive & Diagnostic Analytics

8. Large computers and related products/services

9. Operationalize Model Prepare

10. Intro to R The Language of Advanced Analytics

11. R Usage Growth Rexer Data Miner SurveyRexer Data Miner Survey, 2007-2015 Language Popularity IEEE Spectrum Top Programming LanguagesIEEE Spectrum Top Programming Languages, 2015 76% of analytic professionals report using R 36% select R as their primary tool

12. R is an open source (GNU) version of the S language developed by John Chambers et al. at Bell Labs in 80’s History of RGNU History of R R was initially written in early 1990’s by Robert Gentleman and Ross Ihaka then with the Statistics Department of the University of AucklandRobert Gentleman Ross Ihaka R is administered and controlled by the R FoundationR Foundation Microsoft is founding member and Platinum Sponsor of R ConsortiumR Consortium R Reference Card from CRAN

13. Open Source “lingua franca” Analytics, Computing, Modeling CRAN Task View by Barry Rowlingson: http://www.maths.lancs.ac.uk/~rowlings/R/TaskViews/http://www.maths.lancs.ac.uk/~rowlings/R/TaskViews/ More packages on Github and BioConductor projectGithubBioConductor project

14.  Works With Open Source R  Enterprise Scale & Performance –Scales from workstations to large clusters –Scales to large data sizes –Growing portfolio of Parallelized algorithms  Secure, Scalable R Deployment/Operationalization  Write Once Deploy Anywhere for multiple platforms –RDBMS: SQL Server & TeraData –Windows, Linux: RedHat & SUSE –Hadoop: HortonWorks, Cloudera, MapR –Cloud: AzureVMs, Azure HDInsight  R Tools for Visual Studio IDE RSR Connector R+CRAN DistributedR ScaleR ConnectR DeployR RTVS R Open Microsoft R Server

15. RSR Connector R+CRAN DistributedR ScaleR ConnectR DeployR RTVS ConnectR High-speed & direct connectors Available for: High-performance XDF SAS, SPSS, delimited & fixed format text data files Hadoop HDFS (text & XDF) Teradata Database & Aster EDWs and ADWs ODBC ScaleR Ready-to-Use high-performance big data big analytics Fully-parallelized analytics Data prep & data distillation Descriptive statistics & statistical tests Range of predictive functions User tools for distributing customized R algorithms across nodes Wide data sets supported – thousands of variables DistributedR Distributed computing framework Delivers cross-platform portability R+CRAN Open source R interpreter R 3.1.2 Freely-available huge range of R algorithms Algorithms callable by RevoR Embeddable in R scripts 100% Compatible with existing R scripts, functions and packages Microsoft R Open Based on open source R High-performance math library to speed up linear algebra functions Checkpoint package to easily share R code and replicate results using specific R package versions DeployR RESTful APIs for easy integration from Java, JavaScript,.NET Enterprise authentication & security Horizontal scaling R Tools for Visual Studio State of the art, R Tools for Visual Studio IDE

17. SQL + R In-Database Advanced Analytics

18. Relevant data available in real-time  Ingest All relevant data available in real-time  Query All relevant data available for analytics in real-time  Analytics These are 3 key ingredients to build an Intelligent Application Operationalize Model Prepare

19. 0100101010110 In-memory ColumnStore In-memory OLTP Real-time business problem detection HTAP with SQL Server 2016 In-memory built-in Mission critical OLTP Up to 30x faster transactions with in-memory OLTP Up to 100x faster analytical queries Queries from minutes to seconds

24. ….. Shopping cart ….. Submitted orders ….. Intelligence

26. Microsoft R Open Microsoft R Server R IDE Data Scientist Workstation SQL Server 2016 Script Results Execution 1 2 3 sqlCompute <- RxInSqlServer() rxSetComputeContext(sqlCompute) linModObj <- rxLinMod() Microsoft R Open Microsoft R Server Advanced Analytics Extensions

27. Application Call System Stored Procedure Results: scores, plots The stored procedure contains R code and executes in-database. 1 3 exec sp_execute_external_script @ languague = ‘R’, @script = -- R code -- SQL Server 2016 2 Microsoft R Open Microsoft R Server Advanced Analytics Extensions

28. Recap

29. Operationalize R scripts and models SQL Server 2016 extensibility mechanism allows secure execution of R scripts on the SQL Server Use familiar T-SQL stored procedures to invoke R scripts from your application. Embed the returned predictions and plots in your application. Enterprise Performance and scale Use SQL Server’s in-memory querying and Columnstore Indexes Leverage RevoScaleR support for large datasets and parallel algorithms with SQL Server 2016 Enterprise Edition. Bring compute to data with In-Database analytics

31. Microsoft R Server Big-data analytics and distributed computing on Linux, Hadoop and Teradata SQL Server 2016 R Services Big-data analytics integrated with SQL Server database Visual Studio R Tools for Visual Studio: integrated development environment for R R Sample Programs Github repository of data and samples to learn capabilities of Open Source R and Microsoft R Server SQL Server 2016 Learn about the full suite of capabilities in the latest version of SQL Server