What Azure have to offer for your data BY Jean-Rene (JR) Roy 11/13/2018
ME Jean-Rene Roy OR JR ROy Independent Consultant for 28 years Data Platform MVP for the pass 12 years Software , DB Architect and team lead for many enterprises Program Lead for Ottawa Data Meetup Founder of SQLTeach and DevTeach SQL Server / Dynamics CRM (XRM) / TFS Specialist System Architect for TBS, HoC, CCA, Justice.ca 11/13/2018
What Azure have to offer for your data Agenda: What type of Data Storage is available? In which type of project can I use different Data Storage? Why and when can I use type of Data Storage? azureinteractives.azurewebsites.net/Azure101Cards/default.html 11/13/2018
Machine Learning is part of AI 11/13/2018
Type of Data Storage Two Types: Storage Database 11/13/2018 azureinteractives.azurewebsites.net/Azure101Cards/default.html 11/13/2018
Why so many choices? Offering the right services for the price Provide choices for different application Offer new options for backend support to application Offer global distribution of data and service Data Backup off site http://satazureday.com/ 11/13/2018
The refrigerator project Your new product is a refrigerator It got WIFI connection Camera inside the refrigerator The Services Agreement include storing the Picture in the cloude Including Data Metric of your refrigerator 11/13/2018
Storage options 11/13/2018
Why using it?: Best price for data that is not access frequently. Type of use: Very good to store NoSQL data. Allow to identify Hot, Cold and Archive data. Why using it?: Best price for data that is not access frequently. Type of data: Semi-structure data JSON ODATA Ex: Log data JSON process out put https://azure.microsoft.com/en-us/services/storage/tables/ 11/13/2018
Type of use: High volume of transaction applications process Why using it?: Provide ability to scale up or down on demand Type of data: Binary with attributes Ex: Queue of image processing Transaction log https://azure.microsoft.com/en-us/services/storage/queues/ 11/13/2018
Type of use: Storage and sharing of files Why using it?: When you need to store files of different format accessible anyware. Type of data: Any type of file format Ex: Replication and Sync of document on-premises 11/13/2018
Type of use: Provide disk space to Virtual Machines Why using it?: To support VM on persistent operation Type of data: Any type Ex: Provide disk space on VM running SQL Server 11/13/2018
Type of use: Store different type of data in large scale Why using it?: Big Data storage space for Machine learning Type of data: Any type Ex: Provide disk space on VM running SQL Server https://azure.microsoft.com/en-us/services/data-lake-store/ 11/13/2018
Azure Data Lake and Data Factory https://azure.microsoft.com/en-us/solutions/data-lake/ https://azure.microsoft.com/en-us/documentation/articles/data-factory-introduction/
Data factory Type of use: Extract Transform and Load (ETL) in the cloud Why using it?: Moving data between different storage Type of data: Any type Ex: Data Lake data move to Data Warehouse 11/13/2018
Get started with U-SQL http://blogs.msdn.com/b/visualstudio/archive/2015/09/28/introducing-u-sql.aspx http://www.eweek.com/developer/microsoft-introduces-u-sql-query-language.html
Type of use: Use to support on-premises storage Why using it?: Provide off site store, backup location (Imagine your Z: drive Type of data: Cold and Archive data, Office Files Ex: Provide off site storage to on-premises. Your Z: drive on your PC or Mac. https://azure.microsoft.com/en-us/services/storsimple/ 11/13/2018
Type of use: Storage space use for backup Why using it?: Offer 99.9% availability Geo-Replicated Type of data: Backup Ex: SQL Server Backup in the cloud https://azure.microsoft.com/en-us/services/backup/ 11/13/2018
Backup to Windows Azure Simple configuration UI Easy creation of Azure credential No overhead Restore GUI Backup GUI
Type of use: Support of VM, manages disaster recovery Why using it?: Provide security on VM infratructure Type of data: VM Containes Ex: Application developed on VMs 11/13/2018
Type of use: Used by big corporation heavy lifting of data center. Service include File, Disk space, Blob, Queue and Table. Why using it?: Provide a large amount of services with a single service agreement. 11/13/2018
Database Options 11/13/2018
Virtual Machine running SQl Server Type of use: Control over the data base server Why using it?: Costume development build on Servers Type of data: Any Server Database Ex: Legacy application using mix of data storage 11/13/2018
SQL DataBAse Type of use: SQL Server Database use by application Why using it?: Provide Database Service in the Cloud for application , web site or services Type of data: Relational Data Ex: Mobile App using database https://azure.microsoft.com/en-us/services/sql-database/ 11/13/2018
R and Pyton Integration in SQL Server 2017 Now call Machine learning http://www.blue-granite.com/blog/5-reasons-microsofts-r-integration-in-sql-server-will-be-revolutionary https://www.simple-talk.com/sql/reporting-services/making-data-analytics-simpler-sql-server-and-r/
Azure Database for MySQL Type of use: MySQL Database use by application Why using it?: Provide Database Service in the Cloud for application , web site or services Type of data: Relational Data Ex: Mobile App using database https://azure.microsoft.com/en-us/services/mysql/ 11/13/2018
Azure Database For ProgresSQL Type of use: ProgressSQL Database use by application Why using it?: Provide Database Service in the Cloud for application , web site or services Type of data: Relational Data Ex: Mobile App using database https://azure.microsoft.com/en-us/services/postgresql/ 11/13/2018
SQL Data warehouse Type of use: BI in the Cloud. Large Database and Cube Why using it?: Data is already in the cloud and you need to build a warehouse Type of data: Relational Data, Star schema, Data Mart, Cube Ex: Bank BI https://azure.microsoft.com/en-us/services/sql-data-warehouse/?v=17.44 11/13/2018
SQL Server Stretch Database Type of use: Extending on Premise SQL Server Database in the cloud Why using it?: Save the infrastructure on premise and save $$$ for archive data Type of data: Relational Data Ex: OLTP Database with Archive data in the cloud https://azure.microsoft.com/en-us/services/sql-server-stretch-database/ 11/13/2018
Azure Cosmo DB Type of use: Application using NoSQL Why using it?: Need to provide world wise services to application Type of data: NoSQL Ex: Uber Mobile app, IoT application https://azure.microsoft.com/en-us/services/cosmos-db/?v=17.45a 11/13/2018
What is NoSQL? DBA thinks NoSQL is just for the Dev guy’s and it will go away like the Trump government. You may be right about the Trump government but NoSQL is here to stay and it’s something that is more related to the DBA role. Reference: https://www.upwork.com/hiring/data/sql-vs-nosql-databases-whats-the-difference/
Cosmo DB NoSQL What is Document DB? Not for Document but for JSON Query language is like TSQL It got Stored Procedure, Index… http://justazure.com/mongodb-vs-azure-documentdb/ https://channel9.msdn.com/Shows/Data-Exposed/Introduction-to-Azure-DocumentDB http://www.techrepublic.com/article/microsoft-azure-delivers-nosql-storage-via-documentdb/ http://weblogs.asp.net/scottgu/azure-new-documentdb-nosql-service-new-search-service-new-sql-alwayson-vm-template-and-more http://dl.windowsazure.com/documentDB/jsserverdocs/
Table Storage Type of use: Application using NoSQL, simple data storage, Log data enterprise level Why using it?: Low price Type of data: NoSQL Key-value semi- structure dataset Ex: Xbox data 11/13/2018
Redis Cache Type of use: Cache data, when application need fast access to semi-static data Why using it?: Speed up application Type of data: NoSQL, Object Ex: Mobile app Ad, Web site Page https://azure.microsoft.com/en-us/services/storage/tables/ 11/13/2018
Enterprise integration 11/13/2018
References Azure 101 http://azureinteractives.azurewebsites.net/Azure101Cards/default.html Amazon Calculater http://calculator.s3.amazonaws.com/index.html Google Services: https://cloud.google.com/?utm_source=google&utm_medium=cpc&utm_campaign=2 015-q2-cloud-na-gcp-bkws-freetrial- en&gclid=EAIaIQobChMIv_q3ppG12wIVgq_sCh26GQVLEAAYASAAEgKz1_D_BwE& dclid=CPWlsamRtdsCFfcLrQYdRusPfw 11/13/2018
Questions ? 11/13/2018