3. NoSQL technologies are a fundamental part of Azure today ! !

4. Data is as critical as ever It’s what the people who pay us care most about Data is much more plentiful Storage costs are lower There are bigger data sources: -Web-scale applications -Internet of Things (IoT) -More New data technologies abound NoSQL Big data analytics Search Our field was originally called data processing This isn’t the post-SQL era, but it is the SQL+ era

5. On-Premises Cloud The Trend SQL SQL+

7. Operational Data Analytical Data Managed service provided by Azure Key/Value Store (Tables, Riak, …) Software that can run in Azure virtual machines NoSQL Technologies SQL Technologies Big Data Analytics (HDInsight, Hadoop) Document Store (DocumentDB, MongoDB, …) Relational Database (SQL Database, SQL Server, Oracle, MySQL, …) Column Family Store (HBase, Cassandra …) Relational Analytics (SQL Server, Oracle, MySQL, …)

8. Tables Column Name Column Type SQL Query SQL Query Primary Key Data SQL Database char NameID int date LastUse char CountryAge int 1 3 2 7 Application

9. SQL Database Elastic Scale (in preview) now supports sharding Shard 1 Shard 2 Shard 3 Sharded Database Adam Andrew Anusha Bertrand Bill Carl Catherine Cynthia Database Adam Andrew Anusha Bertrand Bill Carl Catherine Cynthia Atomic transactions typically span only a single shard

10. SQL Database Category Relational Storage Abstractions Tables, rows, columns Transaction Support All rows and tables in a database Secondary Indexes Yes Pricing Units of throughput Stored Procedure/ Triggers Written in T-SQL Query Language SQL Maximum Database Size 500 GB With Elastic Scale, 100s of TBs

11. To scale for lots of users and lots of data Pros: NoSQL technologies can offer more scalability than relational databases Cons: Often lose some benefits of relational databases, e.g., database-wide transactions To work better with different data formats, e.g., JSON Pros: Avoiding object/relational mapping makes code easier to write Cons: Limited BI tools; persistent data designed for a single application is harder to share To work with data in a more flexible way Pros: NoSQL technologies don’t have fixed schemas Cons: Fixed schemas help prevent errors

12. Collections Request Document 1 { "name": "John", "country": "Canada", "age": 43, "lastUse": "March 4, 2014" } { "name": "Eva", "country": "Germany", "age": 25 } Document 2 { "name": "Lou", "country": "Australia", "age": 51, "firstUse": "May 8, 2013" } Document 3 { "docCount": 3, "last": "May 1, 2014" } Document 4 {…} DocumentDB Application

13. RESTful access methods For Create/Read/Update/Delete (CRUD) operations DocumentDB SQL A query language with SQL-derived syntax Example: SELECT c.age FROM customers c WHERE c.name = "Lou" Executing logic in the database Stored procedures Triggers User-defined functions (UDFs) -Allow extending DocumentDB SQL All written in JavaScript

14. Web Browser JavaScript Application Phone/Tablet Native Apps Microsoft Azure Node.js JavaScript Server Code Web Sites JSON Collection JSON DocumentDB JSON Request JSON

15. Collection Database JSON Collection JSON Atomic transactions can span only a single collection The unit of sharding is a collection

16. Database Shard A What does a reader see? A write to the primary replica takes time to propagate to the secondaries Primary replica Secondary replica Shard A Replication can improve performance and availability

17. Session Strong Bounded Staleness Yes, but only for writes by other clients Yes, but only within a specified interval No Eventual Moderately slow No Readers might see out- of-order updates No Readers might see old data Slowest Speed of reads Speed of writes Slowest Fastest Yes Yes, but only for writes by other clients Yes Fastest Moderately fast Fastest The default

18. Pricing Transaction Support Secondary Indexes SQL Database Storage Abstractions Category DocumentDB Relational Document store Tables, rows, columns Collections, documents All rows and tables in a database Yes Units of throughput All documents in the same collection Stored Procedures/ Triggers Written in T-SQL Written in JavaScript Query Language SQL Extended subset of SQL Maximum Database Size 500 GB 100s of TBs

19. Tables Partition B Partition A Property Entity 2 B Property Type Data Property Name String int String Date NameLastUse CountryAge String int String Name CountryAge String int String Date NameFirstUse CountryAge Row key 1 2 1 2 Partition key A A B B int Date Last Count 2 B Azure Tables Application

20. Partitions are replicated; reads and writes provide strong consistency Table Partition A Partition B Partition C A 1 A 2 A 3 B 1 B 2 B 3 C 1 C 2 C 3 Atomic transactions can span only a single partition The unit of sharding is a partition

21. Pricing Transaction Support Secondary Indexes SQL Database Tables Storage Abstractions Category DocumentDB Relational Key/value store Document store Tables, rows, columns Collections, documents All rows and tables in a database Yes No Yes Units of throughput GBs of storage Units of throughput Tables, partitions, entities All entities in the same partition All documents in the same collection Stored Procedures/ Triggers Written in T-SQL None Written in JavaScript Query Language SQL Subset of OData queries Extended subset of SQL Maximum Database Size 500 GB 100s of TBs

22. Tables Column Key (Qualifier) Column Key (Family) 2LastUsev2Usage User Usage Name CountryLastUseFirstUse Row Key Age Data (optionally with time-stamped versions) 1 2 3 5 6 4 HDInsight HBase Application HDInsight supports Phoenix for SQL queries on HBase

23. Table Region A Region B Region C The unit of sharding is a region Regions are replicated; reads and writes provide strong consistency HBase automatically shards a table; users don’t see regions Atomic transactions can span only a single row

24. Pricing Transaction Support Secondary Indexes SQL Database Tables Storage Abstractions Category DocumentDB Relational Key/value store Document store Tables, rows, columns Collections, documents All rows and tables in a database Yes No Yes Units of throughput GBs of storage Units of throughput Tables, partitions, entities All entities in the same partition All documents in the same collection Stored Procedures/ Triggers Written in T-SQL None Written in JavaScript HDInsight HBase Column family store Tables, rows, columns, ce lls, column families No GBs of storage plus VMs per hour All cells in the same row Written in Java Query Language SQL Subset of OData queries Extended subset of SQL SQL subset w/ Phoenix Maximum Database Size 500 GB 100s of TBs

25. Hadoop Technologies HDFS HBase YARN Azure HDInsight provides these as a managed service Storm MapReduce... Tez Hive, Pig, …

26. Blob 1000110100110 0111101111101 1011010001101 Blob 1000110100110 0111101111101 1011010001101 Blob 1000110100110 0111101111101 1011010001101 Azure Blobs HDFS API Excel Tez/ MapReduce Job Logic Hive Pig... VM HDInsight HDInsight HBase is also implemented on this API and relies on Azure Blobs...

28. Operational Data Relational/ NoSQL Store Index Azure Search Index Search requests Search results Read/write requests Results Application User

29. Online retailer Example: An online shoe store User-generated content site Example: A discussion site for movie buffs Custom business application Example: An employee benefits application

30. high high heels high tops high arch Users expect suggestions Azure Search doesn’t provide any UI components

31. Contoso Brand High Heels Pumps, stilettos, and more Fabrikam’s Fancies High heels for fun! High Heels for Everybody Fashion, fashion, and more fashion Search terms shown in bold Results returned in a specific order

32. Price $100 or less (10) $100 - $250 (14) $250 and up (9) Color Contoso Pumps $129.95 Fabrikam Flower $59.99 Fabrikam Lipstick Heels $489.95 Contoso Stilettos $350.00 (34) (22) (19) (11) (21) (5) (9) (10) Help with the user’s next search Requires more information than a simple text UI

33. Azure Search Create index Schema Application Index

34. Category String Searchable, Suggestions, Sortable, Retrievable, Filterable Style String Searchable, Suggestions, Sortable, Retrievable, Filterable Color Collection(String) Searchable, Suggestions, Retrievable, Filterable, Facetable Brand String Searchable, Suggestions, Sortable, Retrievable, Filterable Price Double Searchable, Sortable, Retrievable, Filterable, Facetable Picture String Retrievable Stock Int32 Promotion Boolean Name Type Other Attributes For ordering search results Holds a URL to an Azure blob

35. Azure Search Provide data Application Index

36. False True Contoso Boots High Heels Tuxedo Fabrikam http://... 100 10 158 34 $134.79 $489.95 $59.99 $500.00 White, Black Pink Red Black Beatle Lipstick Heels Flower Black... CategoryBrand Style Price Picture Stock Promotion Color Sneakers Contoso White, Black $29.95 http://... 194 True HiTops Contoso True High Heels http://... 285 $129.95 Red Pumps Contoso TrueHigh Heels http://... 23 $350.00 Red, Black Stilettos

37. Price $100 or less $100 - $250 $250 and up Color Contoso Pumps $129.95 Fabrikam Flower $59.99 Fabrikam Lipstick Heels $489.95 Contoso Stilettos $350.00 Azure Search Index User text=“high heels” Search Request Application Search Result high heels

38. False True Contoso Boots High Heels Tuxedo Fabrikam http://... 100 10 158 34 $134.79 $489.95 $59.99 $500.00 White, Black Pink Red Black Beatle Lipstick Heels Flower Black... Sneakers Contoso White, Black $29.95 http://... 194 True HiTops Contoso True High Heels http://... 285 $129.95 Red Pumps Contoso TrueHigh Heels http://... 23 $350.00 Red, Black Stilettos Returned by a search for “high heels” CategoryBrand Style Price Picture Stock Promotion Color

39. Price $100 or less (10) $100 - $250 (14) $250 and up (9) Color Contoso Pumps $129.95 Fabrikam Flower $59.99 Fabrikam Lipstick Heels $489.95 Contoso Stilettos $350.00 (34) (22) (19) (11) (21) (5) (9) (10) Made possible by facets Contoso is first because of the promotion Pumps are first because there are more in stock

41. Analytical Data Relational Data Warehouse BI Applications Internal Users Operational Data Relational Database End Users Applications

42. Search Data Indexes Analytical Data Unstructured Data Relational Data Warehouse End Users Operational Data Relational Database NoSQL Store Internal Users BI Applications Applications

43. Operational Data Relational Database NoSQL Store Analytical Data Search Data Indexes Unstructured Data Relational Data Warehouse HDInsight Hadoop DocumentDB, Tables, HDInsight HBase Search Managed service provided by Azure Software that can run in Azure virtual machines SQL Server in an IaaS VM SQL Server in an IaaS VM, SQL Database

44. Use SQL Database when: You want relational data You want to get your application up as fast as possible You want your application to require minimal management Use DocumentDB, Tables, or HDInsight HBase when: You need more scale than relational allows You want a non- relational data model You don’t want to be locked into a schema Use Azure Search when: You want to provide a search interface to your users Use HDInsight Hadoop Tez/MapReduce when: You want to do big-data analytics

45. NoSQL technologies are a fundamental part of Azure today ! !

46. David Chappell is Principal of Chappell & Associates (www.davidchappell.com) in San Francisco, California. Through his speaking, writing, and consulting, he helps people around the world understand, use, and make better decisions about new technology. David has been the keynote speaker for more than a hundred events and conferences on five continents, and his seminars have been attended by tens of thousands of IT leaders, architects, and developers in fifty countries. His books have been published in a dozen languages and used regularly in courses at MIT, ETH Zurich, and other universities. In his consulting practice, he has helped clients such as Hewlett-Packard, IBM, Microsoft, Stanford University, and Target Corporation adopt new technologies, market new products, and educate their customers and staff.

47. NO PURCHASE NECESSARY. Open only to event attendees. Winners must be present to win. Game ends May 9 th, 2015. For Official Rules, see The Cloud and Enterprise Lounge or myignite.com/challenge