Download presentation
Presentation is loading. Please wait.
1
Power-up NoSQL with Azure Cosmos DB
12/6/2018 5:27 AM THR2169 Power-up NoSQL with Azure Cosmos DB Radu Vunvulea Senior Architect, Endava @RaduVunvulea © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
2
Purpose Understand where and how Azure Cosmos DB improved our solution
3
12/6/2018 5:27 AM Business Scenario Transport platform between devices and business systems Device management Command handling Payload assignment Payload delivery Microsoft Azure Business Systems © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
4
Command Management 12/6/2018 5:27 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
5
Command Management Azure Table for each device High throughput on R/W
12/6/2018 5:27 AM Command Management Azure Table for each device High throughput on R/W Millions of commands per second Multiple storage accounts Azure Table Service Fabric © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
6
Cosmos Command Management
12/6/2018 5:27 AM Cosmos Command Management Table used to store commands No more cross storage partitioning Reduce deployment complexity Removed storage resolver Azure Cosmos DB Service Fabric © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
7
Command Tracking 12/6/2018 5:27 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
8
Command Tracking Each command has multiple states
12/6/2018 5:27 AM Command Tracking Each command has multiple states Very high throughput on write operations Low latency Timeout detection Reporting capabilities Azure SQL Service Fabric © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
9
Cosmos Command Tracking
12/6/2018 5:27 AM Cosmos Command Tracking Table used to store commands Reduce the load on Azure SQL Scale more easily Timeout detection using Spark Generate reports using Hadoop and PowerBI Azure Cosmos DB Spark © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
10
Payload Metadata 12/6/2018 5:27 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
11
Payload Metadata Multiple Azure Tables High number of read operations
Never delete a metadata Replicate across Azure Region Custom logic for replication Risk of inconsistency Azure Table Azure Service Fabric © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
12
Cosmos Payload Metadata
12/6/2018 5:27 AM Cosmos Payload Metadata Table used to stored payload metadata information Replication across regions Removed custom syncronization layer Reduce load on internal Service Bus instances Azure Cosmos DB © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
13
Payload assignment 12/6/2018 5:27 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
14
Payload assignment Real time calculation Result caching is not allowed
12/6/2018 5:27 AM Payload assignment Service Fabric Real time calculation Result caching is not allowed Requiring computation power Relies on indexes and virtual tables Azure SQL Stored Procedures © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
15
Cosmos Payload assignment
12/6/2018 5:27 AM Cosmos Payload assignment Service Fabric Doesn’t make sense to migrate SQL engine is optimized for this kind of operations Azure SQL can scale pretty nice using partitioning Azure SQL Stored Procedures © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
16
12/6/2018 5:27 AM Device Topology © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
17
Device Topology Documents inside MongoDB
12/6/2018 5:27 AM Device Topology Documents inside MongoDB There are arround different combinations New devices appear every month Synchronization cross region Risk of inconsistency after a few years Writes operations in all nodes MongoDB Azure Service Bus Business Systems © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
18
Cosmos Device Topology
12/6/2018 5:27 AM Cosmos Device Topology Documents inside Cosmos DB Remove the custom synchronization layer No more inconsistency risk Support for future devices Azure Cosmos DB Business Systems © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
19
Payload Delivery Status
12/6/2018 5:27 AM Payload Delivery Status © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
20
Payload Delivery Status
12/6/2018 5:27 AM Payload Delivery Status Azure Service Fabric One Azure Table per device Multiple storage accounts Low throughput No synchronization cross region Reporting capabilities (hot discussions) Storage account resolver capabilities Azure Table Reporting © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
21
Cosmos Payload Delivery Status
12/6/2018 5:27 AM Cosmos Payload Delivery Status Azure Service Fabric Tables inside Cosmos DB No need for multiple storage accounts anymore Reduce deployment complexity Good reporting capabilities Replicate all content to a central location Azure Cosmos DB PowerBI © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
22
12/6/2018 5:27 AM Final thoughts © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
23
Azure Cosmos DB Multi-model Elastic Scale Global distributed
12/6/2018 5:27 AM Azure Cosmos DB Multi-model Elastic Scale Global distributed Low latency Enterprise grade Multiple consistency level © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
24
12/6/2018 5:27 AM Q&A © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
25
Please evaluate this session
Tech Ready 15 12/6/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite Phone: download and use the Microsoft Ignite mobile app Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
26
12/6/2018 5:27 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Similar presentations
