Download presentation
Presentation is loading. Please wait.
Published byRudolph Bates Modified over 9 years ago
1
Extreme Scaling with SQL Azure SQL Bits 7, York, October 2010 Martin Schmidt – Miracle A/S Denmark
2
Subtitle: The Safetrack story
3
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
4
Speaker info O Name: Martin Schmidt O Email: msc@miracleas.dk O Blog: www.performanceduo.comwww.performanceduo.com O Twitter: @ms1333
5
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
6
Safetrack facts O Danish Company – started 2005 O GPS tracking of trucks and excavators O Started out as an insurance service against theft O Today: A complete platform for fleet management O Tracks more than 25.000 units O Website: http://www.safetrack.dk
7
Unit Types
11
How does this Work?
12
How does this Work O All units are equipped with a GPS transmitter O Sends binary packages over GPRS O Built-in SIM card O Sends a package every 2 min when running O Sends a package every 15 min when parked O Data is sent using UDP Protocol
13
ME - 301 Length = 75 mm Width = 45 mm Height = 18 mm
14
Package data O Reporttime O Longitude O Latitude O Speed O KM Status O Inputs status information O Is the lift up / down O Is the engine running O Timecounter info on inputs O For how long has the engine been running O How long has the lift been in use
15
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
16
System Archietecture
17
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
18
Database Design
19
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
20
Issues ? O Database and application on same box O Everything runs on the same single server O Single Point of Failure O Hardware O Database O Services / Website O No HA solution O Limited scaling options (Buy bigger HW)
21
Issues ? O All elements are independend O Easy to split things O No ”secret” data O No personal or banking information O Not breaking the Danish data law
22
Issues ? O SQL Azure in the future? O Windows Azure in the future? O Why Not
23
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
24
SQL Azure O High Availibity = Free O 1 DB = 3 DB’s (automatic failover) O Size limitations O 1 – 50 GB O Safetrack database > 250 GB O Get the database off the current box O Release more power to the Windows service
25
SQL Azure O Let Microsoft be your primary DBA! O SQL Azure = Black boks O Running your database with other unknown applications
26
Windows Azure O Moving the website to Windows Azure O Easy peasy O The Windows Service is not compatible with Azure at present O No support for UDP – TCP Only
27
SQL Azure O Lets move the database to the Cloud O Latency from the local Windows service to SQL Azure is not a big issue. O Size is a issue, we will have to Shard the data across multiple databases O Sharding gives us scalability
28
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
29
Sharding facts O Partition data across multiple databases O Each database holds a subset of the data O A query needs only to look in one database O Sharding is no silver bullet, you still need to think O Important to choose the correct sharding key O Try to avoid fan-out queries, if possible
30
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
31
Solution walkthrough O Shard key candidates O UnitID O CustomerID O The winner is: O CustomerID O All reports on the web front end is based on customerID. This gives the customer the option to se the status of all his units.
32
Data Syncronisation O MS Data sync Framework O Requires SQL Agent to do scheduling O SQL Azure Data Sync (Dev Preview) O The winner so far O We will have a look in a minute O Pretty Slow O SQL Server Integration Services O Still no scheduler O Windows Azure worker role O We need to test this
33
Database Design
34
DEMO O Enough Power Pointing
35
Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure
36
Loading data into Azure O Task: Load existing data into SQL Azure O 265.000.000 Rows (ReportMessage) O 150 GB O Possible solutions O BCP Utility O SSIS
37
Loading data into Azure
38
O Slow, poor performance O Still working on improving performance O Tested throughput (Laptop) O 1000 Rows / sec
39
SQL Azure Ressources O SQL Azure webfrontend O http://sql.azure.com http://sql.azure.com O SQL Azure Labs O http://www.sqlazurelabs.com http://www.sqlazurelabs.com O SQL Azure team Blog O http://blogs.msdn.com/b/sqlazure/
40
More Ressources O PerformanceDUO O http://www.performanceduo.com http://www.performanceduo.com O Miracle A/S O http://www.miracleas.dk http://www.miracleas.dk O MiracleDB O http://Miracledb.codeplex.com http://Miracledb.codeplex.com O Safetrack O http://www.safetrack.dk
41
Q & A O Questions?
42
Thank You
43
Coming up… P/X001 Understanding and Preventing SQL Injection Attacks Kevin Kline P/L001 SSIS Fieldnotes Darren Green P/L002 The (Geospatial) Shapes of Things to Come Simon Munro P/L005 End to End Master Data Management with SQL Server Master Data Services Jeremy Kashel P/T007 Understanding Microsoft Certification in SQL Server Chris Testa-O'Neill # SQLBITS
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.