1. 03 | Data Storage Bruno Terkaly | Technical Evangelist
Bret Stateham | Technical Evangelist

2. Module Overview Windows Azure Storage Overview
Windows Azure Blob Storage
Windows Azure Table Storage
Windows Azure Queue Storage
Windows Azure SQL Database

3. Windows Azure Storage Overview

4. Agenda
Windows Azure Storage
Blob Storage
Drives
Tables
Queues

5. Windows Azure Storage Storage in the Cloud
Scalable, durable, and available
Anywhere at anytime access
Only pay for what the service uses
Exposed via RESTful Web Services
Use from Windows Azure Compute
Use from anywhere on the internet

6. Windows Azure Storage Account User specified globally unique account name
Can choose geo-location to host storage account: US
Europe
Asia
Northern Europe
North Central US
Western Europe
West US
East Asia
East US
South Central US
South East Asia

7. Windows Azure Storage Account
Can CDN Enable Account
Blobs delivered via 24 global CDN nodes
Can co-locate storage account with compute account
Explicitly or using affinity groups
Accounts have two independent 512 bit shared secret keys
100 TBs per account

8. Features Geo-Replication Storage Analytics
Logs: Provide trace of executed requests for your storage accounts
Metrics: Provide summary of key capacity and request statistics for Blobs, Tables, and Queues

9. Storage in the Development Fabric
Provides a local “Mock” storage
Emulates storage in cloud
Allows offline development
Requires SQL Express 2005/ or above
There are some differences between Cloud and Dev Storage:
A good approach for developers:
To test pre-deployment, push storage to the cloud first
Use Dev Fabric for compute connect to cloud hosted storage Finally, move compute to the cloud -

10. The Storage Client API RESTful API
Can call these from any HTTP client e.g. Flash, Silverlight, etc…
Client API from SDK Microsoft.WindowsAzure.StorageClient
Provides a strongly typed wrapper around REST services

11. Storage Libraries in Many Languages
C#/.NET
Python
Ruby
Perl
JavaScript (Node)
Java
PHP
Erlang
Common LISP
Objective-C
C#/VB on Windows Phone 7

12. Windows Azure Storage Abstractions
Blobs
Simple named files along with metadata for the file.
Tables
Structured storage. A table is a set of entities; an entity is a set of properties.
Queues
Reliable storage and delivery of messages for an application.

13. Windows Azure Blob Storage

14. Blob Storage Concepts Account Container Blob Pages/ Blocks
Account
Container
Blob
Pages/ Blocks
PIC01.JPG
images
Block/Page
PIC02.JPG
contoso
Block/Page
videos
VID1.AVI

15. Blob Details Main Web Service Operations PutBlob GetBlob DeleteBlob
CopyBlob
SnapshotBlob
LeaseBlob
Main Web Service Operations

16. Blob Details Associate Metadata with Blob
Standard HTTP metadata/headers (Cache-Control, Content-Encoding, Content-Type, etc)
Metadata is <name, value> pairs, up to 8KB per blob
Either as part of PutBlob or independently
Associate Metadata with Blob

17. Blob Details Blob always accessed by name
Can include ‘/‘ or other delimeter in name e.g. /<container>/myblobs/blob.jpg
Blob always accessed by name

18. Blob Containers Multiple Containers per Account Blob Container
Special $root container
Blob Container
A container holds a set of blobs
Set access policies at the container level
Associate Metadata with Container
List the blobs in a container
Including Blob Metadata and MD5
NO search/query. i.e. no WHERE MetadataValue = ?
Blobs Throughput
Effectively in Partition of 1
Target of 60MB/s per Blob

19. Two Types of Blobs Under the Hood
Block Blob
Page Blob
Targeted at streaming workloads
Each blob consists of a sequence of blocks
Size limit 200GB per blob
Targeted at random read/write workloads
Each blob consists of an array of pages
Size limit 1TB per blob

20. Shared Access Signatures
Fine grain access rights to blobs and containers
Sign URL with storage key – permit elevated rights
Revocation
Use short time periods and re-issue
Use container level policy that can be deleted

21. Windows 8 Uploading Pictures as Blobs

22. Windows Azure Table Storage

23. Table Storage Concepts
Account
Table
Entity
Name =…
= …
customers
Name =…
Add=
contoso
Photo ID =…
Date =…
photos
Photo ID =…
Date =…

24. Entity Properties Entity can have up to 255 properties
Up to 1MB per entity
Mandatory Properties for every entity
PartitionKey & RowKey (only indexed properties)
Uniquely identifies an entity
Defines the sort order
Timestamp
Optimistic Concurrency
Exposed as an HTTP Etag
No fixed schema for other properties
Each property is stored as a <name, typed value> pair
No schema stored for a table
Properties can be the standard .NET types
String, binary, bool, DateTime, GUID, int, int64, and double

25. No Fixed Schema FIRST LAST BIRTHDATE FAV SPORT Wade Wegner 2/2/1981
Nathan
Totten
3/15/1965
Nick
Harris
May 1, 1976
FAV SPORT
Canoeing

26. Querying ?$filter=Last eq ‘Wegner’ FIRST LAST BIRTHDATE Wade Wegner
2/2/1981
Nathan
Totten
3/15/1965
Nick
Harris
May 1, 1976

27. Purpose of the PartitionKey
Entity Locality
Entities in the same partition will be stored together
Entity Group Transactions
Atomic multiple Insert/Update/Delete in same partition in a single transaction
Table Scalability
Target throughput – 500 tps/partition, several thousand tps/account
Automatically load balance partitions

28. Windows Azure Queue Storage

29. Messaging Queue Topic & Subscription S R Queue
11/10/2018
Messaging
Queue
Asynchronous communication
Offline processing
Load-balancing
Topic & Subscription
Asynchronous communication
Publish/Subscription pattern
Message routing
Queue S R
Queue S R

30. ASP.NET App Writing to Azure Tables and Queues

31. Windows Azure SQL Database

32. Storage Relational Data System Center
Private Cloud
On Premises
Since Day 1, Full control, lots of work, not easily scalable
Raw Hardware
Killer offering, Can migrate on premises easily, clusters, VPNs
Semi-manual
SQL VMs
(IaaS)
Public Cloud
SQL Database
(PaaS)
Fully abstracted, triple replication, 150 GB limit
Challenging performance
Now you can now get reserved capacity

33. SQL Database and SQL Server at the Portal