What Is Microsoft Marketplace DataMarket What Is Microsoft Marketplace DataMarket? Michael Stiefel x Level: Intermediate

A marketplace of data sets with a standard API.

DataMarket is about the possibilities…

Application: Should I Move There? Is it safe? Crime Data from the U. S. Government What are my neighbors like? Consumer Expenditure Data Key US Demographics by Zip Code, Place and County What is the weather like? Weather Data Can I buy a house there? Home Valuation Mortgage Information

Trusted Data Providers Authoritative Commercial Government Structured and Unstructured Data

Uses OData Protocol REST based OData feed use HTTP/HTTPS URIs. Open Data Protocol Astoria / ADO.NET Data Services / WCF Data Services Builds on ATOM, JSON, XML Clients can be Java,.NET, PHP, Silverlight, iPhone, Windows Phone 7, etc.

OData Data Model OData Feed is a collection of typed Entries Entry has simple or complex properties Service Operations can be exposed Metadata available Allows for automated discovery of different feeds

Types of Queries Flexible Query Dynamically Build Queries Use Visual Studio Add Service Reference Fixed Query Predetermined provider query May or may not have optional parameters Use provider created proxy class

Making a Query Formulate Query String Add parameters for filters, pagination Server based filtering Get back XML payload Authenticate with Account Key

DataMarket Portal…..

Demos

Business Model Some Free Data Sets for Developers Transaction (query) or Subscription Pricing Broad Spectrum of data "Easy to understand licensing Microsoft takes a brokerage commission

Content Developer Opportunities One place to look for data One format for getting data Understand data set through Explorer Clear licensing Clear Subscription Model

Subscription Models Options Unlimited Limited to a fixed number of transactions Billed monthly Optional throttling by content provider Auto renew Free public data sets available

Content Provider Opportunity Marketplace Control data, terms, price Single point of billing Periodically receive payments and reports Data transformation to common formats Long Tail for Data providers Built on Windows Azure

Advantages Developer has one billing relationship through the marketplace Access data sets that were previously difficult to obtain Standard API allows DataMarket to be used from Java, PHP, or on an IPhone.

DataMarket Front End Architecture Azure Web role for portal and requests Frequent requests cached In memory cache for VM Azure tables for distributed cache Data sources help define cache lifetimes

DataMarket Bank End Architecture Queues and Worker roles for returning data SQL Azure for account information Data sets with CSDL mapping SQL Azure Provider Web services Health Monitoring with sample queries Transferred to Azure tables with reporting Alerts based on results Certificates for 3 rd party connection info

Summary Dallas is an application built on Azure Uses OData API for simplicity Can integrate with Access Control Service Business Model drives "sense" of the application