DBI316

Building and Maintaining Applications with relational and non-relational data is hard Complex integration Duplicated functionality Compensation for unavailable services Pain Points Goals Reduce the cost of managing all data Simplify the development of applications over all data Provide management and programming services for all data

Structured and unstructured Search Related/”Semantic” Search

Structured Data Structured Data Query T-SQL B-trees Manageability Availability Files Programmability

Structured Data Structured Data Query T-SQL B-trees Manageability Availability Files Programmability Unstructured Data Unstructured Data Search

Structured Data Structured Data Query and Type Operations T-SQL/Data Types B-trees Manageability Availability Files Programmability Unstructured Data Unstructured Data Search Filestream Win 32 Semi-structured Data/XML Semi-structured Data/XML XML, FTS, Spatial Indices XML, FTS, Spatial Indices XQuery Spatial ops XQuery Spatial ops Spatial, XML, HierarchyID

Structured Data Structured Data Query and Type Operations T-SQL/Data Types B-trees Manageability& Availability Programmability Unstructured Data Unstructured Data Search Win 32 Semi-structured Data/XML Semi-structured Data/XML Semantic Platform Efficient Storage for BR Data Rich Query and Search Services over all Data Rich Data Programming Capabilities Files Filestream XML, FTS, Spatial Indices XML, FTS, Spatial Indices XQuery Spatial ops XQuery Spatial ops Spatial, XML, HierarchyID

SQL Server 2005 SQL Server 2008 FileTable (Win 32 I/O) Scale-up FileStream Scale-up Search Search functionality Semantic Similarity ReliableMessaging Service Broker Full Text Indexing Rich unstructured Data & Services Remote BLOB Store API Filestream Integrated FTS Spatial Fully supported Geometry and Geography data types and Functions XML Data Type XQuery XML Schema XML Upgrades Large UDTs Sparse Columns Wide Table/ColumnSet Filtered Indices HierarchyID Semistructured Data & Documents SQL Server Denali Reporting Services support FullGlobe 2D Extensions Pervasive Spatial over FileStream R2 Multi-cast Enqueue time Poison-Message handling with RCSI

Fulltext Search Semantic Key Phrase Extraction Rich Services Database Disk1 Disk2 Disk3 Multiple Containers Scale-up Solutions Database Applications Transactional Access Blobs Integrated Administration Integrated Administration? Win32 Applications SMB Share Files/Folders FileStream API Streaming Win32 Access Streaming Win32 Access?? Customer Application Azure lib Centera lib SQL FILESTREAM lib SQL RBS API Azure Centera SQL DB Remote BLOB Storage FileStreams FileTable

ApplicationApplication RBS Client Library BLOB Store Provider Library BLOB Store SQL Server ClaimIDClaimDatePhotoRef43906/5/2007<Binary(20)> Write BLOB(Photo) Return Blob ID Write Blob ID to PhotoRef field 2 3 Machine Boundary RBS Services Create Fetch GC Delete

demo

Use of multiple spindles for achieving better I/O Scalability

File Stores / External Blob Stores (CAS) SQL BLOBsRemote Blob API FILESTREAMFILETABLE Streaming Performance Depends on external store Win32 App Compat Depends on external store Link Level Consistency Data Level Consistency Integrated Query & Management Non-local Windows File Servers n/a External Blob Storesn/a

SELECT * FROM candidates WHERE CONTAINS(resume,’”SQL Server”’) AND ZipCode = ‘98052’ SELECT * FROM candidates WHERE CONTAINS(resume,’”SQL Server”’) AND ZipCode = ‘98052’

KeyTitleDocument D1Annual Budget… D2Corporate Earnings… D3Marketing Reports… ……… Source Table IDKeywordColid…compDocidCompOcCompPid K1revenue1…10,23,123(1,4),(5,8),(1,34)2,5,6,8,4,3 K2growth1…10,23,123(1,5),(5,9),(1,34)2,5,6,8,5,4 ……………… Keyword Index (Full-Text) KeyphrasesKeyphraseDocuments IDDocID T1 (revenue)D1 (Annual Budget) T2 (growth)D2 (Corporate Earnings) T3 (Windows)D3 (Marketing Reports) …… T1 (revenue)D7 (Finance Report) …… T3 (Windows)D11 (Azure Strategy) T4 (Azure)D11 (Azure Strategy) IDKeyword T1revenue T2growth T3Windows T4Azure …… DocumentSimilarity DocIDMatchedDocID D1 (Annual Budget)D2 (Corporate Earnings) D1 (Annual Budget)D7 (Finance Report) D3 (Marketing Reports)D11 (Azure Strategy) …… Full-Text and Semantic Processing quarter, record, revenue… 2b 3 2a 1

demo

Populating an index of 20 million rows of 1K data on identical hardware (time in minutes) 2 min1 min

Queries over 350M documents database and random DMLs running in background. Beating SQL Server 2005 with a scale factor more than 2x and with avg 60x times better throughput

Query avgExecTime (ms) under various number of connections (50 ~ 2000 users) for customer playback benchmark

demo

Find the closest 50 business points (22 million in total)

Required Slide Speakers, please list the Breakout Sessions, Interactive Discussions, Labs, Demo Stations and Certification Exam that relate to your session. Also indicate when they can find you staffing in the TLC.

Required Slide Track PMs will supply the content for this slide, which will be inserted during the final scrub. Try the new SQL Server Mission Critical BareMetal Hand’s on-Labs Visit the updated website for SQL Server® Code Name “Denali” on and sign to be notified when the next CTP is available Follow Twitter account to watch for updates Visit the SQL Server Product Demo Stations in the DBI Track section of the Expo/TLC Hall. Bring your questions, ideas and conversations! Microsoft® SQL Server® Security & ManagementMicrosoft® SQL Server® Optimization and Scalability Microsoft® SQL Server® ProgrammabilityMicrosoft® SQL Server® Data Warehousing Microsoft® SQL Server® Mission Critical Microsoft® SQL Server® Data Integration

Resources Sessions On-Demand & CommunityMicrosoft Certification & Training Resources Resources for IT ProfessionalsResources for Developers Connect. Share. Discuss.

Scan the Tag to evaluate this session now on myTechEd Mobile