ISV Proposition Keith Burns Data Architect Microsoft UK

Slides:



Advertisements
Similar presentations
Yukon – What is New Rajesh Gala. Yukon – What is new.NET Framework Programming Data Types Exception Handling Batches Databases Database Engine Administration.
Advertisements

Chapter 9. Performance Management Enterprise wide endeavor Research and ascertain all performance problems – not just DBMS Five factors influence DB performance.
Module 13: Performance Tuning. Overview Performance tuning methodologies Instance level Database level Application level Overview of tools and techniques.
Microsoft Core Systems What’s new in Windows Server 2008, Exchange Server 2007, and SQL Server 2008 Rob Campbell, Monica DeZulueta, Walter Nichols, and.
Michael Pizzo Software Architect Data Programmability Microsoft Corporation.
Module 12: Auditing SQL Server Environments
Project Management Database and SQL Server Katmai New Features Qingsong Yao
Meanwhile RAM cost continues to drop Moore’s Law on total CPU processing power holds but in parallel processing… CPU clock rate stalled… Because.
Chapter 7 Managing Data Sources. ASP.NET 2.0, Third Edition2.
Jeremy Boyd Director – Mindscape MSDN Regional Director
Graeme Scott – Technology Solution Professional Reduce Infrastructure Costs & Increase Productivity with SQL Server 2008.
Managing and Monitoring SQL Server 2005 Shankar Pal Program Manager SQL Server, Redmond.
Passage Three Introduction to Microsoft SQL Server 2000.
SQL Server 2008 for Hosting Key Questions to Address How can SQL Server save your costs? How can SQL Server help you increase customer base? How can.
SQL Server ® 2008 ® Native Client. Agenda  Introduction to SQL Server Native Client  Building High-Performance Data Access Solutions  Going Beyond.
Time SQL Server 2012 Highlights and ColumnStore Index09:00 – 10:15 AlwaysOn and Contained Databases10:45 – 12:15 PowerPivot and PowerView (BI)13:00 –
Manage & Configure SQL Database on the Cloud Haishi Bai Technical Evangelist Microsoft.
Overview SQL Server 2008 Overview Presented by Tarek Ghazali IT Technical Specialist Microsoft SQL Server MVP, MCTS Microsoft Web Development MCP ITIL.
Convergence /20/2017 © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Performance and Scalability. Performance and Scalability Challenges Optimizing PerformanceScaling UpScaling Out.
Overview of SQL Server Alka Arora.
SQL Server 2008 Spatial Summary 2 Spatial Data Types (CLR UDT) Comprehensive set of Spatial Methods High Performance Spatial Indexes Spatial Library Sink/Builder.
2 An Overview of SQL Server 2008 New Features Jeremy Boyd Mindscape MSDN Regional Director & MVP – SQL Server DAT302.
 Michael Rys Principal Lead Program Manager Microsoft Corporation BB16.
Module 19 Managing Multiple Servers. Module Overview Working with Multiple Servers Virtualizing SQL Server Deploying and Upgrading Data-Tier Applications.
DBSQL 14-1 Copyright © Genetic Computer School 2009 Chapter 14 Microsoft SQL Server.
Module 7 Reading SQL Server® 2008 R2 Execution Plans.
Microsoft TechForge 2009 SQL Server 2008 Unplugged Microsoft’s Data Platform Vinod Kumar Technology Evangelist – DB and BI
1 Moshe Shadmon ScaleDB Scaling MySQL in the Cloud.
Chokchai Junchey Microsoft Product Specialist Certified Technical Training Center.
Amit Shukla, Michael Wang SQL Server Engineering Team Microsoft Session Code: DAT201.
Module 11: Programming Across Multiple Servers. Overview Introducing Distributed Queries Setting Up a Linked Server Environment Working with Linked Servers.
John Plummer Technical Specialist Data Platform Microsoft Ltd StreamInsight Complex Event Processing (CEP) Platform.
Applications hitting a wall today with SQL Server Locking/Latching Scale-up Throughput or latency SLA Applications which do not use SQL Server.
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
C6 Databases. 2 Traditional file environment Data Redundancy and Inconsistency: –Data redundancy: The presence of duplicate data in multiple data files.
Upgrading to SQL Server 2008 Graeme Scott Technology Solution Professional Microsoft Corporation.
Data Warehousing Enhancements Dr Keith Burns Data Architect DPE, Microsoft Ltd.
Riaan Vermeulen Data Solutions Architect Eclipse Networks
Srik Raghavan Principal Lead Program Manager Kevin Cox Principal Program Manager SESSION CODE: DAT206.
Creating and Maintaining Geographic Databases. Outline Definitions Characteristics of DBMS Types of database Relational model SQL Spatial databases.
INNOV-10 Progress® Event Engine™ Technical Overview Prashant Thumma Principal Software Engineer.
SharePoint enhancements through SQL Server RSS integration with SharePoint What’s New Elimination of IIS
SQL School is strongly committed to provide COMPLETE PRACTICAL REALTIME Trainings on SQL Server Technologies – Dev, SQL DBA, MSBI (SSIS, SSAS, SSRS) and.
GLOBEX INFOTEK Copyright © 2013 Dr. Emelda Ntinglet-DavisSYSTEMS ANALYSIS AND DESIGN METHODSINTRODUCTORY SESSION EFFECTIVE DATABASE DESIGN for BEGINNERS.
Martin Cairney Hybrid data platform – making the most of Azure plus your on- prem kit DAT341 B.
Lecture 10 Creating and Maintaining Geographic Databases Longley et al., Ch. 10, through section 10.4.
Hosting Websites and Web Applications with Microsoft ® SQL Server ® 2008.
INTRODUCING SQL SERVER 2012 COLUMNSTORE INDEXES Exploring and Managing SQL Server 2012 Database Engine Improvements.
Don Vilen Program Manager, SQL Server Microsoft Corporation DAT304.
Your Data Any Place, Any Time Performance and Scalability.
Comprehensive Flexible Global Storage and Search Responsive Available Secure Manageable Federation Coordination Consolidation Transformation Synchronization.
Your Data Any Place, Any Time Beyond Relational. Overview of Beyond Relational Applications Today Beyond Relational Feature Overview Whirlwind Feature.
Microsoft Confidential Jon Jahren Produktsjef Applikasjonsplattform Microsoft.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
Copyright Sammamish Software Services All rights reserved. 1 Prog 140  SQL Server Performance Monitoring and Tuning.
Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server
Dan Galvez Hedgehog Development x200.
Doing fast! Optimizing Query performance with ColumnStore Indexes in SQL Server 2012 Margarita Naumova | SQL Master Academy.
1 Copyright © 2005, Oracle. All rights reserved. Oracle Database Administration: Overview.
Session Name Pelin ATICI SQL Premier Field Engineer.
Comprehensive Flexible Global Storage and Search Responsive Available Secure Manageable Federation Coordination Consolidation Transformation Synchronization.
Introducing Hekaton The next step in SQL Server OLTP performance Mladen Prajdić
Software Architecture in Practice
Database Performance Tuning and Query Optimization
A developers guide to Azure SQL Data Warehouse
MANAGING DATA RESOURCES
SQL 2014 In-Memory OLTP What, Why, and How
Chapter 11 Database Performance Tuning and Query Optimization
Your Data Any Place, Any Time
Presentation transcript:

ISV Proposition Keith Burns Data Architect Microsoft UK

Transparent Data Encryption External Key Management Data Auditing Pluggable CPU Transparent Failover for Database Mirroring Policy Management Server Group Management Streamlined Installation Enterprise System Management Performance Data Collection System Analysis Data Compression Query Optimization Modes Resource Governor Entity Data Model LINQ Visual Entity Designer Entity Aware Adapters SQL Server Change Tracking Synchronized Programming Model Visual Studio Support SQL Server Conflict Detection FILESTREAM data type Integrated Full Text Search Sparse Columns Large User Defined Types Date/Time Data Type LOCATION data type SPATIAL data type Virtual Earth Integration Partitioned Table Parallelism Query Optimizations Persistent Lookups Change Data Capture Backup Compression MERGE SQL Statement Data Profiling Star Join Enterprise Reporting Engine Internet Report Deployment Block Computations Scale out Analysis BI Platform Management Export to Word and Excel Author reports in Word and Excel Report Builder Enhancements TABLIX Rich Formatted Data Personalized Perspectives … and many more

Top ISV Features in SQL Server Lock Escalation 2.Plan Freezing 3.Optimise for Ad-hoc Workloads Option 4.Resource Governor 5.Logging enhancements 6.Sparse Data and Indexes 7.Hierarchy Datatype 8.Spatial Data 9.Filestream 10.Security (Auditing & Transparent Database Encryption (TDE)

Lock Escalation Pain Points Lock escalation causes performance problems (blocking); cannot be controlled on per table basis Traceflags -T1211 & -T1224 used to disable lock escalation can help, but often result in other problems SQL Server 2008 disable lock escalation at a table level ALTER TABLE TabA SET (LOCK_ESCALATION = DISABLE); For partitioned tables, results in lock being escalated to the partition, instead of to the table level as in SQL Server 2005

Plan Freezing Pain Points Difficult to tune query plan when T-SQL code not accessible No easy way of ensuring plan consistency across upgrades SQL Server 2005 introduced Plan Guides and USE PLAN hint; but these were difficult to use SQL Server 2008 Plan Freezing builds on plan guides framework and introduces easier creation process based on plan cache entries (sp_create_plan_guide_from_cache) Full DML support INSERT, DELETE, UPDATE supported New function sys.fn_validate_plan_guide introduced to validate existing SQL 2005 plan guides

Optimize for Ad hoc Workloads Option Pain Points Single use ad hoc batches can flood the procedure cache Using Forced Parameterization option for such scenarios can result in adverse side-effects SQL Server 2008 New ‘optimize for ad hoc workloads’ server option Set using sp_configure, or SQL Server Management Studio Stores stub for adhoc compiled plan after first execution, replaces with actual query plan if the query is re-executed Improves efficiency of plan cache

Resource Governor SQL Server 2008 RG is designed for workload balance in database engine Configurable at connection level; Online change of group/pool allowed Definition of group/pool transparent to application Users can control server level setting (MAXDOP) at workgroup level Prevent run-away queries SQL Server Min Memory 10% Max Memory 20% Max CPU 20% Min Memory 10% Max Memory 20% Max CPU 20% Admin Workload Backup Admin Tasks OLTP Workload OLTP Activity Report Workload Ad-hoc Reports Executive Reports High Max CPU 90% Application Pool Admin Pool Connections Classifier Function

Logging Enhancements SQL Server 2008 INSERT into table supports minimal logging 3X-5X Performance Boost over fully logged INSERT Run Time

Sparse Column Storage IDColumnValue 1Q1C 1Q21 1Q109 2Q1B 2Q34 2Q5Low 3Q1C 3Q76 3Q85 PKQ1Q2Q3Q4Q5Q6Q7Q8Q9Q10 1C19 2B4Low 3C EHig h Blu e 6C A2Red 9A36 Desired schema Typical Solution The problem Need to store sparse data Possibly 100’s of columns Typically only few % are populated

Sparse Columns “Sparse” as a storage attribute on a column 0 bytes for a NULL, 4 byte overhead for non-NULL No change in Query/DML behavior Same limitations as normal tables eg 1024 columns Wide Table / defining a “Sparse Column Set ” Column set columns can still be individually specified in SQL statements Select * returns all non-sparse-columns + sparse column set as XML 30,000 sparse columns allowed in a table (2Gb), 1000 indexes // Sparse as a storage attibute in Create/Alter table statements Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE); // Create a sparse column set Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE, Properties XML COLUMN_SET FOR ALL_SPARSE_COLUMNS); // Sparse as a storage attibute in Create/Alter table statements Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE); // Create a sparse column set Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE, Properties XML COLUMN_SET FOR ALL_SPARSE_COLUMNS);

Filtered Indexes Filtered Indexes and Statistics Indexing a portion of the data in a table Filtered/co-related statistics creation and usage Query/DML Optimization to use Filtered indexes and Statistics Restricted to non-clustered indexes Benefits Lower storage and maintenance costs for large number of indexes Query/DML Performance Benefits: IO only for qualifying rows // Create a Filtered Indexes Create Index ZoomIdx on Products(ZoomLength) where Type = ‘Camera’; // Optimizer will pick the filtered index when query predicates match Select ProductId, Type, Resolution, ZoomLength where Type = ‘Camera’’

HierarchyID Key properties Logically encodes the path from the root of the tree to a node Rich built-in methods for manipulating hierarchies Simplifies storage and querying of hierarchical data Comparison a<b is in depth-first order Support for arbitrary insertions and deletions Potential Applications Forum and mailing list threads Business organization charts Content management categories Product categories Files/folders management / /1/ /1/1/ /1/1/1/ /1/1/2/ /1/2/ /2//3/ /3/1//3/2/

Storage and retrieval of spatial data using standard SQL syntax – New Spatial Data Types (geometry, geography) – New Spatial Methods (intersects, buffer, etc.) – New Spatial Indexes Offers full set of Open Geospatial Consortium components (OGC/SQL MM, ISO 19125) Integration with Virtual Earth

Storage Attribute on VARBINARY(MAX) Works with integrated FTS Unstructured data stored directly in the file system (requires NTFS) Dual Programming Model TSQL (Same as SQL BLOB) Win32 Streaming APIs with T-SQL transactional semantics Data Consistency Integrated Manageability Back Up / Restore Administration Size limit is the file system volume size SQL Server Security Stack Store BLOBs in DB + File System ApplicationApplication BLOB DB

TRUSTED, SCALABLE PLATFORM IT & DEVELOPER EFFICIENCY MANAGED SELF-SERVICE BI Data Warehouse Edition Master Data Services Stream Insight PowerPivot / SharePoint 2010 Report Builder 3.0 Data Tier Applications

Master Data Management CRM HR Doc ERPAsset Mgmt Purchasing DB

Relational Database Applications Financial trading Applications Stream Insight Scenarios for Event Processing Aggregate Data Rate (Events/sec.) Latency ~1million Months Days hours Minutes Seconds 100 ms < 1ms Operational Analytics Applications, e.g., Logistics, etc. Manufacturing Applications Monitoring Applications CEP Target Scenarios Data Warehousing Applications Web Analytics Applications

Stream Insight 18 Complex Event Processing (CEP) is the continuous and incremental processing of event streams from multiple sources based on declarativequery and pattern specifications with near-zero latency. Database ApplicationsEvent-driven Applications Query Paradigm Ad-hoc queries or requests Continuous standing queries LatencySeconds, hours, daysMilliseconds or less Data RateHundreds of events/secTens of thousands of events/sec or more request response Event output stream input stream

StreamInsight

Increasing Availability

Additional SQL Server 2008 R2 report features o Mapping support o Report Builder 3.0 o Report Parts o Export to data feed

Summary  SQL Server 2008 has many features designed specifically for ISV workloads; zero or minimal application change required  There are literally 100s of new and improved features – this session only highlights some of the ones most popular with ISVs  Understanding what problem each feature resolves as well as it’s performance, insights and limitations helps more appropriate usage