black marble the strategic IT asset for your organisation MAKING THE SQL DEVELOPER ONE OF THE FAMILY WITH VISUAL STUDIO TEAM SYSTEM Richard Fennell Engineering Director SQLBits IV 28 th March 2009

black marble Agenda Why do we need DB Pro.? What is Visual Studio Team System DB Pro. Features –Project Life-cycle –Testing –Deployment –Power Tools The Future

black marble Pain points in DB development What is the correct DB schema? How do we version control it? How do I know the impact of a change? How do we publish a DB? Where do we get test data from? How do we test it anyway? There has been no Microsoft standard way to manage the DB – until now

ExcelProject Operations, QA and Help Desk Non-Microsoft Developer Team System Web Access Visual Studio Team System Application Life Cycle Management (ALM) Solution

black marble Visual Studio for Database Professionals Incorporates the Database Professional into the software development lifecycle Provides a foundation for change management and process integration Exposes database schema as individual script files Provides a set of essential tools –Version Control via Visual Studio supported providers –Rename Refactoring –Schema Comparison Tools –Data Comparison Tools

black marble Visual Studio for Database Professionals Was known as DataDude in beta phase Released in 2006 Release VS 2008 was really more of a service pack than a major release. VS 2008 GDR Released November 2008

black marble Visual Studio Team System 2008 Database Edition GDR Builds on top of Visual Studio 2008 SP1 Adds support for SQL Server 2008 Introduces a new product architecture –Database Schema Provider model –Separation of Build & Deploy –Public Extensibility Incorporates functionality previously shipped in the Power Tools –T-SQL Static Code Analysis –Dependency Viewer Many product enhancements and improvements

Database Project Ecosystem Database Refactoring Database Unit Testing Data Generation T-SQL Static Code Analysis Schema Compare Data Compare 3 rd Party Designers 3 rd Party Tools SQL Server 2008 DSP Parser ScriptDOM Interpreter Reverse Engineer Deploy SQL Server 2005 DSP Parser ScriptDOM Interpreter Reverse Engineer Deploy SQL Server 2000 DSP Parser ScriptDOM Interpreter Reverse Engineer Deploy 3 rd Party DSP Parser ScriptDOM Interpreter Reverse Engineer Deploy DSP Extensions DSP Extensions DSP Extensions DSP Extensions DSP Extensions DSP Extensions DSP Extensions Database Model API Database Eco Project System Solution Explorer Schema View Dependency Viewer Editor Project Features

black marble Database Edition Features Database Unit Testing –Leverages the existing Test Project Infrastructure –Supports data generation Build and Deployment –MSBuild and Team Build integration

black marble Team Foundation Server Integration As a member of the Visual Studio Team System family, DBPro is integrated with all of the team features TFS provides –Team project with prescriptive guidance –Version control management –Work Item tracking –Team Build integration

black marble Database Edition Power Tools Power Tools 2008 added additional features that didnt make the product release cycle –Dependency Viewer –New Refactorings –Data Generation Wizard –MSBuild Tasks –T-SQL Static Code Analysis –Schema Manager API At present no GDR Power tools released

Writes Tests Writes DB Code Refactors Runs Tests Checks In Works with other developers to integrate Writes Tests Writes DB Code Refactors Runs Tests Checks In Works with other developers to integrate Reviews Changes Compares Updates to Production Builds Deploy Package Deploys to Production Reviews Changes Compares Updates to Production Builds Deploy Package Deploys to Production Creates New DB Project Reverse Engineers DB to Project Creates Data Generation Plan Creates New DB Project Reverse Engineers DB to Project Creates Data Generation Plan DB Developer DB Administrator Manage Develop Deploy Roles in a DB Project DB Administrator

Creating the DB Project DatabaseProjectDatabaseProject Import schema Check in to Source Control ProductionDatabase StagingDatabase Create a Project DBA DBPro TFS Server

DBPro DBA Isolated Iterative Development SyncSync Check-outCheck-out Edit/RefactorEdit/Refactor TestTest Check-inCheck-in Work is being driven and tracked via work itemsWork is being driven and tracked via work items Other team members can pick up changesOther team members can pick up changes TFS Shelving allows DBA to provide guidance and evaluate work Production Database Staging Database Sandbox Database Sandbox Database Sandbox Database

DBPro TFS Server Automated Build & Testing Build Server Test DBA Production Database Staging Database Get Latest TestEnvironment Reports

Deploy the Project DatabaseProjectDatabaseProject Sync from Label SQLDeployScript Build Deploy Refine deploy script Verify DBPro TFS Server DBA Production Database Staging Database Publish

black marble Schema Model Schema Compilation Source Database.dbschema file Project System DDL Scripts (artifacts) Reverse engineer schema into DDL artifacts Compose model representation from source code fragments Build Interpret, Analyze and Validate Schema Model Interpret, Analyze and Validate Schema Model

Schema Deployment Schema Model Target Database Schema Model.dbschema file Deployment Engine Model Diff Incremental Target Update Additional schema artifacts.SQL … … Plan Executors

black marble the strategic IT asset for your organisation demo demo DB Life Cycle

black marble Data Generation Shipped with the product –Data-bound, Regular Expression, Random Number Available as a Power Tool –File-bound and a Wizard tools to ease the process Codeplex – DbProGenerators –Lorem Ipsum, sparse columns, XML bound, Word bound and web search bound Plus what you write yourself.....

black marble the strategic IT asset for your organisation demo demo Data Generation

black marble Testing in DB Pro Firstly remember that can test any CLR code before loading it into SQL Server DBPro adds database tests that can be used to test any stored procedure, function, trigger or DB object A single test project can contain a variety of test types Can be used to auto generate test stubs

black marble the strategic IT asset for your organisation demo demo Automated Testing

black marble Is DB Testing Valid? You have to ask how useful it is to test at the raw data layer? Usually more effective to test the DB via the data access layer or as part of integration testing

black marble MSBuild All the key DB tasks can be scripted Database operations can become part of a scheduled build However this can all get a bit complex and DBPro MSBuild tasks are a bit idiosyncratic. Check the web for examples

black marble The Future Developer & Database Team Editions merged Database Schema Providers –Publicly extensible in Visual Studio 2010 –Quest Software announced that they will offer a Database Schema Provider (DSP) for Oracle –Partnership with IBM provides DB2 support Contextual Project Feature Extensibility –Publicly extensible in Visual Studio 2010

black marble Summary Visual Studio Team Edition for Database Professionals make SQL development part of the project mainstream. Team System coupled with integrated version control helps to mitigate risks associated with DB schema change Build integration provides for quality tracking and improvement Process reduces last minute problems and the need to rollback changes out of production

black marble Good VSTS Blogs Gert Drapers (was Architect/Development Manager Visual Studio Team Edition for DB Professionals, but moved to new team Mar 09) – VSTS DB Team Blog (replaces Gerts blog) – Brian Harry (Product Unit Manager for Team Foundation Server) –

black marble For Further Information My random thoughts But it works on my PC! You can also get in touch via: – WebSite –