1. Continuous Delivery and Team Foundation Server 2013 Ognjen Bajić Ana Roje Ivančić Ekobit

2. Inspirirani ljudima. Ugasite mobitele. Hvala.

3. Agenda Continuous Delivery Challenges Automated Build with Build Verification Tests Functional Testing Test Lab Environments Automating the Release Cycle

4. Inspirirani ljudima. Continuous Delivery Challenges

5. Define + Plan Monitor + Learn Release Develop + Test Modern end-to-end ALM lifecycle Continuous Delivery | Continuous Quality | Continuous Feedback

6. Achieving Continuous Quality on the Road Towards Continuous Delivery Source control everything Automated build and Continuous integration (CI) BVTs Static code analysis, Unit tests (Data driven), Code coverage, Code metrics, Layer Validation, Perf and Load Tests Automated Functional acceptance tests Coded UI Tests (data driven) End-to-end automated Build-Deploy-Test workflow Realistic test environments – Test Lab Clean configuration on virtual machines Manual acceptance tests Exploratory testing Generation of automated regression tests Continuous Deployment with Release Management

7. Inspirirani ljudima. Automated Build with Build Verification Tests

8. Automated Build with Continuous Integration - CI Reflects progress and ensures consistency of changes Establish the automated build from the day one No other measure is more useful Easy to implement with TFS and VS Build multiple solutions, managed/unmanaged code, different platforms/languages Setup wizard and runtime infrastructure Based on MS Build and Windows Workflow technologies Configurable, extensible, scalable Convert automated builds to Continuous Integration – CI builds Execute builds after each check in The fastest error warning system Configure Build Verification Tests – BVTs Execute automated tests and run different validations

9. Automated Build Verification Tests Default Build TemplateCustomized Build Template Static Code Analysis (FxCop) Unit Tests Code Coverage Layer Analysis Style Analysis (Style Cop) Code Metrics Security Analysis (Code analysis tool - CAT.NET)

11. Inspirirani ljudima. Functional Testing

12. Coded UI Tests = Automated tests of the user interface Simulate user interaction with controls on the screen (mouse click, typing) Can verify application behavior and results displayed on the screen Turn manual tests into automated tests Enable functional testing/validation of the user interface Enable automated regression testing Integrated with Build, Lab and Release Management Run as part of build Run as part of Build-Deploy-Test workflow in Test Lab Run as part of Release Management workflow VS 2013 extends list of supported technologies and platforms Fully supported: Web, Win Forms, WPF, IE 8/9/10, SHPT, Windows Store Apps (XAML based) Partly supported: Chrome/Firefox, WIn32/MFC, Dynamics CRM Not supported: IE 6/7, Opera/Safari, Office, Silverlight, Flash/Java

13. Coded UI Tests - 101...Unit tests for the UI (C# or VB.NET)… Data-driven (CSV, Excel, Access-DB, SQL, Test Case) Depend on UIMap generation …Generate some tests quickly without writing code… Generate from recordings for manual Test Cases (used for fast-forward in manual testing) Generate manually by recording actions on the screen (Coded UI Test Builder) …Develop full blown CUIT infrastructure… Record controls (Coded UI Test Builder) and programmatically simulate user interactions Better manage UIMaps (page object pattern) Add assertions and validations Control mechanism for searching controls on the screen Use support for data-driven testing Add support for custom controls Add logging …VS 13 lowers the price of automated testing… Automation saves time for the testers, but increases load on developers

15. Inspirirani ljudima. Test Lab Environments

16. Test Lab TFS includes virtualized Test Lab Test environment – one or more physical/virtual machines managed together (may even use Azure VMs!) Integration of Build and Lab Automated workflow: BUILD - DEPLOY- TEST Easily setup testing environment for each test run Can save snapshot of the environment with the app. installed (only VMs) Facilitates automated and manual testing Automated - Run as part of build-deploy-test workflow Manual - Tester restores snapshot and runs tests Easy testing in all supported configurations Run same battery of automated tests in all your test environments Unit Tests, Data-Driven, CUITs, Generic (*.exe), Ordered

18. Inspirirani ljudima. Automating the Release Cycle

19. Release Management for Visual Studio 2013 Provides a continuous deployment solution Simplifies managing multiple staging environments Automates the deployment process to all stages Enables configuration-based deployments Integrates with TFS ALM Automates workflow Enables a business-approval workflow Improves collaboration throughout the process Enables full traceability Provides release analytics and reporting DEV QA INT PROD Team Foundation Server

21. Step-by-Step Guide to Continuous Delivery Step 1 – Source Control Everything Step 2 – Automated Builds with Build Verification Test Step 3 – Continuous Integration Step 4 – Lab Environments Step 5 – Release Management

22. Inspirirani ljudima. Pitanja i odgovori. www.ekobit.com aroje@ekobit.com obajic@ekobit.com