1. WDK Driver Test Manager

2. Outline HCT and the history of driver testing Problems to solve Goals of the WDK Driver Test Manager (DTM) Automated Deployment Tools Packager Changes to the Windows Logo Program

3. The HCT Today Hardware Compatibility Test (HCT) Can only run logo tests provided by Microsoft Used for DFW/logo program Content ~1600 Test Cases (400+ binaries) Test Manager (shell) Logo Docs and Test Specs Testing for Driver quality Some partners develop their own tests and infrastructure Some partners use only the logo tests for quality testing

4. What You Told Us HCT is not scalable Adding new technologies is problematic Can’t run non-logo tests Can’t run on more than one machine Can’t run partner tests Partners must maintain Logo-only infrastructure Dedicated hardware Dedicated headcount

5. Goals of Driver Test Manager (DTM) Improve the end user Windows experience Reduce blue-screens Increase performance Improve driver quality Improve the partner experience Provide MS quality tests Allow partner tests Provide infrastructure to push testing earlier in development cycle Reduce submission complexity

6. Key Concepts Test Management Studio Device Selection and Scheduling Controller Jobs database Client Packager Collaboration tool Tests and content delivery Automated Software Installer (ASI)

7. AutomationDatastore DTM Scenario DTM Controller Job 0 Log 1 Log 0 Log Scheduler DTM Studio Test System Pool Job Management Device 0 My Job Config Device x The gatherers are sent to the test targets to gather information about their devices The test engineer creates and manages jobs from the studio The scheduler matches the jobs to the test targets with the appropriate hardware The jobs and test configuration are sent to the test targets The tests execute in parallel or in sequence, collecting results in logs When the tests are complete, the results are sent to the controller where they can be reviewed After reviewing the results, the test engineer packages all test information and results The test targets are configured automatically, including a clean install of the OS The package can be saved so the tests can be duplicated at a later date … …and shared with customers, OEMs, or submitted to Microsoft OEMs Microsoft

8. Driver Test Manager (DTM) Jobs A collection of 1 or more tasks Tasks are executables, like “LogoTest.exe” Task dependencies can be created Setup, Regular, Cleanup Created, edited and scheduled in Studio Sharable Constrainable Dimensions Parameters

9. Driver Test Manager (DTM) Scheduler Matches constraints and test machines (clients) Manages job distribution to Machine pool Job Monitor Presents status of machines in machine pool (clients) Presents status of jobs in scheduler Presents status of tasks in jobs Results Explorer Results roll-up view Results collection Log viewer Device Selection Provides for “Device Based Job Selection” paradigm Adds HCT functionality to the DTM Necessary for Logo Programs

10. Automated Deployment Tools Ximage and ASI

11. Ximage A command line interface to the imaging technology used by Windows codenamed “Longhorn” setup Will create file based image and restore it Automated Software Installer (ASI) Automate the install of any Windows OS From disk images From Windows CDs Optimized for testing environments Benefits Increased productivity Eliminate multi-boot and disk-swapping scenarios Manage images and builds for the entire organization in one location

12. Ximage System Imaging Tool

13. Ximage Architecture Ximage.exe Wimgapi.dll File Data Image Metadata Header Tail Wimfltr.sys

14. Automated Software Installer Windows Deployment Tool

15. ASI Functionality Windows Media or images ASI Client ASI Tools File Share ASI Database

16. ASI Client Configuration 1. PXE Boot 3. Safe partition 2. Bootable media

17. Using ASI in the Driver Test Manager Partition 1 “Safe” OS ASI client DTM client Partition 2 Test OS DTM client My Job Config Log 1

18. ASI Server Deployment ASI Client ASI Server Image Cache ASI Server File Share ASI Database

19. Ximage and ASI: Which One Should I Use? Ximage A disk imaging tool Use if you want to restore a test system to exactly the same state multiple times Use if the bits don’t change regularly ASI A software deployment solution optimized for testing environments Use to automate Windows setup Use if the bits change regularly; testing daily builds for example

20. What About Ghost? The DTM will automate any tool with a command line interface Virtually everyone is using Ghost images in their testing Keep using your existing images Consider moving to Ximage and ASI over time Realize the benefits of tools optimized for a test environment Ximage and ASI are included in the WDK Some jobs Microsoft provides may require these tools

21. Packager

22. Packager Architecture DTM Studio DTM Object Model SQL Datastore Package APackage B

23. Benefits of Packager Move jobs or test data between controllers Share jobs with another organization Share test results with other organizations Make a logo submission Simplified reproduction of failures Update mechanism for the WDK

24. Package DTM Controller Packager Functionality DTM Datastore Copy Copy Package DB Binaries Binaries

25. Packager Scenarios

26. Scenario Create Logo Package Driver Share Logs, results, machine configuration data Submit to Microsoft Drivers DTM Controller

27. Scenario Investigate a Failure Test Clients Jobs, tests, results, system configuration data, crash dumps Test Clients Studio View Data Import DTM Controller

28. Scenario Export Tests Jobs and tests Test Clients Import DTM Controller

29. Scenario Package logs and results Results and Logs Test Clients Studio View Data Import DTM Controller

30. Windows XP and Windows Server 2003 Logo Program Support

31. Program simplification Reduce the number of HCT tests to about 30 One “kit” for all Windows XP and Windows Server 2003 devices One “kit” for all Windows XP and Windows Server 2003 systems, excluding datacenter and cluster Windows XP and Windows Server 2003 kits will be in the DTM HCT and DCT will reach end-of-life when the DTM ships

32. Call To Action Start preparing for the WDK now Sign up for the WDK Beta and actively participate Visit the Windows Driver Kit Page – http://www.microsoft.com/whdc/driver/wdk/default.mspx http://www.microsoft.com/whdc/driver/wdk/default.mspx Engage with the WDK Team - provide feedback through Microsoft aliases

33. Additional Resources Web Resources: Windows Driver and Hardware Central – http://www.microsoft.com/whdc/default.mspx http://www.microsoft.com/whdc/default.mspx Windows Driver Kit Page – http://www.microsoft.com/whdc/driver/wdk/default.mspx http://www.microsoft.com/whdc/driver/wdk/default.mspx Email: WDKFB @ microsoft.com for feedback and questions on the WDK

34. © 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.