Performance Sylvain Goyette Senior Program Manager WinHEC 2015 © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Great fundamentals = higher user satisfaction BEST laptop available today … This PC is by far the best laptop on the market! Beautiful design, extremely fast, and long battery life. … Attractive and modern! … This computer is very thin, lightweight, and super fast! … Source: www.microsoftstore.com © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Introduction and Agenda Tech Ready 15 8/9/2018 2:44 AM Introduction and Agenda Fundamentals ETW, tools, Responsiveness, etc. Update What’s new and what’s coming Windows Assessment Toolkit Demos Windows Performance Recorder Windows Performance Analyzer © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8/9/2018 2:44 AM Fundamentals © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Windows performance process WinHEC 2015 8/9/2018 2:44 AM Windows performance process System builders, OEMs, ODMs Software Windows Hardware Design & plan Architect & develop Instrument (ETW) Test & measure (ADK + WPT) Analyze (WPA) Design for performance Deliver consistent performance Iterate & improve Different focus, same approach Service, App, Driver developers © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Test recommendations User experiences Micro benchmarks WinHEC 2015 8/9/2018 2:44 AM Test recommendations User experiences Covers end-to-end scenario that typical users will experience Examples: Boot, video playback, browser navigation, etc. Windows Assessment Toolkit Micro benchmarks Specific operations within your application, service or driver that are critical to optimize for performance Examples: Antivirus file scan, driver load, driver initialization routine, etc. Event Tracing for Windows and Windows Performance Toolkit Key performance metrics Relevant data needed to assess and evaluate performance Examples: CPU usage, disk IOs, memory usage, etc. Windows Performance Toolkit © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Event Tracing for Windows (ETW) WinHEC 2015 8/9/2018 2:44 AM Event Tracing for Windows (ETW) What is it? Fast, reliable, and versatile tracing framework Dynamic trace control (no reboot or app restart required) Uses an efficient non-blocking buffering and logging mechanism Instrument code Investigate performance issues pre/post shipping Correlate app behavior with system resources usage Accurately measure operations in your software for performance evaluation © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

WinHEC 2015 8/9/2018 2:44 AM Responsiveness Unresponsiveness quickly generate customer dissatisfaction 3 key criteria to consider User perception should determine performance goals Measuring on the right hardware is critical (focus on low end systems) Real-world performance, resource constraints and software preload must be taken into account Holistic evaluation of resource utilization Physical: CPU, GPU, disk, display resolution, memory, network, battery Logical: critical sections, critical resources © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Example: Fast Startup (a.k.a. Hybridboot) WinHEC 2015 8/9/2018 2:44 AM Example: Fast Startup (a.k.a. Hybridboot) From a low power state to a responsive desktop Boot, Fast Startup, Standby, Hibernate Usually I/O and CPU intensive Highly impacted by OEM app preload Startup applications, services and logon scheduled tasks Defined as entries under RUN key and Startup folders Also include hardware-related processes (energy saver, control panels, tray icons, etc.) © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Software preload guidance WinHEC 2015 8/9/2018 2:44 AM Software preload guidance Don’t launch unnecessary memory resident processes Use trigger start services and avoid having services running all the time unnecessarily Delay start process if possible with the Task Scheduler Optimize resource usage on app launch Reduce CPU/disk contention and steady state memory usage Avoid managed code in boot path Leverage Automatic Maintenance Perform periodic tasks like updates, scans, etc. and avoid user impact Analysis focus Memory footprint of processes impacting hiberfile size Critical path analysis of logon and device initialization (bad drivers, security providers) CPU and disk resource consumption during post-on/off https://msdn.microsoft.com/en-us/library/windows/hardware/jj130812.aspx © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

How are resources utilized? WinHEC 2015 8/9/2018 2:44 AM How are resources utilized? Elapsed time Scenario start Scenario stop Time T1 T2 T2 Waiting … On whom? T3 Waiting … On whom? Ha! You wish things were that simple T4 DPC CPU Ready or pre-empted © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Windows Assessment Toolkit Updates 8/9/2018 2:44 AM Windows Assessment Toolkit Updates © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Task Manager GPU graphs 8/9/2018 2:44 AM Task Manager GPU graphs Data comes from video memory manager and GPU scheduler in the Graphics Kernel Available no matter what API is used More accurate than 3rd party utilities Requires WDDM 2.0 or above GPU utilization Video memory Per-process usage in details tab Reference: https://blogs.msdn.microsoft.com/directx/2017/07/21/gpus-in-the-task-manager © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Windows Assessment Toolkit Overview 8/9/2018 2:44 AM Windows Assessment Toolkit Overview Automated assessments Performance, quality, and energy efficiency assessments and workloads simulate real world scenarios while capturing metrics and actionable traces Fall Creators Update New Media Quality assessments that generate audio video metrics New Office productivity & video playback energy efficiency workloads Deprecated out-of-date energy efficiency workloads Metrics Performance: boot time, app launch time, memory footprint Media Quality: audio/video glitch stats Energy efficiency: battery rundown stats © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Battery Life & Performance Tools Update 8/9/2018 2:44 AM Battery Life & Performance Tools Update Battery Life Performance New Edge web browsing EE workload YouTube streaming EE workload Hibernate EE workload Skype EE workload PowerView E3 log viewer tool Microsoft Office UX Responsiveness Updates Integrate media diagnostics System Timer Resolution (STR) metrics Modern Standby App UI is subject to change and for reference purposes only. © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Assessment Toolkit Download 8/9/2018 2:44 AM Assessment Toolkit Download ADK Install for Windows Insiders and EEAP partners https://www.microsoft.com/en-us/software-download/windowsinsiderpreviewADK ADK Install post RTM https://developer.microsoft.com/en-us/windows/hardware/windows-assessment-deployment-kit © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Assessment Toolkit Install 8/9/2018 2:44 AM Assessment Toolkit Install Features to select Windows Assessment Toolkit Windows Performance Toolkit Media eXperience Analyzer is optional, but recommend for analyzing ETW logs generated by the Media Quality & Media Energy Efficiency workloads App UI is subject to change and for reference purposes only. © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Media Quality Assessment 8/9/2018 2:44 AM Media Quality Assessment Run Assessments Configure the assessment parameters in the Windows Assessment Console (WAC) then run the assessment View results in WAC Media Quality audio/video glitch counts in the Windows Assessment Console (WAC) App UI is subject to change and for reference purposes only. © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

How to run Media Quality Assessment 8/9/2018 2:44 AM How to run Media Quality Assessment Step 1 Launch the Windows Assessment Console, click options, then New Job Step 2 Select “Create a custom job” Step 3 Click “Add assessments”, select the Windows 10 Media Playback Quality assessment then configure parameters and run App UI is subject to change and for reference purposes only. © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

WinHEC 2015 8/9/2018 2:44 AM Demo © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Tech Ready 15 8/9/2018 Call to action Today should be the start of an ongoing performance partnership Windows enables you to deliver great performance Optimize the right scenarios and delight users Leverage our tools and guidance Attend the performance and power labs © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Call to action Windows Performance Jump Start Tech Ready 15 8/9/2018 Call to action Windows Performance Jump Start Microsoft Virtual Academy Boot performance (Fast Startup) Training Video – Boot Performance Memory Training video – Diagnosing Memory Usage and Leaks Critical path analysis Training video – Critical Path Analysis with WPA © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8/9/2018 2:44 AM © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.