VTune: Intel’s Visual Tuning Environment K. Sridharan, VTune Development Manager

What is VTune? VTune is a performance tuning environment for Windows™ developers from Intel. VTune is now bundled with: Intel C/C++ and FORTRAN compilers Intel Performance Library Suite Intel Architecture tutorials, Processor Manuals and Computer Based Training Materials. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Overview of VTune VTune is a Performance tuning tool for Windows 95 and NT* developers to: Monitor the performance of all active software. Identify “HotSpots” in a program and analyze its performance as it executes on an Intel Architecture microprocessor platform. Examine each instruction and uncover problems at machine code level. Help optimize code using context-sensitive on-line tuning suggestions. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Time-Based Sampling A periodic interrupt drives the Sampling Interrupt sources can be VTD, RTC or NMI*. Sample data stored in buffer until its full. Buffer flush disables sampling during write. Analyze the sampling data. Data consists of cs:eip and module name data. Match addresses with an application or OS routine. Sampling data stored in Access 7.0 DB. Easy to import Sampling data into Excel. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Event-Based Sampling on Pentium®Pro Processor CPU Events report on internal CPU states. Event Sampling enabled by CPU and APIC VTune helps manage the choices Data Cache Misses Partial Stall Counts Branch Statistics Mispredictions and Total Branches Taken Clock Count Statistics Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

HotSpot Analysis From the System-wide view, you can zoom into a specific module of interest. Display all of the HotSpots organized by functions in the module, memory locations, class names and source files. For each HotSpot, VTune displays the symbol name, address, and the number of samples collected. For detailed information, double click on a HotSpot to open a source code or assembly view. The HotSpot view helps you to identify sections in your code that take the most CPU time and that have potential performance problems. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Static Analysis Shows performance information by instruction Target machine can be different than Host machine. Indicates pairing on Pentium® processor, decoder groups on PentiumPro Processor. Shows penalties incurred by the instruction. Shows execution clocks or micro-ops. Disassembly fits into a Portal which can be moved or enlarged. Size of Portal affects speed of analysis. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Dynamic Analysis Assists in pin-pointing the issues identified by sampling or static analysis. Uses advanced simulator technology to run, trace and simulate your actual code in one step Fine-tune performance attributes of key sections of your code, such as: Cache behavior analysis Branch Prediction results Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

VTune’s Code Coaches C and Fortran Code Coaches offer specific suggestions on the modifications to improve performance; Examples: Loop interchange and loop Invariant code motion Converts from scalar to mmx using intrinsics calls Traversing an array/list: binary search, hash tables Consider using MMX(tm) technology Consider using Intel’s Performance Libraries. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Intel Compiler Strategy Intel’s compilers track Intel microprocessor improvements Available as a plug in extension to the “Microsoft Developer’s Studio” Intel’s compiler optimizations and code generation is tuned to each new processor. This includes support for new instructions like PP cmov and MMX™ instructions. This compiler technology is available as a drop in product in the Microsoft Developer’s Studio Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Compiler Performance Features Profile guided optimizations Floating point optimizations Floating point alignment MMX™ Technology Today I’ll be talking about a few of the performance features in the Intel compilers Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Intel Performance Library Suite Signal Processing Library V3.0 DSP, Filtering, Transform and Telephony Recognition Primitives Library V3.0 Voice/Speech Recognition and Processing Image Processing Library V1.0 Beta Photo Editing, Enhancement and Transform Math Kernel Library V2.0 Scientific and Technical Computation Thank you for coming and listening to our presentation. My name is so and so. I am going to talk about the Intel Performance Library Suite, another software product offered by Intel. It is developed to enhance some of the computational intensive operations in typical media and scientific applications. There are two different types of libraries we will talk about. The first set is consisted of three C-callable multimedia libraries optimized for MMX that includes the Signal Processing Library, the Recognition Primitives Library and the Image Processing Library. And the second is the Math Kernel Library, which is a floating point Fortran callable library for scientific applications on Workstations. Each library is designed to address certain media market segments. For example : we are quite successful in getting speech vendors, like IBM, purespeech, NEC to use intel splib and rplib in their voice recognition software; companies like MGI have already used iplib in their imaging products. You can visit our demo station to see some of these applications. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Why Use Intel’s Performance Libraries ? Highly optimized for performance Alternative for code development Stay current with the latest Intel Architectures High level programming language interface Reduce development effort Why Use the Libs? Our libraries are optimized at the assembly level with tuned cache usage to strive for the highest performance. Our goal is to provide an alternative for code development which allows developers to access the performance benefits of the latest intel architecture, specifically the MMX™ Technology, even before development tools are available. Basically the performance libraries keep you current with present and future Intel architectures. As a developer, you can either read new instruction and cache specifications for each new processor that comes out and start another cycle of hand tuned assembly coding, OR, just get on the performance library train for an optimized ride. You'll stay current and optimized without re-coding a single line -- or at least, your competitors will. Our libraries are constantly updated to support new intel microprocessors, and their function interface are maintained the same across all platforms. We provide a high level programming language interface to our hand tuned and optimized code, so that you can just concentrate on your application. Potentially, can help to eliminate partial or all of your assembly coding efforts. All these benefits are translated to less development effort and therefore faster time to market. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

VTune Coming Attractions VTune Support For Java: First release is VTune 2.5: view performance in every component: including Java class files call graph working with major vendors. Beta this month. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

VTune Coming Attractions Beta later this year. All OS events (Perfmon) and Events over time Process, Processor Views. Call graph Memory Pattern Analysis C++/ASM coach Dynamic Analysis for PII Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Backup Slides

Key Features: Code Analysis of binary files Perform code analysis without the need to create an executable and sample. Accepts .exe, .dll or .obj files. Zoom into source code by double-clicking on the desired function from the summary. If no source code is available, the binary is disassembled. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Source View C/C++, FTN or Assembly or ?? displayed. Sample times shown by source line. Source and disassembly can be intermixed. Any of these file types can supply symbol and line number information: .SYM, .HDR, .DMP, .DBG, .MAP, .PDB , C7/CV (NB09), NB10, NB11, FB09, FB0A, DWARF 2. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Libraries Platform Support 32-bit operating system (Microsoft* Win 95 and Microsoft* Win NT) Compiler support Multi-Media Libraries (DLLs and Static Libraries) Intel C/C++ Compiler Plug-in MSVC/C++ V4.x Borland V5.0 Math Kernel Library (Static Libraries) Intel Fortran 77 Compiler Microsoft Powerstation Fortran V4.0 Watcom Fortran 77 V10.6 The library suite is designed for 32-bit operating system only, specifically Microsoft Win95 and Win NT. All the multi-media libraries are available in DLL and static library formats, which support Intel, Microsoft and Borland C/C++ compiler. The Math Kernel Library currently only comes in static library form which supports Intel, Microsoft and Watcom Fortran compiler. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Multi-Media Library Features High performance Optimized processor specific DLLs and static libraries for : Intel 486 TM Pentium® Processor Pentium® Processor with MMXTM Technology Pentium® Pro Processor Pentium® II Processor Scalable architecture Processor detection and processor specific DLL loading C-Callable programming interface Support for integer and floating point data Custom DLL Builder for minimum memory footprint Let’s move on to talking about some of the common features presented in those three multi-media libraies, which totally comprised of more than 350 functions. We distribute a full set of DLL and Static Libraries that are optimized for each processor listed here. From Intel 486 to the latest Pentium II processor, which will be launched in couple months. The libraries implemented a scalable architecture that contains code segment to detect what an application is currently running on, and dynamically load in the processor-specific DLL for optimal performance. Dynamic DLL Loading only works with DLL, not with static libraries. These libraries provide a C-callable function interface. Most library functions support both floating point and integer data type. Only integer functions can take advantage of the MMX™ Technology. We have also provided a utility to allow developer to custom build their own DLL. We will describe this in more details later slide. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation

Math Kernel Library Workstation technical computing library Basic Linear Algebra Subroutines (BLAS) Single and double precision FFTs Main features Optimized kernels at every level of BLAS Level 3 BLAS multithreaded - performance scales on SMP systems Optimized for Pentium® Pro Processor Interfaces to several FORTRAN compilers Static libraries DLL will be available The Math Kernel Library is different from the previous three mutli-media libraries. The Math library has a Fortran programming interface, and is targeted for technical computation on an Intel workstation platform. The Math Kernel Library implemented an optimized version of the Basic Linear Algebra Subrountines, which is a public standard, involving extensive vector and matrix operations. We have also included single and double precision FFTs for additional functionality. Our BLAS routines are highly optimized for Intel Pentium Pro at both the source level and the assembly level. Level 3 BLAS is also implemented with multi-thread for scalable performance on SMP systems. Matrix operations are blocked for optimal use the cache memory. Currently, the math kernel library is only available in static library form, DLL versions will be available in the future. For date of availability, please check our Web site for updates. Monday, April 22, 2019Monday, April 22, 2019 Intel Corporation