Automated Instrumentation and Monitoring System (AIMS)

Slides:



Advertisements
Similar presentations
Section 6.2. Record data by magnetizing the binary code on the surface of a disk. Data area is reusable Allows for both sequential and direct access file.
Advertisements

Parallel Virtual Machine Rama Vykunta. Introduction n PVM provides a unified frame work for developing parallel programs with the existing infrastructure.
K T A U Kernel Tuning and Analysis Utilities Department of Computer and Information Science Performance Research Laboratory University of Oregon.
LabVIEW is a graphical programming development environment for data acquisition and control, data analysis, and data presentation. With LabVIEW you can.
Intel® performance analyze tools Nikita Panov Idrisov Renat.
MCTS GUIDE TO MICROSOFT WINDOWS 7 Chapter 10 Performance Tuning.
National Instruments Confidential. 2 LabVIEW Development Tips and Tricks Revealed Carl Ljungholm - LabVIEW Product Support Engineer Travis Hailey - LabVIEW.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 11: Monitoring Server Performance.
Chapter 14 Chapter 14: Server Monitoring and Optimization.
Chapter 11 - Monitoring Server Performance1 Ch. 11 – Monitoring Server Performance MIS 431 – created Spring 2006.
OS Spring’03 Introduction Operating Systems Spring 2003.
MCITP Guide to Microsoft Windows Server 2008 Server Administration (Exam #70-646) Chapter 14 Server and Network Monitoring.
1 Chapter 1 Tour of Access. 1 Chapter Objectives Start and exit Microsoft Access Open and run an Access application Identify the major elements of the.
Check Disk. Disk Defragmenter Using Disk Defragmenter Effectively Run Disk Defragmenter when the computer will receive the least usage. Educate users.
1 Using Compressed Files and Folders Applications and operating systems read and write to compressed files. NTFS uncompresses the file before making it.
CH 13 Server and Network Monitoring. Hands-On Microsoft Windows Server Objectives Understand the importance of server monitoring Monitor server.
Windows Server 2008 Chapter 11 Last Update
MSS & AMS Name and configure MIDI controllers, devices and sound modules. Control their routing to Pro Tools MSS - Configurations can be imported or exported.
Chapter 9 Introduction to ActionScript 3.0. Chapter 9 Lessons 1.Understand ActionScript Work with instances of movie clip symbols 3.Use code snippets.
1 Chapter Overview Monitoring Server Performance Monitoring Shared Resources Microsoft Windows 2000 Auditing.
Infinity-project.org Engineering education for today’s classroom The Infinity Project SM LabVIEW for The Infinity Project.
Introduction to HP LoadRunner Getting Familiar with LoadRunner >>>>>>>>>>>>>>>>>>>>>>
MCTS Guide to Microsoft Windows 7
Computing IV Visual C Introduction with OpenCV Example Xinwen Fu.
Chapter 11: Introduction to the Visual Basic Environment Spreadsheet-Based Decision Support Systems Prof. Name Position (123) University.
CHAPTER SIX Reducing Program Complexity General Sub Procedures and Developer-defined Functions.
5 Chapter Five Web Servers. 5 Chapter Objectives Learn about the Microsoft Personal Web Server Software Learn how to improve Web site performance Learn.
CCS APPS CODE COVERAGE. CCS APPS Code Coverage Definition: –The amount of code within a program that is exercised Uses: –Important for discovering code.
Adventures in Mastering the Use of Performance Evaluation Tools Manuel Ríos Morales ICOM 5995 December 4, 2002.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
9 Chapter Nine Compiled Web Server Programs. 9 Chapter Objectives Learn about Common Gateway Interface (CGI) Create CGI programs that generate dynamic.
Marcel Casado NCAR/RAP WEATHER WARNING TOOL NCAR.
VAMPIR. Visualization and Analysis of MPI Resources Commercial tool from PALLAS GmbH VAMPIRtrace - MPI profiling library VAMPIR - trace visualization.
Khoros Yongqun He Dept. of Computer Science, Virginia Tech.
Guide to Linux Installation and Administration, 2e1 Chapter 10 Managing System Resources.
XP New Perspectives on Integrating Microsoft Office 2003 Tutorial 3 1 Integrating Microsoft Office 2003 Tutorial 3 – Integrating Word, Excel, Access, and.
Overview of CrayPat and Apprentice 2 Adam Leko UPC Group HCS Research Laboratory University of Florida Color encoding key: Blue: Information Red: Negative.
1 Integrating Microsoft Office 2003 Tutorial 3 – Integrating Word, Excel, Access, and PowerPoint.
Performance Monitoring Tools on TCS Roberto Gomez and Raghu Reddy Pittsburgh Supercomputing Center David O’Neal National Center for Supercomputing Applications.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
Portable Parallel Performance Tools Shirley Browne, UTK Clay Breshears, CEWES MSRC Jan 27-28, 1998.
1 Computing for Todays Lecture 21 Yumei Huo Spring 2006.
Virtual Instrumentation With LabVIEW. Front Panel Controls = Inputs Indicators = Outputs Block Diagram Accompanying “program” for front panel Components.
SvPablo. Source view Pablo GUI for instrumenting source code and viewing runtime performance data Joint work at Univ. of Illinois and Rice Univ. HPF programs.
Tool Visualizations, Metrics, and Profiled Entities Overview [Brief Version] Adam Leko HCS Research Laboratory University of Florida.
A lesson approach © 2011 The McGraw-Hill Companies, Inc. All rights reserved. Microsoft® Excel 2013.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 3: Process-Concept.
Overview of AIMS Hans Sherburne UPC Group HCS Research Laboratory University of Florida Color encoding key: Blue: Information Red: Negative note Green:
CHAPTER SIX Reducing Program Complexity General Sub Procedures and Developer-defined Functions.
Debugging tools in Flash CIS 126. Debugging Flash provides several tools for testing ActionScript in your SWF files. –The Debugger, lets you find errors.
Important! Be sure to connect the communication cable to your computer before opening the Aqua4Plus Lite software. (Click to continue)
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
Projections - A Step by Step Tutorial By Chee Wai Lee For the 2004 Charm++ Workshop.
Tuning Threaded Code with Intel® Parallel Amplifier.
Lesson 17 Mail Merge. Overview Create a main document. Create a data source. Insert merge fields into a main document. Perform a mail merge. Use data.
Key Applications Module Lesson 12 — Word Essentials Computer Literacy BASICS.
MPE Logging/nupshot. Included with MPICH 1.1 distribution Distributed separately from rest of MPICH from PTLIB MPE logging library produces trace files.
Chapter Goals Describe the application development process and the role of methodologies, models, and tools Compare and contrast programming language generations.
Chapter 10 Application Development
Hands-On Microsoft Windows Server 2008
INTRODUCING Adams/CHASSIS
An Introduction to Computers and Visual Basic
MCTS Guide to Microsoft Windows 7
Chrome Developer Tools
An Introduction to Computers and Visual Basic
Using Visual Studio with C#
Advanced TAU Commander
An Introduction to Computers and Visual Basic
Tutorial 12 Managing and Securing a Database
Presentation transcript:

Automated Instrumentation and Monitoring System (AIMS)

AIMS Components Source code instrumentors –xinstrument –batch_inst Monitoring library Analysis tools –View Kernel (VK) –tally statistics generator

xinstrument GUI allows user to select specific source code constructs to be instrumented Default is to instrument all communication routines Other possibilities –All subroutines –All I/O –Enable by Type –Point and click on particular constructs in Construct Tree diagrams

xinstrument (cont.) Regards source code as nested collection of constructs –conditionals –loops –subroutines –communication calls Instrumented construct is replaced or surrounded by calls to AIMS monitor routines Execution of instrumented construct generates time- stamped event

xinstrument display

Files Menu Selections

Options Menu Selections

Enable by Type dialog box

Advanced Options Menu Selections

Files created by xinstrument The following files are created by xinstrument and placed in./inst or designated output directory –Instrumented source code –AIMS.monrc - parameters from Settings pane plus other options –Application database default name is APPL_DB Stores information about static structure of application Used by analysis tools to relate traced events to Instrumented constructs Incorporated at beginning of trace file –Profile Table of flags, one for each construct in The application database Can be edited to change instrumentation

batch_inst Command-line instrumentor batch_inst [-options] [filenames] where options include:

Compiling and Running Instrumented Code Copy necessary files to inst directory –Makefile –Header files –Source files not instrumented –Input files

Example directory structure

Compiling and Running (cont.) Link with AIMS MPI monitor library MON_LIB = $(AIMS_DIR)/lib app: $(F77) -o app_program $(APP_OBJS) $(MON_LIB)/mpilib.a Set $AIMS_TMP_DIR environment variable to location to store local trace files Make sure AIMS scripts and executables are in your path Per-process trace files are automatically collected and merged at end of execution

Visualizing Trace Files with VK View Kernel (VK) animates a trace file VCR-like controls for tracefile playback Can set breakpoints by time or in specific source code constructs Source code click-back capability Timeline display Spokes view animates messages passed between tasks

Timeline Display Toggles between three different views OverVIEW –Horizontal bars represent tasks –Colors represent different instrumented subroutines –White space indicates task is blocked waiting to complete send or receive –XX pattern indicates time spent writing AIMS trace files to disk –Lines between bars represent messages transmitted between taSks –Use keystroke and click combinations to get more information

AIMS OverVIEW with source code clickback

Click-back keystroke combinations

Timeline Display (cont.) I/OverVIEW –Colored bars indicate read, write, seek, etc. –Height of bar represents size of message MsgVIEW –Idle time shown with two colors, one for send idling and one for receive idling –Time spent computing shown as white space –Message lines –Height of bar represents message size

AIMS MsgVIEW

AIMS I/OverVIEW

blue - idle receive green - busy yellow - idle send hatched - flushing Spokes View

Controlling Scale and Speed of Playback No scrolling or zooming capabilities Set jump factor between 0 and 1 to speed up animation Set pause times or breakpoints to slow down animation Set scale to view larger or smaller time interval (default is 100 milliseconds)

tally Processes trace file to produce resource utilization statistics on node-by-node and routine-by-routine basis tally output can be input to statistical drawing packages such as Excel or WingZ

tally [options] [sorted tracefile] where options include:

tally output - tally.summary Information for each procedure/function: –busy time: time spent performing useful work –global blocking: time spent in global blocking operation –send blocking: time spent in send operation –receive blocking: time spent in receive operation –life time: exclusive time –percentage communication: percentage of total execution time spent in communication –communication index: time spent in routine with respect to total time of program, as well as percentage of time spent in communication in this routine

tally.summary (cont.) Information for each node (and routine): –busy time –global blocking –send blocking –recv blocking –percentage communication

tally output - ncpu.summary NCPU for a given subroutine and a given k is the amount of CPU time used by that subroutine when k processors are busy, divided by k. Routine Concurrency - amount of time spent by each subroutine when k copies were executing simultaneously (indicates degree to which each routine was parallelized)

Graphs created by Excel 4.0 from tally output