Program Visualization at the System Level University of Notre Dame Dirk Van Bruggen and Jian Mu.

Slides:



Advertisements
Similar presentations
NAGIOS AND CACTI NETWORK MANAGEMENT AND MONITORING SYSTEMS.
Advertisements

P3- Represent how data flows around a computer system
LOAD BALANCING IN A CENTRALIZED DISTRIBUTED SYSTEM BY ANILA JAGANNATHAM ELENA HARRIS.
The Little man computer
XENMON: QOS MONITORING AND PERFORMANCE PROFILING TOOL Diwaker Gupta, Rob Gardner, Ludmila Cherkasova 1.
Advanced MPI Lab MPI I/O Exercises. 1 Getting Started Get a training account from the instructor Login (using ssh) to ranger.tacc.utexas.edu.
Program Visualization at the System Level University of Notre Dame Jian Mu and Dirk Van Bruggen.
Chapter 12 Pipelining Strategies Performance Hazards.
Program Flow Charting How to tackle the beginning stage a program design.
Program Flow Charting How to tackle the beginning stage a program design.
1 Lab Session-IV CSIT-120 Fall 2000 Precedence Rules Machine Language Programming The “Micro” Machine The “Micro” Simulator The “Micro” Translator (Thanks.
EXCEL PART1. Objectives  Understand spreadsheet software  Tour the Excel 2010 window  Understand formulas  Enter labels and values and use the Sum.
Multi-Core ßeta Computer Christopher Celio & Matt Long Spring 2007.
A Visual Introduction to PC SAS. Start SAS by double-clicking on the SAS icon...
Why Threads Are A Bad Idea (for most purposes) John Ousterhout Sun Microsystems Laboratories
Octopus system1 Moshe Tocker Avihai Mejer. Octopus system2 The Octopus system Goal The system’s primary goal is to Measure performance parameters in real.
The Program Design Phases
An Introduction to Operating Systems. Definition  An Operating System, or OS, is low-level software that enables a user and higher-level application.
Beginning Programming with the Visual Studio.NET Environment.
I/O Systems ◦ Operating Systems ◦ CS550. Note:  Based on Operating Systems Concepts by Silberschatz, Galvin, and Gagne  Strongly recommended to read.
1 I.Introduction to Algorithm and Programming Algoritma dan Pemrograman – Teknik Informatika UK Petra 2009.
Rensselaer Polytechnic Institute CSCI-4210 – Operating Systems David Goldschmidt, Ph.D.
Startup – Chapter 1.
MS WINDOWS POWER SHELL CSE 535 Operating Systems.
KWIC Project – Part 1 Mini-Project to Evaluate Architectural Patterns(Styles) Carl Chesser Ji Li EECS 761.
© Janice Regan, CMPT 128, Jan CMPT 128 Introduction to Computing Science for Engineering Students Creating a program.
Nick Draper Teswww.mantidproject.orgwww.mantidproject.org Instrument Independent Reduction and Analysis at ISIS and SNS.
Lecture 2 Process Concepts, Performance Measures and Evaluation Techniques.
Extending Petascale I/O with Data Services Hasan Abbasi Karsten Schwan Matthew Wolf Jay Lofstead Scott Klasky (ORNL)
What have mr aldred’s dirty clothes got to do with the cpu
Command Prompt Chapter 10 Introduction to Batch Files Richard Goldman February 7, 2000.
Process Control. Module 11 Process Control ♦ Introduction ► A process is a running occurrence of a program, including all variables and other conditions.
A User-Lever Concurrency Manager Hongsheng Lu & Kai Xiao.
Guide To UNIX Using Linux Third Edition Chapter 8: Exploring the UNIX/Linux Utilities.
PARALLEL APPLICATIONS EE 524/CS 561 Kishore Dhaveji 01/09/2000.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems with Multi-programming Chapter 4.
Power Profiling using Sim-Panalyzer Andria Dyess and Trey Brakefield CPE631 Spring 2005.
Youngil Kim Awalin Sopan Sonia Ng Zeng.  Introduction  Concept of the Project  System architecture  Implementation – HDFS  Implementation – System.
UNIX Unit 1- Architecture of Unix - By Pratima.
Concurrency, Processes, and System calls Benefits and issues of concurrency The basic concept of process System calls.
Extraction Tools and Relational Database Schemas for CVS, SVN, and Bazaar Revision Control Systems.
CS 351/ IT 351 Modeling and Simulation Technologies HPC Architectures Dr. Jim Holten.
Introduction to Operating Systems Prepared by: Dhason Operating Systems.
Predictive Application- Performance Modeling in a Computational Grid Environment (HPDC ‘99) Nirav Kapadia, José Fortes, Carla Brodley ECE, Purdue Presented.
Chapter 8 System Management Semester 2. Objectives  Evaluating an operating system  Cooperation among components  The role of memory, processor,
Power Guru: Implementing Smart Power Management on the Android Platform Written by Raef Mchaymech.
Chapter Eight Exploring the UNIX Utilities. 2 Lesson A Using the UNIX Utilities.
Maximizing Performance – Why is the disk subsystem crucial to console performance and what’s the best disk configuration. Extending Performance – How.
CS 177 Recitation Week 1 – Intro to Java. Questions?
Youngil Kim Awalin Sopan Sonia Ng Zeng.  Introduction  System architecture  Implementation – HDFS  Implementation – System Analysis ◦ System Information.
Mode Superposition Module 7. Training Manual January 30, 2001 Inventory # Module 7 Mode Superposition A. Define mode superposition. B. Learn.
ALLOY: A Formal Methods Tool Glenn Gordon Indiana University of Pennsylvania COSC 481- Formal Methods Dr. W. Oblitey 26 April 2005.
CPIT Program Execution. Today, general-purpose computers use a set of instructions called a program to process data. A computer executes the.
Introduction to Computer Programming Concepts M. Uyguroğlu R. Uyguroğlu.
Some of the utilities associated with the development of programs. These program development tools allow users to write and construct programs that the.
1.3 Operating system services An operating system provide services to programs and to the users of the program. It provides an environment for the execution.
The Little man computer
CSCI-235 Micro-Computer Applications
Computer 4 JEOPARDY Bobbie, Sandy, Trudy.
Where are being used the OS?
Operating Systems Overview
Chapter 6: CPU Scheduling
Chapter 1: An Overview of Computers and Programming Languages
Morgan Kaufmann Publishers Computer Performance
Why Threads Are A Bad Idea (for most purposes)
Software - Operating Systems
Why Threads Are A Bad Idea (for most purposes)
Why Threads Are A Bad Idea (for most purposes)
1.3.7 High- and low-level languages and their translators
ME 123 Computer Applications I Lecture 7: Basic Functions 3/20/03
Presentation transcript:

Program Visualization at the System Level University of Notre Dame Dirk Van Bruggen and Jian Mu

The Problem Simple programs can be complex Commands offer a look into the system calls Output is difficult to decipher How does the program run? What files/resources are used?

The Solution Create a program to assist in visualizations Create a Data Pipeline Create Modules for each stage commandsparser Data processor visualizer

Implementation Written in a combination of Python and C++ Data Processing Modules Pull out size of data read Calculate IO Rate per files Calculate Time spent on each file Sum up the total time taken for all system calls

Usage Example All-pairs program: Compare_bitdumb Set ASet B Matrix M File size = 100M

Visualization App

Test Results CPU utilization over time

Test Results (contd.) Memory utilization over time

Test Results (contd.) Load average in the last one minute

How Much Overhead?

User Study Small Study – 4 testers Results Raw strace – Information is too dense Time consuming to find total file sizes Viz App is easier to find total file sizes Range of improvement answers.

Future Work Ideas from user study: Labeling Function Zoom Problems Display call details Display time spent opening and reading per file Easier expansion of directories

Questions?