Linux Performance Profiling & Visualization

Slides:



Advertisements
Similar presentations
K T A U Kernel Tuning and Analysis Utilities Department of Computer and Information Science Performance Research Laboratory University of Oregon.
Advertisements

Online Hotel Reservation System
Using one level of Cache:
Using netstat for Performance Analysis
Program Visualization at the System Level University of Notre Dame Dirk Van Bruggen and Jian Mu.
Threads 1 CS502 Spring 2006 Threads CS-502 Spring 2006.
Measuring Performance Chapter 12 CSE807. Performance Measurement To assist in guaranteeing Service Level Agreements For capacity planning For troubleshooting.
Chapter 3 Software Two major types of software
CS 0008 Day 2 1. Today Hardware and Software How computers store data How a program works Operators, types, input Print function Running the debugger.
TM Herding Penguins with Performance Co-Pilot Ken McDonell Performance Tools Group SGI, Melbourne.
CPU Scheduling - Multicore. Reading Silberschatz et al: Chapter 5.5.
ITEC 325 Lecture 29 Memory(6). Review P2 assigned Exam 2 next Friday Demand paging –Page faults –TLB intro.
COMPUTER SOFTWARE Section 2 “System Software: Computer System Management ” CHAPTER 4 Lecture-6/ T. Nouf Almujally 1.
Uncovering the Multicore Processor Bottlenecks Server Design Summit Shay Gal-On Director of Technology, EEMBC.
Introduction to Open Source Performance Tool --Linux Tool Perf Yiqi Ju (Fred) Sep. 13, 2012.
Open Source Performance Monitoring Tools, Tips and Tricks for Java Matt Secoske Consultant - Bass & Associates
WebVizOr: A Fault Detection Visualization Tool for Web Applications Goal: Illustrate and evaluate the uses of WebVizOr, a new tool to aid web application.
EzHPC ERDC, ITL ezHPC Workshop April 23, Problem HPC tools are primarily command line Hard to remember syntax to accomplish things Not everyone.
Guide to Linux Installation and Administration, 2e1 Chapter 10 Managing System Resources.
Process Control. Module 11 Process Control ♦ Introduction ► A process is a running occurrence of a program, including all variables and other conditions.
Decision Support Tools. Decision Support: About This Presentation Employee engagement in benefit enrollment decisions is an important part of our enrollment.
Understanding Xamarin Development Matt
1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.
IOS and Android with Windows Azure Websites Name Title Address Website.
Acegene IT Co. Ltd.1 Linux 操作系统 系统优化 周炯上海艾基信息技术有限公司.
University of Illinois at Urbana-Champaign BeeSpace Navigator v4.0 and Gene Summarizer beespace.uiuc.edu `
Cosc 4750 Maintenance & Analysis. Maintenance Contracts Annual cost of 10%-12% of component’s list price. On-site maintenance –usually within hours.
Eclipse Simple Profiler Ben Xu Mar 7,2011. About Eclipse simple profiler is a open source project to analyze your plug-ins/RCPs performance.
Oracle 10g Advanced Performance Tuning Kyle Hailey Delphix - wait events docs – tools S-ASH.
Software Performance Monitoring Daniele Francesco Kruse July 2010.
E-MOS: Efficient Energy Management Policies in Operating Systems
Creaza Engage your students. General Information TOOL NAME AND URL: -Creaza - DESCRIPTION: Creaza is an online toolkit that makes.
Wes Hackett Principal Solutions Architect Chris O’Brien Head of Development.
Título/Title Nome/Name Cargo/Position Foto/ Picture Linux Performance on Power Breno Leitão Software Engineer.
DreamFactory for Microsoft Azure Is an Open Source REST API Platform That Enables Mobilization of Data in Minutes across Frameworks and Storage Methods.
Introduction to Operating Systems Concepts
Lesson 11: Web Services and API's
BY: SALMAN 1.
Computer System Structures
Linux Command Tips.
Bishnu Priya Nanda , Tata Consultancy Services Ltd.
Computer Systems Nat 5 Computing Science
Office Add-ins: Make your solution a native part of Office
BY: SALMAN.
Chapter 2: Operating-System Structures
Computer Systems Nat 5 Computing Science
Lesson 11: Web Services & API's
2017.
Linux Performance Profiling & Visualization
CPU Scheduling – Multiprocessor
MobiSys 2017 Symbolic Execution of Android Framework with Applications to Vulnerability Discovery and Exploit Generation Qiang Zeng joint work with Lannan.
IBM Data Server Gateway for OData
NVIDIA Profiler’s Guide
Microsoft Ignite NZ October 2016 SKYCITY, Auckland.
Learn How Performance of Java Application Can be Improved?
End-to-End REST Service Testing Automation
Environmental Sensing Monitoring and Analyzing Water Temperatures
Yellowfin: An Azure-Compatible Business Intelligence Platform That Connects People with Their Data for Better Decision Making MICROSOFT AZURE APP BUILDER.
University of California Comparision
EnMS Polska Builds energyBIS on Microsoft Azure to Ensure a Scalable and Secure Energy Efficiency Monitoring and Management System MICROSOFT AZURE ISV.
Presentation & Demo August 7, 2018 Bill Shelden.
Tools.
CS 8532: Advanced Software Engineering
MCI 3G Services Business Plan
Lesson 11: Web Services and API's
Tools.
ICT Gaming Lesson 2.
Software - Operating Systems
SeeSoft A Visualization Tool..
Don’t just listen to music; listen to people
Presentation transcript:

Linux Performance Profiling & Visualization

performance measurements top iotop vmstat Sar oprofile perf A variety of tools such as top, iotop, iostat, vmstat, sar oprofile, perf etc exist in Linux system; however, it is extremely difficult for people to address the problems from the raw data printed by these tools … ... ... ... ... ... ... ... ... ... ... ...

Problems in existing tools RAW data, difficult for non-experts to understand e.g. load average…

Problems in existing tools Not visualized e.g. how many memory used in Linux?

Problems in existing tools Lack of the description for changes e.g. how the CPU usage is changing during a period?

Problems in existing tools Cannot interact with users smoothly e.g. what if we only care about a particular process in “top”?

LEP A Solution Intuitive Visualized Interactive Ease of Use CURVED LINE PIE diagram BAR diagram COLORED interactive

What is LEP Linux Easy Profiling Web-based Open-source All-In-One LEP(Linux Easy Profiling) is a web-based open-source tool suite to make them be all-in-one and visualized, and its key developers, for this moment, include Baohua Song Bob Liu Mac Xu More developers are coming(eg, Ping Liu, Ray Chen, Joy Zhou….)

LEP architecture JSONRPC LEPD HTML JS LEPV LEPD Django Python Restful API LEPD

LEP Summary C/S PC / Embedded Board Linux / Android JSONRPC Web App Restful API Docker

LEP Dataflow HTTP GET AVG LOAD { 'last15':Decimal('2.13'), } LEPV cJSON & jsonrpc-c RPC provided Read proc entries / Execute a command { 'result':'2.58 2.25 2.13 4/110 19674\n' } LEPD JSON RPC AVG LOAD /proc/loadavg

Live Demo DEMO

LEP: Load balance view

LEP: Memory consumption view

LEP: App memory usage view

LEP: Average load view

LEP: Symbol level view

LEP: Interaction with users

LEP: Interaction with users

Next steps for LEP More features Better documentations

Upcoming features ARM support Predict memory leak for an application and kernel Analyze cache miss Analyze time consumption for one native/Java processes Benchmark integration I/O queues Kernel memory details such as buddy, slab, CMA etc. Runtime scheduler(CPU/IO) Boot procedure ….

LEB LET LEP Plans - LE series Easy Building Easy Testing Easy Profiling

Contributors YOU Barry Song Bob Liu Mac Xu More developers are coming Ping Liu Ray Chen Joy Zhou YOU LEP(Linux Easy Profiling) is a web-based open-source tool suite to make them be all-in-one and visualized, and its key developers, for this moment, include Baohua Song Bob Liu Mac Xu More developers are coming(eg, Ping Liu, Ray Chen, Joy Zhou….)

Fork the code here: LEPD: git@www.linuxep.com:repo/lep/lepd LEPV: git@www.linuxep.com:repo/lep/lepv