PerfExplorer Component for Performance Data Analysis Kevin Huck – University of Oregon Boyana Norris – Argonne National Lab Li Li – Argonne National Lab.

Slides:

Advertisements

Similar presentations

Machine Learning-based Autotuning with TAU and Active Harmony Nicholas Chaimov University of Oregon Paradyn Week 2013 April 29, 2013.

Advertisements

Kensington Oracle Edition: Open Discovery Workflow Meets Oracle 10g Professor Yike Guo.

ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),

Allen D. Malony Department of Computer and Information Science Performance Research Laboratory University of Oregon Multi-Experiment.

Robert Bell, Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science.

Scalability Study of S3D using TAU Sameer Shende

Sameer Shende Department of Computer and Information Science Neuro Informatics Center University of Oregon Tool Interoperability.

Profiling S3D on Cray XT3 using TAU Sameer Shende

1 of 7 A High-Performance Data Mining Framework in MySQL Dr. Lutz Hamel Tiegeng Ren Dept. of Computer Science in URI 3/31/2003.

CSCI 150 Database Applications Chapter 1 – Getting Started.

TAU Parallel Performance System DOD UGC 2004 Tutorial Allen D. Malony, Sameer Shende, Robert Bell Univesity of Oregon.

Nick Trebon, Alan Morris, Jaideep Ray, Sameer Shende, Allen Malony {ntrebon, amorris, Department of.

Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science Institute University.

Getting Started (Excerpts) Chapter One DAVID M. KROENKE’S DATABASE CONCEPTS, 2 nd Edition.

Workshop on Performance Tools for Petascale Computing 9:30 – 10:30am, Tuesday, July 17, 2007, Snowbird, UT Sameer S. Shende

Performance Tools BOF, SC’07 5:30pm – 7pm, Tuesday, A9 Sameer S. Shende Performance Research Laboratory University.

Allen D. Malony Department of Computer and Information Science Computational Science Institute University of Oregon TAU Performance.

TAU: Performance Regression Testing Harness for FLASH Sameer Shende

Sameer Shende, Allen D. Malony and Alan Morris {sameer, malony, Department of Computer and Information Science Performance Research.

Scalability Study of S3D using TAU Sameer Shende

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

Who am I? ● Catalin Comanici ● QA for 10 years, doing test automation for about 6 years ● fun guy and rock star wannabe.

ETL By Dr. Gabriel.

Performance Tools for Empirical Autotuning Allen D. Malony, Nick Chaimov, Kevin Huck, Scott Biersdorff, Sameer Shende

Challenges in Performance Evaluation and Improvement of Scientific Codes Boyana Norris Argonne National Laboratory Ivana.

Allen D. Malony Performance Research Laboratory (PRL) Neuroinformatics Center (NIC) Department.

An Automated Component-Based Performance Experiment and Modeling Environment Van Bui, Boyana Norris, Lois Curfman McInnes, and Li Li Argonne National Laboratory,

The Astro-Wise Pipeline Conceptual Design Review Roeland Rengelink Requirements Development Framework Prototype.

Allen D. Malony, Kevin Huck Department of Computer and Information Science Performance.

ROOT: A Data Mining Tool from CERN Arun Tripathi and Ravi Kumar 2008 CAS Ratemaking Seminar on Ratemaking 17 March 2008 Cambridge, Massachusetts.

CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives CCA Fall Meeting October.

CQoS Update Li Li, Boyana Norris, Lois Curfman McInnes Argonne National Laboratory Kevin Huck University of Oregon.

Some Thoughts on HPC in Natural Language Engineering Steven Bird University of Melbourne & University of Pennsylvania.

Component Infrastructure of CQoS and Its Application in Scientific Computations Li Li 1, Boyana Norris 1, Lois Curfman McInnes 1, Kevin Huck 2, Joseph.

Extreme Blue © 2004 IBM Corporation Eunomia HDB Compliance Auditing System Architecture.

Winrunner Usage - Best Practices S.A.Christopher.

A Component Infrastructure for Performance and Power Modeling of Parallel Scientific Applications Boyana Norris Argonne National Laboratory Van Bui, Lois.

Use of Hierarchical Keywords for Easy Data Management on HUBzero HUBbub Conference 2013 September 6 th, 2013 Gaurav Nanda, Jonathan Tan, Peter Auyeung,

Technology + Process SDCI HPC Improvement: High-Productivity Performance Engineering (Tools, Methods, Training) for NSF HPC Applications Rick Kufrin *,

Profile Analysis with ParaProf Sameer Shende Performance Reseaerch Lab, University of Oregon

Introduction to SQL Server Data Mining Nick Ward SQL Server & BI Product Specialist Microsoft Australia Nick Ward SQL Server & BI Product Specialist Microsoft.

Plans and Opportunities Involving Beam Dynamics Components ComPASS SAP Project and Phase I and II Doe SBIR Boyana Norris (ANL) In collaboration with Stefan.

Components for Beam Dynamics Douglas R. Dechow, Tech-X Lois Curfman McInnes, ANL Boyana Norris, ANL With thanks to the Common Component Architecture (CCA)

Center for Component Technology for Terascale Simulation Software CCA is about: Enhancing Programmer Productivity without sacrificing performance. Supporting.

Kevin A. Huck Department of Computer and Information Science Performance Research Laboratory University of.

Copyright © 2012, SAS Institute Inc. All rights reserved. ANALYTICS IN BIG DATA ERA ANALYTICS TECHNOLOGY AND ARCHITECTURE TO MANAGE VELOCITY AND VARIETY,

Efficient RDF Storage and Retrieval in Jena2 Written by: Kevin Wilkinson, Craig Sayers, Harumi Kuno, Dave Reynolds Presented by: Umer Fareed 파리드.

6th Feb 2003SCT DAQ analysis development 1 SCT analysis framework Work by:Alan Barr, Matt Palmer, Dave Robinson Almost all slides originally produced by.

Database Concepts Track 3: Managing Information using Database.

Session 7B Friday, 29 September 2000 Interactive Computer aided Learning Graphical Interactive Systems, University of Tübingen (Germany) Basic Requirements.

© 2006, National Research Council Canada © 2006, IBM Corporation Solving performance issues in OTS-based systems Erik Putrycz Software Engineering Group.

Connections to Other Packages The Cactus Team Albert Einstein Institute

XMI2SQL Capstone Presentation Principal Investigator: Eric Hartford Committee Chair: Sam Chung, Ph.D. Committee Member: Isabelle Bichindaritz, Ph.D.

21 Sep UPC Performance Analysis Tool: Status and Plans Professor Alan D. George, Principal Investigator Mr. Hung-Hsun Su, Sr. Research Assistant.

Shangkar Mayanglambam, Allen D. Malony, Matthew J. Sottile Computer and Information Science Department Performance.

Allen D. Malony Department of Computer and Information Science Performance Research Laboratory University.

Allen D. Malony Department of Computer and Information Science Performance Research Laboratory.

Fundamentals of MyBATIS

7 Copyright © 2006, Oracle. All rights reserved. Creating Experts.

Online Performance Analysis and Visualization of Large-Scale Parallel Applications Kai Li, Allen D. Malony, Sameer Shende, Robert Bell Performance Research.

Performance Tool Integration in Programming Environments for GPU Acceleration: Experiences with TAU and HMPP Allen D. Malony1,2, Shangkar Mayanglambam1.

Kai Li, Allen D. Malony, Sameer Shende, Robert Bell

Boyana Norris Argonne National Laboratory Ivana Veljkovic

Performance Technology for Scalable Parallel Systems

TAU integration with Score-P

Allen D. Malony, Sameer Shende

DUCKS – Distributed User-mode Chirp-Knowledgeable Server

TAU Performance DataBase Framework (PerfDBF)

Database Management System

UFCEUS-20-2 Web Programming

Presentation transcript:

PerfExplorer Component for Performance Data Analysis Kevin Huck – University of Oregon Boyana Norris – Argonne National Lab Li Li – Argonne National Lab 11/23/20151CCA-Salishan April, 2008

PerfDMF Performance Data Management Framework Provides profile data management Database support: MySQL, PostgreSQL, Derby, Oracle, DB2 Parsers/Importers: TAU, Dynaprof, mpiP, gprof, psrun (PerfSuite), HPCToolkit (Rice), HPC Toolkit (IBM), CUBE (KOJAK), OpenSpeedShop, GPTL, application timers Profile query and analysis API 11/23/20152CCA-Salishan April, 2008

PerfExplorer Built on PerfDMF Framework for systematic, collaborative and reusable parallel performance analysis – Large-scale performance analysis for single experiments on thousands of processors – Multiple experiments from parametric studies – Addresses the need for complexity management Clean interface to existing tools for easy access to analysis and data mining (Weka, R) Abstraction/automation of data mining operations 11/23/20153CCA-Salishan April, 2008

PerfExplorer 2.0 “Component”-based analysis – Provides access analysis operations & data from scripts Scripting – Provides analysis automation Metadata Support Inference engine – To reason about causes of performance phenomena from expert rules Persistence of intermediate results Provenance – Provides historical record of analysis results 11/23/20154CCA-Salishan April, 2008

PerfExplorer 2.0 “Components” Basic StatisticsExtract eventsTop X events CopyExtract metricsTop X percent events CorrelationExtract phasesANOVA Correlation with metadataExtract rankLinear regression Derive metricsk-meansNon-linear regression* DifferenceMerge trialsBackward elimination* Extract callpath eventsPCACorrelation elimination* Extract non-callpath eventsScalability* future development 11/23/20155CCA-Salishan April, 2008

PerfExplorer 2.0 Design with CCA CCA Component Interface 11/23/20156CCA-Salishan April, 2008

PerfExplorer CCA Component First Goal – support for CQoS – Choosing linear solver and parameters for iterative non-linear solver, based on input data and minimizing time to solution (time, iterations) No interfaces defined yet… Just getting started with CCA, modifying PE2 – No GUI, parse Li’s tables, support User Events Planned analysis methods – Simple regression (linear and non-linear) – Machine Learning methods – Support Vector Regression: there is Weka support. – Genetic Algorithms: there may be Weka support. 11/23/20157CCA-Salishan April, 2008

Acknolwedgements University of Oregon – Prof. Allen Malony – Dr. Sameer Shende – Matt Sottile – Alan Morris Argonne National Lab – Boyana Norris – Li Li 11/23/20158CCA-Salishan April, 2008