ICOM 5995: Performance Instrumentation and Visualization for High Performance Computer Systems Lecture 10 November 6, 2002 Nayda G. Santiago

Announcement Today Due Progress Report Course Schedule Secret Code Final Presentations (15 minutes) Lecture on November 20, 2002 Daniel Burbano – Research Presentation Adaptive Communication Patterns in MPI I will be in SC02

Schedule Novemberl 6 to December 8, 2002 Nov 3Nov 4Nov 5Nov 6Nov 7Nov 8Nov 9 Nov 10Nov 11Nov 12Nov 13Nov 14Nov 15Nov 16 Nov 17Nov 18Nov 19Nov 20Nov 21Nov 22Nov 23 Nov 24Nov 25Nov 26Nov 27Nov 28Nov 29Nov 30 WednesdaySundayMondayTuesdayThursdayFridaySaturday WednesdaySundayMondayTuesdayThursdayFridaySaturday Dec 1Dec 2Dec 3Dec 4Dec 5Dec 6Dec 7 Dec 8Dec 9Dec 10Dec 11Dec 12Dec 13Dec 14 WednesdaySundayMondayTuesdayThursdayFridaySaturday Ultimo Dia Clases Veterans Day Comienzan los Finales Project Due Clase de lunesBajas Feriado Descubrimiento Feriado: Accion De Gracias Feriado: Accion De Gracias Prog. Report Due Presentations Nayda Presents SC02 Daniel’s Presentation

Overview Performance Evaluation Methodologies Analytical methods. Simulation-based methodologies Measurement-based methodologies Reference Ferrari’s Book

Overview Evaluation Techniques Method used to obtain information about the performance indices given a workload and a set of system parameters. Classification Analytical Simulation-based Measurement-based

Analytic Techniques Based on a model, solved by other means but simulation Model Representation of the system which consists of organized information about it and is built for the purpose of studying it. Different models of a system To answer different questions. Different amount of details. Represent interactions among parts of the components of the system.

Analytic Techniques Analytic study Model formulation Model solution symbolic or numeric Model calibration and validation Verification of the validity of the model

Analytic Techniques Types of models Deterministic The evolution in time of the system can be predicted exactly Example Graph Models of programs Probabilistic The behavior of the system cannot be predicted exactly but the probability of certain behavior is known. Markov Models Stochastic processes

Simulation-based Techniques Evaluation technique which represents the behavior of the system in the time domain. The observation of the behavior in time of the system model, under stimuli generated by a model of the system’s inputs, produces numerical results used in evaluation studies.

Measurement-based Techniques The performance information required by a study is obtained from the system itself. Planning Decide what to measure Select measurement tool or tools Design experiment and estimate cost.

Measurement-based Techniques Measurement Tools Sensor Sense the magnitude of the quantity being measured Transformer Transform the information received from the sensor Indicator Allow the experimenter to read the result of the measurement SensorIndicatorTransformer Measurement instrument

Measurement-based Techniques Computer system example Sensor Can I get clock time? Transformer Read contents of combinations of registers Indicator Store measurements in storage medium for later analysis.

Measurement-based Techniques Characteristics of measurement tools Interference Accuracy Resolution Scope Compatibility Cost Ease of installation Ease of use