Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Influence of different system abstractions on the performance analysis.

Slides:



Advertisements
Similar presentations
Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Modular Performance Analysis with Real-Time Calculus Lothar Thiele,
Advertisements

Pushing the limits of CAN - Scheduling frames with offsets provides a major performance boost Nicolas NAVET INRIA / RealTime-at-Work
© COPYRIGHT IKERLAN 2014 Adding Precedence Relations to the Response-Time Analysis of EDF Distributed Real-Time Systems Unai Díaz de Cerio (IK4-Ikerlan)
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Design Space Exploration of Embedded Systems © Lothar Thiele ETH Zurich.
1 of 14 1 /23 Flexibility Driven Scheduling and Mapping for Distributed Real-Time Systems Paul Pop, Petru Eles, Zebo Peng Department of Computer and Information.
Requirements and Solutions for Timing Analysis of Automotive Systems Saoussen Anssi 1, Sébastien Gérard 2, Arnaud Albinet 1, François Terrier 2 1 Continental.
1 of 14 1 Analysis of Mixed Time-/Event-Triggered Distributed Embedded Systems Paul Pop, Traian Pop, Petru Eles, Zebo Peng Embedded Systems Laboratory.
On Schedulability and Time Composability of Data Aggregation Networks Fatemeh Saremi *, Praveen Jayachandran †, Forrest Iandola *, Md Yusuf Sarwar Uddin.
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 19 Scheduling IV.
Automatic Verification of Component-Based Real-Time CORBA Applications Gabor Madl Sherif Abdelwahed
An Automata-based Approach to Testing Properties in Event Traces H. Hallal, S. Boroday, A. Ulrich, A. Petrenko Sophia Antipolis, France, May 2003.
Performance Research in the Boderc project Jozef Hooman Research Fellow Embedded Systems Institute Eindhoven The Netherlands Artist Meeting Bologna 22.
Lab Meeting Performance Analysis of Distributed Embedded Systems Lothar Thiele and Ernesto Wandeler Presented by Alex Cameron 17 th August, 2012.
Methods for Evaluation of Embedded Systems Simon Künzli, Alex Maxiaguine Institute TIK, ETH Zurich.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Performance Analysis of Embedded Systems Lothar Thiele ETH Zurich.
Project 4 U-Pick – A Project of Your Own Design Proposal Due: April 14 th (earlier ok) Project Due: April 25 th.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
Hybrid Approach to System-Level Performance Analysis Simon Künzli Bologna, May 22, 2006 contains joint work with Francesco Poletti, Luca Benini, and Lothar.
Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Power Management for Solar-Driven Sensor Nodes Clemens Moser ( joint.
1 of 30 June 14, 2000 Scheduling and Communication Synthesis for Distributed Real-Time Systems Paul Pop Department of Computer and Information Science.
Institut für Datentechnik und Kommunikationetze Analysis of Shared Coprocessor Accesses in MPSoCs Overview Bologna, Simon Schliecker Matthias.
1 of 14 1/15 Schedulability Analysis and Optimization for the Synthesis of Multi-Cluster Distributed Embedded Systems Paul Pop, Petru Eles, Zebo Peng Embedded.
Compositional Verification of Timed Systems. A Concept. Bengt Jonsson Leonid Mokrushin Xiaochun Shi Wang Yi Uppsala University Sweden Distributed Embedded.
Scheduling with Optimized Communication for Time-Triggered Embedded Systems Slide 1 Scheduling with Optimized Communication for Time-Triggered Embedded.
1 of 16 March 30, 2000 Bus Access Optimization for Distributed Embedded Systems Based on Schedulability Analysis Paul Pop, Petru Eles, Zebo Peng Department.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Embedded Systems Exercise 1: Real-Time Systems Ernesto Wandeler 20.
1 of 14 1 Analysis and Synthesis of Communication-Intensive Heterogeneous Real-Time Systems Paul Pop Computer and Information Science Dept. Linköpings.
Embedded Systems Exercise 3: Scheduling Real-Time Periodic and Mixed Task Sets 18. May 2005 Alexander Maxiaguine.
Model-based Analysis of Distributed Real-time Embedded System Composition Gabor Madl Sherif Abdelwahed
Holistic Scheduling and Analysis of Mixed Time/Event-Triggered Distributed Embedded System Traian Pop, Petru Eles, Zebo Peng EE249 Discussion Paper Review.
ARTIST2 Network of Excellence on Embedded Systems Design cluster meeting –Bologna, May 22 nd, 2006 System Modelling Infrastructure Activity leader : Jan.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Research Challenges in Embedded Computing Lothar Thiele.
1 of 14 1 / 18 An Approach to Incremental Design of Distributed Embedded Systems Paul Pop, Petru Eles, Traian Pop, Zebo Peng Department of Computer and.
A Tool for Describing and Evaluating Hierarchical Real-Time Bus Scheduling Policies Author: Trevor Meyerowitz, Claudio Pinello, Alberto DAC2003, June 24,2003.
Greenbench: A Benchmark for Observing Power Grid Vulnerability Under Data-Centric Threats Mingkui Wei, Wenye Wang Department of Electrical and Computer.
Automotive Software Integration
1 Prediction of Software Reliability Using Neural Network and Fuzzy Logic Professor David Rine Seminar Notes.
02/06/05 “Investigating a Finite–State Machine Notation for Discrete–Event Systems” Nikolay Stoimenov.
Reconfigurable Hardware in Wearable Computing Nodes Christian Plessl 1 Rolf Enzler 2 Herbert Walder 1 Jan Beutel 1 Marco Platzner 1 Lothar Thiele 1 1 Computer.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Internal Design Representations for Embedded System Design Lothar.
Embedded System Design Framework for Minimizing Code Size and Guaranteeing Real-Time Requirements Insik Shin, Insup Lee, & Sang Lyul Min CIS, Penn, USACSE,
VTT-STUK assessment method for safety evaluation of safety-critical computer based systems - application in BE-SECBS project.
Experience with Using a Performance Predictor During Development a Distributed Storage System Tale Lauro Beltrão Costa *, João Brunet +, Lile Hattori #,
A Framework For User Feedback Based Cloud Service Monitoring
Leiden Embedded Research Center Prof. Dr. Ed F. Deprettere, Dr. Bart Kienhuis, Dr. Todor Stefanov Leiden Embedded Research Center (LERC) Leiden Institute.
Real-Time Systems Mark Stanovich. Introduction System with timing constraints (e.g., deadlines) What makes a real-time system different? – Meeting timing.
Common Set of Tools for Assimilation of Data COSTA Data Assimilation Summer School, Sibiu, 6 th August 2009 COSTA An Introduction Nils van Velzen
A Forward end-to-end delays Analysis for packet switched networks Georges Kemayo, Frédéric Ridouard, Henri Bauer, Pascal Richard LIAS, Université de Poitiers,
Autonomic scheduling of tasks from data parallel patterns to CPU/GPU core mixes Published in: High Performance Computing and Simulation (HPCS), 2013 International.
10 th December, 2013 Lab Meeting Papers Reviewed:.
Fuzzy Systems Michael J. Watts
MARC CLUSTER BENCHMARK Non-Linear Analysis of a Suspension Knuckle using MSC Marc 2003 DDM.
Teaching Assistant Demonstrator - Contribution - Jan Beutel, Michael Eisenring, Marco Platzner, Christian Plessl, Lothar Thiele Computer Engineering and.
Real-Time Scheduling II: Compositional Scheduling Framework Insik Shin Dept. of Computer Science KAIST.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
1 of 14 1 Integrating Embedded System Design Tools in the Generic Modeling Environment Peter Tureby, Fredrik Wester Final Project at the Embedded Systems.
Abstract Priority-based FRP (P-FRP) is a functional programming formalism for reactive systems that guarantees real-time response. Preempted tasks in P-FRP.
Harini Ramaprasad, Frank Mueller North Carolina State University Center for Embedded Systems Research Bounding Preemption Delay within Data Cache Reference.
1 of 14 1/15 Schedulability-Driven Frame Packing for Multi-Cluster Distributed Embedded Systems Paul Pop, Petru Eles, Zebo Peng Embedded Systems Lab (ESLAB)
Goals in Wearable Computing Jan Beutel, Michael Eisenring, Marco Platzner, Christian Plessl, Lothar Thiele Computer Engineering and Networks Lab Swiss.
Resource Optimization for Publisher/Subscriber-based Avionics Systems Institute for Software Integrated Systems Vanderbilt University Nashville, Tennessee.
Introduction to Machine Learning, its potential usage in network area,
WoPANets: Decision-support Tool for real-time Networks Design
Gabor Madl1, Nikil Dutt1, Sherif Abdelwahed2
Gabor Madl Ph.D. Candidate, UC Irvine Advisor: Nikil Dutt
Model-Driven Analysis Frameworks for Embedded Systems
CPU Scheduling G.Anuradha
The Vision of Self-Aware Performance Models
Lightweight but Powerful QoS Solution for Embedded Systems
Leonie Ahrendts, Sophie Quinton, Thomas Boroske, Rolf Ernst
Presentation transcript:

Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Influence of different system abstractions on the performance analysis of distributed real-time systems Simon Perathoner 1, Ernesto Wandeler 1, Lothar Thiele 1 Arne Hamann 2, Simon Schliecker 2, Rafik Henia 2, Razvan Racu 2, Rolf Ernst 2 Michael González Harbour 3 Artist2 Meeting (Cluster on Execution platforms) Linköping, 14. May ETH Zürich 2 TU Braunschweig 3 Universidad de Cantabria

2 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Motivation Abstractions Benchmarks Conclusions Outline

3 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory System level performance analysis Max. Bufferspace ? Max. CPU load? Max. end-to- end delay?

4 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Formal analysis methods Abstraction Analysis Performance values Distributed system Abstraction 1 Analysis method 1 Abstraction 2 GPC GSC TDMA Analysis method 2 Abstraction 3 Analysis method 3

5 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Motivating questions What is the influence of the different models on the analysis accuracy ? Evaluation and comparison of abstractions is needed ! Does abstraction matter ? Which abstraction is best suited for a given system ?

6 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory How can we compare different abstractions ? scope usability simple exact compositional easy to use tool support stepwise refinement efficient implementation learning curve scalability accurac y analysis time holistic performance metrics modeling effort modular correctness Method 1 Method 2

7 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory What makes a direct comparison difficult? Many aspects can not be quantified A B C D Models cover different scenarios:

8 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Intention Compare models and methods that analyze the timing properties of distributed systems: SymTA/S [Richter et al.] MPA-RTC [Thiele et al.] MAST [González Harbour et al.] Timed automata based analysis [Yi et al.] …

9 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Leiden Workshop on Distributed Embedded Systems: Define a set of benchmark examples that cover common area Define benchmark examples that show the power of each method SymTA/S MAST TA MPA Approach

10 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Expected (long term) results Understand the modeling power of different methods Understand the relation between models and analysis accuracy Improve methods by combining ideas and abstractions

11 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Contributions We define a set of benchmark systems aimed at the evaluation of performance analysis techniques We apply different analysis methods to the benchmark systems and compare the results obtained in terms of accuracy and analysis times We point out several analysis difficulties and investigate the causes for deviating results

12 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Motivation Abstractions Benchmarks Conclusions Outline

13 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Abstraction 1 - Holistic scheduling Basic concept: extend concepts of classical scheduling theory to distributed systems Holistic scheduling FP CPUs + TDMA bus [Tindell et al.] 1994 FP + data dependencies [Yen et al.] 1995 FP + control dependencies [Pop et al.] 2000 CAN [Tindell et al.] 1995 Mixed TT/ET systems [Pop et al.] 2002 EDF offset based [González et al.]

14 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Holistic scheduling – MAST tool MAST - The Modeling and Analysis Suite for Real-Time Applications [González Harbour et al.] System TXT Results TXT

15 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Abstrction 2 – The SymTA/S approach Basic c o n c e p t : Application of classical scheduling techniques at resource level and propagation of results to next component Problem:The local analysis techniques require the input event streams to fit given standard event models Solution:Use appropriate interfaces: EMIFs & EAFs EMIF / EAF

16 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory SymTA/S – Tool

17 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Abstraction 3 – MPA-RTC t events  ll uu t availability uu ll service  Load model Service m o d e l Arrival curvesService c u r v e s

18 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Abstraction 3 – MPA-RTC [  l,  u ] [  l,  u ] [  l’,  u’ ] [  l’,  u’ ] GPC

19 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Abstraction 4 - TA based performance analysis Verification of performance properties by model checking (UPPAAL) fixed priority scheduling periodic stream Exact performance values

20 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Motivation Abstractions Benchmarks Conclusions Outline

21 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmarks Pay burst only once Complex activation pattern Variable feedback Cyclic dependencies AND/OR task activation Intra-context information Workload correlation Data dependencies

22 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 1 – Complex activation pattern WCRT T3 ? period C = 35 C = 2 C = 12 C = 4 (FP) periodic P = 60 periodic P = 5 periodic

23 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 1 – Analysis results

24 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 1 – Result interpretation P I3 = 65 ms

25 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 1 – Worst case Delay I2-O2

26 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 2 – Variable feedback Max delay ? Exec. time C C = 2 C = 1 (FP) periodic P = 100 periodic P = 5

27 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 2 – Analysis results

28 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 3 – Cyclic dependencies Max. delay ? jitter C = 1 C = 4 (FP) periodic with burst P = 10

29 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 3 – Analysis results Scenario 1: priority T1 = high priority T3 = low

30 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Benchmark 3 – Analysis results Scenario 2: priority T1 = low priority T3 = high

31 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Analysis times [s] B1B2B3 (sc.1) B3 (sc.2) B4 MPA-RTC min med max SymTA/S min med max MAST min med max < 0.5 Timed aut. min med max < < < 0.5 Simulation min med max 1.0 < < 0.5

32 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Motivation Abstractions Benchmarks Conclusions Outline

33 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Discussion Approximation of complex event streams with standard event models can lead to poor performance predictions at local level Holistic approaches better in the presence of correlations among task activations (e.g. data dependencies) Cyclic dependencies represent a serious pitfall for the accuracy of compositional analysis methods Holistic methods less appropriate for timing properties referred to the actual release time of an event within a large jitter interval

34 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Conclusions The analysis accuracy and the analysis time depend highly on the specific system characteristics None of the analysis methods performed best in all benchmarks The analysis results of the different approaches are remarkable different even for apparently basic systems The choice of an appropriate analysis abstraction matters The problem to provide accurate performance predictions for general systems is still far from solved

Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Thank you! Simon Perathoner