Mar.4.99 849 Dependable Embedded System -- Ying Shi Robustness.

Slides:



Advertisements
Similar presentations
Testing Relational Database
Advertisements

Configuration management
SOFTWARE TESTING. INTRODUCTION  Software Testing is the process of executing a program or system with the intent of finding errors.  It involves any.
Software Fault Injection for Survivability Jeffrey M. Voas & Anup K. Ghosh Presented by Alison Teoh.
Fault Detection in a HW/SW CoDesign Environment Prepared by A. Gaye Soykök.
Term Paper OLOMOLA,Afolabi( ). Dependability Modellling.
Software Engineering for Real- Time: A Roadmap H. Kopetz. Technische Universitat Wien, Austria Presented by Wing Kit Hor.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 23 Slide 1 Software testing.
1 Software Testing and Quality Assurance Lecture 33 – Software Quality Assurance.
Analysing Systems Failures (1) Main Principles: systems thinking.
SWE Introduction to Software Engineering
8. Fault Tolerance in Software 8.5 Construction of Acceptance Tests Goal Goal: describe the types and selection criteria for acceptance tests Two levels.
Software Engineering Metrics for Object Oriented Programming Developed by – Shrijit Joshi.
Leonardo da Vinci ALLEGRO © J. M. Martins Ferreira - University of Porto (FEUP / DEEC)1 Basic test concepts J. M. Martins Ferreira FEUP / DEEC - Rua Dr.
7. Fault Tolerance Through Dynamic or Standby Redundancy 7.5 Forward Recovery Systems Upon the detection of a failure, the system discards the current.
Software Testing and QA Theory and Practice (Chapter 15: Software Reliability) © Naik & Tripathy 1 Software Testing and Quality Assurance Theory and Practice.
1 Functional Testing Motivation Example Basic Methods Timing: 30 minutes.
Software Dependability CIS 376 Bruce R. Maxim UM-Dearborn.
Computer System Lifecycle Chapter 1. Introduction Computer System users, administrators, and designers are all interested in performance evaluation. Whether.
Software faults & reliability Presented by: Presented by: Pooja Jain Pooja Jain.
CS527: (Advanced) Topics in Software Engineering Overview of Software Quality Assurance Tao Xie ©D. Marinov, T. Xie.
Handouts Software Testing and Quality Assurance Theory and Practice Chapter 15 Software Reliability
Software Quality Assurance Lecture #8 By: Faraz Ahmed.
University of Coimbra, DEI-CISUC
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 9 Slide 1 Critical Systems Specification 2.
Software Reliability SEG3202 N. El Kadri.
Verification and Validation Overview References: Shach, Object Oriented and Classical Software Engineering Pressman, Software Engineering: a Practitioner’s.
1 ECE 453 – CS 447 – SE 465 Software Testing & Quality Assurance Instructor Kostas Kontogiannis.
Intro to Architecture – Page 1 of 22CSCI 4717 – Computer Architecture CSCI 4717/5717 Computer Architecture Topic: Introduction Reading: Chapter 1.
1 Software Testing and Quality Assurance Lecture 33 – Software Quality Assurance.
1 Software testing. 2 Testing Objectives Testing is a process of executing a program with the intent of finding an error. A good test case is in that.
Software Engineering General architecture. Architectural components:  Program organisation overview Major building blocks in a system Definition of each.
Defensive Programming 1 Nikolaus Embgen. Topics 1.Motivation 2.The concept 3.What can we do? 4.How to use this? 5.What else can we do? 6.The conclusion.
Model-Driven Analysis Frameworks for Embedded Systems George Edwards USC Center for Systems and Software Engineering
Code Complete Steve McConnell. 20. The Software-Quality Landscape.
User Interfaces 4 BTECH: IT WIKI PAGE:
FDT Foil no 1 On Methodology from Domain to System Descriptions by Rolv Bræk NTNU Workshop on Philosophy and Applicablitiy of Formal Languages Geneve 15.
Software Reliability Research Pankaj Jalote Professor, CSE, IIT Kanpur, India.
Verification and Validation Assuring that a software system meets a user's needs.
Software Testing Definition Software Testing Module ( ) Dr. Samer Odeh Hanna.
Introduction to Design. What is Design? 2 minutes Pairs.
Chapter 8 Lecture 1 Software Testing. Program testing Testing is intended to show that a program does what it is intended to do and to discover program.
Chapter 13: Software Quality Project Management Afnan Albahli.
Fault Tolerance Benchmarking. 2 Owerview What is Benchmarking? What is Dependability? What is Dependability Benchmarking? What is the relation between.
Exceptional Control Flow Topics Exceptions except1.ppt CS 105 “Tour of the Black Holes of Computing”
(13-1) Exception Handling in C++ D & D Chapter 17 Instructor - Andrew S. O’Fallon CptS 122 Washington State University.
1 Software Engineering: A Practitioner’s Approach, 6/e Chapter 15a: Product Metrics for Software Software Engineering: A Practitioner’s Approach, 6/e Chapter.
CS451 Lecture 10: Software Testing Yugi Lee STB #555 (816)
West Virginia University Sherif Yacoub, Hany H. Ammar, and Ali Mili A UML Model for Analyzing Software Quality Sherif Yacoub, Hany H. Ammar, and Ali Mili.
CSE SW Metrics and Quality Engineering Copyright © , Dennis J. Frailey, All Rights Reserved CSE8314M13 8/20/2001Slide 1 SMU CSE 8314 /
Copyright , Dennis J. Frailey CSE Software Measurement and Quality Engineering CSE8314 M00 - Version 7.09 SMU CSE 8314 Software Measurement.
Adaptive Processes © Adaptive Processes Simpler, Faster, Better Defect Testing Testing programs to establish the presence of system defects.
1 Chapter 1 The Software Quality Challenge. 2 The uniqueness of software quality assurance  DO you think that there is a bug-free software?  Can software.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 23 Slide 1 Software testing.
Testing Overview Software Reliability Techniques Testing Concepts CEN 4010 Class 24 – 11/17.
SENG521 (Fall SENG 521 Software Reliability & Testing Fault Tolerant Software Systems: Techniques (Part 4a) Department of Electrical.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Overview Theory of Program Testing Goodenough and Gerhart’s Theory
Rekayasa Perangkat Lunak Part-10
Rekayasa Perangkat Lunak
Software Testing.
Some Simple Definitions for Testing
BASICS OF SOFTWARE TESTING Chapter 1. Topics to be covered 1. Humans and errors, 2. Testing and Debugging, 3. Software Quality- Correctness Reliability.
YG - CS170.
Model-Driven Analysis Frameworks for Embedded Systems
Rekayasa Perangkat Lunak
Fault Tolerance Distributed Web-based Systems
Performance Evaluation
Presentation transcript:

Mar Dependable Embedded System -- Ying Shi Robustness

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -2 Outline Basic concepts Metric -- RB, major of this talk Metric -- RB, major of this talk other Robustness aspects + topic connections Conclusion Reference List Robustness Control Theory Manufacturing/ Quality QoS Exception Handling

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -3 What’s Robustness One of those system attributes such as performance IEEE Standard Glossary –“The degree to which a system or component can function correctly in the presence of invalid inputs or stressful environmental conditions.” error tolerance, fault tolerance specifically might be interpreted as the degree of the system ability of –handling exceptions –tolerating faults... One of the concerns -- establish Metric for this attribute

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -4 Robustness Benchmark (RB) An identification of system error detection mechanism(EDM) A RB should measure how a system reacts to possible erroneous inputs or environmental factors that could affect the system and result in failures.

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -5 System component Hierarchy Robustness measure of a combined components system would provide an indication of how erroneous or unexpected inputs are handles by all levels of abstraction

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -6 Cover both HW & SW Both HW errors and SW errors to be covered traps Many HW EDMs are embedded in the design (CPU, mem, and I/O subsystems). Errors detected at this level, reflected to the SW level primarily through traps, almost always gracefully accommodated by the error handler (except crashes) SW level, ideally, EDMs should be embedded within each of these levels to detect, isolate, and accommodate(via error handler)errors from coding or possibly design.

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -7 Reality Restricts Ideally Ideally, to exercise all possible levels of error detection, trapped by both HW and SW, w/ the end result being a measurement w/ respect to an absolutely robust system reality In reality, –exhaustive testing is not possible –natural errors occur infrequently enough that simply observing system operation is too time consuming. Thus RB would serve as a relative measure of robustness or fault tolerance between two systems/machines.

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -8 Living with the Restriction Try to cover more and make reasonable combining Measure different system components:: –input error checking capability of system software –file system management –utilities –library routines... weighs quantitatively, how much of each metric weighs towards the final overall system robustness figure

Robustness - Dependable Embedded System Ying Shi Mar.4,99 -9 More of Robustness Techniques towards Robustness –classical HW FTC techniques –graceful degradation –fail-safe –idiot-proof (UI) –functional diversity –etc...

Robustness - Dependable Embedded System Ying Shi Mar.4, Connections Exception Handling –one of the means towards robustness Control Theory –nah...leave with leo’s later talk Quality of Service –robust system have the ability to guarantee QoS –they are two individual system attributes Manufacturing/quality –robustness is the drive during manufacturing –robustness - one of system qualities

Robustness - Dependable Embedded System Ying Shi Mar.4, Conclusion Robustness refers to one of the system attributes, also a goal in design Complexity makes it impossible to have an ideal RB, thus as a relative metric b/w systems RB as a guide for design Robustness is quite a broad topic, I assume, there is too much to dig in the future to say any specific aspects of it are the main future trend

Robustness - Dependable Embedded System Ying Shi Mar.4, Reference List Required paper :: Development of a Benchmark to Measure System Robustness, Siewiorek, Hudak, Suh, Segall, 23rd FTCS –insight into developing a system level RB –several primitive benchmarks, and combined into RB suites –a methodology to combine the primitive RBs to form an overall robustness figure Journal –FTCS; R&M proceeding