Mission Success Starts with Safety The Similarities and Differences of Reliability Engineering and Probabilistic Risk Assessment RAMS VII Workshop November.

Slides:



Advertisements
Similar presentations
Integra Consult A/S Safety Assessment. Integra Consult A/S SAFETY ASSESSMENT Objective Objective –Demonstrate that an acceptable level of safety will.
Advertisements

Practical application of Systems Engineering fundamentals to aircraft design – What should our TC do? Armand J. Chaput -Adjunct Professor, Unmanned Air.
Operation & Maintenance Engineering Detailed activity description
On Representing Uncertainty In Some COCOMO Model Family Parameters October 27, 2004 John Gaffney Fellow, Software & Systems.
1 Review of US Human Space Flight Plans Committee Evaluation Measures and Criteria for Humans Spaceflight Options 12 August 2009.
The Normalization of Deviance at NASA. Background January 28, 1986 Shuttle engineers were worried about launching at the predicted temperature of 31 degrees.
Module 3 UNIT I " Copyright 2002, Information Spectrum, Inc. All Rights Reserved." INTRODUCTION TO RCM RCM TERMINOLOGY AND CONCEPTS.
Introduction to Statistical Quality Control, 4th Edition Chapter 7 Process and Measurement System Capability Analysis.
Comprehend the Challenger accident Comprehend the Columbia accident The Space Shuttle Program: Challenger and Columbia Accidents.
STS-107 COLUMBIA ACCIDENT STS-107 COLUMBIA ACCIDENT MISSION,CREW.
SQM - 1DCS - ANULECTURE Software Quality Management Software Quality Management Processes V & V of Critical Software & Systems Ian Hirst.
Annex I: Methods & Tools prepared by some members of the ICH Q9 EWG for example only; not an official policy/guidance July 2006, slide 1 ICH Q9 QUALITY.
Sustainment Management Systems
Quality Risk Management ICH Q9 Annex I: Methods & Tools
Copyright notice General presentation Siemens Wind Power Reliability Assessment and Improvement through ARM Modeling Poul Skjærbæk, Thomas Mousten, Henrik.
National Aeronautics and Space Administration Estimating Flight Software Risk for a Space Launch Vehicle 2014 RAMS VII Workshop November 4,
69 th Annual International Conference on Mass Properties Engineering Michael Diggs, Melissa Cooley & David Hansch Naval Architects The Use of Inferential.
-Exponential Distribution -Weibull Distribution
An Introduction to AlarmInsight
Mission Success Starts With Safety 1 Probabilistic Risk Assessment: NASA Strategy for Capability Enhancement Dr. Michael G. Stamatelatos Manager, Risk.
Introduction to Statistical Quality Control, 4th Edition Chapter 7 Process and Measurement System Capability Analysis.
OSMA2003 Center for Reliability Engineering 1 Integrating Software into PRA Presented by C. Smidts Center for Reliability Engineering University of Maryland.
WHAT IS SYSTEM SAFETY? The field of safety analysis in which systems are evaluated using a number of different techniques to improve safety. There are.
1 Logistics Systems Engineering Reliability Fundamentals NTU SY-521-N SMU SYS 7340 Dr. Jerrell T. Stracener, SAE Fellow.
“ Building Strong “ Delivering Integrated, Sustainable, Water Resources Solutions 1 What is Engineering Risk and Reliability? Why We Use It? Robert C.
Version control – Project repository, version management capability, make facility, issue/bug tracking Change control Configuration audit – compliments.
FAULT TREE ANALYSIS (FTA). QUANTITATIVE RISK ANALYSIS Some of the commonly used quantitative risk assessment methods are; 1.Fault tree analysis (FTA)
Slide 1V&V 10/2002 Software Quality Assurance Dr. Linda H. Rosenberg Assistant Director For Information Sciences Goddard Space Flight Center, NASA
Stracener_EMIS 7305/5305_Spr08_ System Reliability Analysis - Concepts and Metrics Dr. Jerrell T. Stracener, SAE Fellow Leadership in Engineering.
National Aeronautics and Space Administration From Determinism to “Probabilism” Changing our mindsets, or why PTC isn’t an easy sell - yet.
Assessment of Alternate Methodologies for Establishing Equivalent Satisfaction of the Ec Criterion for Launch Licensing Terry Hardy AST-300/Systems Engineering.
M. Frize, Winter 2003 Reliability and Medical Devices Prof. Monique Frize, P. Eng., O.C. ELG5123/ February 2003.
J1879 Robustness Validation Hand Book A Joint SAE, ZVEI, JSAE, AEC Automotive Electronics Robustness Validation Plan The current qualification and verification.
The Space Shuttle On January 5, 1972, President Nixon announced that NASA would proceed with the development of a reusable low cost space shuttle system.
Plan ENTERPRISE Assess Handle Monitor RISK MANAGEMENT Communicate David Hall, SRS Technologies Minimizing (Some Of) The Subjectivity in Risk Assessments.
Create your futurewww.utdallas.edu Office of Communications create your futurewww.utdallas.edu Columbia Disaster Robiel Ghebrekidan SYSM 6309: Advanced.
NASA/Air Force Cost Model presented by Keith Smith Science Applications International Corporation 2002 SCEA National Conference June
Multi-Mission Earth Entry Vehicle: Aerodynamic and Aerothermal Analysis of Trajectory Environments Kerry Trumble, NASA Ames Research Center Artem Dyakonov,
EMGT 506 Challenger Case Study Question 2 Group B.
1 An Overview of MSFC Quantitative Risk Assessment (QRA) Practices Fayssal Safie/MSFC October 25, 2000.
DER Program Weibull Strength Parameter Requirements for Si 3 N 4 Turbine Rotor Reliability Steve Duffy & Eric Baker Connecticut Reserve Technologies, LLC.
General Aspects of Quality assessment of multisource interchangeable medicines Rutendo Kuwana Technical Officer, WHO, Geneva Training workshop: Assessment.
RLV Reliability Analysis Guidelines Terry Hardy AST-300/Systems Engineering and Training Division October 26, 2004.
Thermal Protection for Space Craft The problem of space craft high heating The solution The crash of the Columbia space ship national Alex&TybyNational.
Conference on Quality in Space & Defense Industries CQSDI ‘08 Probabilistic Technology Panel: What Is Probabilistic Technology? Mohammad Khalessi, Ph.D.
Probabilistic Risk Assessment and Conceptual Design Bryan C Fuqua – SAIC Diana DeMott – SAIC
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 23 Slide 1 Software testing.
By. Eric nard. 1979,the united states Steve lindsey nicole stott michael barrat alvin drew steve brown and eric doe.
ESA UNCLASSIFIED – For Official Use Experiment Development and Integration Process Philippe Schoonejans, Head of Robotics and Future Projects Office ESA.
William Prosser April 15, Introduction to Probability of Detection (POD) for Nondestructive Evaluation (NDE) This briefing is for status only and.
Failure Modes, Effects and Criticality Analysis
Risk Assessment: A Practical Guide to Assessing Operational Risk
CS 577b: Software Engineering II
CHALLENGER DISASTER : CASE STUDY – TO BE
PRA: Validation versus Participation in Risk Analysis PRA as a Risk Informed Decision Making Tool Richard T. Banke– SAIC
Martin Shaw – Reliability Solutions
Failure mode and effect analysis
© The Aerospace Corporation 2008 Rationale for Selected MIL-STD-1540E Thermal Test Requirement John W. Welch The Aerospace Corporation TFAWS
Project Management for Software Engineers (Summer 2017)
Analysis of Two Extreme Gas Dynamic Activities
Reliability Engineering Applications and Case Studies
Planetary Protection Category V Restricted Earth Return
J1879 Robustness Validation Hand Book A Joint SAE, ZVEI, JSAE, AEC Automotive Electronics Robustness Validation Plan Robustness Diagram Trends and Challenges.
HMI Reliability Dale Wolfe Reliability Engineer LMSSC*ATC*LMSAL
Mohammad Khalessi, Ph.D. CEO/President PredictionProbe, Inc.
Knowing When to Stop: An Examination of Methods to Minimize the False Negative Risk of Automated Abort Triggers RAM XI Training Summit October 2018 Patrick.
Unit I Module 3 - RCM Terminology and Concepts
Managing Project Risks and Opportunities
Definitions Cumulative time to failure (T): Mean life:
Jeff Dutton/NASA COR August 26, 2019
Presentation transcript:

Mission Success Starts with Safety The Similarities and Differences of Reliability Engineering and Probabilistic Risk Assessment RAMS VII Workshop November 4-5, 2014 Fayssal M. Safie, Ph. D. NASA R&M Tech Fellow/Marshall Space Flight Center

Agenda Objective Probabilistic Risk Assessment (PRA) What Is It? How Does it Works? What Have We Done? Reliability Engineering – The Reliability Engineering Case – The Reliability Metric The Link between PRA and Reliability Concluding Remarks F. Safie2

Objective F. Safie3 The objective of this presentation is to discuss the PRA process and the reliability engineering discipline, their differences and similarities, and how they are used as complimentary analyses to support design and flight decisions.

Probabilistic Risk Assessment (PRA) What Is It? F. Safie4 PRA is a systematic process designed to answer three basic questions: What can go wrong that would lead to loss or degraded performance? How likely is it? What is the severity? In a PRA process, risk assessment is the task of generating the triplet set: R  RISK  {  S i, P i, C i  } Where, S is the scenario, P is the likelihood of the scenario, and C is the consequence of the scenario respectively

Probabilistic Risk Assessment (PRA) How Does It Works? F. Safie5 The following are the major steps in a PRA process

Probabilistic Risk Assessment (PRA) The Skills Needed F. Safie6

What Have We Done? F. Safie7 Since 1986, NASA Headquarters has conducted several PRA studies: Planning Research Corporation conducted the first of these studies in 1988 In 1995, Science Applications International Corporation (SAIC) conducted a comprehensive PRA study In July 1996, NASA conducted a study to develop a model that provided the overall Space Shuttle risk and estimates of risk changes due to proposed Space Shuttle upgrades After the Columbia accident, NASA conducted a PRA on the Shuttle External Tank (ET) foam. This study was used to understand the risk due to ET foam loss in flight Most recently, a PRA for Ares I launch vehicle was performed in support of the Constellation program

Reliability Engineering Reliability is a very broad design-support discipline. It has important interfaces with most engineering disciplines Reliability Engineering as a Discipline is: – The application of engineering principles to the design and processing of products, both hardware and software, for the purpose of meeting product reliability requirements or goals Reliability as a Figure of Merit is: – The probability that an item will perform its intended function for a specified mission profile F. Safie8

Reliability Requirements Reliability Case Reliability Program Management & Control Design Reliability The Reliability Engineering Case Process Reliability Reliability Testing Worst Case Analysis Human Reliability Analysis Root Cause Analysis Sneak Circuit Analysis Probabilistic Design Analysis Reliability Program Plan Contractors and Suppliers Monitoring Reliability Program Audits Reliability Progress Reports Failure Review Processes Process Characterization Critical Parameter Process Parameter Design Process Uniformity Statistical Process Control Design Reliability Drivers Stress Screening Reliability Requirements Analysis Reliability Requirements Allocation Reliability Prediction FMEA/CIL F. Safie 9 Process Capability Process Monitoring

10 Causes and Contributing Factors The zinc chromate putty frequently failed and permitted the gas to erode the primary O-rings. The particular material used in the manufacture of the shuttle O-rings was the wrong material to use at low temperatures. Elastomers become brittle at low temperatures. Design Reliability The Challenger Case

Causes and Contributing Factors Breach in the Thermal Protection System caused by the left bipod ramp insulation foam striking the left wing leading edge There were large gaps in NASA's knowledge about the foam cryopumping and cryoingestion, were experienced during tanking, launch, and ascent Dissections of foam revealed subsurface flaws and defects as contributing to the loss of foam 11 Process Reliability The Columbia Case

Reliability Predictions The process of quantitatively estimating the reliability of a system using both objective and subjective data Performed to the lowest level for which data is available. The sub-level reliabilities are then combined to derive the system level prediction The techniques are dependent on the degree of the design definition and the availability of historical data. Examples are Techniques are: – Similarity analysis – Physics-based – Techniques that utilize generic failure rates such as MIL- HDBK 217, Reliability Prediction of Electronic Equipment F. Safie12

Reliability Demonstration The process of quantitatively estimating the reliability of a system using objective data at the level intended for demonstration Statistical formulas are used to calculate the demonstrated reliability at some confidence level Models and techniques used in reliability demonstration include Binomial, Exponential, Weibull models, etc. Due to high cost and schedule impact of reliability demonstration, programs employed this method only to demonstrate a certain reliability comfort level. For example, a reliability goal of.99 at 95% confidence level is demonstrated by conducting 298 successful tests F. Safie13

The Link between PRA and Reliability The ET Foam Probabilistic Risk Assessment TPS Void Distributions Process Control TPS Debris Generation (divot/no divot, size/shape, (mass), time and location of release, and pop-off velocity TPS Reliability TPS Transport Model (axial/lateral locations and velocities during ascent Orbiter Impact Algorithms (impact/no impact, location, time, mass, velocity and angle) Orbiter Damage Analysis (tile/RCC panel damage) Probability of Orbiter Damage Exceeding Damage Tolerance System Risk ET TPS Dissections (ET Project) TPS Geometry Properties, Boundary Conditions (ET Project) Debris Transport and CFD Calculations (SE&I) Orbiter Geometric Models (Orbiter Project) Orbiter Impact / Damage Tolerances (Orbiter Project) ET Dissection / Manufacturing Data Thermal-Vacuum and Flight Imagery Data Debris Transport Analysis Orbiter Post-Flight Data Input Data Validation Data 14

Concluding Remarks Reliability engineering is a design function that deal with loss of function PRA is a process that deals with system risk scenarios that could lead to loss of mission or loss of crew PRA and reliability engineering are two different areas serving different functions in supporting the design and operation of launch vehicles; however, PRA as a risk assessment, and reliability as a metric could play together in a complimentary manner in assessing the risk and reliability of launch vehicles In general, reliability data is used as a critical data source for PRA F. Safie15