Guidelines for validation experiments Oberkampf and Roy provide guidelines for validation experiments This lecture deals with their applications to the.

Slides:



Advertisements
Similar presentations
VV&A-1 VV&A Breakout Session Simone Youngblood The Johns Hopkins University Applied Physics Lab.
Advertisements

Kriging.
1 BROOKHAVEN SCIENCE ASSOCIATES Nick Simos Brookhaven National Laboratory EXPERIENCE WITH IMPLICIT AND EXPLICIT CODES IN ANALYZING BEAM-INDUCED RAPID THERMO-MECHANICAL.
Ch 3: Unified Process CSCI 4320: Software Engineering.
Describing Process Specifications and Structured Decisions Systems Analysis and Design, 7e Kendall & Kendall 9 © 2008 Pearson Prentice Hall.
CCMT Validation of Shock Tube Simulation Chanyoung Park, Raphael (Rafi) T. Haftka and Nam-Ho Kim Department of Mechanical & Aerospace Engineering, University.
Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11
Curve fit metrics When we fit a curve to data we ask: –What is the error metric for the best fit? –What is more accurate, the data or the fit? This lecture.
1 Approved for unlimited release as SAND C Verification Practices for Code Development Teams Greg Weirs Computational Shock and Multiphysics.
1 Static Testing: defect prevention SIM objectives Able to list various type of structured group examinations (manual checking) Able to statically.
Model Personalization (1) : Data Fusion Improve frame and answer (of persistent query) generation through Data Fusion (local fusion on personal and topical.
Steps of a sound simulation study
Simulation.
Chapter 4 Sampling and Investigating Hard Data
SE is not like other projects. l The project is intangible. l There is no standardized solution process. l New projects may have little or no relationship.
Lecture 10 Comparison and Evaluation of Alternative System Designs.
Dimensions of Data Quality M&E Capacity Strengthening Workshop, Addis Ababa 4 to 8 June 2012 Arif Rashid, TOPS.
Intercollegiate Rocket Engineering Competition Spring 2015 EML Ethics and Design Project Organization.
Section 2: Science as a Process
Chapter 1: Introduction to Statistics
S/W Project Management Software Process Models. Objectives To understand  Software process and process models, including the main characteristics of.
Categories of Testing.
CPIS 357 Software Quality & Testing I.Rehab Bahaaddin Ashary Faculty of Computing and Information Technology Information Systems Department Fall 2010.
TWIST Measuring the Space-Time Structure of Muon Decay Carl Gagliardi Texas A&M University TWIST Collaboration Physics of TWIST Introduction to the Experiment.
1 OM2, Supplementary Ch. D Simulation ©2010 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible.
Lecture 3: Visual Modeling & UML 1. 2 Copyright © 1997 by Rational Software Corporation Computer System Business Process Order Item Ship via “ Modeling.
I.Introduction to Engineering Statistics A. The Engineering Method The heart of sound engineering practice is the engineering method systematic approach.
Describing Process Specifications and Structured Decisions Systems Analysis and Design, 7e Kendall & Kendall 9 © 2008 Pearson Prentice Hall.
Requirements Engineering ments_analysis.
Moving into Implementation SYSTEMS ANALYSIS AND DESIGN, 6 TH EDITION DENNIS, WIXOM, AND ROTH © 2015 JOHN WILEY & SONS. ALL RIGHTS RESERVED.Roberta M. Roth.
TWIST A Precision Measurement of Muon Decay at TRIUMF Peter Kitching TRIUMF/University of Alberta TWIST Collaboration Physics of TWIST Introduction to.
Statistics and the Verification Validation & Testing of Adaptive Systems Roman D. Fresnedo M&CT, Phantom Works The Boeing Company.
NCHRP Project Development of Verification and Validation Procedures for Computer Simulation use in Roadside Safety Applications SURVEY OF PRACTITIONERS.
Understanding Sampling
Introduction to Software Project Estimation I (Condensed) Barry Schrag Software Engineering Consultant MCSD, MCAD, MCDBA Bellevue.
Introduction to Earth Science Section 2 Section 2: Science as a Process Preview Key Ideas Behavior of Natural Systems Scientific Methods Scientific Measurements.
Jet With No Cross Flow RANS Simulations of Unstart Due to Mass Injection J. Fike, K. Duraisamy, J. Alonso Acknowledgments This work was supported by the.
Chapter 8 Lecture 1 Software Testing. Program testing Testing is intended to show that a program does what it is intended to do and to discover program.
EDMS-based Change Management Support Lars Hagge Joint ILC/XFEL Meeting DESY, Hamburg,
Software Engineering1  Verification: The software should conform to its specification  Validation: The software should do what the user really requires.
Experimental Control Definition Is a predictable change in behavior (dependent variable) that can be reliably produced by the systematic manipulation.
Probabilistic Robotics Introduction.  Robotics is the science of perceiving and manipulating the physical world through computer-controlled devices.
Requirements Engineering ments_analysis.
- 1 - Computer model under uncertainty In previous lecture on accuracy assessment –We considered mostly deterministic models. – We did not distinguish.
All you wanted to know about laboratory tests, but were afraid to ask By Dietmar Stöckl STT Consulting The informed patient meeting the laboratory.
Banaras Hindu University. A Course on Software Reuse by Design Patterns and Frameworks.
Some type of major TSE effort TSE for an “important” statistic Form a group to design a TSE evaluation for existing survey “exemplary TSE estimation plan”
Design and implementation Chapter 7 – Lecture 1. Design and implementation Software design and implementation is the stage in the software engineering.
AIAA th AIAA/ISSMO Symposium on MAO, 09/05/2002, Atlanta, GA 0 AIAA OBSERVATIONS ON CFD SIMULATION UNCERTAINTIES Serhat Hosder, Bernard.
1 SYS366 Week 2 - Lecture 2 Visual Modeling & UML.
Designs for Experiments with More Than One Factor When the experimenter is interested in the effect of multiple factors on a response a factorial design.
5 September 2002AIAA STC Meeting, Santa Fe, NM1 Verification and Validation for Computational Solid Mechanics Presentation to AIAA Structures Technical.
Lecturer: Eng. Mohamed Adam Isak PH.D Researcher in CS M.Sc. and B.Sc. of Information Technology Engineering, Lecturer in University of Somalia and Mogadishu.
Building Valid, Credible & Appropriately Detailed Simulation Models
Research design By Dr.Ali Almesrawi asst. professor Ph.D.
Theory of Turbine Cascades P M V Subbarao Professor Mechanical Engineering Department Its Group Performance, What Matters.……
A V&V Overview of the 31st Symposium on Naval Hydrodynamics
Purpose Design your own experimental procedures. Decide
Introduction to System Analysis and Design
Investigation of Flow in a Model of Human Respiratory Tract
TechStambha PMP Certification Training
Overview of System Engineering
Intended Usage Estimation of various performance indices, e.g.,
This teaching material has been made freely available by the KEMRI-Wellcome Trust (Kilifi, Kenya). You can freely download,
Chute Modelling Capabilities & Future Directions Paul Munzenberger
Verification and Validation Unit Testing
AIAA OBSERVATIONS ON CFD SIMULATION UNCERTAINTIES
Design Model Like a Pyramid Component Level Design i n t e r f a c d s
AIAA OBSERVATIONS ON CFD SIMULATION UNCERTAINTIES
Purpose Design your own experimental procedures. Decide
Presentation transcript:

Guidelines for validation experiments Oberkampf and Roy provide guidelines for validation experiments This lecture deals with their applications to the –Paper helicopter –CCMT shock tube validation of Rocflu

CCMT | 2 Explosive solid particle dispersal  Target three dimensional dispersal phenomenon -Explosive processes influence dynamics of densely packed particles -Predicting particle dynamics with a simulation

CCMT | 3 Validation of Shock Tube Simulation  Validation of the models for shock-particle interactions Experimental Data Shock Tube Simulation Validation

I: Joint design Guideline 1: A validation experiment should be jointly designed by experimentalists, model developers, and code users working closely together throughout the program, from inception to documentation with complete candor about the strength and weaknesses of each approach.

History of processes Experiments always precede some of the modeling. Validation is intended to check whether the model only works as a curve fit or does it have predictive capability. For shock tube V&V team acts as bridge. How did you wear the different hats of analysts, code developers and experimentalists for helicopter project? What is the validation part of the paper helicopter project?

CCMT | 6 Prediction Metrics Prediction Metrics: The locations of the particle curtain edges at upstream and downstream  What are the alternatives? Curtain thickness after impact Before impact After impact

What should be measured? Guideline 2: A validation experiment should be designed to capture the essential physics of interest, and measure all relevant physical modeling data, initial and boundary conditions, and system excitation information required by the model. For the shock tube experiment the essential physics is the interaction of shock and particles. What is the essential physics for helicopter? What else would be worthwhile measuring?

Synergism Guideline 3: A validation experiment should try to emphasize the inherent synergism that is attainable between computational and experimental approaches. –Example: Use simple configuration to reveal test deficiencies (e.g. flow without particles) –Example: Use simulation to decide on sensor placement. –Examples from helicopter project?

Independence Guideline 4: Although the experimental design should be developed cooperatively, independence must be maintained in obtaining the computational and experimental system response results. –Blind test prediction is important! –Why?

Hierarchy of measurements Guideline 5: Experimental measurements should be made of a hierarchy of system response quantities, for example from globally integrated quantities to local quantities. –For shock tube experiment, local quantities include pressures and local volume fractions. –What are local and global quantities for helicopter measurements?

Uncertainty Guideline 6: The experimental design should be constructed to analyze and estimate the components of random (precision) and systematic (bias) experimental uncertainties. How do you determine the bias in the helicopter experiment?