S-GEMS-UQ: An Uncertainty Quantification Toolkit for SGEMS

Slides:



Advertisements
Similar presentations
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Advertisements

The Data Mining Visual Environment Motivation Major problems with existing DM systems They are based on non-extensible frameworks. They provide a non-uniform.
Presented by IBM developer Works ibm.com/developerworks/ 2006 January – April © 2006 IBM Corporation. Making the most of Creating Eclipse plug-ins.
Guide To UNIX Using Linux Third Edition
XP New Perspectives on Microsoft Access 2002 Tutorial 71 Microsoft Access 2002 Tutorial 7 – Integrating Access With the Web and With Other Programs.
Synthesis of Incomplete and Qualified Data using the GCE Data Toolbox Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia.
9 Chapter Nine Extracting and Transforming Data with SQL Server 2000.
Data Management Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition.
Server-side Scripting Powering the webs favourite services.
CPS120: Introduction to Computer Science The World Wide Web Nell Dale John Lewis.
ACOT Intro/Copyright Succeeding in Business with Microsoft Excel
Automatic Generation Tools UNICOS Application Builder Overview 11/02/2014 Ivan Prieto Barreiro - EN-ICE1.
Information Systems: Databases Define the role of general information systems Describe the elements of a database management system (DBMS) Describe the.
Computers Data Representation Chapter 3, SA. Data Representation and Processing Data and information processors must be able to: Recognize external data.
Views The architecture was specifically changed to accommodate multiple views. The used of the QStackedWidget makes it easy to switch between the different.
Stephen Booth EPCC Stephen Booth GridSafe Overview.
Taxonomies of Visualization Techniques CMPT 455/826 - Week 12, Day 2 w12d2 Sept-Dec
Java Root IO Part of the FreeHEP Java Library Tony Johnson Mark Dönszelmann
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
NET-AUCTION This online auction project Directed by: Mr. Maxim Gurevich Submitted by: Yuri Kipnis Alex Scheotkin Alex Scheotkin.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
1 MSCS 237 Overview of web technologies (A specific type of distributed systems)
Céline Scheidt and Jef Caers SCRF Affiliate Meeting– April 30, 2009.
The IPSO Factor Enriching portfolios with market data.
XML Databases. XML Like HTML –Tags –Fixed vocabulary of tags and fixed structure –Tags indicate formatting, not semantics Strict HTML – XHTML –Always.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
Connecting to External Data. Financial data can be obtained from a number of different data sources.
Enterprise Database Systems Introduction to SQL Server Dr. Georgia Garani Dr. Theodoros Mitakos Technological.
Servicing Seismic and Oil Reservoir Simulation Data through Grid Data Services Sivaramakrishnan Narayanan, Tahsin Kurc, Umit Catalyurek and Joel Saltz.
Maitrayee Mukerji. INPUT MEMORY PROCESS OUTPUT DATA INFO.
Information Retrieval in Practice
Section 10.1 Define scripting
Architecture Review 10/11/2004
Simulation Production System
Decision Support Systems
DATA MANAGEMENT MODULE: USING SQL in R
Miscellaneous Excel Combining Excel and Access.
Web Routing Designing an Interface
The Client-Server Model
Distributed Cache Technology in Cloud Computing and its Application in the GIS Software Wang Qi Zhu Yitong Peng Cheng
CMS High Level Trigger Configuration Management
Stanford Center for Reservoir Forecasting
An Introduction to the IVC Software Framework
NOX: Towards an Operating System for Networks
System Design.
A strategy for managing uncertainty
The Client/Server Database Environment
Potential use of JAS/JAIDA etc. SAS J2EE Review
Microsoft Access 2003 Illustrated Complete
CFS Community Day Core Flight System Command and Data Dictionary Utility December 4, 2017 NASA JSC/Kevin McCluney December 4, 2017.
Jef Caers, Xiaojin Tan and Pejman Tahmasebi Stanford University, USA
Tutorial 8 Objectives Continue presenting methods to import data into Access, export data from Access, link applications with data stored in Access, and.
SCRF 26th Annual Meeting May
The Celera Genome Browser: A Tool for Visualizing and Annotating the Human Genome
Chapter 6 System and Application Software
Clementine Data Mining Presentation Lecturer:Dr.vahidipour Presenters: Nastaran Jafari,Zahra Bayat,Sara Ghorbani.
Use of Mathematics using Technology (Maltlab)
CSE 491/891 Lecture 21 (Pig).
Lecture 2 Components of GIS
QGIS, the data model, use and storage
Yao Tong, Tapan Mukerji Stanford University
Tutorial 7 – Integrating Access With the Web and With Other Programs
HP Quality Center 10.0 The Test Plan Module
Chapter 6 System and Application Software
Siyao Xu, Andre Jung Tapan Mukerji and Jef Caers
Chapter 6 System and Application Software
Chapter 6 System and Application Software
Neal Kurande, WinaGodwin Anyanwu Jr., Adam Chau
Integrated Statistical Production System WITH GSBPM
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

S-GEMS-UQ: An Uncertainty Quantification Toolkit for SGEMS Annual Meeting 2013 Stanford Center for Reservoir Forecasting S-GEMS-UQ: An Uncertainty Quantification Toolkit for SGEMS Lewis Li, Alex Boucher, & Jef Caers

Geostatistical Modeling of Uncertainty Geostatistical Realizations Forward model Analysis of Responses Spatial Model parameters Forward model parameters This figure represented a generalized workflow for uncertainty quantification. We first have field data that can be for instance, seismic data or well logs. From this data, we can abstract parameters that are used for spatial modeling. These are then passed into some geostatisical algorithm; be it variogram based or mult point statistics. The result realizations are then put through a forward model, (this could be either a full flow simulator or some proxy response). We then would analyze the response data to quantify uncertainty or do sensitivity analysis on the model parameters. Field Data SCRF 2013

Software Challenges Nearly every step of workflow is performed in separate programs Needs extensive modification for different scenarios Linking to external programs Post processing is cumbersome due to parameters, models, responses, etc. being fragmented across different programs Large size of data sets Often need to generate hundreds or thousands of models, system needs to be responsive enough to accommodate Ease of visualizing No user friendly and intuitive interfaces SCRF 2013

SGEMS-UQ Goals Compatible: Reduce/eliminate ad-hoc linking of codes Flexible: Can be adapted regardless of: Which geostatistical algorithms are generated Which proxy models are used Which simulation parameters are specified How distances are computed How users which to interpret results and perform sensitivity analysis Extensible: Framework for data mining Scalable: Be scalable for large datasets User Friendly: Provide intuitive GUI SCRF 2013

Goal: Compatibility Link with SGEMS 3.0 Develop as a plugin Link with external flow simulators Results are usually comma separated values Use XML (Extensible Markup Language) SCRF 2013

Response XML Responses can be of a variety of formats Vector Scalar Time series Probability distribution Defined a specified XML format with appropriate tags Program detects response type and selects appropriate data structure and links to corresponding object Provide Python script to convert exported files into this format

Goal: Extensible Modular Design XML combined with SQL database for storing parameters Allows for a data mining framework

Data Manipulation Language SELECT ... FROM ... WHERE ... INSERT INTO ... VALUES ... UPDATE ... SET ... WHERE ... DELETE FROM ... WHERE ... Ex: SELECT * FROM SGSIM WHERE TrainingImage = TI1 All we need to know is which algorithm each realization was generated with Use a hash table to store this in memory

Data Mining SQL SQL Parameter A Parameter B Parameter C … Parameter A

Distance Based Uncertainty Quantification

SGeMS-UQ Workflow Access SGeMS main program workspace Read, store and manage simulation parameters Read proxy responses from third party simulators Display responses Compute MDS Perform k-medoid clustering Export clustering results Data mine the parameters and perform sensitivity analysis

SCRF 2011