MACCCR 5 th Fuels Research Review September 17, 2012 Michael Frenklach Supported by AFOSR PrIMe Next Frontier: Large, Multi-dimensional Data Sets.

Slides:



Advertisements
Similar presentations
How to Set Up a System for Teaching Files, Conferences, and Clinical Trials Medical Imaging Resource Center.
Advertisements

National Institute of Statistics, Geography and Informatics (INEGI) Implementation of SDMX in Mexico.
Pulan Yu School of Informatics Indiana University Bloomington Web service based Varuna.Net.
12 October 2011 Andrew Brown IMu Technology EMu Global Users Group 12 October 2011 IMu Technology.
University of Southampton Electronics and Computer Science M-grid: Using Ubiquitous Web Technologies to create a Computational Grid Robert John Walters.
PNC, “Collaboration: Tools and Infrastructure” December 7, 2012 Michael Frenklach Supported by AFOSR, Fung PrIMe: Integrated Infrastructures for Data and.
Introduction to Web services MSc on Bioinformatics for Health Sciences May 2006 Arnaud Kerhornou Iván Párraga García INB.
Task Scheduling and Distribution System Saeed Mahameed, Hani Ayoub Electrical Engineering Department, Technion – Israel Institute of Technology
An integrated system for handling restricted use data Felicia LeClere, Ph.D. IASSIST 2009 Tampere, Finland.
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
Why choose Drupal?
CS 432 Object-Oriented Analysis and Design
Introduction to Web Applications Instructor: Enoch E. Damson.
SaaS, PaaS & TaaS By: Raza Usmani
CrackingSiebel.com Utility Siebel Repository Extract (SRE) Tool.
Professional Informatics & Quality Assurance Software Lifecycle Manager „Tools that are more a help than a hindrance”
InterSwyft Technology presentation. Introduction InterSwyft brings secured encrypted transmission of SMS messages for internal and external devices such.
FTP. SMS based FTP Introduction Existing System Proposed Solution Block Diagram Hardware and Software Features Benefits Future Scope Conclusion.
February Semantion Privately owned, founded in 2000 First commercial implementation of OASIS ebXML Registry and Repository.
INTRODUCTION TO WEB DATABASE PROGRAMMING
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
Crystal Hoyer Program Manager IIS Team Preview of features that will be announced at MIX09 Please do not blog, take pictures or video of session.
Trimble Connected Community
Customized cloud platform for computing on your terms !
EPCC, University of Edinburgh DIRAC and SAFE. DIRAC requirements DIRAC serves a variety of different user communities. –These have different computational.
Basics of Web Databases With the advent of Web database technology, Web pages are no longer static, but dynamic with connection to a back-end database.
NASA/ESA Interoperability Efforts CEOS Subgroup - CINTEX Alexandria, Sept 12, 2002 Ananth Rao Yonsook Enloe SGT, Inc.
A Distributed Computing System Based on BOINC September - CHEP 2004 Pedro Andrade António Amorim Jaime Villate.
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
© 2008 IBM Corporation ® IBM Cognos Business Viewpoint Miguel Garcia - Solutions Architect.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
Computer Emergency Notification System (CENS)
Introduction to the Adapter Server Rob Mace June, 2008.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Moby Web Services Iván Párraga García MSc on Bioinformatics for Health Sciences May 2006.
MIS 105 LECTURE 1 INTRODUCTION TO COMPUTER HARDWARE CHAPTER REFERENCE- CHP. 1.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
Cloud Strategy made Simple David G. Fletcher. 2 Hybrid Cloud Approach Utah is building a private cloud to provision services from its virtualized infrastructure.
SWGData and Software Access - 1 UCB, Nov 15/16, 2006 THEMIS SCIENCE WORKING TEAM MEETING Data and Software Access Ken Bromund GST Inc., at NASA/GSFC.
© 2013, published by Flat World Knowledge Chapter 10 Understanding Software: A Primer for Managers 10-1.
Imagine Creating Software Without a Single Line of Code!
Mohit Anand, Software Engineer Adobe 1 Selecting GUI Automation Testing Tool for Mobile Domain.
Dispatching Java agents to user for data extraction from third party web sites Alex Roque F.I.U. HPDRC.
Slide 1 Service-centric Software Engineering. Slide 2 Objectives To explain the notion of a reusable service, based on web service standards, that provides.
Using the ARCS Grid and Compute Cloud Jim McGovern.
Pertemuan 16 Materi : Buku Wajib & Sumber Materi :
Maite Barroso - 10/05/01 - n° 1 WP4 PM9 Deliverable Presentation: Interim Installation System Configuration Management Prototype
Copyright © 2002 Pearson Education, Inc. Slide 3-1 Internet II A consortium of more than 180 universities, government agencies, and private businesses.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Alex Undrus – Shifters Meeting – 16 Oct ATLAS Nightly System Integration LS1 Ugrade SIT Task Force Objective: increase efficiency, flexibility,
Satisfying Requirements BPF for DRA shall address: –DAQ Environment (Eclipse RCP): Gumtree ISEE workbench integration; –Design Composing and Configurability,
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Splunk Enterprise Instructor: Summer Partain 3 Day Course.
VIEWS b.ppt-1 Managing Intelligent Decision Support Networks in Biosurveillance PHIN 2008, Session G1, August 27, 2008 Mohammad Hashemian, MS, Zaruhi.
Design & Implementation of Black Sea Information System Approaches & Considerations.
1 Presented by: Val Pennell, Test Tool Manager Date: March 9, 2004 Software Testing Tools – Load Testing.
ENEA GRID & JPNM WEB PORTAL to create a collaborative development environment Dr. Simonetta Pagnutti JPNM – SP4 Meeting Edinburgh – June 3rd, 2013 Italian.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
Chapter 8 Environments, Alternatives, and Decisions.
z/Ware 2.0 Technical Overview
On the road: Test automation in practice for a BMW map update service
Teacher: Alison Roberts Northern Sydney Institute of TAFE
Textbook Engineering Web Applications by Sven Casteleyn et. al. Springer Note: (Electronic version is available online) These slides are designed.
4.03 Understand Information Technology activities and careers.
Recitation on AdFisher
worlds largest IT service provider
Presentation transcript:

MACCCR 5 th Fuels Research Review September 17, 2012 Michael Frenklach Supported by AFOSR PrIMe Next Frontier: Large, Multi-dimensional Data Sets

PrIMe Cloud Infrastructure: ‒ Data Flow Network ‒ Remote Server: PrIMe-RMG ‒ Interfaces ‒ Big Data Other new developments: ‒ Species identification app ‒ UQ: Statistical sampling of the feasible set... PrIMe with Humanities

PrIMe Process Informatics Model  Data sharing  App sharing  Automation

domain 2 web page Present-day Science Sharing: via web-page access database apps Internet domain 1 web page

science domain 2 database apps Internet science domain 1 PrIMe Science Sharing: via web-service data/app access

science domain 2 database apps Internet science domain 1 PrIMe Science Sharing: via web-service data/app access client web service data flow network client workflow app

Initial Model: “Upload your data to PrIMe Warehouse” (“give me your data”) New, Distributed Model: “You may, if choose, connect your data to the communal system” with a switch in the OFF position: “you can use the communal data and tools but your own data is private to you only” “but please flip the switch to the ON position when you are ready to share your own data”

“Connect your code to the communal system” - you control your own code: release version user access, licenses collect fees, if desired

Remote server app — PrIMe Web Services (PWS) no restrictions on platform no restrictions on data formats no restrictions on local programming language(s) PrIMe Workflow Interface (PWI) is the only “standard” developed, maintained, and controlled by the community

client machine client data PrIMe web services PrIMe Data Flow Network PrIMe Dispatcher

excessively large data sets do not move the data but use “smart agents” (eg, HTML5 walkers) web services with user-reloaded tasks: fetch data features for user-requested analysis

Created ~2 years ago ‒installed by professional programmers ‒implemented on Reaction Design site Modified June 2012 ‒can be installed by users ‒implemented with RMG at MIT site ‒installed by first-year grad students!

installation manual

User creates a PrIMe Workflow (PWA) project User submits a request: “create a reaction model for …” The request activates RMG code at MIT server User receives when the model is generated User retrieves the model or it “moves” along the PWA project to the next component

client machine client data PrIMe web services binary XML – HDF5 e.g., reaction model: GRI-Mech 3.0

input data for UQ bypassing Warehouse species identification via crowd-sourcing UQ: sampling within the feasible region comparison between interval-to-interval UQ and rigorous Bayesian parallelization of Chemkin II

experimental uncertainty M(x1,x2)M(x1,x2)  feasible set prior knowledge

An ongoing collaborative study with Jerome Sacks, National Institute of Statistical Sciences Rui Paulo, ISEG Technical University of Lisbon Gonzalo Garcia-Donato, Universidad de Castilla-La Mancha Bayesian simulations: no simplifying assumptions, but utilize the Solution Mapping strategy for numerical efficiency

Execution time of flame simulations with a large acetylene model

Execution time of flame simulations with a hydrogen model

A collaborative project of PrIMe with Humanities: Berkeley Electronic Cultural Atlas Initiative

“Study of Buddhist Texts” PrIMe is used to predict the past The abstracted dots represent “panes”

A collaborative project of PrIMe with Humanities: Berkeley Electronic Cultural Atlas Initiative Berkeley Institute of Information: “Editors Notes”

Remote-server app and new apps −RMG: interface (with MIT, Bill Green) −Communal/User tools: Cantera (with NCSU, Phil Westmoreland) −Big Data: feature collection for UQ (with Utah, Phil Smith) Enabling new science infrastucture −ALS-data analysis (with NCSU; Phil Westmoreland) −Species IDs (with Kaust; Mani Sarathy) −H2-O2: automation/addition of flame targets (with Tsinghua, Xiaoqing You) −Submission of Chemkin mechanisms (with Kaust and Tsinghua)