Höchstleistungsrechenzentrum Stuttgart SEGL Parameter Study Slide 1 Science Experimental Grid Laboratory (SEGL) Dynamical Parameter Study in Distributed.

Slides:



Advertisements
Similar presentations
Large-Scale, Adaptive Fabric Configuration for Grid Computing Peter Toft HP Labs, Bristol June 2003 (v1.03) Localised for UK English.
Advertisements

Convegno Progetto FIRB LSNO – Capri 19/20 aprile ESOPO: an Environment for Solving Optimization Problems Online M. DApuzzo *, M.L. De Cesare **,
ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.
Computational Grids and Computational Economy: Nimrod/G Approach David Abramson Rajkumar Buyya Jonathan Giddy.
Pricing for Utility-driven Resource Management and Allocation in Clusters Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS)
1 Towards an Open Service Framework for Cloud-based Knowledge Discovery Domenico Talia ICAR-CNR & UNIVERSITY OF CALABRIA, Italy Cloud.
Page 1 CSISS LCenter for Spatial Information Science and Systems 03/19/2008 GeoBrain BPELPower Workflow Engine Liping Di, Genong Yu Center.
Cultural Heritage in REGional NETworks REGNET Project Meeting Content Group Part 1: Usability Testing.
4. May 2007 Workshop on Dynamic Service Level AgreementsPage 1 Dynamic SLA Negotiation in BREIN Bastian Koller High Performance Computing Center Stuttgart.
W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.
Slicer3 for developers – Sonia Pujol, Ph.D. -1- National Alliance for Medical Image Computing Programming into Slicer3 Sonia Pujol, Ph.D. Surgical Planning.
1 Copyright © 2005, Oracle. All rights reserved. Introduction.
18 Copyright © 2005, Oracle. All rights reserved. Distributing Modular Applications: Introduction to Web Services.
3 Copyright © 2005, Oracle. All rights reserved. Designing J2EE Applications.
Copyright © 2006 Data Access Technologies, Inc. Open Source eGovernment Reference Architecture Approach to Semantic Interoperability Cory Casanave, President.
CPSCG: Constructive Platform for Specialized Computing Grid Institute of High Performance Computing Department of Computer Science Tsinghua University.
0 - 0.
The ANSI/SPARC Architecture of a Database Environment
1 9 Moving to Design Lecture Analysis Objectives to Design Objectives Figure 9-2.
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Enterprise Java and Data Services Designing for Broadly Available Grid Data Access Services.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
Lehrstuhl Informatik III: Datenbanksysteme Grid-based Data Stream Processing in e-Science 1 Richard Kuntschke 1, Tobias Scholl 1, Sebastian Huber 1, Alfons.
Integration of EASY5/GSDS for Auto Code Generation and Testing Mike Bingle, Associate Technical Fellow Model Based Processes and Tools Simulation Engineering.
Yammer Technical Solutions Overview
Dr. Eva Swenson, University of Toronto Terry Riopelle, Software AG Nov University of Toronto Turning Data into Information.
What's new?. ETS4 for Experts - New ETS4 Functions - improved Workflows - improvements in relation to ETS3.
Queensland University of Technology, University of Tartu Part II: the last mile.
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
LabVIEW Crash Course Presented by:.
WEB- BASED TRAINING Chapter 4 Virginija Limanauskiene, KTU, Lithuania.
Web Service Composition Prepared by Robert Ma February 5, 2007.
TSpaces Services Suite: Automating the Development and Management of Web Services Presenter: Kevin McCurley IBM Almaden Research Center Contact: Marcus.
1 1 Mechanical Design and Production Dept, Faculty of Engineering, Zagazig University, Egypt. Mechanical Design and Production Dept, Faculty of Engineering,
INTRODUCTION TO SIMULATION WITH OMNET++ José Daniel García Sánchez ARCOS Group – University Carlos III of Madrid.
25 July, 2014 Martijn v/d Horst, TU/e Computer Science, System Architecture and Networking 1 Martijn v/d Horst
Database System Concepts and Architecture
© 2003 Xilinx, Inc. All Rights Reserved Course Wrap Up DSP Design Flow.
2009 – E. Félix Security DSL Toward model-based security engineering: developing a security analysis DSML Véronique Normand, Edith Félix, Thales Research.
Mani Srivastava UCLA - EE Department Room: 6731-H Boelter Hall Tel: WWW: Copyright 2003.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
UNICORE UNiform Interface to COmputing REsources Olga Alexandrova, TITE 3 Daniela Grudinschi, TITE 3.
Process-oriented System Automation Executable Process Modeling & Process Automation.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Katanosh Morovat.   This concept is a formal approach for identifying the rules that encapsulate the structure, constraint, and control of the operation.
Ohio State University Department of Computer Science and Engineering Automatic Data Virtualization - Supporting XML based abstractions on HDF5 Datasets.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
Nimrod & NetSolve Sathish Vadhiyar. Nimrod Sources/Credits: Nimrod web site & papers.
Application portlets within the PROGRESS HPC Portal Michał Kosiedowski
1 Sergio Maffioletti Grid Computing Competence Center GC3 University of Zurich Swiss Grid School 2012 Develop High Throughput.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grid programming with components: an advanced COMPonent platform for an effective invisible grid © 2006 GridCOMP Grids Programming with components. An.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
Digital Intuition Cluster, Smart Geometry 2013, Stylianos Dritsas, Mirco Becker, David Kosdruy, Juan Subercaseaux Welcome Notes Overview 1. Perspective.
ITSC/University of Alabama in Huntsville ADaM System Architecture Rahul Ramachandran, Sara Graves and Ken Keiser Mathematical Challenges in Scientific.
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
Scientific Programmes Committee Centre for Aerospace Systems Design & Engineering Amitay Isaacs Department of Aerospace Engineering Indian Institute of.
Managing Learning Objects in Large Scale Courseware Authoring Studio Ivo Marinchev, Ivo Hristov Institute of Information Technologies Bulgarian Academy.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Feb 24-27, 2004ICDL 2004, New Dehli Improving Federated Service for Non-cooperating Digital Libraries R. Shi, K. Maly, M. Zubair Department of Computer.
Millions of Jobs or a few good solutions …. David Abramson Monash University MeSsAGE Lab X.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
SEGL HPC Workflow System
Introduction to the SHIWA Simulation Platform EGI User Forum,
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

Höchstleistungsrechenzentrum Stuttgart SEGL Parameter Study Slide 1 Science Experimental Grid Laboratory (SEGL) Dynamical Parameter Study in Distributed Systems Natalia Currle-Linde University of Stuttgart High-Performance Computing-Center Stuttgart (HLRS)

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 2 Overview Background & Motivation Related Work Architecture & implementation details of SEGL Usage Example Future Work

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 3 Background &Motivation Parameter studies - a great challenge Parameter studies easy to parallelize Grid Technology enables integration of resources provides a new technical basis for complex parametric investigations Problem: Administration of jobs, parameters, results …. Motivation Motivation : automatically start, execute, monitor applications efficient enable efficient execution of experiments User doesn`t need to have knowledge of specific programming language knowledge of Grid structure.

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 4 Tools for parameter investigation studies NIMROD (Monash University, Australia) Can be used to manage the execution of parameter studies across distributed computers ILAB ( NASA Ames Research Center ) Allows the generation of multi-parametric models and adds workflow management do not support dynamic parameterizations

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 5 Workflow Support: multiphysics applications, preprocessing steps, postprocessing filters,visualization, iterative search in the parameter space for optimum solutions Require: use of Grid Workflow TRIANA UNICORE BPEL4WS specification of loops criteria synchronisation points communication via message

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 6 Dynamic parameterization SEGL enables dynamical selection of parameter sets on the basis of previous and intermediate results SEGL supports creation of complex processes, which involves –several levels of parameterization –repeated processing –data archiving –conclusions and branches during the processing –synchronization of parallel branches and processes

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 7 Requirement – Hide complexity from the user Users are very sensitive to the level of automation of application preparation They must be able to define a fine - grained logical execution process formulate the parameterization rules identify the position in the input area of the parameters which are to be changed in the course of the experiment All other details should be hidden from the user.

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 8 Science Experimental Grid Laboratory System Architecture

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 9 System Architecture J2EE JBOSS Appication Server JDO (OODB) UNICORE -Adapter

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 10 Graphic language three levels Experiment is described at three levels : control flow, data flow, data repository Control flow Control flow : description of logical schema of experiments direction, condition, sequence of execution Data flow Data flow : local description of interblock computation processes standard/user-specific computation module direction of input/output data between repositoryand computation module parameterization rules Data repository Data repository : aggregation of data container application ->application server QL description ->server data base

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 11

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 12 Control Flow User defines the sequence of execution of experiment blocks Solver block simple parameter sweep Control block program object: allows changing sequence of execution according to specified criteria

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 13 Data Flow is dynamic Manipulation of data in a very fine- grained way Solver Block: computation module C replacemant module R parameterization module P data base Each module: Java object has standard structure consists of several sections Computation module : organizes preparation of input data generates job initializes/controls record of results in DB controls execution of module operation

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 14 Data Flow (variants of parameterization)

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 15 Control Flow

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 16 Power plant simulation Unit: Output Power170 MWel Firing SystemTangential, Windbox Bituminous Coal OFA retrofit for NOx-reduction in 1991 Optimized Operation Parameters required Target : Minimizing NOx and Unburned Carbon Parameters : Damper Setting CCOFA Damper Setting sep. OFA Tilting Angle sep. OFA

Höchstleistungsrechenzentrum Stuttgart Natalia Currle-LindeSEGL Parameter Study Slide 17 Conclusion & Future Work SEGL allows end-user programming of complex, computation- intensive simulation and modeling for science and engineering offers efficient way to execute scientific experiments Future work: –Globus Adapter –Investigation of Unicore Resource Broker