Python/C FASE prototype L. Paioro, B. Garilli et al. OPTICON Network 9.2 MiMa Collaboration INAF-IASF Milano L. Paioro - Python/C FASE prototype.

Slides:



Advertisements
Similar presentations
IVOA Beijing Interop May 15-16, 2007 Apps Messaging Issues.
Advertisements

Three types of remote process invocation
Elton Mathias and Jean Michael Legait 1 Elton Mathias, Jean Michael Legait, Denis Caromel, et al. OASIS Team INRIA -- CNRS - I3S -- Univ. of Nice Sophia-Antipolis,
THE CORE PROJECT Jose Jimenez (project manager). What is the Core platform?
TSpaces Services Suite: Automating the Development and Management of Web Services Presenter: Kevin McCurley IBM Almaden Research Center Contact: Marcus.
Web Service Ahmed Gamal Ahmed Nile University Bioinformatics Group
A component- and message-based architectural style for GUI software
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science Emery Berger University of Massachusetts Amherst Operating Systems CMPSCI 377 Lecture.
This product includes material developed by the Globus Project ( Introduction to Grid Services and GT3.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
G O B E Y O N D C O N V E N T I O N WORF: Developing DB2 UDB based Web Services on a Websphere Application Server Kris Van Thillo, ABIS Training & Consulting.
A brief look at CORBA. What is CORBA Common Object Request Broker Architecture developed by OMG Combine benefits of OO and distributed computing Distributed.
Scripting Languages For Virtual Worlds. Outline Necessary Features Classes, Prototypes, and Mixins Static vs. Dynamic Typing Concurrency Versioning Distribution.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
SE-565 Software System Requirements More UML Diagrams.
A Virtual Cloud Computing Provider for Mobile Devices Gonzalo Huerta-Canepa Dongman Lee.
Ajmer Singh PGT(IP) Software Concepts. Ajmer Singh PGT(IP) Operating System It is a program which acts as an interface between a user and hardware.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
OpenMP in a Heterogeneous World Ayodunni Aribuki Advisor: Dr. Barbara Chapman HPCTools Group University of Houston.
Configuration Management and Server Administration Mohan Bang Endeca Server.
German National Research Center for Information Technology Research Institute for Computer Architecture and Software Technology German National Research.
© 2012 WIPRO LTD | 1 Version 1.0a, 23 rd April 2012 TTCN-3 Users Conference Practical integration of TTCN-3 with Robot test automation framework.
Discovering E-Services Using UDDI in SELF-SERV Quan Z. Sheng, Boualem Benatallah, Rayan Stephan, Eileen Oi-Yan Mak, Yan Q. Zhu School of Computer Science.
Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System.
Distributed-Memory Programming Using MPIGAP Vladimir Janjic International Workhsop “Parallel Programming in GAP” Aug 2013.
6st ACS Workshop UTFSM ACS Course Component, Container, Lifecycle Management 6st ACS Workshop UTFSM, Valparaiso, Chile H. Sommer, G. Chiozzi.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
PARMON A Comprehensive Cluster Monitoring System A Single System Image Case Study Developer: PARMON Team Centre for Development of Advanced Computing,
BLU-ICE and the Distributed Control System Constraints for Software Development Strategies Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
Interoperability between Scientific Workflows Ahmed Alqaoud, Ian Taylor, and Andrew Jones Cardiff University 10/09/2008.
Grid Computing Research Lab SUNY Binghamton 1 XCAT-C++: A High Performance Distributed CCA Framework Madhu Govindaraju.
MACCE and Real-Time Schedulers Steve Roberts EEL 6897.
“DECISION” PROJECT “DECISION” PROJECT INTEGRATION PLATFORM CORBA PROTOTYPE CAST J. BLACHON & NGUYEN G.T. INRIA Rhône-Alpes June 10th, 1999.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Distributed Programming CSCI 201L Jeffrey Miller, Ph.D. HTTP :// WWW - SCF. USC. EDU /~ CSCI 201 USC CSCI 201L.
TAL7011 – Lecture 4 UML for Architecture Modeling.
Logical view –show classes and objects Process view –models the executables Implementation view –Files, configuration and versions Deployment view –Physical.
ICALEPCS’ GenevaACS in ALMA1 Allen Farris National Radio Astronomy Observatory Lead, ALMA Control System.
Chapter 2 Processes and Threads Introduction 2.2 Processes A Process is the execution of a Program More specifically… – A process is a program.
MIMA prototype design Proposal for a design implementing the three major FASE execution modes Luigi Paioro – ON 9.2 Face to face meeting, Milan, Jul 16.
CPSC 171 Introduction to Computer Science System Software and Virtual Machines.
1 Java Servlets l Servlets : programs that run within the context of a server, analogous to applets that run within the context of a browser. l Used to.
Toward interactive visualization in a distributed workflow Steven G. Parker Oscar Barney Ayla Khan Thiago Ize Steven G. Parker Oscar Barney Ayla Khan Thiago.
© FPT SOFTWARE – TRAINING MATERIAL – Internal use 04e-BM/NS/HDCV/FSOFT v2/3 JSP Application Models.
CSI 3125, Preliminaries, page 1 SERVLET. CSI 3125, Preliminaries, page 2 SERVLET A servlet is a server-side software program, written in Java code, that.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
1 ProActive GCM – CCA Interoperability Maciej Malawski, Ludovic Henrio, Matthieu Morel, Francoise Baude, Denis Caromel, Marian Bubak Institute of Computer.
Chapter 1 Basic Concepts of Operating Systems Introduction Software A program is a sequence of instructions that enables the computer to carry.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
AFS/OSD Project R.Belloni, L.Giammarino, A.Maslennikov, G.Palumbo, H.Reuter, R.Toebbicke.
GT3 Index Services Lecture for Cluster and Grid Computing, CSCE 490/590 Fall 2004, University of Arkansas, Dr. Amy Apon.
NGS computation services: APIs and.
Title – NwHIN CAQH/CORE X12 support Discussion Date June
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
© Oxford University Press 2011 DISTRIBUTED COMPUTING Sunita Mahajan Sunita Mahajan, Principal, Institute of Computer Science, MET League of Colleges, Mumbai.
Nguyen Thi Thanh Nha HMCL by Roelof Kemp, Nicholas Palmer, Thilo Kielmann, and Henri Bal MOBICASE 2010, LNICST 2012 Cuckoo: A Computation Offloading Framework.
Core and Framework DIRAC Workshop October Marseille.
Design of a Notification Engine for Grid Monitoring Events and Prototype Implementation Natascia De Bortoli INFNGRID Technical Board Bologna Feb.
System Components Operating System Services System Calls.
CORBA Antonio Vasquez, John Shelton, Nidia, Ruben.
Chapter 9: The Client/Server Database Environment
Spark Presentation.
Distribution and components
The Client/Server Database Environment
Introduction to Operating System (OS)
Object-Orientated Programming
NGS computation services: APIs and Parallel Jobs
An Introduction to Software Architecture
Knowledge Byte In this section, you will learn about:
Presentation transcript:

Python/C FASE prototype L. Paioro, B. Garilli et al. OPTICON Network 9.2 MiMa Collaboration INAF-IASF Milano L. Paioro - Python/C FASE prototype - Marseille, June 2010

Architectural Concepts Applications  Top level GUI/Web/CLI applications exploiting external computational components Computational components  Task stateless component single operation  driven by a parameter set  Tool stateful component multiple operations  each operation driven by a parameter set Packages  Bundles of components L. Paioro - Python/C FASE prototype - Marseille, June 2010

Example Of Use 1 GUI Application FASE Compute wavelength calibration mypipeline package lamp_calib task mypipeline.lamp_calib Application API Comp-Cont API L. Paioro - Python/C FASE prototype - Marseille, June 2010

Example Of Use 2 Compute wavelength calibration FASE mypipeline package lamp_calib task Comp-Cont API mypipeline.lamp_calib Application API Command Line Application L. Paioro - Python/C FASE prototype - Marseille, June 2010

How Applications/Components Communicate Within FASE INLINE PROFILE  Direct in-process communication Python applications with Python components Python applications with ANSI-C components through SWIG bindings SAMP PROFILE  IVOA SAMP messaging communication From any application to any component Embedded SAMP Hub and Package-Manager daemon L. Paioro - Python/C FASE prototype - Marseille, June 2010

Component-Container Model Components are wrapped by containers implementing a standard set of interfaces which connects them to any framework implementation compliant with the CCM standards Component-containers are packaged together in a standard format which enables them to be deployed within any framework implementation compliant with the packaging standards L. Paioro - Python/C FASE prototype - Marseille, June 2010

The Application Programming Interfaces System API  Shared by applications and computational components to perform generic access to the framework resources and services Component-Container API  Allows to implement a task or tool container and make it executable through the framework Application API  Provides proxies to the computational components in order to access and execute them through the framework L. Paioro - Python/C FASE prototype - Marseille, June 2010

System API (UML) Connect with the framework instance and return references to the main services Load the packages, query their capabilities and create new requests, responses and related psets Service for synchronous and asynchronous invocations Service for events notification and receiving L. Paioro - Python/C FASE prototype - Marseille, June 2010

Component-Container API (UML) Introspection capabilities Single atomic operation Task (IS one operation) and Tool (IS COMPOSED BY several operations) Single atomic operation I/O: -Parameter set -Job ID -Errors L. Paioro - Python/C FASE prototype - Marseille, June 2010

Component-Container API (UML) Collection of parameters Single parameter L. Paioro - Python/C FASE prototype - Marseille, June 2010

Application API (UML) Proxy to the package after loading, allows to get new tasks and tools instances ToolProxy allows to access tool operations and execute them (synch/asynch) TaskProxy to launch a task execution (synch/async) L. Paioro - Python/C FASE prototype - Marseille, June 2010

INLINE Component Container Example: Python Python Task Component L. Paioro - Python/C FASE prototype - Marseille, June 2010

INLINE Component Container Example: Python Python Task INLINE Container Python Task Component L. Paioro - Python/C FASE prototype - Marseille, June 2010

INLINE Component Container Example: Python L. Paioro - Python/C FASE prototype - Marseille, June 2010 OR MAGICAL DECORATION

INLINE Component Container Example: ANSI-C ANSI-C Task Component L. Paioro - Python/C FASE prototype - Marseille, June 2010

INLINE Component Container Example: ANSI-C ANSI-C Task Component ANSI-C Task INLINE Container L. Paioro - Python/C FASE prototype - Marseille, June 2010

The Package Description File Given a package description file, component- containers skeletons can be generated by appropriate tools for any language! L. Paioro - Python/C FASE prototype - Marseille, June 2010

Python Application Example: synchronous and asynchronous L. Paioro - Python/C FASE prototype - Marseille, June 2010

Issues To Be Faced Completion of ANSI-C interfaces  A better FASE errors handling (suitable for multi- threading cases)  Tools handling  Application API Batch execution (OpenPBS) Parallel execution  MPI (multi-process)  OpenMP (multi-threaded)  OpenCL/CUDA (GPU parallel) L. Paioro - Python/C FASE prototype - Marseille, June 2010