Protocols in Workflow. Membership First session –Chair: John Brooke –Note Takers: Raj Bose, Mario Antonioletti –Geoff Lusted –Michael Burns Second Session.

Slides:



Advertisements
Similar presentations
Single sign-on authentication: introduction GWS-WG session, IVOA interop meeting, Kyoto, May 2005 Guy Rixon.
Advertisements

The Grid Job Monitoring Service Luděk Matyska et al. CESNET, z.s.p.o. Prague Czech Republic.
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.
Fujitsu Laboratories of Europe © 2004 What is a (Grid) Resource? Dr. David Snelling Fujitsu Laboratories of Europe W3C TAG - Edinburgh September 20, 2005.
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
GT 4 Security Goals & Plans Sam Meder
Data services on the NGS.
Under the Hood of a Workflow Manager Matthew Shields, BiodiversityWorld GRID workshop, NeSC, 30 June - 1 July T r a ai n.
B. Fairman Sony US Advanced Technologies Center 1 Ubiquitous Video W3C Video on the Web Workshop
Security Daniel Mallmann MWSG meeting Amsterdam December 2005.
VOMS & SAML Valerio Venturi MWSG /6/07. EU project: RIO31844-OMII-EUROPE OMII-Europe OMII-Europe is an EU-funded project which has been established.
Seminar Grid Computing ‘05 Hui Li Sep 19, Overview Brief Introduction Presentations Projects Remarks.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
PROGRESS: ICWS'2003 Web Services Communication within the PROGRESS Grid-Portal Environment Michał Kosiedowski.
The Globus Toolkit Gary Jackson. Introduction The Globus Toolkit is a product of the Globus Alliance ( It is middleware for developing.
6th Biennial Ptolemy Miniconference Berkeley, CA May 12, 2005 Distributed Computing in Kepler Ilkay Altintas Lead, Scientific Workflow Automation Technologies.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
Use of Kerberos-Issued Certificates at Fermilab Kerberos  PKI Translation Matt Crawford & Dane Skow Fermilab.
Copyright B. Wilkinson, This material is the property of Professor Barry Wilkinson (UNC-Charlotte) and is for the sole and exclusive use of the students.
Web Services and OGSA Tal Lavian, Phil Wang. What Are Web Services? ● Conventions for program-to-program Communication ● Built on existing Web infrastructure.
OGSA : Open Grid Services Architecture Ramya Rajagopalan
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
CLIENT A client is an application or system that accesses a service made available by a server. applicationserver.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Why GridFTP? l Performance u Parallel TCP streams, optimal TCP buffer u Non TCP protocol such as UDT u Order of magnitude greater l Cluster-to-cluster.

The ACGT Workflow Editing & Enactment Environment Giorgos Zacharioudakis Institute of Computer Science, Foundation for Research & Technology – Hellas (ICS-FORTH)
1 All-Hands Meeting 2-4 th Sept 2003 e-Science Centre The Data Portal Glen Drinkwater.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
Communicating Security Assertions over the GridFTP Control Channel Rajkumar Kettimuthu 1,2, Liu Wantao 3,4, Frank Siebenlist 1,2 and Ian Foster 1,2,3 1.
Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
LEGS: A WSRF Service to Estimate Latency between Arbitrary Hosts on the Internet R.Vijayprasanth 1, R. Kavithaa 2,3 and Raj Kettimuthu 2,3 1 Coimbatore.
Socket Programming Introduction. Socket Definition A network socket is one endpoint in a two-way communication flow between two programs running over.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Remarks on OGSA and OGSI e-Science All Hands Meeting September Geoffrey Fox, Indiana University.
Access and Query Task Force Status at F2F1 Simon Miles.
Grid technology Security issues Andrey Nifatov A hacker.
Objective What is RFT ? How does it work Architecture of RFT RFT and OGSA Issues Demo Questions.
Net 221D:Computer Networks Fundamentals
Reading TCP/IP Protocol. Training target: Read the following reading materials and use the reading skills mentioned in the passages above. You may also.
1 AHM, 2–4 Sept 2003 e-Science Centre GRID Authorization Framework for CCLRC Data Portal Ananta Manandhar.
1 Service oriented computing Gergely Sipos, Péter Kacsuk
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
Andrew McNab - HTTP/HTTPS extensions HTTP/HTTPS as Grid data transport 6 March 2003 Andrew McNab, University of Manchester
An approach to Web services Management in OGSA environment By Shobhana Kirtane.
Globus Data Storage Interface (DSI) - Enabling Easy Access to Grid Datasets Raj Kettimuthu, ANL and U. Chicago DIALOGUE Workshop August 2, 2005.
The Globus Toolkit The Globus project was started by Ian Foster and Carl Kesselman from Argonne National Labs and USC respectively. The Globus toolkit.
A Sneak Peak of What’s New in Globus GridFTP John Bresnahan Michael Link Raj Kettimuthu (Presenting) Argonne National Laboratory and The University of.
Current Globus Developments Jennifer Schopf, ANL.
LAN Chat server BY: VIPUL GUPTA VIKESH SINGH SUKHDEEP SINGH.
FILE TRANSFER SPEEDS OVER HTTP AND FTP Yibiao Li 06/01/2009 Christmas Meeting 2008/09.
SuperComputing 2003 “The Great Academia / Industry Grid Debate” ?
OGSA Data Architecture WG Data Transfer Discussion
Data services on the NGS
Data Bridge Solving diverse data access in scientific applications
The OGSA Data Architecture
Viet Tran Institute of Informatics Slovakia
University of Virginia, USA GGF9, Chicago, Illinois, US
SDM workshop Strawman report History and Progress and Goal.
Unicore and Standards Dr. David Snelling
Wireless Reliable Messaging Protocol for Web Services (WS-WRM)
Distributed Systems Bina Ramamurthy 4/22/2019 B.Ramamurthy.
Presentation transcript:

Protocols in Workflow

Membership First session –Chair: John Brooke –Note Takers: Raj Bose, Mario Antonioletti –Geoff Lusted –Michael Burns Second Session (above plus) –Peter Furniss –Jon Blower –Denise Ecklund –Martin Craig

Scope What do we mean by a protocol? –SOAP is not sufficient for using large data sets within Web/Grid services context –Concentrate on scientific based workflow –Protocols used to communicate data between activities, e.g. GridFTP, http, ftp, sockets … –Context The context determines some of the detail

Data sources/sinks Databases –accessing –querying –transferring data rates state (of transmission) Streaming –connection (possibly using sockets) –data rates Files & Formats –transferring –state

Control and data protocols We distinguished between protocols to do with workflow and control and protocols to do with data transfer. However the more we looked at it the more we realised that these are inherently linked in scientific workflows. We concentrated for a long time on data transfer between components of the workflow.

Security Issues Trust delegation –Globus model with proxy certificates –Unicore where all activities are pre-signed Static model –Need to specify the level of security of a workflow sub-workflow? whole of the workflow? –Trust chain in the workflow and encapsulation Trust between members in the chain Sometimes it's not the data that needs to be moved but the computation –Algorithms may be commercially sensitive

More Issues Level of encapsulation of the workflow –Level of workflow granularity required of the enactment, e.g. the security/state/type of data transfer between services Push vs Pull data transfer models –Implies an ordering in the process flow Does WS* have the capabilities of expressing everything that people want to do over the Grid –State issues, e.g. status of file transfer tasks.

Even More Issues Provenance Metadata Failure recovery/notification The issues here are to do with how far into the workflow protocols should these considerations extend. They are often built on lower level protocols which are built on lower level etc.. As in Simons fleas.

Next steps?? Need to examine more workflows, looked at OGSA-DAI, Unicore, GADS data serving web service but there are any more. We suggest that the issues of transfer of very large amounts of data in different ways is a differentiating area for scientific workflows. Security is also viewed differently so should look at this. Considerable overlap with concerns of other breakout groups.