San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure SRB + Web Services = Datagrid Management System (DGMS) Arcot Rajasekar (Arun Jagatheesan) San Diego Supercomputer Center

National Partnership for Advanced Computational Infrastructure Outline SRB WSDL-based Services: What do we plan to accomplish? Why are we doing this? How do we plan to reach our goals? Design, Arch, Implementation Who is doing this? When? What are our timelines

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure What? SRB = Storage Resource Broker + MCAT Transparent access to distributed storage and services Used and proven technology More than 3 years of deployment over 2 dozen projects Mol Sci, Neuro Sci, Astronomy, Med, ESS, DigLibs, … ~18 TB of data handled until last year >7 million files Multiple Access Methods – APIs, GUIs, Commands, Web-HTTP Developed at SDSC/NPACI

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure Why SRB WSDL Services  Universal DataGrid Services Emergence of Service oriented architectures To be compliant with the Grid Requirements SRB as a Grid Component SRB as a Commodity service Data Management as a service in the Grid Project-driven TeraGrid, NVO, PPDG, GriPhyN, SCEC, … BIRN, RoadNet, IT2,... Loose coupling, interoperability, standards based.

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure 1 Min Tutorial Web Page (HTML) Searched and used by human being Any computer Web Service Searched and used by computer programs Any programming language, OS etc HTML HTTP Google XML/ WSDL – Web Service Description SOAP (HTTP/SMTP) – Transport/Acces UDDI - Discover WSDL SOAP (HTTP/SMTP) UDDI

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure How - Design SRB = Command Channel + Data Channel Protocol = set of rules for end points to communicate with each other SRB Web services – Protocol for exchange of SRB Command Channel ONLY. Client flexibility to choose any protocol (SRB- RPC, FTP, GFTP, HTTP) for local data channel Internal Data grid operations like replication – always SRB-RPC

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure How – Design II All or nothing (Atomic) Value addition - Services apart from original SRB Services Asynchronous – UUID based sessions Session and event management WSCAT – (We ♥ databases?), Status Query Service Security – CA, HTTPS, GSI-SOAP etc., Open protocol for SRB Web services client. Each operation a service – not a single aggregated SRB Web service.

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure How - Architecture WSDL- DataGrid SOAP Server SRB service bean Java Native Interface SRB Native Methods JDBC Transaction or Event Database SRB Server Query Interface and Trigger Mechanism Service Publisher and WSDL documents JasmineGridFTPSRM Any DBMS or Data Manager Current Implementation. Will change soon.

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure Issues + Status SOAP client interoperability Asynchronous call – Management (UUID??) Usage of Some preliminary version of WSDL Ingest File to Grid, srbOperations. Core Datagrid Operations Document in creation Schemas for Datagrids

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure Who SDSC DAKS/NPACI DICE SDSC GridPortal Group Related Work: Jlab LBNL … We plan to collaborate to get a common service definitions

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure When First Version (GGF5): Data Movement Functions Put, Get and Replicate Second Version (Jan 2003): Data Discovery Query, Browse, Attach Metadata, Extract Metadata,… Other Versions ( ): More SRB functions exposed through WSDL framework After That : Layers 

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure What lies ahead? Layers Data Management Services Data Mining Services Knowledge Management & Information Mediation Services