Bridging VO and the GRID (a successful experience) Giuliano Taffoni INAF - OATs Trieste Italy

IVOA Meeting - 6 October 2005 People F. Pasian R. Smareglia C. Vuerli A.Barisani E. Ambrosi (INFN) A. Ghiselli (INFN)

IVOA Meeting - 6 October 2005 The Virtual Observatory Access to archives and catalogues DB geographically distributed and heterogeneous; Common standards; Interoperability; Data exchange, analysis, simulations….

IVOA Meeting - 6 October 2005 The Virtual Observatory Virtual Observatory is a GRID Data and Service Grid

IVOA Meeting - 6 October 2005 THE GRID Keywords are: Batch system File system Wide area network Computational and Storage grid Access to computational and storage resources: Cluster geographically distributed and heterogeneous; Security: GSI and certificates; Data access and replication.

IVOA Meeting - 6 October 2005 THE GRID is… Computing power and data storage on demand

IVOA Meeting - 6 October 2005 THE GRID in the World EGEE: Europe + south America + Asia Gridbus Doe,Legion NAREGI, BioGrid ….and many others. ~ CPUs and ~ 500 Tflops ~ 100 PB

IVOA Meeting - 6 October 2005 Grid and VO GRID VO

IVOA Meeting - 6 October 2005 Why and Who Data analysis “virtual data” simulated data; theoretical data; Grid Astronomers Italian projects: GRID.it or DRACO German… Stored or on demand

IVOA Meeting - 6 October 2005 Two-way approach Two approaches: From VO into a Grid (CEA) From the GRID into VO. Equally valid: both present problems and advantages;

IVOA Meeting - 6 October 2005

Solutions? Different approaches: OGSA-DAI (GT4) WS-RF DataGrid spitfire :-( EGEE Fireman ? Etc….

IVOA Meeting - 6 October 2005 The query element New Calculus capabilities for GridNode (Inference, Query, Reasoning ) as now binary code execution. New Fabric-Element for Computing(RDBMS, REASONING SYSTEM) as now LSF, PBS etc Developed with EGEE/LCG people at INFN/CNAF Interoperability with OGSA-DAI. GRID Replica and storage capabilities (lcg-fc) NOT only astronomical community! QE: a low level integration framework.

IVOA Meeting - 6 October 2005

GRID to VO Extending Glue to describe RDBMS DB Resource. Use case: astroDB-source-engine: IVOA standards: VOResource VOQL Verify the ability of the GIS to act as VObs Resource: resource localization/description; Astronomical Resource XSD => Astronomical Resource GLUE; BDII ~= Registry Query Language for Registry => ClassAD Requirements; VOQL (XML) query;

IVOA Meeting - 6 October 2005 Exe= query Requir= VOResourc e JDL RB QE MDS BDII Jdl2ClassAD Grid Info System ~Registry GlueAstroIdentity = Identifier GlueAstroPublisher=Curation.P ublisher GlueAstroCreator=Curation.Cr eator.Name ETC… g ……..… GRIS List of Available resources Integration schema of the IVOA Resource in the Grid Info System. GlueSchema IVOA compliant info set, based on new information providers. GlueSchema IVOA compliant info set, based on new information providers. VO resource

IVOA Meeting - 6 October 2005 Grid Services query exec QE Query (VOQL) CE exec Query(VOQL) CE exec API for applications: work in progress. IVOA Query (VOQL) exec IVOA Resource IVOA Registry Internet Joining VO and Grid: from the Grid to VO.

IVOA Meeting - 6 October 2005 Summing up We have a QE We merge IVOA and GRID standards. We reach VORes. from the GRID (using GRID native services: security etc.) Query workflows (unstable) We extend the BDII We test distributed GRID Archives Interaction with GFS (lcf file catalog) Working on distributed DBs (DUROC) Working on API for applications

IVOA Meeting - 6 October 2005 Thank for your patience!