DGC Paris 6.03.02 WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.

Slides:



Advertisements
Similar presentations
1 WP2: Data Management Paul Millar eScience All Hands Meeting September
Advertisements

WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.
WP2: Data Management Gavin McCance University of Glasgow.
Data Management Expert Panel - WP2. WP2 Overview.
Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
DGC Paris Community Authorization Service (CAS) and EDG Presentation by the Globus CAS team & Peter Kunszt, WP2.
Distributed Heterogeneous Data Warehouse For Grid Analysis
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Title – n° 1 Grid Data Management in Action Experience in Running and.
GGF Toronto Spitfire A Relational DB Service for the Grid Peter Z. Kunszt European DataGrid Data Management CERN Database Group.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
CS CS 5150 Software Engineering Lecture 13 System Architecture and Design 1.
Security Mechanisms The European DataGrid Project Team
UMIACS PAWN, LPE, and GRASP data grids Mike Smorul.
Data Grid Web Services Chip Watson Jie Chen, Ying Chen, Bryan Hess, Walt Akers.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
Andrew McNab - Manchester HEP - 26 June 2001 WG-H / Support status Packaging / RPM’s UK + EU DG CA’s central grid-users file grid “ping”
Digital Object Architecture
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
第十四章 J2EE 入门 Introduction What is J2EE ?
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Next Generation Data Mgmt... – n° 1 James Casey CERN
VOX Project Status T. Levshina. Talk Overview VOX Status –Registration –Globus callouts/Plug-ins –LRAS –SAZ Collaboration with VOMS EDG team Preparation.
Shibboleth: Installation and Deployment Scott Cantor July 29, 2002 Scott Cantor July 29, 2002.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
INFNGrid Constanza Project: Status Report A.Domenici, F.Donno, L.Iannone, G.Pucciani, H.Stockinger CNAF, 6 December 2004 WP3-WP5 FIRB meeting.
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Author - Title- Date - n° 1 Partner Logo WP5 Summary Paris John Gordon WP5 6th March 2002.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
Shibboleth: Installation and Deployment Scott Cantor July 29, 2002 Scott Cantor July 29, 2002.
Replica Management Services in the European DataGrid Project Work Package 2 European DataGrid.
LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
Data Management GridPP and EDG Gavin McCance University of Glasgow May 9, 2002
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
Worldwide Protein Data Bank wwPDB Common D&A Project November 24, 2009 November 24, 2009 Steering Committee Project Update.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
Data Management The European DataGrid Project Team
Ákos FROHNER – DataGrid Security n° 1 Security Group TODO
STAR Scheduling status Gabriele Carcassi 9 September 2002.
DGC Paris Spitfire A Relational DB Service for the Grid Leanne Guy Peter Z. Kunszt Gavin McCance William Bell European DataGrid Data Management.
1 P.Kunszt C EU DataGrid Data Management Workpackage : WP2 Status and Plans Peter Z Kunszt IT/DB
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL DOE/NSF Review of US LHC Software and Computing Fermilab Nov 29, 2001.
WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.
Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
Current Globus Developments Jennifer Schopf, ANL.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
Storage Element Security Jens G Jensen, WP5 Barcelona, May 2003.
Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,
Overview of the New Security Model Akos Frohner (CERN) WP8 Meeting VI DataGRID Conference Barcelone, May 2003.
October 2014 HYBRIS ARCHITECTURE & TECHNOLOGY 01 OVERVIEW.
StoRM: a SRM solution for disk based storage systems
Grid Portal Services IeSE (the Integrated e-Science Environment)
Data Management cluster summary
Patrick Dreher Research Scientist & Associate Director
Presentation transcript:

DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team

DGC Paris Current Status All components delivered to Testbed Release GDMP: Immediate problems have been resolved for Release – thanks to the GDMP team! (Heinz, Shahzad, Flavia, Aleksandr, Andrea) Planning for next releases have been worked out in detail for all our components. Documentation for our new components will be available soon. Collaboration with Globus on the new Replica Catalog is progressing well and is on track. Coordination with other work packages: our relationships and dependencies are being worked on and many issues were resolved and we uncovered new ones. Input for the new Architecture Group!

DGC Paris Sessions WP2 session Monday afternoon –It took us 1 hour to find the room IPSL-Jussieux!! –Planning and Discussion on all 4 WP2 Tasks –Presentations on Replication, Optimization, Security and Metadata Management (see details below). WP2/3 session Tuesday morning –Presentation of Spitfire’s security mechanism and of R-GMA architecture with focus on the RDBMS backend –Discussion on Security requirements of monitoring. –Agreement on the component dependencies: R-GMA relies on the security infrastructure provided by Spitfire. –Agreement on external package dependencies.

DGC Paris Sessions WP2/1/7 session Tuesday afternoon –For Query Optimization we need a getAccessCost function from WP7 which gives the estimated cost of transfer between two sites. –WP7 has agreed to provide this C++ API. WP2/5 session Tuesday afternoon/Wednesday morning –Security issues: the Replica Manager will be given the administrative rights to the files it manages, ‘owner’ is an attribute to the file. –Discussion how concept of master/secondary copy in replication maps to permanent/durable/volatile files in SE –Discussion on interfaces to the SE: see John’s talk –Open issue: how tightly are RM and SE coupled?

DGC Paris Summary of Plans GDMP v3.0 will be the LAST release of GDMP as we know it. GDMP in the future will rely on the Replica Manager and provide the subscription based mirroring functionality. It will be implemented as a web service. The Replica Catalog will be replaced with the Giggle framework, jointly developed with Globus. The Replica Manager will take over most of GDMPs current functionality and will be a web service. We provide client APIs. All user interaction should go through the RM. Spitfire will have both an XML over http access method for static queries and a SOAP interface. Security infrastructure for all services in place as presented.

DGC Paris Architecture

DGC Paris Planning Release 1.2 (end of March) GDMP version 3.0 –Support for multiple VOs –New security mechanism for server and clients –Client-server functionality –simple C++ API –some new client commands –preliminary space management (needs to be done by SE later) Replica Manager –First version is a simple wrapper around existing Globus replica manager –Core API as defined in Replica Manager Design Document will be implemented C++ as well as command line tool Replication

DGC Paris Planning Release 1.2 (end of March) Replica Catalog –GUI and command line tool for existing RC Available to the production testbed –Introduce a proposed security patch for RC –Collaboration with Globus and PPDG on new, distributed Replica Catalog Framework (Giggle) joint development with Globus is running and testable by interested applications Internal release For expert users only Replication cont.

DGC Paris Planning Release 1.2 (end of March) Integrated XSQL-Spitfire : all security works XSQL version of a Replica MetaData Catalog Installation decoupled from Tomcat & MySQL SOAP interfaces designed and we have a basic understanding of the technology Working prototype of Simulator ALL : Documentation on API available Spitfire & Security Optimization

DGC Paris Planning Release 1.3 (end of May) Alpha release of SOAP interface Test-suite designed, unit tests implemented Test-driven by Biology Applications Replica Manager –Core API implemented –Core API also can use Giggle framework –Simulator integrated as optimization API; alpha RLS framework (Giggle) –Working Beta, can be used by non-expert users Spitfire & Security Replication & Optimization

DGC Paris Planning Release 1.4 (end of July) Replica Manager integrated with Giggle and Replica Metadata Catalog according to the Web Service Paradigm Working solution for enforcing a unique LFN Improvements on optimization API Replication & Optimization

DGC Paris Planning Release 1.4 (end of July) Beta1, all functionality available Security fully integrated Installation works with more than just Tomcat and MySQL Test-suite completely implemented Working Replication Metadata Catalog using this Beta –Some integration with replica manager Working Bio-App. Spitfire & Security

DGC Paris Planning Testbed 2 (end of September) Full integration of all components Plans for more applications

DGC Paris Security Mechanism Servlet Container SSLServletSocketFactory TrustManager Security Servlet Does user specify role? Map role to connection id Authorization Module HTTP + SSL Request + client certificate Yes Role Trusted CAs Is certificate signed by a trusted CA? No Has certificate been revoked? Revoked Certs repository Find default No Role repository Role ok? Connection mappings Translator Servlet RDBMS Request and connection ID Connection Pool