LCG 3D Distributed Deployment of Databases Barbara Martelli

INFN-GRID Technical Board 16/02/2005 LCG 3D Project Goals Define an LCG distributed database service allowing LCG applications to find relevant database back-ends authenticate use the provided data in a consistent location independent way Avoid the costly parallel development of data distribution backup procedures high availability mechanisms in each grid site in order to limit the support costs. INFN-GRID Technical Board 16/02/2005

INFN-GRID Technical Board 16/02/2005 Why LCG 3D LCG provides an infrastructure for distributed access to file based data and data replication Physics applications (and Grid services) require a similar infrastructure for data stored in relational databases Need for some standardisation as part of LCG Need to bring service providers (site technology experts) closer to database users/developers to define a LCG database service for the upcoming data challenges in 2005 INFN-GRID Technical Board 16/02/2005

Database Service Structure Different requirements and service capabilities for different Tiers Database Backbone (Tier1 <-> Tier1) High volume, often complete replication of RDBMS data Can expect good, but not continuous network connection to other T1 sites Symmetric, possibly multi-master replication Large scale central database service, local dba team Tier1 <->Tier2 Medium volume, sliced extraction of data Asymmetric, possibly only uni-directional replication Part time administration (shared with fabric administration) Tier1/2 <->Tier4 (Laptop extraction) Support fully disconnected operation Low volume, sliced extraction from T1/T2 Need a catalog of implementation/distribution technologies Each addressing parts of the problem But all together forming a consistent distribution model INFN-GRID Technical Board 16/02/2005

M M O O M O M T0 T3/4 T1- db back bone T2 - local db cache - autonomous T3/4 T1- db back bone - all data replicated - reliable service T2 - local db cache -subset data -only local service O M O M Oracle Streams Cross vendor extract MySQL Files Proxy Cache

INFN-GRID Technical Board 16/02/2005 Project Structure WP1 - Data Inventory and Distribution Requirements Define a complete inventory of RDBMS data and applications foreseen by the experiment computing models Feed back to the software development process the proposed distribution model WP2 - Database Service Definition and Implementation represent the service infrastructure of the particular site contribute to the definition of a common database and distribution service which is provided to worker node and grid service applications WP3 - Evaluation Tasks define an evaluation plan for a particular technology which is used to implement part of the 3d distribution infrastructure setup a prototype system for the particular technology and compare the prototype performance with the requirements delivered by the WP1 summarise the outcome of a evaluation in a short technology evaluation document INFN-GRID Technical Board 16/02/2005

INFN-GRID Technical Board 16/02/2005 CNAF Contribute to 3D Personnel Barbara Martelli Elisabetta Vilucchi Simone Dalla Fina (INFN - PD) HW resources 4 machines (2 dual PIII 2,4 GHz, 512 MB RAM with two 60 GB disks, 2 dual Intel Xeon 2,4 GHz with HyperThreading, 512 MB RAM with two 60 GB disks) 1TB storage accessible via SAN One machine at INFN-Padua (Dual PIII 1,3 GHz, 1GB RAM, two 60 GB disks) INFN-GRID Technical Board 16/02/2005

CNAF Planned Activities Q1 CNAF is in the first set of sites which will join 3D testbed (before the end of March) Install and test Oracle 10g Initial setup and distribution tests using Oracle Streams technology Setup Oracle Enterprise Manager for testbed and evaluate suitability for shared administration in WAN INFN-GRID Technical Board 16/02/2005

CNAF Planned Activities Q2 Introduce new applications into 3D testbed Distribute applications and workload as defined by experiments Run distributed tests and test data distribution as required by experiments Test of RAC setup INFN-GRID Technical Board 16/02/2005

CNAF Planned Activities Q3 Final version of 3D service definition and service implementation documents Installation of T1 production setup Need the testbed to stay available for ongoing integration INFN-GRID Technical Board 16/02/2005

CNAF Planned Activities Q4 Starting production deployment of distributed service According to experiment deployment plans INFN-GRID Technical Board 16/02/2005

INFN-GRID Technical Board 16/02/2005 Contacts and Links Barbara Martelli barbara.martelli@cnaf.infn.it Elisabetta Vilucchi elisabetta.vilucchi@cnaf.infn.it Simone Dalla Fina dfina@pd.infn.it http://lcg3d.cern.ch INFN-GRID Technical Board 16/02/2005