Database Readiness Workshop Intro & Goals

Slides:



Advertisements
Similar presentations
CERN - IT Department CH-1211 Genève 23 Switzerland t LCG Persistency Framework CORAL, POOL, COOL – Status and Outlook A. Valassi, R. Basset,
Advertisements

CERN - IT Department CH-1211 Genève 23 Switzerland t Relational Databases for the LHC Computing Grid The LCG Distributed Database Deployment.
Ian M. Fisk Fermilab February 23, Global Schedule External Items ➨ gLite 3.0 is released for pre-production in mid-April ➨ gLite 3.0 is rolled onto.
Database monitoring and service validation Dirk Duellmann CERN IT/PSS and 3D
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
LCG 3D StatusDirk Duellmann1 LCG 3D Throughput Tests Scheduled for May - extended until end of June –Use the production database clusters at tier 1 and.
LCG Database Workshop Summary and Proposal for the First Distributed Production Phase Dirk Duellmann, CERN IT (For the LCG 3D Project :
RLS Tier-1 Deployment James Casey, PPARC-LCG Fellow, CERN 10 th GridPP Meeting, CERN, 3 rd June 2004.
ATLAS Metrics for CCRC’08 Database Milestones WLCG CCRC'08 Post-Mortem Workshop CERN, Geneva, Switzerland June 12-13, 2008 Alexandre Vaniachine.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
Databases Technologies and Distribution Techniques Dirk Duellmann, CERN HEPiX, Rome, April 4th 2006.
Workshop Summary (my impressions at least) Dirk Duellmann, CERN IT LCG Database Deployment & Persistency Workshop.
LCG 3D Project Status and Production Plans Dirk Duellmann, CERN IT On behalf of the LCG 3D project CHEP 2006, 15th February, Mumbai.
CHEP 2006, Mumbai13-Feb-2006 LCG Conditions Database Project COOL Development and Deployment: Status and Plans Andrea Valassi On behalf of the COOL.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
Database Administrator RAL Proposed Workshop Goals Dirk Duellmann, CERN.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
3D Workshop Outline & Goals Dirk Düllmann, CERN IT More details at
LCG Service Challenges: Planning for Tier2 Sites Update for HEPiX meeting Jamie Shiers IT-GD, CERN.
CERN - IT Department CH-1211 Genève 23 Switzerland t COOL Conditions Database for the LHC Experiments Development and Deployment Status Andrea.
CERN-IT Oracle Database Physics Services Maria Girone, IT-DB 13 December 2004.
Database Readiness Workshop Summary Dirk Duellmann, CERN IT For the LCG 3D project SC4 / pilot WLCG Service Workshop.
SC4 Planning Planning for the Initial LCG Service September 2005.
Database authentication in CORAL and COOL Database authentication in CORAL and COOL Giacomo Govi Giacomo Govi CERN IT/PSS CERN IT/PSS On behalf of the.
Oracle for Physics Services and Support Levels Maria Girone, IT-ADC 24 January 2005.
3D Project Status Dirk Duellmann, CERN IT For the LCG 3D project Meeting with LHCC Referees, March 21st 06.
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.
LCG Distributed Databases Deployment – Kickoff Workshop Dec Database Lookup Service Kuba Zajączkowski Chi-Wei Wang.
CERN IT Department CH-1211 Geneva 23 Switzerland t WLCG Operation Coordination Luca Canali (for IT-DB) Oracle Upgrades.
LCG 3D Project Update (given to LCG MB this Monday) Dirk Duellmann CERN IT/PSS and 3D
Maria Girone CERN - IT Tier0 plans and security and backup policy proposals Maria Girone, CERN IT-PSS.
LCG Service Challenges SC2 Goals Jamie Shiers, CERN-IT-GD 24 February 2005.
CORAL CORAL a software system for vendor-neutral access to relational databases Ioannis Papadopoulos, Radoval Chytracek, Dirk Düllmann, Giacomo Govi, Yulia.
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
Site Services and Policies Summary Dirk Düllmann, CERN IT More details at
Status of tests in the LCG 3D database testbed Eva Dafonte Pérez LCG Database Deployment and Persistency Workshop.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
Database Project Milestones (+ few status slides) Dirk Duellmann, CERN IT-PSS (
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
Summary of SC4 Disk-Disk Transfers LCG MB, April Jamie Shiers, CERN.
A quick summary and some ideas for the 2005 work plan Dirk Düllmann, CERN IT More details at
Storage & Database Team Activity Report INFN CNAF,
2007 Workshop on INFN ComputingRimini, 7 May 2007 Conditions Database Service implications at Tier1 and Tier2 sites Andrea Valassi (CERN IT-PSS)
CERN - IT Department CH-1211 Genève 23 Switzerland t Service Level & Responsibilities Dirk Düllmann LCG 3D Database Workshop September,
Operations Workshop Introduction and Goals Markus Schulz, Ian Bird Bologna 24 th May 2005.
INFN Tier1/Tier2 Cloud WorkshopCNAF, 22 November 2006 Conditions Database Services How to implement the local replicas at Tier1 and Tier2 sites Andrea.
Database Readiness Workshop Summary Dirk Duellmann, CERN IT For the LCG 3D project GDB meeting, March 8th 06.
WLCG IPv6 deployment strategy
Status of Distributed Databases (LCG 3D)
Dirk Duellmann CERN IT/PSS and 3D
Database Replication and Monitoring
LCG Service Challenge: Planning and Milestones
LCG 3D Project Update for the meeting with the LHCC referees
(on behalf of the POOL team)
LCG 3D Distributed Deployment of Databases
Database Services at CERN Status Update
3D Application Tests Application test proposals
Grid Deployment Area Status Report
Elizabeth Gallas - Oxford ADC Weekly September 13, 2011
Dirk Düllmann CERN Openlab storage workshop 17th March 2003
Conditions Data access using FroNTier Squid cache Server
Workshop Summary Dirk Duellmann.
LHCb Conditions Database TEG Workshop 7 November 2011 Marco Clemencic
LHC Data Analysis using a worldwide computing grid
LHCb status and plans Ph.Charpentier CERN.
Dirk Duellmann ~~~ WLCG Management Board, 27th July 2010
The LHCb Computing Data Challenge DC06
Presentation transcript:

Database Readiness Workshop Intro & Goals Dirk Duellmann, CERN IT & LCG

LCG Database Deployment Plan After last workshop a database deployment plan has been presented to LCG GDB and MB http://agenda.cern.ch/fullAgenda.php?ida=a057112 Two production phases March - Sept ‘06 : partial production service Production service (parallel to existing testbed) H/W requirements defined by experiments/projects Based on Oracle 10gR2 Subset of LCG tier 1 sites: ASCC, CERN, BNL, CNAF, GridKA, IN2P3, RAL Sept ‘06- onwards : full production service Adjusted h/w requirements (defined at summer ‘06 workshop) Other tier 1 sites joined in: PIC, NIKHEF, NDG, TRIUMF Database Readiness Workshop - Intro & Goals Dirk Duellmann

LCG Application s/w Status COOL and POOL have released versions based on CORAL Includes re-try and failover required for reliable db service use These features need be tested for experiment POOL includes production version FroNTier plug-in Control of SQUID caching may still be required to implement more realistic caching policies These releases (or bug fixes) are target for 2006 deployment LCG s/w expected to be stable by end of February for distributed deployment as part of SC4 or experiment challenges Caveats: COOL still has important functionality items on the development plan for this year Conditions schema stability will need careful planning for COOL and FroNTier Database Readiness Workshop - Intro & Goals Dirk Duellmann

Coming up during the year Discussion with BARC and LFC team on LFC based implementation of a database lookup service Work plan proposal aiming at a working prototype by end of April Until summer: xml based catalogs for resolution of logical database connections Security and LCG certificate integration No real progress in this area - asked Oracle to confirm their support for proxy certificates Need working solution (or fallback) by summer! Database Readiness Workshop - Intro & Goals Dirk Duellmann

This workshop Readiness of the production services at T0/T1 status reports from tier 0 and tier 1 sites technical problems with the proposed setup (RAC clusters)? open questions from sites to experiments? Readiness of experiment (and grid) database applications Application list, code release, data model and deployment schedule Successful validation at T0 and (if required T1)? Any new deployment problems seen by experiment users which need a service change Define site/experiment milestones for database project plan (Re-)align with other work plans - eg experiment challenges, SC4 Report will be given to pre-CHEP workshop Database Readiness Workshop - Intro & Goals Dirk Duellmann

Workshop Scope Define LCG Database service at Tier 0 and Tier 1 H/w and s/w setup at both tiers Data replication/distribution techniques between tiers and database users (streams and frontier) Not all projects and sites will be represented today Grid Middleware and Castor Will present plans during upcoming pre-CHEP workshop LFC, FTS, VOMS - LFC and VOMS replication plans? Castor - local site services ASCC Clash with local vacation period, need to strengthen contact Database Readiness Workshop - Intro & Goals Dirk Duellmann

Application Deployment Tests & Conclusions Still quite a few tests are ongoing Online -> Offline -> Tier 1 Service and access pattern validation tests will need to continue Eg after requirement, software or service changes Should keep the 3D test bed setup available Can we conclude on “replication technology tests”? Propose to prepare Streams and FroNTier write-up Will ask for input from people responsible for tests Proposed target for completion: summer workshop Database Readiness Workshop - Intro & Goals Dirk Duellmann