Tier1 Databases GridPP Review 20 th June 2012 Richard Sinclair Database Services Team Leader.

Slides:

Advertisements

Similar presentations

Hardware Reliability at the RAL Tier1 Gareth Smith 16 th September 2011.

Advertisements

Storage Review David Britton,21/Nov/ /03/2014 One Year Ago Time Line Apr-09 Jan-09 Oct-08 Jul-08 Apr-08 Jan-08 Oct-07 OC Data? Oversight.

Project Status David Britton,15/Dec/ Outline Programmatic Review Outcome CCRC08 LHC Schedule Changes Service Resilience CASTOR Current Status Project.

RAL Tier1 Operations Andrew Sansum 18 th April 2012.

Metadata Progress GridPP18 20 March 2007 Mike Kenyon.

January 6. January 7 January 8 January 9 January 10.

DSG Database Administration Projects Presentation July 09, 2003 CD Projects Status Meeting.

CERN - IT Department CH-1211 Genève 23 Switzerland t LCG Persistency Framework CORAL, POOL, COOL – Status and Outlook A. Valassi, R. Basset,

Migrating CRISTAL from Objectivity to RDBMS Andrew Branson University of the West of England CERN, 13/01/2014.

12. March 2003Bernd Panzer-Steindel, CERN/IT1 LCG Fabric status

Objectivity Data Migration Marcin Nowak, CERN Database Group, CHEP 2003 March , La Jolla, California.

Oracle 10g Database Administrator: Implementation and Administration Chapter 14 Proactive Maintenance.

Hardware Upgrade Project George Palios. Contents Outlines the activities undertaken to upgrade the hardware for the Revenues, Benefits and NNDR Systems.

Tier1 Site Report HEPSysMan, RAL June 2010 Martin Bly, STFC-RAL.

LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.

LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.

Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status Tony Cass (With thanks to Miguel Coelho dos Santos & Alex Iribarren) LCG-LHCC.

CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.

CERN IT Department CH-1211 Genève 23 Switzerland t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.

RAL Site Report Castor F2F, CERN Matthew Viljoen.

ATLAS Metrics for CCRC’08 Database Milestones WLCG CCRC'08 Post-Mortem Workshop CERN, Geneva, Switzerland June 12-13, 2008 Alexandre Vaniachine.

Operation of CASTOR at RAL Tier1 Review November 2007 Bonny Strong.

1 24x7 support status and plans at PIC Gonzalo Merino WLCG MB

Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Drupal Database Selection Tim Bell 6 th June.

Workshop Summary (my impressions at least) Dirk Duellmann, CERN IT LCG Database Deployment & Persistency Workshop.

OSG Area Coordinator’s Report: Workload Management April 20 th, 2011 Maxim Potekhin BNL

GridPP3 Project Management GridPP20 Sarah Pearce 11 March 2008.

ATLAS in LHCC report from ATLAS –ATLAS Distributed Computing has been working at large scale Thanks to great efforts from shifters.

CERN Physics Database Services and Plans Maria Girone, CERN-IT

1 Given the following data, calculate forecasts for months April through June using a three- month moving average and an exponential smoothing forecast.

RAL Site Report Castor Face-to-Face meeting September 2014 Rob Appleyard, Shaun de Witt, Juan Sierra.

CD FY10 Budget and Tactical Plan Review FY10 Tactical Plans for Database Services Nelly Stanfield October 7, 2009 Database Services3425-v1.

WLCG Service Report ~~~ WLCG Management Board, 9 th August

Alberto Aimar CERN – LCG1 Reliability Reports – May 2007

CASTOR evolution Presentation to HEPiX 2003, Vancouver 20/10/2003 Jean-Damien Durand, CERN-IT.

CERN-IT Oracle Database Physics Services Maria Girone, IT-DB 13 December 2004.

Grid Deployment Enabling Grids for E-sciencE BDII 2171 LDAP 2172 LDAP 2173 LDAP 2170 Port Fwd Update DB & Modify DB 2170 Port.

CERN - IT Department CH-1211 Genève 23 Switzerland Tier-0 CCRC’08 May Post-Mortem Miguel Santos Ricardo Silva IT-FIO-FS.

INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.

CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,

Database Competence Centre openlab Major Review Meeting nd February 2012 Maaike Limper Zbigniew Baranowski Luigi Gallerani Mariusz Piorkowski Anton.

SunSatFriThursWedTuesMon January

Greenlight Presentation Oracle 11g Upgrade February 16, 2012.

VISION & CHANDLER MIGRATION 10/03/2013. Executive Summary Last year we requested several critical Vision enhancements immediately post go-live.

Tier-1 Andrew Sansum Deployment Board 12 July 2007.

Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.

CERN IT Department CH-1211 Geneva 23 Switzerland t WLCG Operation Coordination Luca Canali (for IT-DB) Oracle Upgrades.

WLCG Service Report ~~~ WLCG Management Board, 16 th September 2008 Minutes from daily meetings.

RAL Database services Oracle Oracle Oracle / / (SE) Oracle MySQL 5.0 MySQL 5.5 MySQL 5.6 (in test) ElasticSearch.

CERN IT Department CH-1211 Geneva 23 Switzerland t Eva Dafonte Perez IT-DB Database Replication, Backup and Archiving.

GridPP storage status update Joint GridPP Board Deployment User Experiment Update Support Team, Imperial 12 July 2007,

U.S. ATLAS Facility Planning U.S. ATLAS Tier-2 & Tier-3 Meeting at SLAC 30 November 2007.

WLCG critical services update Andrea Sciabà WLCG operations coordination meeting December 18, 2014.

8 August 2006MB Report on Status and Progress of SC4 activities 1 MB (Snapshot) Report on Status and Progress of SC4 activities A weekly report is gathered.

WLCG Service Report Jean-Philippe Baud ~~~ WLCG Management Board, 24 th August

WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.

WLCG Collaboration Workshop 21 – 25 April 2008, CERN Remaining preparations GDB, 2 nd April 2008.

Storage & Database Team Activity Report INFN CNAF,

DB Questions and Answers open session (comments during session) WLCG Collaboration Workshop, CERN Geneva, 24 of April 2008.

3D Application Tests Application test proposals

Elizabeth Gallas - Oxford ADC Weekly September 13, 2011

Database Readiness Workshop Intro & Goals

CASTOR-SRM Status GridPP NeSC SRM workshop

Savannah to Jira Migration

CTA: CERN Tape Archive Adding front-ends and back-ends Status report

GridPP Tier1 Review Fabric

LHCb Conditions Database TEG Workshop 7 November 2011 Marco Clemencic

SHARE Special Project Enterprise Learning Management Pilot Project Planning/Implementation Certification December 17, 2014 Requesting Agency: Cassandra.

Presentation transcript:

Tier1 Databases GridPP Review 20 th June 2012 Richard Sinclair Database Services Team Leader

Highlights CASTOR Hardware Refresh –Improved Performance –Data Guard Standby Systems 3D Systems Upgraded to 11g –Successful Despite Going First –Guiding of Other Sites Smooth Running of non-CASTOR DB’s Improved Metric Collection and Reporting

Non-CASTOR Availability 2011 ServiceAvailability (%) LFC/FTS99.68 ATLAS 3D99.79 LHCB 3D99.82 ATLAS TAGS99.83

Non-CASTOR Availability 2012 ServiceAvailability (%) LFC/FTS98.79 ATLAS 3D99.92 LHCB 3D99.91 ATLAS TAGS99.94 CASTOR99.1 NOTE: CASTOR Figures Post Migration (March – June)

CASTOR Throughput Average Transactions Per Second

Lowlights CASTOR DB Performance Before Hardware Refresh –Particularly bad during January and February 2012 –Had Reached the Limit of Hardware Capability –Interim Configuration Performed Poorly –Required Frequent Manual Tuning Delays in Implementing Migration Plan –Hardware Problems Delayed Initial Deployment Move of ATLAS LFC to CERN

Database Migration Plan Started Testing Summer Step Process (Tracked by Change Control Meetings) Aims: –Refresh Hardware –Provide Off Site Resilience –Simplify Database Architecture –Improve Performance

Plans for 2012 Complete Database Migration Retirement of Oracle 10g Systems Refresh Testing and Development Kit Introduce Standby Systems for Tier1 MySQL Databases Investigate Non-Oracle Solutions for More Services Potential Retirement of LHCB 3D, LFC