BNL ATLAS Database service update Yuri Smirnov, Iris Wu BNL, USA LCG Database Deployment and Persistency Workshop, CERN, Geneva October 17-19, 2005.

Slides:



Advertisements
Similar presentations
LCG Tiziana Ferrari - SC3: INFN installation status report 1 Service Challenge Phase 3: Status report Tiziana Ferrari on behalf of the INFN SC team INFN.
Advertisements

1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
RLS Production Services Maria Girone PPARC-LCG, CERN LCG-POOL and IT-DB Physics Services 10 th GridPP Meeting, CERN, 3 rd June What is the RLS -
IHG (Innsbrucker Hochenergiephysikgruppe) The High Energy – Particle Physics group (IHG) at the Institute for Experimental Physics Innsbruck is involved.
Magda – Manager for grid-based data Wensheng Deng Physics Applications Software group Brookhaven National Laboratory.
BNL Oracle database services status and future plans Carlos Fernando Gamboa RACF Facility Brookhaven National Laboratory, US Distributed Database Operations.
Database monitoring and service validation Dirk Duellmann CERN IT/PSS and 3D
Database Deployment on OSG Yuri Smirnov BNL US ATLAS DDM operations and MC production Workshop, BNL September 28-29, 2006.
ASGC 1 ASGC Site Status 3D CERN. ASGC 2 Outlines Current activity Hardware and software specifications Configuration issues and experience.
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.
ORACLE GOLDENGATE AT CERN
MySQL and GRID Gabriele Carcassi STAR Collaboration 6 May Proposal.
ATLAS Metrics for CCRC’08 Database Milestones WLCG CCRC'08 Post-Mortem Workshop CERN, Geneva, Switzerland June 12-13, 2008 Alexandre Vaniachine.
How to Install and Use the DQ2 User Tools US ATLAS Tier2 workshop at IU June 20, Bloomington, IN Marco Mambelli University of Chicago.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.
BNL Facility Status and Service Challenge 3 Zhenping Liu, Razvan Popescu, Xin Zhao and Dantong Yu USATLAS Computing Facility Brookhaven National Lab.
Workshop Summary (my impressions at least) Dirk Duellmann, CERN IT LCG Database Deployment & Persistency Workshop.
LCG 3D Project Status and Production Plans Dirk Duellmann, CERN IT On behalf of the LCG 3D project CHEP 2006, 15th February, Mumbai.
ATLAS Database Operations Invited talk at the XXI International Symposium on Nuclear Electronics & Computing Varna, Bulgaria, September 2007 Alexandre.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
MAGDA Roger Jones UCL 16 th December RWL Jones, Lancaster University MAGDA  Main authors: Wensheng Deng, Torre Wenaus Wensheng DengTorre WenausWensheng.
BNL Service Challenge 3 Site Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
Grid User Management System Gabriele Carcassi HEPIX October 2004.
Magda Distributed Data Manager Status Torre Wenaus BNL ATLAS Data Challenge Workshop Feb 1, 2002 CERN.
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
ATLAS applications and plans LCG Database Deployment and Persistency Workshop 17-Oct-2005,CERN Stefan Stonjek (Oxford), Torre Wenaus (BNL)
LFC Replication Tests LCG 3D Workshop Barbara Martelli.
Light weight Disk Pool Manager experience and future plans Jean-Philippe Baud, IT-GD, CERN September 2005.
DB Questions and Answers open session Carlos Fernando Gamboa, BNL WLCG Collaboration Workshop, CERN Geneva, April 2008.
BNL Facility Status and Service Challenge 3 HEPiX Karlsruhe, Germany May 9~13, 2005 Zhenping Liu, Razvan Popescu, and Dantong Yu USATLAS/RHIC Computing.
Post-DC2/Rome Production Kaushik De, Mark Sosebee University of Texas at Arlington U.S. Grid Phone Meeting July 13, 2005.
CERN Database Services for the LHC Computing Grid Maria Girone, CERN.
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
BNL Service Challenge 3 Status Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
Site Report: Prague Jiří Chudoba Institute of Physics, Prague WLCG GridKa+T2s Workshop.
BNL Service Challenge 3 Site Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
ATLAS Midwest Tier2 University of Chicago Indiana University Rob Gardner Computation and Enrico Fermi Institutes University of Chicago WLCG Collaboration.
Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.
LCG 3D Project Update (given to LCG MB this Monday) Dirk Duellmann CERN IT/PSS and 3D
Magda Distributed Data Manager Prototype Torre Wenaus BNL September 2001.
Materials for Report about Computing Jiří Chudoba x.y.2006 Institute of Physics, Prague.
BNL Oracle database services status and future plans Carlos Fernando Gamboa, John DeStefano, Dantong Yu Grid Group, RACF Facility Brookhaven National Lab,
Maria Girone CERN - IT Tier0 plans and security and backup policy proposals Maria Girone, CERN IT-PSS.
Grid Technologies for Distributed Database Services 3D Project Meeting CERN, May 19, 2005 A. Vaniachine (ANL)
CNAF Database Service Barbara Martelli CNAF-INFN Elisabetta Vilucchi CNAF-INFN Simone Dalla Fina INFN-Padua.
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL DOE/NSF Review of US LHC Software and Computing Fermilab Nov 29, 2001.
PIC port d’informació científica Luis Diaz (PIC) ‏ Databases services at PIC: review and plans.
Status of tests in the LCG 3D database testbed Eva Dafonte Pérez LCG Database Deployment and Persistency Workshop.
Database Project Milestones (+ few status slides) Dirk Duellmann, CERN IT-PSS (
BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.
Database Access Patterns in ATLAS Computing Model G. Gieraltowski, J. Cranshaw, K. Karr, D. Malon, A. Vaniachine ANL P, Nevski, Yu. Smirnov, T. Wenaus.
Western Tier 2 Site at SLAC Wei Yang US ATLAS Tier 2 Workshop Harvard University August 17-18, 2006.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
ATLAS 3D Requests LCG3D Kickoff Workshop CERN, Geneva, Swizerland December 13, 2004 Alexandre Vaniachine, Jeff Tseng, Andrea Formica.
A quick summary and some ideas for the 2005 work plan Dirk Düllmann, CERN IT More details at
VO Box discussion ATLAS NIKHEF January, 2006 Miguel Branco -
DB Questions and Answers open session (comments during session) WLCG Collaboration Workshop, CERN Geneva, 24 of April 2008.
Dario Barberis: ATLAS DB S&C Week – 3 December Oracle/Frontier and CondDB Consolidation Dario Barberis Genoa University/INFN.
The status of IHEP Beijing Site WLCG Asia-Pacific Workshop Yaodong CHENG IHEP, China 01 December 2006.
US ATLAS DDM Operations Alexei Klimentov, BNL US ATLAS Tier-2 Workshop UCSD, Mar 8 th 2007.
Magda Distributed Data Manager Torre Wenaus BNL October 2001.
Dirk Duellmann CERN IT/PSS and 3D
Database Replication and Monitoring
LCG 3D Distributed Deployment of Databases
3D Application Tests Application test proposals
Database Readiness Workshop Intro & Goals
Presentation transcript:

BNL ATLAS Database service update Yuri Smirnov, Iris Wu BNL, USA LCG Database Deployment and Persistency Workshop, CERN, Geneva October 17-19, 2005

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 2 Outline TBNL Databases and servers for ATLAS production TATLAS MySQL servers and DBs at BNL Tier1 TWork on DataBase replication CERN-BNL TMonitoring tools for MySQL servers: MySQLStat, Ganglia, BNL GridCat TOracle servers and Databases  Resources  Status of parcitipation in 3D testbed TPlans and conclusions

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 3 BNL MySQL Servers/DBs for ATLAS production TBNL Tier1 site constantly contributes to ATLAS Data Challanges and Production on the GRID (GRID3 and OSG now) TDetails about DC2 and Rome production in the talk of Sasha Vaniachine and David Malon TFollowing BNL DB MySQL servers are used:  dms01  Xeon 2 CPU 3GHz, 2GB RAM, 250GB disk  RHEL3, MySQL  DBs: Globus RLS (both LRC and RLI), DQ1  db1  P-III 2 CPU 1GHz, 1GB RAM, 100GB disk  RHEL3, MySQL  DBs: Production VDC for Capone, Conitions DB (both IOV+payload), NOVA  dbdevel1  P-III 2 CPU 0.7GHz, 0.5GB RAM, 20GB disk  RHEL3, MySQL  Magda File Catalog, ATLASDD

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 4 ATLAS MySQL Database servers  ATLAS MySQL servers at BNL  dms01 ( RLS, DQ1 for GRID3 and OSG)  dms02 ( DQ2, LFC for OSG)  db1 (ConditionsDB IOV+payload, GeometryDB NOVA, DBs for subdetectors LAr,TileCal,etc., production VDC, DialDB)  dbdevel1 (ATLASDD, MagdaFC)  dbdevel2 (TAG DB, PandaDB Archive)  adbpro development mysql cluster (PandaDevDB)  gums (GUMS DB for OSG and LCG)  vo (VOMS DB for OSG and LCG)

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 5 Database replication at BNL TMySQL – MySQL replication:  DataBases: Geometry DB NOVA, LAr subsystem DB  collected the first experience CERN-BNL ATLAS DB replication  procedure using both mysqldump and on-line replication  thanks to Wensheng Deng and Sasha Vaniachine for participation TOracle – MySQL replication:  DataBase: TAG DB.  use case : Oracle CERN to MySQL BNL (push)  tool: Octopus replicator ( Java-based extraction, transfomation and loading)  thanks to Julius Hrivnac and Kristo Karr for successful collaboration  More details in Twiki:

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 6 MySQL servers monitoring We use different monitoring tools for MySQL servers: -MySQLStat (thanks to Jason Smith) -Ganglia -BNL GridCat provides some info about production servers for GRID3 (thanks to Dantong Yu )

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 7 MySQL servers monitoring

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 8 MySQL servers monitoring: GANGLIA

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 9 BNL Servers/DBs (Oracle, etc.) TOracle  oracle01  Xeon 2 CPU 3GHz, 2GB RAM, 200GB disk  Operating system : RHEL3 Oracle 10g ( )  DB: bnlsc3  Used in Service Challenge 3 (SC3) as the backend Database of FTS (File Transfer Service)  gridftp01  Xeon 2 CPU 1GHz, 2GB RAM, 200GB disk  Operating system: RHEL3 Oracle 10g ( )  DB: bnlorcl  Used for LCG 3D replication TPostgreSQL  Used by dCache system

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 10 Status of participation in 3D testbed TOracle database ( ) is installed with requried patch set for streams replication TStreams setup will start this week  Oracle  Oracle streams replication TATLAS Databases and applications to work with  COOL  TAG (?)  Geometry DB (?)  Others (?) TFeedback  Useful installation scripts and documents  Thanks to Eva Dafonte for the help and participation

October 17, 2005 Yuri Smirnov, Iris Wu (BNL) 11 Plans and Conclusion TBNL Tier1 is very interested in ATLAS GRID-based production, databases services support and LCG applications validation TSeveral new production servers (4-5 both MySQL and ORACLE) will be installed and used soon (end of 2005). Configuration:  Xeon 2 CPU 3GHz, 2GB RAM, 200GB disk  Operating system : RHEL3