CC-IN2P3 Jean-Yves Nief, CC-IN2P3 HEPiX, SLAC

Slides:

Advertisements

Similar presentations

30-31 Jan 2003J G Jensen, RAL/WP5 Storage Elephant Grid Access to Mass Storage.

Advertisements

April 1999 NIKHEF site report Ronald Boontje 1 NIKHEF Site report HEPiX April 1999 RAL.

Data Grid: Storage Resource Broker Mike Smorul. SRB Overview Developed at San Diego Supercomputing Center. Provides the abstraction mechanisms needed.

Jean-Yves Nief, CC-IN2P3 Wilko Kroeger, SCCS/SLAC Adil Hasan, CCLRC/RAL HEPiX, SLAC October 11th – 13th, 2005 BaBar data distribution using the Storage.

On Developing Data Grid Workflows using Storage Resource Broker (SRB) and Kepler Tim H. Wong - UC Davis Efrat Frank - SDSC Bertram Ludäscher - UC Davis.

CONTENT: A model for collaborative database building Trevor Bond Alan Cornish Washington State University Libraries.

Data Grid: GRASP Mike Smorul. Grid Retrieval and Search Platform Based on concepts developed in the Earth Science Data Interface (ESDI) developed at the.

On Developing Data Grid Workflows using Storage Resource Broker (SRB) and Kepler Tim H. Wong - UC Davis Efrat Frank - SDSC Dr. Bertram Ludäscher - UC Davis.

Generic policy rules and principles Jean-Yves Nief.

IRODS usage at CC-IN2P3 Jean-Yves Nief. Talk overview What is CC-IN2P3 ? Who is using iRODS ? iRODS administration: –Hardware setup. iRODS interaction.

Stanford University StanfordNetDB Stanford NetDB- An Open Source Network Management Application for DNS, DHCP, IP Address Spaces, etc.

November 16, 2007 Dominique Boutigny – CC-IN2P3 Grids: Tools for e-Science DoSon AC GRID School.

2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.

MIRC Refresher Course: New Developments Medical Imaging Resource Center.

IRODS performance test and SRB system at KEK Yoshimi KEK Building data grids with iRODS 27 May 2008.

Jean-Yves Nief, CC-IN2P3, Lyon First Latin American EELA Workshop April 24th – 26th, 2006 Data distribution and aggregation over geographically distant.

Core SRB Technology for 2005 NCOIC Workshop By Michael Wan And Wayne Schroeder SDSC SDSC/UCSD/NPACI.

Introduction to iRODS Jean-Yves Nief. Talk overview Data management context. Some data management goals: –Storage virtualization. –Virtualization of the.

CC - IN2P3 Site Report Hepix Fall meeting 2009 – Berkeley

Farm Management D. Andreotti 1), A. Crescente 2), A. Dorigo 2), F. Galeazzi 2), M. Marzolla 3), M. Morandin 2), F.

Paul Scherrer Institut 5232 Villigen PSI HEPIX_AMST / / BJ95 PAUL SCHERRER INSTITUT THE PAUL SCHERRER INSTITUTE Swiss Light Source (SLS) Particle accelerator.

Jean-Yves Nief CC-IN2P3, Lyon HEPiX-HEPNT, Fermilab October 22nd – 25th, 2002.

RAL Site Report John Gordon IT Department, CLRC/RAL HEPiX Meeting, JLAB, October 2000.

LCG Phase 2 Planning Meeting - Friday July 30th, 2004 Jean-Yves Nief CC-IN2P3, Lyon An example of a data access model in a Tier 1.

Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April

4-8 th October 1999CERN Site Report, HEPiX SLAC. A.Silverman CERN Site Report HEPNT/HEPiX October 1999 SLAC Alan Silverman CERN/IT/DIS.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Jefferson Lab Site Report Sandy Philpott Thomas Jefferson National Accelerator Facility Newport News, Virginia USA

ABone Architecture and Operation ABCd — ABone Control Daemon Server for remote EE management On-demand EE initiation and termination Automatic EE restart.

Site Report Bristol University HEP group March 2000Jean-Pierre Melot, Bristol2 The People 7 Academics Brian Foster, ZEUS spokesman Greg Heath,

Test Results of the EuroStore Mass Storage System Ingo Augustin CERNIT-PDP/DM Padova.

Module 3: Configuring Mailbox Server Roles. Overview Overview of Exchange Server 2007 Administration Tools Implementing Mailbox Server Roles Managing.

GCRC Meeting 2004 BIRN Coordinating Center Software Development Vicky Rowley.

The RSNA Teaching File System (MIRC) John Perry.  MIRC Overview – Teaching Files  RSNA Clinical Trial and Research Software  Hands On: Using the RSNA.

Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:

1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,

Introduction to The Storage Resource.

Shell Interface Shell Interface Functions Data. Graphical Interface Graphical Interface Command-line Interface Command-line Interface Experiments Private.

Using RSNA’s Teaching File Software (MIRC): A Hands on Course Mary Wyers, MD.

Managing Petabytes of data with iRODS at CC-IN2P3

Biomedical Informatics Research Network The Storage Resource Broker & Integration with NMI Middleware Arcot Rajasekar, BIRN-CC SDSC October 9th 2002 BIRN.

W.A.Wojcik/CCIN2P3, Nov 1, CCIN2P3 Site report Wojciech A. Wojcik IN2P3 Computing Center URL:

15 December 2000Tim Adye1 Data Distribution Tim Adye Rutherford Appleton Laboratory BaBar Collaboration Meeting 15 th December 2000.

Network Services. Domain Controllers: – Used for Account management (e.g. user accounts, group accounts Register Hardware like Printers and PC Authentication.

The Storage Resource Broker and.

GDB meeting - Lyon - 16/03/05 An example of data management in a Tier A/1 Jean-Yves Nief.

W.A.Wojcik/CCIN2P3, HEPiX at SLAC, Oct CCIN2P3 Site report Wojciech A. Wojcik IN2P3 Computing Center URL:

Lynda : Lyon Neuroimaging Database and Applications (1) Institut des Sciences Cognitives UMR 5015 CNRS ; (2) parallel computing ENS-Lyon ; (3)Centre de.

Jean-Yves Nief, CC-IN2P3 CC-IN2P3 KEK-CCIN2P3 meeting on Grids. September 11th – 12th, 2006.

A possible SRB to iRODS Migration (a path from here to there)‏ Adil Hasan RAL.

Repository Manager 1.3 Product Overview Name Title Date.

1 eScience Grid Environments th May 2004 NESC - Edinburgh Deployment of Storage Resource Broker at CCLRC for E-science Projects Ananta Manandhar.

IRODS at CC-IN2P3: overview Jean-Yves Nief. Talk overview iRODS in production: –Hardware setup. –Usage. –Prospects. iRODS developpements in Lyon: –Scripts.

CC-IN2P3 data repositories Jean-Yves Nief. What is CC-IN2P3 ? 04/12/2009CC-IN2P3 data repositories2 Federate computing needs of the french community:

CCIN2P3 Site Report - BNL, Oct 18, CCIN2P3 Site report Wojciech A. Wojcik IN2P3 Computing Center.

SmartCode Brad Argue INLS /19/2001.

Grid Interoperability

NA4/medical imaging. Medical Data Manager Installation

Introduction to iRODS Jean-Yves Nief.

Control and data acquisition system of the KTX device

The transfer performance of iRODS between CC-IN2P3 and KEK

HYCOM CONSORTIUM Data and Product Servers

Arcot Rajasekar Michael Wan Reagan Moore (sekar, mwan,

Concurrency Conclusion

Module 1: Overview of Systems Management Server 2003

Short to middle term GRID deployment plan for LHCb

Concurrency Conclusion

STATEL an easy way to transfer data

Web Application Development Using PHP

Presentation transcript:

SRB @ CC-IN2P3 Jean-Yves Nief, CC-IN2P3 HEPiX, SLAC October 11th – 13th, 2005

HEPiX Conference, SLAC, October 11th-13th 2005 Overview (I). SRB not only used for BaBar. Attractive for many projects: Transparent interface with the Mass Storage System (MSS). Easy administration of small files to be stored into the MSS (container = tar ball). Interface with some existing relational database. OS of your choice on each participating site. Collaborative tool in order to share files: ACL’s within groups, domains, zones, metadata, annotations. HEPiX Conference, SLAC, October 11th-13th 2005

HEPiX Conference, SLAC, October 11th-13th 2005 Overview (II). 2 SRB servers ( + 1 extra soon): SUN NetraT 1405, V440, V480. Clients application in a distributed environment: Lots of time saved in code development. Environment with multiple OS: Linux: RedHat, Scientific Linux, Debian. Solaris. Windows. Interfaces: Scommands invoked from the shell (script based on them). Java APIs. Web interface. HEPiX Conference, SLAC, October 11th-13th 2005

SuperNovae Factory (P. Antilogus). SRB connected to an other database. Telescope data stored into the SRB. Collaborative tool (files exchanged between users). HPSS/Lyon SRB Hawaii CC-IN2P3 a few GBs / day HEPiX Conference, SLAC, October 11th-13th 2005

CMOS, Calice: ILC (J.P. Froberger, G. Musat) CMOS: 5 to 10 TBs / year HPSS/Lyon IReS (Strasbourg) (2 TB) CC-IN2P3 SRB SRB Calice: 2 to 5 TBs / year HPSS/Lyon User PC CC-IN2P3 SRB

Neuroscience research (P. Calvat, G. Bondaz, J-Y Nief). IRM Siemens MAGNETOM Sonata Maestro Class 1.5 T DICOM DICOM DICOM DICOM DICOM Acquisition DICOM SRB Consol Siemens Celsius Xeon (Window NT) FTP, File sharing, … Export PC Dell PowerEdge 800 DICOM DICOM

Neuroscience research (II). Goal: make SRB invisible to the end user. More than 500,000 files registered. Now interfaced within the MATLAB environment: Data pushed where the CPUs are (CC-IN2P3, ENS Lyon). ~ 1.5 FTE for 3 months… Next step: Ever growing community (a few TBs / year). Goal: Join the BIRN network (US biomedical network). HEPiX Conference, SLAC, October 11th-13th 2005

HEPiX Conference, SLAC, October 11th-13th 2005 Summary. Lightweight administration for the entire system. Fully automated monitoring of the system health. Doing user support for each project administrator. Database: Information system need to be performant. Need to have a DBA. Over 140 TB stored in SRB. Over 1 million of files for some catalogs very soon. More projects coming to SRB. HEPiX Conference, SLAC, October 11th-13th 2005