Tour of CERN Computer Center

Slides:



Advertisements
Similar presentations
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Why Grids Matter to Europe Bob Jones EGEE.
Advertisements

Particle physics – the computing challenge CERN Large Hadron Collider –2007 –the worlds most powerful particle accelerator –10 petabytes (10 million billion.
CERN IT Department1 / 17 Tour of CERN Computer Center and the Grid at CERN Information Technologies Department Tour of CERN Computer Center and the Grid.
Welcome to CERN Accelerating Science and Innovation 2 nd March 2015 – Bidders Conference – DO-29161/EN.
Randall Sobie The ATLAS Experiment Randall Sobie Institute for Particle Physics University of Victoria Large Hadron Collider (LHC) at CERN Laboratory ATLAS.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
EGEE is proposed as a project funded by the European Union under contract IST The EGEE International Grid Infrastructure and the Digital Divide.
CERN Krakow 2001 F. Gagliardi - CERN/IT 1 RTD efforts in Europe by Kyriakos Baxevanidis Foster cohesion, interoperability, cross- fertilization of knowledge,
The LHC Computing Grid Project Tomi Kauppi Timo Larjo.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
Frédéric Hemmer, CERN, IT DepartmentThe LHC Computing Grid – October 2006 LHC Computing and Grids Frédéric Hemmer IT Deputy Department Head October 10,
CERN TERENA Lisbon The Grid Project Fabrizio Gagliardi CERN Information Technology Division May, 2000
Welcome to this presentation! We’re so glad you came. While you’re here, you can explore many questions: What is CERN and the Large Hadron Collider (LHC)?
Jarek Nabrzyski, Ariel Oleksiak Comparison of Grid Middleware in European Grid Projects Jarek Nabrzyski, Ariel Oleksiak Poznań Supercomputing and Networking.
L ABORATÓRIO DE INSTRUMENTAÇÃO EM FÍSICA EXPERIMENTAL DE PARTÍCULAS Enabling Grids for E-sciencE Grid Computing: Running your Jobs around the World.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
To the Grid From the Web. From the Web to the Grid – 2007 Why was the Web invented at CERN? Science depends on free access to information and exchange.
… where the Web was born 11 November 2003 Wolfgang von Rüden, IT Division Leader CERN openlab Workshop on TCO Introduction.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
To the Grid From the Web Dr. Francois Grey IT Department, CERN.
Authors: Ronnie Julio Cole David
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
Ian Bird LHC Computing Grid Project Leader LHC Grid Fest 3 rd October 2008 A worldwide collaboration.
…building the next IT revolution From Web to Grid…
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
Presentation of the A particle collision = an event Physicist's goal is to count, trace and characterize all the particles produced and fully.
Dr. Andreas Wagner Deputy Group Leader - Operating Systems and Infrastructure Services CERN IT Department The IT Department & The LHC Computing Grid –
Computing for LHC Physics 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Maria Alandes Pradillo CERN IT Department.
LHC Computing, CERN, & Federated Identities
Data Processing and the LHC Computing Grid (LCG) Jamie Shiers Database Group, IT Division CERN, Geneva, Switzerland
Induction: What is EGEE? –April 26-28, What is EGEE? John Murison, EGEE Training Team EGEE is funded by the European Union under contract IST
Conference xxx - August 2003 EGEE is proposed as a project funded by the European Union under contract IST Fabrizio Gagliardi EGEE designated.
GRIDSTART Brussels 20/9/02 1www.gridstart.org GRIDSTART and European activities Dr Francis Wray EPCC The University of Edinburgh.
The Worldwide LHC Computing Grid Frédéric Hemmer IT Department Head Visit of INTEL ISEF CERN Special Award Winners 2012 Thursday, 21 st June 2012.
LHC collisions rate: Hz New PHYSICS rate: Hz Event selection: 1 in 10,000,000,000,000 Signal/Noise: Raw Data volumes produced.
Hans Hoffmann, Director Technology Transfer & Scientific Computing, ( ) Why CERN provides a unique IT challenge for industry: from the Web to the.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
GridPP, The Grid & Industry
Grid Computing: Running your Jobs around the World
Clouds , Grids and Clusters
Grid site as a tool for data processing and data analysis
PROGRAMME 10:00 Introduction to presentations and tour (10‘) Francois Grey  10:10 CERN openlab student programme - CERN opencluster (05')    Stephen Eccles 
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
Grid related projects CERN openlab LCG EDG F.Fluckiger
Long-term Grid Sustainability
A. Rama Bharathi Regd. No: 08931F0040 III M.C.A
Russian Regional Center for LHC Data Analysis
Dagmar Adamova, NPI AS CR Prague/Rez
EGEE support for HEP and other applications
UK GridPP Tier-1/A Centre at CLRC
The LHC Computing Grid Visit of Her Royal Highness
Grid Computing.
Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)
Building a UK Computing Grid for Particle Physics
Javier Magnin Brazilian Center for Research in Physics & ROC-LA
The CERN openlab and the European DataGrid Project
Tour of CERN Computer Center
Communications and development Francois Grey, CERN openlab development Enterasys Networks visit 23/01/03.
CERN, the LHC and the Grid
EGI Webinar - Introduction -
The LHC and grids Welcome to this presentation! We’re so glad you came. While you’re here, you can explore many questions: What is CERN and the Large.
CERN openlab for DataGrid applications
Grid Application Model and Design and Implementation of Grid Services
The LHC Computing Grid Visit of Professor Andreas Demetriou
Presentation transcript:

Tour of CERN Computer Center Information Technologies Department Tour of CERN Computer Center and the Grid at CERN Welcome!

Computing at CERN General Purpose Computing Environment Administrative Computing Services Physics and engineering computing Consolidation, coordination and standardization of computing activities Physics applications (e.g., for data acquisition/offline analysis) Accelerator design and operations http://cern.ch/it

LHC Data every year 40 million collisions per second After filtering, 100 collisions of interest per second > 1 Megabyte of data digitised per collision recording rate > 1 Gigabyte / sec 1010 collisions recorded each year stored data > 15 Petabytes / year 1 Megabyte (1MB) A digital photo 1 Gigabyte (1GB) = 1000MB 5GB = A DVD movie 1 Terabyte (1TB) = 1000GB World annual book production 1 Petabyte (1PB) = 1000TB Annual production of one LHC experiment 1 Exabyte (1EB) = 1000 PB 3EB = World annual information production CMS LHCb ATLAS ALICE http://cern.ch/lhc

LHC Data every year LHC data correspond to about Balloon (30 Km) Concorde (15 Km) Mt. Blanc (4.8 Km) CD stack with 1 year LHC data! (~ 20 Km) LHC data correspond to about 20 million CDs each year Where will the experiments store all of these data?

Where will the experiments find such a computing power? LHC Data Processing LHC data analysis requires a computing power equivalent to ~ 100,000 of today's fastest PC processors Where will the experiments find such a computing power?

Computing power available at CERN High-throughput computing based on reliable “commodity” technology More than 35’000 CPUs in about 6000 boxes (Linux) 14 Petabytes on 14’000 drives (NAS Disk storage) 34 Petabytes on 45’000 tape slots with 170 high speed drives Nowhere near enough!

Computing for LHC Problem: even with Computer Centre upgrade, CERN can provide only a fraction of the necessary resources Solution: Computing centers, which were isolated in the past, will be connected, uniting the computing resources of particle physicists worldwide Users of CERN Europe: 267 institutes 4603 users Out of Europe: 208 institutes 1632 users

What is the Grid? The World Wide Web provides seamless access to information that is stored in many millions of different geographical locations In contrast, the Grid is an emerging infrastructure that provides seamless access to computing power and data storage capacity distributed over the globe

One Web but many Grids Grid development has been initiated by the academic, scientific and research community, but industry is also interested. UK e-Science Grid Netherlands – VLAM, PolderGrid Germany – UNICORE, Grid proposal France – Grid funding approved Italy – INFN Grid Eire – Grid proposals Switzerland - Network/Grid proposal Hungary – DemoGrid, Grid proposal Norway, Sweden - NorduGrid NASA Information Power Grid DOE Science Grid NSF National Virtual Observatory NSF GriPhyN DOE Particle Physics Data Grid NSF TeraGrid DOE ASCI Grid DOE Earth Systems Grid DARPA CoABS Grid NEESGrid DOH BIRN NSF iVDGL DataGrid (CERN, ...) EuroGrid (Unicore) DataTag (CERN,…) Astrophysical Virtual Observatory GRIP (Globus/Unicore) GRIA (Industrial applications) GridLab (Cactus Toolkit) CrossGrid (Infrastructure Components) EGSO (Solar Physics)

5 big ideas 1. Sharing resources on a global scale Main issues are trust, different management policies, virtual organisations, 24 hour access and support. 2. Security Main issues are well-defined yet flexible rules, authentication, authorisation, compatibility and standards 3. Balancing the load This is more than just cycle scavenging, (SETI@home), need middleware to monitor and broker resources 4. The death of distance Networks delivered 56Kb/s 10 years ago, now we have 155Mb/s, for the LHC anticipate 10 Gb/s 5. Open standards Grid standards are converging, and include Web services, the Globus Toolkit, various protocols

Grid applications for Science Medical/Healthcare (imaging, diagnosis and treatment ) Bioinformatics (study of the human genome and proteome to understand genetic diseases) Nanotechnology (design of new materials from the molecular scale) Engineering (design optimization, simulation, failure analysis and remote instrument access and control) Natural Resources and the Environment (weather forecasting, earth observation, modeling and prediction of complex systems)

Grid@CERN CERN projects: Worldwide LHC Computing Grid (WLCG) External projects with CERN participation: Enabling Grids for E-SciencE (EGEE) European Grid Initiative (EGI) Industry funded projects: CERN Openlab

WLCG: Worldwide LHC Computing Grid Biggest scientific Grid project in the world More than 140 sites in 33 countries 90’000 processors by end of 2009 All Tiers 1 must store all the data produced by LHC Should run 100 millions programmes in 2009 Used by 5000 scientists in 500 institutes http://cern.ch/lcg

The EGEE vision Access to a production quality GRID will change the way science and much else is done in Europe An international network of scientists will be able to model a new flood of the Danube in real time, using meteorological and geological data from several centres across Europe. A team of engineering students will be able to run the latest 3D rendering programs from their laptops using the Grid. A geneticist at a conference, inspired by a talk she hears, will be able to launch a complex biomolecular simulation from her mobile phone. http://www.eu-egee.org

CERN Openlab III Framework for evaluating and integrating cutting edge IT technologies or services in partnership with industry, focusing on future versions of the WLCG. Phase III focuses on Security Automation tools Data replication and monitoring Behaviour of a network of thousand machines Platform: thermal optimisation, applications... http://cern.ch/openlab

Computer Centre Tour Ground Floor OpenLab CPUs and Disks CIXP: CERN Internet Exchange Point Basement Storage Silos: >34 petabytes New water cooled racks IMPORTANT – FOR YOUR OWN SAFETY PLEASE DO NOT TOUCH EQUIPMENT AND CABLES DURING VISIT

To know more about the Grid… NETWORKING CERN Networking with industry – cross fertilisation GROWTH Growing the Grid: ”from where the web was born, to where the Grid grew up” Catalysing the next IT revolution SPINNING OUT New technologies and companies evolving OPENING UP CERN opening up, reaching out to the world