13 October 2014 Eric Grancher, head of database services, CERN IT Manuel Martin Marquez, data scientist, CERN openlab.

Slides:



Advertisements
Similar presentations
CERN STAR TAP June 2001 Status of the EU DataGrid Project Fabrizio Gagliardi CERN EU-DataGrid Project Leader June 2001
Advertisements

Programme: 145 sessions & social events
Accelerating Science and Innovation Welcome to CERN.
CERN an (unusual) introduction Rolf-Dieter Heuer Director-General, CERN India and CERN – Visions for Future Collaboration Mumbai 28 February 2011.
Welcome to CERN Accelerating Science and Innovation 2 nd March 2015 – Bidders Conference – DO-29161/EN.
Welcome to CERN Research Technology Training Collaborating.
SAP Student Interest Group
Delegations III KAM, Bratislava 4th to 8th September 2013.
Knowledge Management LXV International Council Meeting Qawra, Malta 16 th - 23 rd of March 2014.
Helge Meinhard CERN CERN Openlab Summer Student Lectures 2015 From Detectors to Publications.
ELSA Shop(ping) – Spring SALE! LXV International Council Meeting Qawra, Malta 16 th - 23 rd of March 2014.
Knowledge Management and Transition ICM Cluj-Napoca, 24th April 2015.
Accelerating Science and Innovation. Science for Peace CERN was founded in 1954 as a Science for Peace Initiative by 12 European States Member States:
EDUCATION & RESEARCH Training CERN and the Oracle Value to Research February 3rd, Eva Dafonte Perez, Deputy.
ELSA Shop(ping) LXIV International Council Meeting Opatija, Croatia October 28 th - November 3 rd 2013.
João BENTO BE Department Presentation available at Welcome to CERN “Magic is not happening at CERN, magic is being explained.
Area Definition III KAM,Bratislava. The European Law Students’ Association Albania ˙ Austria ˙ Azerbaijan ˙ Belgium ˙ Bosnia and Herzegovina ˙ Bulgaria.
From Open Science to (Open) Innovation Markus Nordberg, Marzio Nessi (CERN) About CERN, Open Physics, Innovation and IdeaSquare.
ELSA Law Schools ICM Cluj-Napoca, 21st April 2015.
Welcome – Benvenuti Carlo Verdone to Accelerating Science and Innovation to Accelerating Science and Innovation.
Bidders’ conference IT-4123 Supply, Replacement and Repair of Crane Rails Introduction to CERN and rails consolidation program Handling Engineering Group.
Rackspace Analyst Event Tim Bell
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
5 December 2013, Eric Grancher CERN, head of database services.
IRC: ICT Presentation Sept Opportunities through Collaboration Ing.Pierre Theuma Manager, IRC Malta.
6 May 2014 CERN openlab IT Challenges workshop, Kacper Szkudlarek, CERN Manuel.
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
Weblogic at CERN now and in the future SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Helge Meinhard CERN CERN Openlab Summer Student Lectures 2014 From Detectors to Publications.
EXTREME MAKEOVER Members’ Magazine LXIV International Council Meeting Opatija, Croatia October 28 th - November 3 rd 2013.
The Challenges of Scientific Computing
WelcomeWelcome CSEM – CERN Day 23 rd May 2013 CSEM – CERN Day 23 rd May 2013 to Accelerating Science and Innovation to Accelerating Science and Innovation.
CERN as a World Laboratory: From a European Organization to a global facility CERN openlab Board of Sponsors July 2, 2010 Rüdiger Voss CERN Physics Department.
CERN openlab Overview CERN openlab Introduction Alberto Di Meglio.
Brocade Flow Optimizer CERN openlab
CERN IT Department CH-1211 Genève 23 Switzerland 3 rd Meeting of the GEANT Experts group Brussels, 10 March 2011 Frédéric Hemmer CERN IT.
Computing for LHC Physics 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Maria Alandes Pradillo CERN IT Department.
Introduction to CERN and Grid Computing Dr. Wolfgang von Rüden CERN, Geneva HP ProCurve event CERN, 20 February 2008.
Stakeholder Relations at Large-Scale Infrastructures The CERN Model Rolf Heuer 7 th Canadian Science Policy Conference, Ottawa, 26 November 2015.
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Frédéric Hemmer IT Department 26 th January 2010 Visit of Michael Dell 1 Frédéric.
Geography Review On Map 1, please identify: -Spain -France -England -Russia -Ottoman empire -Persia -China -Mughal India -Songhai Empire.
The European Law Students’ Association Albania ˙ Austria ˙ Azerbaijan ˙ Belgium ˙ Bosnia and Herzegovina ˙ Bulgaria ˙ Croatia ˙ Cyprus ˙ Czech Republic.
Enterprise Manager at CERN Andrei Dumitru IT Department / Database Services / openlab.
BIDDERS’ CONFERENCE IT-3981 Dismantling, Refurbishment, Replacement and Supply of Electrical Overhead Travelling Cranes Over 10 Tons Capacity January.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 1 st March 2011 Visit of Dr Manuel Eduardo Baldeón.
CERN openlab Overview CERN openlab Summer Students 2015 Fons Rademakers.
The Mission of CERN  Push back  Push back the frontiers of knowledge E.g. the secrets of the Big Bang …what was the matter like within the first moments.
25-September-2005 Manjit Dosanjh Welcome to CERN International Workshop on African Research & Education Networking September ITU, UNU and CERN.
Germany and CERN / June 2009Germany and CERN | May Welcome - Willkommen CERN: to CERN: Accelerating Science and Innovation Professor Wolfgang A.
WLCG after 1 year with data: Prospects for the future Ian Bird; WLCG Project Leader openlab BoS meeting CERN4 th May 2011.
Figure 1. PARTICIPATING STEM CELL DONOR REGISTRIES Number of registries Year ©BMDW.
IEC System of Conformity Assessment Schemes for Electrotechnical Equipment and Components.
WLCG – Status and Plans Ian Bird WLCG Project Leader openlab Board of Sponsors CERN, 23 rd April 2010.
Best Sustainable Development Practices for Food Security UV-B radiation: A Specific Regulator of Plant Growth and Food Quality in a Changing Climate The.
Bidders’ Conference IT-4130/EN Replacement of Personnel Lifts (up to 2 t Capacity) I. Rühl / EN-HE.
CERN August 2013CERN Teacher Programmes1 Designing Effective Outreach Programmes for Teachers at CERN Inspiring the next generation of scientists and engineers.
5-minutes tour of CERN (based on official CERN slides) 5-minutes tour of CERN (based on official CERN slides) Christian Joram / CERN EIROfrum Topical Workshop.
European Organization for Nuclear Research
The 5 minutes tour of CERN The 5 minutes race of CERN
The 5 minutes tour of CERN The 5 minutes race of CERN
First beam impact report
ALIGNMENT RULE PROCEDURE
CERN Teacher Programmes
CERN – A Strategic Partner in the Data Revolution
Understanding the Universe with help from OpenStack, CERN and Budapest
ALIGNMENT RULE PROCEDURE
European representation of respiratory critical care HERMES participants. European representation of respiratory critical care HERMES participants. Countries.
Perspective of an International Research Center
CERN: from fundamental sciences to daily applications
Presentation transcript:

13 October 2014 Eric Grancher, head of database services, CERN IT Manuel Martin Marquez, data scientist, CERN openlab

Outlook 3 CERN History of using Oracle and current usage Information Discovery (Manuel)

A European Laboratory with Global reach 4 Research Technology Science dissemination Scientific collaborations

Events at LHC J. Knobloch/CERN: European Grid Initiative – EGI Luminosity : cm -2 s MHz – every 25 ns 20 events overlaying

Trigger & Data Acquisition J. Knobloch/CERN: European Grid Initiative – EGI

Data Recording J. Knobloch/CERN: European Grid Initiative – EGI

Computing and storage needs 8 Data volume 25 PB per year (in files) > 5.3 * rows in an Oracle table (IOT, in one of the databases) Computing and storage capacity, world-wide distributed > 150 sites (grid computing) > CPU cores > 269 PB disk capacity > 210 PB tape capacity Distributed analysis with costs spread in the different sites (« LHC Computing Grid »)

Oracle at CERN, 1982 accelerator control 9 now and

10 Credit: C. Roderick Accelerator applications

Accelerator logging 11 50TB/year, rate to increase to 100 – 150 TB in 2014 (Quench Protection System) Credit: C. Roderick

Administrative systems 12 AIS has standardized on Oracle as database and uses the Oracle database as interface between the tools Java EE and Apex, deployment with Weblogic Oracle E-Business HR, managed as Oracle Managed Cloud Services (“OnDemand”)

Engineering applications An integrated PLM platform based on commercial tools. Simplified web interfaces for precise tasks 3D CAD CATIA Design data management Manufacturing follow-up Installation follow-up Maintenance management Data publishing Workflow actions 13 Credit: D. Widegren

CERN in numbers Document & Drawings (incl. CAD): ~1, documents & drawings ~7,000 new documents & drawings created per month Components: ~1,300,000 registered individually followed equipment ~3,000,000 equipment interventions/jobs logged ~ 15,000 equipment interventions/jobs logged per month 14 Credit: D. Widegren

CASTOR and Oracle, tapes 15 Home made mass storage system, relies on Oracle databases for name server, request handling and staging 4 libraries, SL x4 = 40K slots (4500 free) Occupancy: 65PB worth of data Drives: 20 T10KB legacy drives; 40 T10KC drives (to be replaced by T10KD's) Credit: German Cancio Melia

CERN Disk/Tape Storage storage-day.ch CASTOR Archive in Numbers 16 Data: ~90PB of data on tape; 250M files Up to 4.5 PB new data per month Over 10GB/s (R+W) peaks Credit: German Cancio Melia

Experiment online systems 17 Experiments rely on a SCADA system for their control Up to 150,000 changes / second stored in Oracle databases

Experiment offline systems 18 Geometry DB Conditions DB Credit: Vakho Tsulaia

And… Fidelio Micros for CERN hotel 19

Oracle at CERN 20 From accelerator control to accelerator logging, administration, engineering systems, access control, laboratory infrastructure (cabling, network configuration, etc.), mass storage system, experiment online systems, experiment offline systems, CERN hotel Etc.

CERN openlab 21 Public-private partnership between CERN and leading ICT companies, currently in fourth phase (started in 2003). Its mission is to accelerate the development of cutting-edge solutions to be used by the worldwide LHC community. Innovative ideas aligned between CERN and the partners. “Fellows” and summer students

CERN European Organization for Nuclear Research Founded in 1954 Research: Seeking and finding answers to questions about the Universe Technology, International collaboration, Education Twenty one Member States Austria, Belgium, Bulgaria, Czech Republic, Denmark, Finland, France, Germany, Greece, Italy, Israel, Hungary, Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland, United Kingdom Seven Observer States European Commission, USA, Russian Federation, India, Japan, Turkey, UNESCO People ~2400 Staff, ~900 Students, post-docs and undergraduates, ~9000 Users, ~2000 Contractors Associate Member States Serbia Candidate State Romania 23

World’s largest computing grid - WLCG 1 PB raw data per second before filtering / >20 PB of new data annually 68,889 physical CPUs / 305,935 logical CPUS 157 computer centres around the world 24

Oracle at CERN, version Credit: N. Segura Chinchilla

LHC 17 miles (27km) long tunnel Thousands of superconducting magnets Coldest place in the Universe: 1.9 degrees kelvin Ultra vacuum: 10x emptier than on the Moon 600 million collisions per second The largest particle accelerator & detectors