E-Science Workshop, Santiago de Chile, 23./24.5.2007 KIT (www.kit.edu) Frank Schmitz Forschungszentrum Karlsruhe Institut.

Slides:



Advertisements
Similar presentations
Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) StorNextFS, a fast global Filesysteme in a heterogeneous Cluster Environment.
Advertisements

Particle physics – the computing challenge CERN Large Hadron Collider –2007 –the worlds most powerful particle accelerator –10 petabytes (10 million billion.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, , Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier.
Forschungszentrum Karlsruhe Technik und Umwelt LHCC Meeting Bologna, 15 June Planning a Regional Data and Computing Center in Germany Peter Mickel.
The High Energy Physics Community Grid Project Inside D-Grid ACAT 07 Torsten Harenberg - University of Wuppertal
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004 Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Plans and outlook at GridKa Forschungszentrum.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
CBPF J. Magnin LAFEX-CBPF. Outline What is the GRID ? Why GRID at CBPF ? What are our needs ? Status of GRID at CBPF.
IWR Ideen werden Realität Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Institut für Wissenschaftliches Rechnen GridKa Database Services Overview.
STEINBUCH CENTRE FOR COMPUTING - SCC KIT – University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association.
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Infrastructure overview Arnold Meijster &
S. Gadomski, "ATLAS computing in Geneva", journee de reflexion, 14 Sept ATLAS computing in Geneva Szymon Gadomski description of the hardware the.
KIT – The cooperation of Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) SX-9, a good Choice ? Steinbuch Centre for Computing.
Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH)‏ Steinbuch Centre for Computing (SCC) A large Multi-Functional HPC.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
Grid Architecture Grid Canada Certificates International Certificates Grid Canada Issued over 2000 certificates Condor G Resource TRIUMF.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Development of a billing framework for D-Grid Prof. Dr. Gabriele von Voigt, Dr. Claus-Peter Rückemann, Wolfgang Müller Cracow Grid Workshop 2006 (CGW2006)
The German HEP Community Grid for the German HEP Community Grid 27-March-2007, ISGC2007, Taipei Agenda: D-Grid in context HEP Community.
© 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute.
A.V. Bogdanov Private cloud vs personal supercomputer.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
Experiences with using UNICORE in Production Grid Infrastructures DEISA and D-Grid Michael Rambadt
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
DESY Participation in an External Experiment Joachim Mnich PRC Meeting
A short introduction to GRID Gabriel Amorós IFIC.
GGF12 – 20 Sept LCG Incident Response Ian Neilson LCG Security Officer Grid Deployment Group CERN.
A short introduction to the Worldwide LHC Computing Grid Maarten Litmaath (CERN)
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
Astro-WISE & Grid Fokke Dijkstra – Donald Smits Centre for Information Technology Andrey Belikov – OmegaCEN, Kapteyn institute University of Groningen.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
R. Cherkaoui March 2010 EU-MED 3 Brussels High-performance networking in the context of the ATLAS particle physics experiment Prof. Rajaa Cherkaoui.
10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab
© 2006 Open Grid Forum Enabling Pervasive Grids The OGF GIN Effort Erwin Laure GIN-CG co-chair, EGEE Technical Director
Forschungszentrum Jülich in der Helmholtz-Gesellschaft Experiences with using UNICORE in Production Grid Infrastructures DEISA and D-Grid Michael Rambadt.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Cracow Grid Workshop October 2009 Dipl.-Ing. (M.Sc.) Marcus Hilbrich Center for Information Services and High Performance.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft 1 Institute for Scientific Computing in the Forschungszentrum Karlsruhe Overview Rainer Kupsch.
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
Ian Bird LHC Computing Grid Project Leader LHC Grid Fest 3 rd October 2008 A worldwide collaboration.
…building the next IT revolution From Web to Grid…
Overview of grid activities in France in relation to FKPPL FKPPL Workshop Thursday February 26th, 2009 Dominique Boutigny.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Computing Coordination Aspects for HEP in Germany International ICFA Workshop on HEP Networking, Grid and Digital Divide Issues for Global e-Science nLCG.
Particle Physics in Germany activities and perspectives Bernhard Spaan - TU Dortmund Chair of Komitee für Elementarteilchenphysik (KET) technische universität.
Grid Activities in Portugal Gonçalo Borges Jornadas LIP 2010 Braga, Janeiro 2010.
LHC Computing, CERN, & Federated Identities
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
Dr. Isabel Campos Plasencia (IFCA-CSIC) Spanish NGI Coordinator ES-GRID The Spanish National Grid Initiative.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE: Enabling grids for E-Science Bob Jones.
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
KIT – Universität des Landes Baden-Württemberg und nationales Forschungszentrum in der Helmholtz-Gemeinschaft Steinbuch Centre for Computing
The status of IHEP Beijing Site WLCG Asia-Pacific Workshop Yaodong CHENG IHEP, China 01 December 2006.
Enabling Grids for E-sciencE INFSO-RI Dr. Rüdiger Berlich Forschungszentrum Karslruhe Introduction to Grid Computing Christopher.
Computing infrastructures for the LHC: current status and challenges of the High Luminosity LHC future Worldwide LHC Computing Grid (WLCG): Distributed.
 Prospective Nationale sur les Grilles de Production, Paris, L'état d'avancement des grilles.
LHC collisions rate: Hz New PHYSICS rate: Hz Event selection: 1 in 10,000,000,000,000 Signal/Noise: Raw Data volumes produced.
Availability of ALICE Grid resources in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
Grid Computing: Running your Jobs around the World
Grid site as a tool for data processing and data analysis
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
Long-term Grid Sustainability
DGI: The D-Grid Infrastructure
LHC Data Analysis using a worldwide computing grid
Presentation transcript:

e-Science Workshop, Santiago de Chile, 23./ KIT ( Frank Schmitz Forschungszentrum Karlsruhe Institut for Scientific Computing (IWR) Hermann-von-Helmholtz-Platz Eggenstein-Leopoldshafen Germany

e-Science Workshop, Santiago de Chile,

e-Science Workshop, Santiago de Chile, 3 University 11fakulties 120 institutes 4,000 employees 18,500 students 250 mio € budget University 11fakulties 120 institutes 4,000 employees 18,500 students 250 mio € budget Forschungszentrum 10programs (research areas) 21 large institutes 4,000 employees 310 mio € budget Forschungszentrum 10programs (research areas) 21 large institutes 4,000 employees 310 mio € budget Karlsruhe Institute of Technology (KIT) 10 km 15 min science education structures for the administration institutes services infrastructure KIT…

e-Science Workshop, Santiago de Chile, 4 GridKa, the Tier-1 computer center for LHC LHC=large hadron collider (CERN) Grid based structure in a worldwide environment for high energy physics gLite storage resource manager (SRM) based on dCache Resource broker for world wide usage of LHC resources PBSpro for resource management Certification Authority (CA)

e-Science Workshop, Santiago de Chile, 5 GridKa, the Tier-1 computer center for LHC Atlas (SLAC, USA) (CERN) (FermiLab,USA) Have already “real” data LHC experiments & LCG non-LHC experiments 8,8 Mio. computing jobs and 5,1 Mio. h CPU-time in 2006 Deliver yearly 12 PB measured data

e-Science Workshop, Santiago de Chile, 6 22 Research Centers 44 Working Groups 350 Scientists Aachen (4)● Bielefeld (2)● Bochum (2)● Bonn (3)● Darmstadt (1) ▲ Dortmund (1)● Dresden (2)● Erlangen (1)● Frankfurt (1)● Freiburg (2)● Hamburg (1) ▲ Heidelberg (1) ▲ (6)● Karlsruhe (2)● Mainz (3)● Mannheim (1)● München (1)●(5) ▲ Münster (1)● Rostock (1)● Siegen (1)● Wuppertal (2)● ▲

e-Science Workshop, Santiago de Chile, 7 FZK has signed the WLCG MoU and is able to deliver resources for the LHC experiment up to 2022 as the Tier-1 center resources for WLCG

e-Science Workshop, Santiago de Chile, 8 Motivation for the project CampusGrid heterogeneous IT-environment: vector-, SMP-, cluster-, blade- systems, SAN, NAS, Unix, Linux, Windows, Solaris, SuperUX, …. global view by the user only one user management (ADS from Microsoft) one job management metacomputing (MPI,..), “real-time” applications access data for visualization at the local workstation global accounting seamless integration into different projects and middleware concepts like gLite, LCG, D-Grid, Unicore, GT4, ….

e-Science Workshop, Santiago de Chile, 9 Ideas and solution testing of different global file system solutions  StorNextFS from Quantum/ADIC seems to be the best SRM for world wide access integration of InfiniBand, iSCSI and FC-SAN Globus Toolkit 4 (GT4), gLite/LCG and UNICORE as the middleware solution in the project Resource Broker (local solution!) security  Kerberos 5 integration accounting  should be solved by D-Grid and GridKa

e-Science Workshop, Santiago de Chile, 10 watercooled Infiniband cluster with 32 SUN V20z and 64 FSC RX220 nodes (more than 190 cores and >1 TByte main memory) 2 Infinicon 9100, Infiniband switches, MPI latency 4.0 μs between nodes Parts of the CampusGrid Project

e-Science Workshop, Santiago de Chile, 11 D-Grid (the German Grid initiative) starting September 2005 to build a sustainable Grid infrastructure six Community Grid projects an the D-Grid Integration Project (DGI) funded by BMBF, the Federal Ministry of Education and Research astronomy, climate research, high energy physics, engineering research, medical research, humanities gLite, GT4, UNICORE SRM/dCache for the data access heterogeneous CPU access (AIX, Linux, Solaris, SuperUX planned)

e-Science Workshop, Santiago de Chile, 12 Collaborative Climate Community Data and Processing Grid (C3-Grid) understanding the earth system including their subsystems like oceans, atmosphere, biosphere etc. coupling models for the mentioned subsystems in complex cumulative simulations producing Petabytes of output linking distributed data archives in several German institutions for earth system sciences together running standards for data structures

e-Science Workshop, Santiago de Chile, 13

e-Science Workshop, Santiago de Chile, 14 Other Grid-projects EGEE (enabling Grids for e-science) GGUS (global Grid user support) g-Eclipse Int.EU.grid (interactive European Grid) ISSeG (integrated site security for Grids)

e-Science Workshop, Santiago de Chile, 15 Thank you! Questions?