HEPiX report Spring 2016 HEPiX meeting DESY Zeuthen (Berlin), Germany Helge Meinhard, CERN-IT Grid Deployment Board 11-May-2016 2 Helge Meinhard (at)

Slides:



Advertisements
Similar presentations
HEPiX Autumn Meeting 2014 University of Nebraska, Lincoln 2 Arne Wiebalck Liviu Valsan Borja Aparicio Wiebalck, Valsan,
Advertisements

Tier-1 experience with provisioning virtualised worker nodes on demand Andrew Lahiff, Ian Collier STFC Rutherford Appleton Laboratory, Harwell Oxford,
CERN IT Department CH-1211 Genève 23 Switzerland t Summary of the HEPiX Autumn 2013 Meeting Arne Wiebalck Afroditi Xafi Thomas Oulevey CERN.
CERN IT Department CH-1211 Genève 23 Switzerland t HEPiX Report Helge Meinhard, David Gutierrez, Jérôme Belleman / CERN-IT Technical Forum/Computing.
HEPiX Catania 19 th April 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 19 th April 2002 HEPiX 2002, Catania.
HEPiX Orsay 27 th April 2001 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 27 th April 2001 HEPiX 2001, Orsay.
RAL Site Report HEPiX Fall 2013, Ann Arbor, MI 28 Oct – 1 Nov Martin Bly, STFC-RAL.
Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)
HEPiX October 2009 Keith Chadwick. Outline Virtualization & Cloud Computing Physical Infrastructure Storage Monitoring Security ITIL HEPiX Conference.
HEPiX Summary Martin Bly HEPSysMan - RAL, June 2013.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
1 INFRA : INFRA : Scientific Information Repository supporting FP7 “The views expressed in this presentation are those of the author.
HEPiX Spring Meeting 2015 University of Oxford, UK 2 Arne Wiebalck Julien Leduc Adam Krajewski Wiebalck, Leduc, Krajewski:
Oxford Update HEPix Pete Gronbech GridPP Project Manager October 2014.
The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.
HEPiX Fall 2013 U Mich Ann Arbor, USA Workshop Wrap-Up Helge Meinhard, Sandy Philpott.
HEPiX Fall 2012 IHEP Beijing / PR China Workshop wrap-up Helge Meinhard.
Evolution, by tackling new challenges| CHEP 2015, Japan | Patrick Fuhrmann | 16 April 2015 | 1 Patrick Fuhrmann On behave of the project team Evolution,
HEPiX Spring 2012 Highlights Helge Meinhard CERN-IT GDB 09-May-2012.
Meeting Wrap-up Spring 2012 FZU Prague Michel Jouvin / Sandy Philpott.
Developing & Managing A Large Linux Farm – The Brookhaven Experience CHEP2004 – Interlaken September 27, 2004 Tomasz Wlodek - BNL.
JLab Scientific Computing: Theory HPC & Experimental Physics Thomas Jefferson National Accelerator Facility Newport News, VA Sandy Philpott.
21 October 2010 Dietrich Liko Grid Tier-2 HEPHY Scientific Advisory Board.
KISTI-GSDC SITE REPORT Sang-Un Ahn, Jin Kim On the behalf of KISTI GSDC 24 March 2015 HEPiX Spring 2015 Workshop Oxford University, Oxford, UK.
WLCG operations A. Sciabà, M. Alandes, J. Flix, A. Forti WLCG collaboration workshop July , Barcelona.
HEPiX FNAL ‘02 25 th Oct 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 25 th October 2002 HEPiX 2002, FNAL.
GDB July 2015 Jeremy’s quick summary notes Also refer to the meeting minutes
HEPIX Fall 2015 Summary Tony Wong Helge Meinhard.
HEPiX Spring 2013 CNAF Bologna / Italy Workshop wrap-up Helge Meinhard.
HEPiX IPv6 Working Group David Kelsey GDB, CERN 11 Jan 2012.
HEPiX Summary Fall 2014 – Lincoln, Nebraska Martin Bly.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
Federated Identity Management for HEP David Kelsey HEPiX, IHEP Beijing 18 Oct 2012.
HEPiX Spring 2014 LAPP Annecy-Le-Vieux, France Workshop Wrap-Up Helge Meinhard.
HEPiX report Autumn/Fall 2015 HEPiX meeting Brookhaven National Lab, Upton NY, U.S.A. Helge Meinhard, CERN-IT Grid Deployment Board 04-Nov-2015 (with.
LHC Computing, CERN, & Federated Identities
HEPiX Fall 2009 Highlights Michel Jouvin LAL, Orsay November 10, 2009 GDB, CERN.
Randall Sobie University of Victoria IHEPCCC - HEPiX April International HEP Computing Coordination Committee Randall Sobie.
Evolving Security in WLCG Ian Collier, STFC Rutherford Appleton Laboratory Group info (if required) 1 st February 2016, WLCG Workshop Lisbon.
16-Nov-01D.P.Kelsey, HTASC report1 HTASC - Report to HEP-CCC David Kelsey, RAL rl.ac.uk 16 November 2001, CERN ( )
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
WLCG and IPv6 David Kelsey (STFC-RAL) LHCOPN/LHCONE, Rome 28 Apr 2014.
HEPiX Spring 2015 Oxford University, UK Workshop Wrap-Up Helge Meinhard.
Ian Collier, STFC, Romain Wartel, CERN Maintaining Traceability in an Evolving Distributed Computing Environment Introduction Security.
LBNL/NERSC/PDSF Site Report for HEPiX Catania, Italy April 17, 2002 by Cary Whitney
HEPiX report Spring 2015 HEPiX meeting Oxford University, UK Helge Meinhard, CERN-IT Grid Deployment Board 10-Jun Helge Meinhard (at) CERN.ch.
Michele Michelotto – CCR Marzo 2015 Past present future Fall 2012 Beijing IHEP Spring 2013 – INFN Cnaf Fall 2013 – Ann Arbour, Michigan Univ. Spring.
The HEPiX IPv6 Working Group David Kelsey HEPiX, Prague 26 April 2012.
STFC in INDIGO DataCloud WP3 INDIGO DataCloud Kickoff Meeting Bologna April 2015 Ian Collier
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPIX, BNL 13 Oct 2015.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
Computing Fabrics & Networking Technologies Summary Talk Tony Cass usual disclaimers apply! October 2 nd 2010.
HEPiX Fall 2014 U Nebraska Lincoln, USA Workshop Wrap-Up Sandy Philpott, Helge Meinhard.
HEPiX spring 2013 report HEPiX Spring 2013 CNAF Bologna / Italy Helge Meinhard, CERN-IT Contributions by Arne Wiebalck / CERN-IT Grid Deployment Board.
Bob Jones EGEE Technical Director
Status of WLCG FCPPL project
HEPiX Fall 2016 Summary Report
Dag Toppe Larsen UiB/CERN CERN,
Belle II Physics Analysis Center at TIFR
WLCG Manchester Report
HEPiX Spring 2016 DESY Zeuthen, Germany Workshop Wrap-Up
Update from the HEPiX IPv6 WG
Venue and Participants
HTCondor Workshop 2017 DESY Hamburg, Germany Workshop Wrap-Up
Helge Meinhard, CERN-IT Grid Deployment Board 10-May-2017
Introduction to HEPiX Helge Meinhard, CERN-IT
WLCG and support for IPv6-only CPU
WLCG Collaboration Workshop;
HEPiX October 2009 Keith Chadwick.
HEPiX Spring 2009 Highlights
Presentation transcript:

HEPiX report Spring 2016 HEPiX meeting DESY Zeuthen (Berlin), Germany Helge Meinhard, CERN-IT Grid Deployment Board 11-May Helge Meinhard (at) CERN.ch

HEPiX report HEPiX Global organisation of service managers and support staff providing computing facilities for HEP community Most WLCG sites, including WLCG Tier-0, Tier-1 and many Tier-2, represented Other communities increasingly interested Meetings are held twice per year - Thus far: spring in Europe, autumn in North America or Asia – being revised Reports on status and recent work, work in progress & future plans - Usually no showing-off, honest exchange of experiences (Re-juvenated) Web site: 11-May-2016 Helge Meinhard (at) CERN.ch3

HEPiX report HEPiX Spring 2016 Held 18 – 22 April at DESY Zeuthen (near Berlin) Sponsors: Western Digital, Univa, IBM, Dell 119 registered participants - Many first timers, many old friends - 84 from Europe, 12 from North America, 11 from Asia, 12 from eight companies - 36 different affiliations - Participants from photon science, life science, … 70 contributions - Slots cut down to 25 mins - Proof of ‘HEPiX unitarity principle’ Benchmarking working group re-launch BoF on monitoring Full details: Extensive workshop notes in preparation 11-May-2016 Helge Meinhard (at) CERN.ch4

HEPiX report 11-May-2016 Helge Meinhard (at) CERN.ch5

HEPiX report Group Photo 11-May-2016 Helge Meinhard (at) CERN.ch6

HEPiX report HEPiX: 25 Years 11-May-2016 Helge Meinhard (at) CERN.ch7

HEPiX report Tracks and Trends… (1) Site reports – 15 contributions - Lustre (very popular among sites), CEPH, Slurm for HPC oriented computing, IPv6, SDN, orchestration (Kubernetes, Mesos), HTCondor, Puppet & companion softwares, HTCondorCE (nice trend, might replace other CE flavors at some point?...), ELK, Jenkins, GitLab, ZFS, … Security and networking: 7 contributions - Security: As scary as ever! Threat landscape continues to evolve - Aim to support users check for security issues (IHEP); KEK CSIRT - Identity federations: Lots of activity in AARC, REFEDS, FIM4R, WLCG - Networking: Activities in IPv6 and network monitoring/measurement (perfSONAR in WLCG/OSG) - Enabling dual-stack IPv4/IPv6 perfSONAR still a good starting point for sites - Aiming to support IPv6-only CPU in IHEP - interesting attempt to do network path optimisation with SDN 11-May-2016 Helge Meinhard (at) CERN.ch8

HEPiX report Tracks and Trends… (2) Storage and file systems: 12 contributions - Several sites looking for a new place for $HOME. Various solutions being discussed (local+backup, sync services, alternative distributed file systems,...) - Future of OpenAFS worrying. Nothing unsurmountable, but in particular the Linux area needs some efforts to keep up with recent kernels and currently there are no resources in sight. - After being well established for its traditional use cases, Ceph starts to grow more into use cases closer to physics data. And due to its flexibility may also form the basis of project to allow for easier access to data, such as OSIRiS. Grids/clouds: 10 contributions - Reports of success bringing virtualisation overhead down to low single figures - Containers - many sites investigating, the range of use cases, range of approaches to orchestration 11-May-2016 Helge Meinhard (at) CERN.ch9

HEPiX report Tracks and Trends… (3) End-user IT services and operating systems: 3 contributions - Scientific Linux - Printing Services at CERN: Consolidate, standardise, simplify - Linux on Desktops at DESY Computing and batch systems: 6 contributions - Barcelona workshop on HTCondor was a great success, much information - DESY has plans to use HTCondor, CERN has a project to extend batch services into the public cloud - Life science with similar requirements as HEP, cooperation highly wanted - HS06 benchmarking does not always reflect the true efficiency for important applications and specific architectures - A relaunch of the HEPiX Benchmarking Working Group took place on Thursday, first focus on fast benchmarks - Power efficiency on ARM is at least 2x better than for Intel/AMD, but has still problems (cores/system etc); for conventional architectures Intel is leading in terms HS06/Watt 11-May-2016 Helge Meinhard (at) CERN.ch10

HEPiX report Tracks and Trends… (4) IT facilities and business continuity: 6 contributions - Monitoring: desire to combine and correlate system and environment data - BNL is consolidating scientific computing and looking to build a new building - DESY is updating its infrastructure to be able to cope with additional capacity needs and to improve the efficiency - GreenITCube: building, migration of systems, monitoring Basic IT services: 7 contributions - Secure use of ELK - Rundeck experience at CERN - Experience with 4.5 years of Chef at GSI - Running a data centre with 8-year old nodes - Monitoring challenges and solutions 11-May-2016 Helge Meinhard (at) CERN.ch11

HEPiX report Next meetings Autumn/Fall 2016: Lawrence Berkeley National Lab, CA, U.S.A – 21 October 2016 (week after WLCG workshop and CHEP in San Francisco) Spring 2017: Budapest, Hungary - 24 – 28 April 2017 Autumn/Fall 2017: KEK, Tsukuba, Japan - 16 – 20 October 2017 Proposals received for subsequent meetings Will need to re-consider swap of European/N-American meeting, Asian labs becoming important contributors to HEPiX Expressions of interest and proposals are always welcome 11-May-2016 Helge Meinhard (at) CERN.ch12

HEPiX report Questions? 11-May-2016 Helge Meinhard (at) CERN.ch13