Ian Bird LHCC Referees’ meeting; CERN, 11 th June 2013 March 6, 2013

Slides:



Advertisements
Similar presentations
Jorge Gasós Grid Technologies Unit European Commission The EU e Infrastructures Programme Workshop, Beijing, June 2005.
Advertisements

Research Councils ICT Conference Welcome Malcolm Atkinson Director 17 th May 2004.
HEAnet Cloud Compute Update 1.HEAnet Cloud – a Multilayered Strategy 2.HEAnet Cloud Project 3.Cloud Realities 4.Role of the NREN – Why Cloud ? 5.NREN Collaboration.
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Ian Bird LHCC Referees’ meeting; CERN, 18 th November 2014.
SCD in Horizon 2020 Ian Collier RAL Tier 1 GridPP 33, Ambleside, August 22 nd 2014.
CERN Summary Ian Bird eInfrastructure Workshop 9 December, 2003.
Cloud Computing Special Interest Group Cloud Computing for the UK Research Community Workshop December 2013 Philip Kershaw, STFC Rutherford Appleton.
12. March 2003Bernd Panzer-Steindel, CERN/IT1 LCG Fabric status
1 Ideas About the Future of HPC in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views of.
Ian Bird WLCG Workshop Okinawa, 12 th April 2015.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
The OMII Perspective on Grid and Web Services At the University of Southampton.
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
1 European policies for e- Infrastructures Belarus-Poland NREN cross-border link inauguration event Minsk, 9 November 2010 Jean-Luc Dorel European Commission.
Climate Sciences: Use Case and Vision Summary Philip Kershaw CEDA, RAL Space, STFC.
M.A.Doman Short video intro Model for enabling the delivery of computing as a SERVICE.
Ian Bird LHCC Referee meeting 23 rd September 2014.
Rackspace Analyst Event Tim Bell
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Future Plans T. Ferrari/EGI.eu 1.
Notur: - Grant f.o.m is 16.5 Mkr (was 21.7 Mkr) - No guarantees that funding will increase in Same level of operations maintained.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Vision for European DCIs Steven Newhouse Project Director, EGI-InSPIRE 15/09/2010.
LHC Computing Review Recommendations John Harvey CERN/EP March 28 th, th LHCb Software Week.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
This document produced by Members of the Helix Nebula Partners and Consortium is licensed under a Creative Commons Attribution 3.0 Unported License. Permissions.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Towards H2020 Tiziana Ferrari/EGI.eu WLCG Collaboration Workshop.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
Ian Bird LHCC Referees Meeting; CERN, 12 th March 2013 March 6, 2013
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse Technical Director CERN.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
Ian Bird GDB; CERN, 8 th May 2013 March 6, 2013
E-Science Research Councils awarded e-Science funds ” science increasingly done through distributed global collaborations enabled by the Internet, using.
Ian Bird LHCC Referees’ meeting; CERN, 3 rd March 2015.
ESFRI & e-Infrastructure Collaborations, EGEE’09 Krzysztof Wrona September 21 st, 2009 European XFEL.
Ian Bird, WLCG MB; 27 th October 2015 October 27, 2015
Ian Bird GDB CERN, 9 th September Sept 2015
Future computing strategy Some considerations Ian Bird WLCG Overview Board CERN, 28 th September 2012.
LHC Computing, CERN, & Federated Identities
Networks ∙ Services ∙ People Thomas Bärecke Journée Fédération, Paris Collaboration européenne GÉANT SA5 03/07/2015 SA5 T5 team
Ian Bird WLCG Networking workshop CERN, 10 th February February 2014
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI strategy and Grand Vision Ludek Matyska EGI Council Chair EGI InSPIRE.
Ian Bird WLCG Management Board; CERN, 20 th May 2014.
Ian Bird, CERN WLCG LHCC Referee Meeting 1 st December 2015 LHCC; 1st Dec 2015 Ian Bird; CERN1.
LHCC Referees Meeting – 28 June LCG-2 Data Management Planning Ian Bird LHCC Referees Meeting 28 th June 2004.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
G-Cloud - The Delivery of a Shared Computing Platform for Government Ian Osborne Director, Digital Systems KTN Intellect.
Ian Bird, CERN 1 st February Dec 2015
Computing Fabrics & Networking Technologies Summary Talk Tony Cass usual disclaimers apply! October 2 nd 2010.
EGI-Engage EGI Webinar - Introduction - Gergely Sipos EGI.eu / MTA SZTAKI 6/26/
IT procurement in Research Infrastructures Standard Processes Needs Other considerations 1st February 2013Jean-François Perrin - Institut Laue Langevin.
EGI-InSPIRE EGI-InSPIRE RI The European Grid Infrastructure Steven Newhouse Director, EGI.eu Project Director, EGI-InSPIRE 29/06/2016CoreGrid.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
EGI-InSPIRE EGI-InSPIRE RI EGI strategy towards the Open Science Commons Tiziana Ferrari EGI-InSPIRE Director at EGI.eu.
Ian Bird LHCC Referees; CERN, 2 nd June 2015 June 2,
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Role and Challenges of the Resource Centre in the EGI Ecosystem Tiziana Ferrari,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI DCI Collaborations Steven Newhouse 15/09/2010 DCI Vision1.
Evolution of storage and data management
Bob Jones EGEE Technical Director
Status of WLCG FCPPL project
Ian Bird WLCG Workshop San Francisco, 8th October 2016
Computing models, facilities, distributed computing
Steven Newhouse EGI-InSPIRE Project Director, EGI.eu
GÉANT International Networking and Collaboration
e-Infrastructures – future? (specifically in Europe)
Connecting the European Grid Infrastructure to Research Communities
EGI Webinar - Introduction -
Presentation transcript:

Ian Bird LHCC Referees’ meeting; CERN, 11 th June 2013 March 6, 2013

Main points Several countries stated that the goal of aiming to fit within constant budgets would be appreciated - But concern that equipment renewal must fit within this as well as capacity expansion Misunderstanding of current situation? Some discussion on desirability of seeking funding asap to retain key personnel in various countries as EC funds come to an end - Problem is that H2020 unlikely to provide funds before at least 1 year (likely 18 months) from now Chair of RSG will work together with MB to try and improve the requirement/scrutiny/pledge process prior to October RRB – to reflect experience and adapt better to budget and procurement timescales March 6, 2013

March 6, 2013 CPUDiskTape Situation following April 2013 RRB – RSG report

March 6, 2013 Tier 0 CPU Tier 0 Disk Tier 0 Tape Tier 1 CPU Tier 1 DiskTier 1 Tape Tier 2 CPU Tier 2 Disk

March 6, PB/yr +363 kHS06/yr

MSS access March 6, 2013 Data written TB/month Data read TB/month

Data transfers March 6, 2013

Resource use March 6, 2013

CPU & disk servers installed - Currently: ~5000 cores; ~few PB disk All fully tested Will be put in production as part of the Agile Infrastructure - Managed by Openstack as part of lxbatch (SLC6 deployment is being done this way) - With new release of Openstack WAN connections (2x100 Gb/s) in production since February March 6, 2013

EMI and EGI-Inspire ended CERN groups – integrated into a new team - Brings together ES and GT - Involved in: EUDAT, iMarine, CRISP, HelixNebula - Group size will decrease by 50% over one year Sections - Operations and Liaison - Monitoring Infrastructure - Information and Data Programme of work set (partly) in conjunction with experiments - Try and keep some level of flexibility to address priorities March 6, 2013

Long term thinking Vision paper for discussion with EC and EIROforum User Forum paper – guide the direction of future infrastructures by the science communities Data preservation – see Jamie’s talk Research Data Alliance Software investment – optimise how we use CPUs/storage/networks None of this is HEP-specific! March 6, 2013

19th May 2013 ACAT 2013;

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Managed services – operated for research communities Individual science community operated services Key principles: Governed & driven by science/research communities Business model: Operations should be self-sustaining: - Managed services are paid by use (e.g. Cloud services, data archive services, …) - Community services operated by the community at their own cost using their own resources (e.g. grids, citizen cyberscience) Software support – open source, funded by collaborating developer institutions

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Foundation infrastructure Networks: In Europe - Geant and NRENs - Including networking to commercial resources Federated ID management services - Unique identity for all researchers, but evolving capabilities - Eduroam/edugain - Trust federations (EUGridPMA, etc) - Single sign-on to all resources and services - Credential translation service - …

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Cloud facilities Cloud (IaaS, PaaS, SaaS) for research community - Could be operated by large academic data centre(s), or outsourced Only need 1 or 2 such centres If successful, once requirements understood can be operated by industry

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Data facilities A few large data centres providing long term archival facilities Public/open access Metadata facilities, persistent identifiers, … EUDAT as prototype of part of this service - Connection with PRACE large scale facilities, or other large science data centres

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment HPC facilities Make use of foundation services, and in principle many application software tools HPC science communities may need to build analysis services on cloud, grids or citizen cyberscience Archive centres could leverage existing HPC facility expertise

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Distributed, federated resources High level software tools and services to allow research communities to build a distributed infrastructure (grid) to integrate their own resources The community operates the infrastructure, and provides the resources - Could be a collaboration of several sciences pooling resources – i.e. the grid concept

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Distributed, federated resources High level software tools and services to allow research communities to build a citizen cyberscience application/portal etc. - Service could be hosted on cloud facility

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Software tools and services Application-level tools of general and broad use - Data management, data transfer, storage tools - … Provide a repository, brokering for finding such tools

An e-Infrastructure system 19th May 2013 ACAT 2013; Networks, Federated ID management, etc. Grid for comm unity CCS for comm unity Application software tools and services Cloud Resource(s) Data Archives HPC Facilities Collaborative tools and services Software investment Collaborative tools and services Services that allow researchers to integrate e-infrastructure with everyday activities, personal devices, etc: - “drop box”, collaborative tools (e.g. Indico), office automation, etc. - Such services would be hosted in the cloud IaaS noted above