STFC in INDIGO DataCloud WP3 INDIGO DataCloud Kickoff Meeting Bologna 22-24 April 2015 Ian Collier

Slides:



Advertisements
Similar presentations
Level 1 Components of the Project. Level 0 Goal or Aim of GridPP. Level 2 Elements of the components. Level 2 Milestones for the elements.
Advertisements

Tier-1 Evolution and Futures GridPP 29, Oxford Ian Collier September 27 th 2012.
SCD in Horizon 2020 Ian Collier RAL Tier 1 GridPP 33, Ambleside, August 22 nd 2014.
Cloud & Virtualisation Update at the RAL Tier 1 Ian Collier Andrew Lahiff STFC RAL Tier 1 HEPiX, Lincoln, NEBRASKA, 17 th October 2014.
Tier-1 experience with provisioning virtualised worker nodes on demand Andrew Lahiff, Ian Collier STFC Rutherford Appleton Laboratory, Harwell Oxford,
Constellation Technologies Providing a support service to commercial users of gLite Nick Trigg.
Assessment of Core Services provided to USLHC by OSG.
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.1 The CERN Cloud Computing Project William Lu, Ph.D. Platform Computing.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
RAL Site Report HEPiX Fall 2013, Ann Arbor, MI 28 Oct – 1 Nov Martin Bly, STFC-RAL.
Open Source Grid Computing in the Finance Industry Alex Efimov STFC Kite Club Knowledge Exchange Advisor UK CERN Technology Transfer Officer
Climate Sciences: Use Case and Vision Summary Philip Kershaw CEDA, RAL Space, STFC.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
Integrated e-Infrastructure for Scientific Facilities Kerstin Kleese van Dam STFC- e-Science Centre Daresbury Laboratory
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
JASMIN and CEMS: The Need for Secure Data Access in a Virtual Environment Cloud Workshop 23 July 2013 Philip Kershaw Centre for Environmental Data Archival.
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Virtualisation & Cloud Computing at RAL Ian Collier- RAL Tier 1 HEPiX Prague 25 April 2012.
E-Science Research Councils awarded e-Science funds ” science increasingly done through distributed global collaborations enabled by the Internet, using.
Your university or experiment logo here The European Landscape John Gordon GridPP24 RHUL 15 th April 2010.
Federated Identity Management for HEP David Kelsey STFC – RAL Nijmegen workshop 22 June 2012.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
GDB Introduction Ian Collier STFC Rutherford Appleton Laboratory Group info (if required) GDB, January 13 th 2016.
LHC Computing, CERN, & Federated Identities
Evolving Security in WLCG Ian Collier, STFC Rutherford Appleton Laboratory Group info (if required) 1 st February 2016, WLCG Workshop Lisbon.
Ian Collier, STFC, Romain Wartel, CERN Maintaining Traceability in an Evolving Distributed Computing Environment Introduction Security.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
HEPiX report Spring 2015 HEPiX meeting Oxford University, UK Helge Meinhard, CERN-IT Grid Deployment Board 10-Jun Helge Meinhard (at) CERN.ch.
IPCEI on High performance computing and big data enabled application: a pilot for the European Data Infrastructure Antonio Zoccoli INFN & University of.
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
IBERGRID as RC Total Capacity: > 10k-20K cores, > 3 Petabytes Evolving to cloud (conditioned by WLCG in some cases) Capacity may substantially increase.
Experience integrating a production private cloud in a Tier 1 Grid site Ian Collier Andrew Lahiff, George Ryall STFC RAL Tier 1 ISGC 2015 – March 20 th.
INDIGO – DataCloud CERN CERN RIA
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
EGI-Engage EGI Webinar - Introduction - Gergely Sipos EGI.eu / MTA SZTAKI 6/26/
EGI-InSPIRE EGI-InSPIRE RI The European Grid Infrastructure Steven Newhouse Director, EGI.eu Project Director, EGI-InSPIRE 29/06/2016CoreGrid.
Computing infrastructures for the LHC: current status and challenges of the High Luminosity LHC future Worldwide LHC Computing Grid (WLCG): Distributed.
Report from US ALICE Yves Schutz WLCG 24/01/2007.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
RAL Site Report HEP SYSMAN June 2016 – RAL Gareth Smith, STFC-RAL With thanks to Martin Bly, STFC-RAL.
Ian Bird LHCC Referees; CERN, 2 nd June 2015 June 2,
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
GDB Introduction Ian Collier STFC Rutherford Appleton Laboratory GDB, May 11 th 2016.
18/12/03PPD Christmas Lectures 2003 Grid in the Department A Guide for the Uninvolved PPD Computing Group Christmas Lecture 2003 Chris Brew.
PaaS services for Computing and Storage
WP3 Security SQA INDIGO - DataCloud
INFN Computing Outlook The Bologna Initiative
gLite->EMI2/UMD2 transition
WLCG Manchester Report
HEPiX Spring 2014 Annecy-le Vieux May Martin Bly, STFC-RAL
Exploitation and Sustainability updates
Ian Collier STFC Rutherford Appleton Laboratory
National e-Infrastructure Vision
SCD Cloud at STFC By Alexander Dibbo.
Dagmar Adamova, NPI AS CR Prague/Rez
HPEiX Spring RAL Site Report
UK Status and Plans Scientific Computing Forum 27th Oct 2017
ALICE Computing Upgrade Predrag Buncic
New strategies of the LHC experiments to meet
Input on Sustainability
LHC Data Analysis using a worldwide computing grid
EGI Webinar - Introduction -
Simplified Deployment and Ready-to-Use Solution Breaks Down Barriers to Hybrid Cloud MINI-CASE STUDY “By joining the Microsoft Azure Marketplace we can.
New Types of Accounting Beyond CPU
EGI-Engage T. Ferrari/EGI.eu.
This work is supported by projects Research infrastructure CERN (CERN-CZ, LM ) and OP RDE CERN Computing (CZ /0.0/0.0/1 6013/ ) from.
WLCG Tier-2 site at NCP, Status Update and Future Direction
User Accounting Integration Spreading the Net.
Presentation transcript:

STFC in INDIGO DataCloud WP3 INDIGO DataCloud Kickoff Meeting Bologna April 2015 Ian Collier

STFC The Science and Technology Facilities is one seven UK research councils –STFC is a funding agency –STFC runs large scientific facilities Telescopes Particle physics Computing Scientific Computing Department –UK Tier 1 Centre at the Rutherford Appleton Laboratory Ian Collier coordinating INDIGO work –Other staff to be determined

STFC – RAL Tier 1 WLCG Tier 1 –13K core batch system (HTCondor & ARC CE) –12PB online disk storage (Castor) –13PB custodial (tape) storage –Run global & national services FTS3,CVMFS Stratum 0 & Stratum 1 Scientific Computing Cloud –1000 core OpenNebula private cloud 1PB (raw) Ceph cloud backend –Several PB ceph cluster testing grid storage –Developing shared use of batch & cloud on same physical resources –Bringing first external users online

Task T3.1: Software quality assurance –Particular focus on ensuring the security of the proposed solutions offered by INDIGO NOT a line by line audit Rather ensuring security & traceability considerations are built in at all levels –STFC has deep experience to draw upon in this area leads EGI Security tasks Currently leading WLCG cloud traceability WG

Task T3.3: Pilot Services Building on experience –Running a WLCG Tier 1 –Engaged in staged rollout & early adopter activities –Recent work integrating private cloud resources into our production grid site –Cloud platform (which can be expanded into our much larger batch system) explicitly available for pilot deployment WLCG workload permitting can potentially be temporarily expanded to entire T1 CPU resource

Questions