Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation.

Slides:



Advertisements
Similar presentations
Ian Bird LHCC Referees’ meeting; CERN, 18 th November 2014.
Advertisements

Ian Bird LCG Project Leader LHCC + C-RSG review. 2 Review of WLCG  To be held Feb 16 at CERN  LHCC Reviewers:  Amber Boehnlein  Chris.
Ian Bird WLCG Workshop Okinawa, 12 th April 2015.
Ian Bird WLCG Management Board CERN, 17 th February 2015.
Assessment of Core Services provided to USLHC by OSG.
EGI: A European Distributed Computing Infrastructure Steven Newhouse Interim EGI.eu Director.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director.
Ian Bird LHCC Referee meeting 23 rd September 2014.
Evolution of Grid Projects and what that means for WLCG Ian Bird, CERN WLCG Workshop, New York 19 th May 2012.
Future of Operational Tools- Separate proposal First meeting – 6th October.
WLCG Collaboration Workshop 7 – 9 July, Imperial College, London In Collaboration With GridPP Workshop Outline, Registration, Accommodation, Social Events.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
Impact of end of EMI+EGI-SA3 April 2013: EMI project finishes EGI-Inspire-SA3 finishes (mainly CERN affected) EGI-Inspire continues until April 2014 EGI.eu.
Ian Bird GDB; CERN, 8 th May 2013 March 6, 2013
Ian Bird LHCC Referees’ meeting; CERN, 3 rd March 2015.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
Ian Bird GDB CERN, 9 th September Sept 2015
Procedure to follow for proposed new Tier 1 sites Ian Bird CERN, 27 th March 2012.
Evolution of storage and data management Ian Bird GDB: 12 th May 2010.
Future computing strategy Some considerations Ian Bird WLCG Overview Board CERN, 28 th September 2012.
Procedure for proposed new Tier 1 sites Ian Bird WLCG Overview Board CERN, 9 th March 2012.
WLCG Technical Evolution Group: Operations and Tools Maria Girone & Jeff Templon Kick-off meeting, 24 th October 2011.
WLCG Laura Perini1 EGI Operation Scenarios Introduction to panel discussion.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
Ian Bird WLCG Workshop, Barcelona, 9 th July July 2014 Ian Bird; Barcelona1.
Additional Services: Security and IPv6 David Kelsey STFC-RAL.
DJ: WLCG CB – 25 January WLCG Overview Board Activities in the first year Full details (reports/overheads/minutes) are at:
Data management demonstrators Ian Bird; WLCG MB 18 th January 2011.
Ian Bird CERN, 17 th July 2013 July 17, 2013
Summary of HEP SW workshop Ian Bird MB 15 th April 2014.
Ian Bird WLCG Networking workshop CERN, 10 th February February 2014
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI strategy and Grand Vision Ludek Matyska EGI Council Chair EGI InSPIRE.
WLCG Technical Evolution Group: Operations and Tools Maria Girone & Jeff Templon GDB 12 th October 2011, CERN.
Some interest in common solutions in various areas – Federated data, common analysis framework, dashboards, SAM, clouds, …, etc In 2013 after end of EGI-SA3.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Evolution of WLCG infrastructure Ian Bird, CERN Overview Board CERN, 30 th September 2011 Accelerating Science and Innovation Accelerating Science and.
Ian Bird LCG Project Leader Status of EGEE  EGI transition WLCG LHCC Referees’ meeting 21 st September 2009.
WLCG: The 1 st year with data & looking to the future WLCG: Ian Bird, CERN WLCG Project Leader WLCG Project LeaderLCG-France; Strasbourg; 30 th May 2011.
Resource Provisioning EGI_DS WP3 consolidation workshop, CERN Fotis Karayannis, GRNET.
EGI and Data Scientists: Demand Sy Holsinger EGI.eu Senior Strategy and Policy Officer EGI Community Forum November 2015, Bari EDISON – Education.
Ian Bird, CERN 1 st February Dec 2015
Outcome should be a documented strategy Not everything needs to go back to square one! – Some things work! – Some work has already been (is being) done.
Computing Fabrics & Networking Technologies Summary Talk Tony Cass usual disclaimers apply! October 2 nd 2010.
EMI is partially funded by the European Commission under Grant Agreement RI EMI Sustainability Alberto Di Meglio, CERN DCI Projects Meeting Amsterdam,
EGI-InSPIRE EGI-InSPIRE RI The European Grid Infrastructure Steven Newhouse Director, EGI.eu Project Director, EGI-InSPIRE 29/06/2016CoreGrid.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
LHCbComputing Update of LHC experiments Computing & Software Models Selection of slides from last week’s GDB
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
Ian Bird LCG Project Leader Summary of EGI workshop.
Operations Coordination Team Maria Girone, CERN IT-ES GDB, 11 July 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI.eu Service Portfolio - EGI CF’13 - Apr 2013 EGI.eu Service Portfolio.
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
Evolution of storage and data management
WLCG IPv6 deployment strategy
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
gLite->EMI2/UMD2 transition
WLCG: TDR for HL-LHC Ian Bird LHCC Referees’ meting CERN, 9th May 2017.
Final summary Ian Bird Amsterdam, DAaM 18th June 2010.
Strategy document for LHCC – Run 4
WLCG Collaboration Workshop;
WLCG Collaboration Workshop;
Connecting the European Grid Infrastructure to Research Communities
Input on Sustainability
EGI Webinar - Introduction -
This work is supported by projects Research infrastructure CERN (CERN-CZ, LM ) and OP RDE CERN Computing (CZ /0.0/0.0/1 6013/ ) from.
Presentation transcript:

Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation

Things have gone well in 1st year Worry over coming resource contention Number of interesting optimizations Xrootd for remote data acess beyond ALICE Network improvements and more site connections with LHCOne Better disk management and separation of disk and tape Looking at cloud components and broader use of virtualization – etc... View from experiments

Concern over EMI, EGI relationships Concern over evolution and future of middleware Concern over use of EMI-1 How will WLCG techniques evolve? Will there be a single common computing model ? – (and how will the models evolve) Want commonality (of WLCG) with other VOs Whole node scheduling – – group has not reported, sites need input about how to manage this View from the Tiers

Should agree that very many different types, not common across experiments WLCG should define security policy and interfaces to Tier 3s, common tools however, they should remain independent and not under strong control We need to understand how we approach this... Organise a GDB discussion on Tier 3 interfaces? Summary: – some want to be left alone - should be – some want help and suggestions, tools - can we provide such support? – Can EGI help support - yes via another volunteer NGI Tier 3s

A lot of progress since Amsterdam Dirk Duellmann: – Good list of areas where work is still needed and open questions remain – Areas for common solutions – Suggestion to have a coordination team – action for GDB? LHCONE – significant progress – Important to make sure we have sufficient and appropriate monitoring/operations Storage & Data

Need better monitoring to profile efficiency problems Can we have common strategy for data access: – files copied to WN or used from SE? – – allows site to better optimise for one or the other Whole node scheduling – need to show that real efficiency is possible before invest effort in deployment issues memory improvements by whole node sched or move to 3 GB/core? – Is whole node sched really going to be worth the effort? Resource Efficiency

Our favourite topic … still … No disagreement that we should – Assess where we are and what we need in the light of real experience with data – Document a vision of evolution for WLCG for the future – Use that to provide clear input to EMI/EGI, OSG, and others – NB: WLCG should have a vision of what WE need as a community: understood that sites have constraints of compatibility with other VOs/projects etc. but that should not our goals Process: – WG proposed – Agree mandate in a MB (next week?) – Agree membership MB Middleware…

Experience with data has clarified many things Good time to re-assess what works and what needs improvement/re-thinking Opportunities for improving commonalities – Would help support load (sites & experiments) – Should take the opportunity – Sense a willingness to do this Themes?

WLCG recognised as having enabled rapid physics output – LHCC – CERN Scientific Policy Committee – CERN Council – Resource Review Boards (i.e. Funding Agencies) – As well as many other places/articles  Repository  Dissemination  LCGNews Thanks to huge and sustained collaborative effort by all sites and experiments !! Success !

Thank you! Patrick for the excellent organisation and hospitality! – Not forgetting the DESY support team EMI and DELL for their sponsorship of the workshop and social events! 10 Summary