WLCG Data Steering Group

Slides:



Advertisements
Similar presentations
Live Healthy Napa County Creating and Sustaining a Common Agenda.
Advertisements

BFC Information and Communication Tools. Objective to facilitate communication and information flows, the sharing of technical and administrative resources.
Federated Identity Management for HEP David Kelsey WLCG GDB 9 May 2012.
Enabling Grids for E-sciencE Overview of System Analysis Working Group Julia Andreeva CERN, WLCG Collaboration Workshop, Monitoring BOF session 23 January.
© GEO Secretariat GEO Work Plan 2nd GEOSS Science and Technology Stakeholder Workshop "GEOSS: Supporting Science for the Millennium Development.
Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation.
GEO Work Plan Symposium 2012 ID-03: Science and Technology in GEOSS ID-03-C1: Engaging the Science and Technology (S&T) Community in GEOSS Implementation.
CERN IT Department CH-1211 Geneva 23 Switzerland GT WG on Storage Federations First introduction Fabrizio Furano
WLCG Collaboration Workshop 7 – 9 July, Imperial College, London In Collaboration With GridPP Workshop Outline, Registration, Accommodation, Social Events.
WLCG Grid Deployment Board, CERN 11 June 2008 Storage Update Flavia Donno CERN/IT.
Tracking national portfolios and assessing results Sub-regional Workshop for GEF Focal Points in West and Central Africa June 2008, Douala, Cameroon.
WebFTS File Transfer Web Interface for FTS3 Andrea Manzi On behalf of the FTS team Workshop on Cloud Services for File Synchronisation and Sharing.
Business Analysis. Business Analysis Concepts Enterprise Analysis ► Identify business opportunities ► Understand the business strategy ► Identify Business.
Ian Bird GDB CERN, 9 th September Sept 2015
Procedure to follow for proposed new Tier 1 sites Ian Bird CERN, 27 th March 2012.
Storage Interfaces Introduction Wahid Bhimji University of Edinburgh Based on previous discussions with Working Group: (Brian Bockelman, Simone Campana,
Data Placement Intro Dirk Duellmann WLCG TEG Workshop Amsterdam 24. Jan 2012.
Harnessing the data revolution for sustainable development in the global statistical system Meeting of Directors of National Statistics Offices on the.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
Wahid Bhimji (Some slides are stolen from Markus Schulz’s presentation to WLCG MB on 19 June Apologies to those who have seen some of this before)
INDIGO – DataCloud WP5 introduction INFN-Bari CYFRONET RIA
WGCapD, CEOS and the UN Sustainable Development Goals (SDGs) Committee on Earth Observation Satellites Deputy CEOS Executive Officer / CSA Marie-Josée.
WLCG Accounting Task Force Update Julia Andreeva CERN GDB, 8 th of June,
Capacity Building in: GEO Strategic Plan 2016 – 2025 and Work Programme 2016 Andiswa Mlisa GEO Secretariat Workshop on Capacity Building and Developing.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
Accounting Review Summary and action list from the (pre)GDB Julia Andreeva CERN-IT WLCG MB 19th April
Baseline Services Group Status of File Transfer Service discussions Storage Management Workshop 6 th April 2005 Ian Bird IT/GD.
UNGGIM – PRIVATE SECTOR NETWORK. AGENDA > OVERVIEW OF PRIVATE SECTOR >PURPOSE AND VISION OF PRIVATE SECTOR NETWORK > STRUCTURE AND TERMS OF REFERENCE.
WLCG Accounting Task Force Introduction Julia Andreeva CERN 9 th of June,
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
WLCG IPv6 deployment strategy
WLCG Workshop 2017 [Manchester] Operations Session Summary
AENEAS WP6 first conference call
Cross-sector and user-centric AAI
WLCG Network Discussion
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
Engaging with global clinical communities (on a day to day basis)
Ian Bird GDB Meeting CERN 9 September 2003
Scientific Computing Strategy (for HEP)
Taming the protocol zoo
Proposal for obtaining installed capacity
Experiment Dashboard overviw of the applications
Dagmar Adamova, NPI AS CR Prague/Rez
Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)
Update from the HEPiX IPv6 WG
WLCG Accounting Task Force Update Julia Andreeva CERN WLCG Workshop 08
Storage Resource Reporting Proposal
System performance and cost model working group
Ákos Frohner EGEE'08 September 2008
LCG Monte-Carlo Events Data Base: current status and plans
DCache things Paul Millar … on behalf of the dCache team.
WLCG and support for IPv6-only CPU
WLCG Collaboration Workshop;
LCG Operations Workshop, e-IRG Workshop
Monitoring of the infrastructure from the VO perspective
WIS Strategy – Life Cycle Data Management
Overview of working draft v. 29 January 2018
CEOS Contribution to Disaster Risk Management Way Forward
Follow us: June 15-16, 2017 Steering Committee Meeting Summary of Conclusions and Action Items Follow.
Scanning the environment: The global perspective on the integration of non-traditional data sources, administrative data and geospatial information Sub-regional.
Evidence to Action Summit Nairobi Kenya May
New Types of Accounting Beyond CPU
Interoperability and standards for statistical data exchange
To Support The Poverty Reduction Strategy on a Sustainable Basis
Plenary Decision Items
ETS WG, 31 January-2 February 2005
Employee engagement Delivery guide
CIS progress June-November 2011: main highlights
ETS WG role and working methods
Date and venue: 23 September, MSFD PCG, DG Environment, Brussels
Presentation transcript:

WLCG Data Steering Group Report and discussion Oliver Keeble, CERN

WLCG Workshop, Manchester From the WLCG MB 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Original Proposal A data steering group is created One person per experiment, storage provider, 2 or 3 for infrastructure No limit on group lifetime This steering group Defines long term WLCG strategy for data management Tracks relevant technical themes Meets regularly to define priorities And on that basis oversees pre-GDB slots Triggering of task forces if necessary WLCG data discussions in other forums, e.g. the WLCG Workshop data session Reporting to WLCG ops meeting where requested. Escalation and reporting to MB The steering group is not itself a decision-making body 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester The result The group has Met 4 times now Collected input from the stakeholders Aggregated the input, categorising under a set of 7 strategic aims Made a first prioritisation of these aims Made a first recommendation about what to do about them Full details, agendas, mandate etc https://twiki.cern.ch/twiki/bin/view/LCG/WLCGDataSteeringGroup 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Representatives Alice - Latchezar Betev Atlas - Martin Barisits CMS – Brian Bockelman LHCb- Philippe Charpentier, Christophe Haen Infrastructure Alastair Dewhurst Michel Jouvin Pepe Flix Frank Wuerthwein Operations Julia Andreeva Storage Castor, dCache, DPM, EOS, StorRM, XrootD 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester More input please… Everyone is encouraged to give input to their representative, or right now… Priorities for topics to address at the community level 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Strategic Areas 20/06/2017 WLCG Workshop, Manchester

Infrastructure diversity Promote the growth of the infrastructure through resource diversity. Cloud storage, object stores HPC Data management Colocation with other communities Adapting workflow to resources -> QoS 20/06/2017 WLCG Workshop, Manchester

Common global strategy Articulate a common vision to guide strategy Can a common vision be described? How could we get this? CWP? A reference model under iterative refinement? Identify which higher-level services are candidates for common projects Sustainability and collaboration SKA Globus project 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Quality of Service Exploit resources in the most effective way through “QoS”, understanding how different classes of service (and therefore cost) are appropriate for different workflows Parameter space – where are the gains? Role of tape beyond archive Archives backed other than by tape Cache hierarchies Tuneable reliability 20/06/2017 WLCG Workshop, Manchester

Infrastructure Architecture Understand how higher level architectural changes can be exploited Multi-site storage Regional federations Caches Diskless sites -> Networking 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Operations Reduce costs through making storage systems and data management operations easier and more transparent Storage accounting, space reporting Monitoring Topology system, CRIC 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Analysis Enable future analysis models by providing the relevant services Access paradigms Interfaces to storage systems Queries, hints. Event level access Data formats -> CWP analysis group 20/06/2017 WLCG Workshop, Manchester

AAI, Federated Identity Ensure that data management systems, and storage in particular, is ready for any new authentication and authorisation infrastructure Edugain OpenID Connect Web/non-web workflows GSI authentication 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Priorities Infrastructure diversity In particular, object stores (Atlas, CMS, xrootd) Archival storage implementations (disk/tape) and their optimal exploitation (Atlas, Alice, Castor/EOS) Caching storage (Atlas, CMS) post-X509 AAI, Federated identity (longer term) 20/06/2017 WLCG Workshop, Manchester

WLCG Workshop, Manchester Next steps Dedicated meetings on the priorities Next data pre-GDB – Sept 12th (tbc) Resource reporting Tape/archive exploitation Object stores Cross-cutting discussions AAI Networking? Exchange forum? Periodic f2f to let prototype teams share experience 20/06/2017 WLCG Workshop, Manchester