GOCDB Update 27/05/2016 Me: Working on GOCDB 3 days a week

Slides:



Advertisements
Similar presentations
Make Secure Information Sharing (SIS) Easy and an Reality C. Edward Chow, PI Osama Khaleel Bill Kretschmer C. Edward Chow, PI Osama Khaleel Bill Kretschmer.
Advertisements

Building Search Portals With SP2013 Search. 2 SharePoint 2013 Search  Introduction  Changes in the Architecture  Result Sources  Query Rules/Result.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
Introduction With TimeCard users can tag SharePoint events with information that converts them into time sheets. This way they can report.
Marian Babik, Luca Magnoni SAM Test Framework. Outline  SAM Test Framework  Update on Job Submission Timeouts  Impact of Condor and direct CREAM tests.
Module 10 Administering and Configuring SharePoint Search.
UK NGI Operations John Gordon 15 th May Helpdesk Ticket Workflow NGI Core Services.
New & Improved Events List Relationships and Joins Large List Support Field & List Item Validation.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES GGUS Overview ROC_LA CERN
Emergency Suspension list Vincent BRILLAULT HEPiX Spring 2014, Annecy.
TopCAT Use Cases Priorities User Interface 1 ICAT developer workshop, August 2009 Laurent Lerusse – STFC
Storage Accounting John Gordon, STFC GDB March 2013.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number STFC Daresbury Labs, Warrington,
© FPT SOFTWARE – TRAINING MATERIAL – Internal use 04e-BM/NS/HDCV/FSOFT v2/3 JSP Application Models.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
Biomedical Informatics Research Network Feature & Requirements of the BIRN Portal: Detail User Requirements Jeff Grethe, Steve Peltier October 9, 2002.
European Grid Initiative e-Infrastructure Directory Service: GOCDB Tiziana Ferrari/EGI.eu on behalf of David Meredith/STFC 1 Wiki:
GOCDB Handover + Status Update Quite heavy GGUS ticketing traffic; responding to user issues has been quite timely, especially in first few weeks (expected.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regional tools use cases overview Peter Solagna – EGI.eu On behalf of the.
GocDB Extensibility Mechanism David Meredith James McCarthy.
Maria Alandes Pradillo, CERN Training on GLUE 2 information validation EGI Technical Forum September 2013.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
GOCDB Status and Plans David Meredith John Casson
Accounting Review Summary and action list from the (pre)GDB Julia Andreeva CERN-IT WLCG MB 19th April
David Hatten Developer, UrbanCode 17 October 2013
WLCG IPv6 deployment strategy
Gridpp37 – 31/08/2016 George Ryall David Meredith
WLCG Workshop 2017 [Manchester] Operations Session Summary
GOCDB + EGI Marketplace
NGI and Site Nagios Monitoring
Project Center Use Cases Revision 2
UVOS and VOMS differences
gLite->EMI2/UMD2 transition
GOCDB New Requirements
Key Activities. MND sections
POW MND section.
1 VO User Team Alarm Total ALICE ATLAS CMS
Short term improvements to the Information System: a status report
Programming Assignment #1
Operational Tools Update OMB 27/07/2010
1 VO User Team Alarm Total ALICE ATLAS CMS
Patricia Méndez Lorenzo ALICE Offline Week CERN, 13th July 2007
1 VO User Team Alarm Total ALICE 1 2 ATLAS CMS 4 LHCb 20
Advancements in Availability and Reliability computation Introduction and current status of the Comp Reports mini project C. Kanellopoulos GRNET.
1 VO User Team Alarm Total ALICE ATLAS CMS
CRC exercises Not happy with the way the document for testbed architecture is progressing More a collection of contributions from the mware groups rather.
Update from the HEPiX IPv6 WG
GOCDB Mini-Project Scoping Enhancements and Management Interface
Project Center Use Cases Revision 3
Artem Trunov, Günter Quast EKP – Uni Karlsruhe
APEL Storage Accounting
Outline Introduction Objectives Motivation Expected Output
1 VO User Team Alarm Total ALICE 2 ATLAS CMS LHCb 14
Project Center Use Cases Revision 3
TS4.10 Comp Reports A new approach to Computing Availability/Reliability reports for EGI Progress Report C. Kanellopoulos GRNET 9/14/2018.
Introduction With TimeCard users can tag SharePoint events with information that converts them into time sheets. This way they can report.
Monitoring of the infrastructure from the VO perspective
xGUS The EGI Helpdesk Template
EGI OMB 24/11/2017 George Ryall David Meredith
IPv6 transition Vincenzo Spinoso EGI Operations.
EGI Ops Tools Advisory Group (GOCDB)
Guidelines Please do not add more slides than required by this template Presentation time 5min Rehearse!
IPv6 update Duncan Rand Imperial College London
Kanban Task Manager SharePoint Editions ‒ Introduction
Presentation transcript:

27/05/2016 George.Ryall@stfc.ac.uk David.Meredith@stfc.ac.uk GOCDB Update 27/05/2016 George.Ryall@stfc.ac.uk David.Meredith@stfc.ac.uk Me: Working on GOCDB 3 days a week So far I have been getting up to speed and making ipv6 test machine work My first major task will be the write API (more later) If you recognise me, it’s because I previously worked on GOCDB for six months - introducing scope tags and an admin interface

Current Status New tags: wlcg, atlas, alice, cms, lhcb, tier1, tier2 Integration with EGI Proxy IdP Being used by Elixir early adopters to define their infrastructure Elixir Integration Elixir sites created under ELIXIR (NGI) + CESNET-MetaCloud (Site) Elixir resources have been tagged with the ‘elixir’ reserved scope tag. Q: Can ARGO/OpsPortal use the tags to filter/group/monitor resources based on these tags? IPv6 GOCDB test instance Being tested by WLCG IPv6 testbed WLCG campaign to validate wlcg VO reserved scope tags New tags: wlcg, atlas, alice, cms, lhcb, tier1, tier2 All sites being asked to check their reserved scope tags, see: https://twiki.cern.ch/twiki/bin/view/EGEE/VOTagsVal Last check: ~84 site-tickets solved, ~34 assigned or in-progress Lots of discussion on the use of GOCDB VO scope tags for WLCG use-cases (for example, should a tag with a given VO name imply that the: service is available for VO; service is used by VO; service is known by the VO but not currently in use; service should be tested by VO ?) WLCG exploring the use of GOCDB to replace BDII Requires a Write API to POST semi-static service/custom props Details: https://twiki.cern.ch/twiki/bin/view/EGEE/StopBDII#Computing See next slide If tag use is to reflect BDII then it is about authorisation of that VO to use the resource

WLCG exploring use of GOCDB to replace BDII New attributes required in GOCDB Has been prototyped using the custom properties feature, (next slide) Still a proposal Proposed WLCG future Info system architecture

Custom Properties Used to Prototype/Explore WLCG Requirements for new Attributes 1) Paste/upload multiple-property template file 2)

Write API to Update/Add Custom Properties Proposal 1: Add a write API methods to POST properties to a specified Site, Service, ServiceEndpoint, e.g. ‘/gocdbpi/site/<siteId>/updateCustomProps’ ‘/gocdbpi/service/<serviceId>/updateCustomProps’ ‘/gocdbpi/serviceEndpoint/<servEndpId>/updateCustomProps’ Proposal 2: To secure the methods, allow SiteAdmins to create/manage their own ACL via the portal UI SiteAdmins edit which DNs can POST updates (e.g. DNs of robot certs for scripting).

~v5.6.1 – Default Paging (date TBC) Some queries are expensive (memory + timeout limits exceeded) Introduce default paging on expensive PI queries get_downtime* get_service* others…. If ‘page’ URL param is not specified, page 1 is returned by default Current, next, last page provided in <results> Clients must re-issue the query and increment page to fetch all the results Will require widespread agreement and consultation before implementation

~v5.6.1 – Default Paging (date TBC) Some queries are expensive (memory + timeout limits exceeded) Introduce default paging on expensive PI queries get_downtime* get_service* others…. If ‘page’ URL param is not specified, page 1 is returned by default Current, next, last page provided in <results> Clients must re-issue the query and increment page to fetch all the results Will require wides[read agreement and consultation before implementation