EGI InSPIRE Report to the EGI Council Steven Newhouse On behalf of the Editorial Board.

Slides:



Advertisements
Similar presentations
Shaping Our Future: A New Proposal for Global Collaboration IAB Global Summit 2012 David Doty New York City October 3, 2012.
Advertisements

EGI Status. 9th Sep 2009 EGI Status 2 Outline EGI –The Council –EGI.eu & EGI PROPER proposal SSCs, Middleware (gLite, EMI, UMD) Now.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE-III Program of Work Erwin Laure EGEE-II / EGEE-III Transition Meeting CERN,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Introduction to EGI Service Cost Analysis, Motivation and Expected Results.
EGI: A European Distributed Computing Infrastructure Steven Newhouse Interim EGI.eu Director.
EGI – the next evolutionary step in Grid infrastructures Luděk Matyska CESNET Czech Republic
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks From ROCs to NGIs The pole1 and pole 2 people.
EGI Status and Outlook Pre-GDB May 12 th, 2009 Jürgen Knobloch, CERN EGI_DS Technical Director 2-Mar-091 J. Knobloch - Pre-GDB 12-May-2009.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Future support of EGI services Tiziana Ferrari/EGI.eu Future support of EGI.
What is EGI? The European Grid Infrastructure enables access to computing resources for European scientists from all fields of science, from Physics to.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PoW for the second year Transition to EGI.
EGI: SA1 Operations John Gordon EGEE09 Barcelona September 2009.
EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director.
Towards the new EGI governance model Arjen van Rijn (Nikhef) Chair Organizational Taskforce (EGI_DS and Local Host)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
Overview & Status of the Middleware & EGI Core Proposals Steven Newhouse Interim EGI Director EGEE Technical Director 26/05/2016 Status of EGI & Middleware.
Notur: - Grant f.o.m is 16.5 Mkr (was 21.7 Mkr) - No guarantees that funding will increase in Same level of operations maintained.
The EGI Blueprint: Grid Operations and Security Migration to the next grid operations era Tiziana Ferrari (Istituto Nazionale di Fisica Nucleare)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ?? Athens, May 5-6th 2009 Community Support.
European Middleware Initiative (EMI) – Release Process Doina Cristina Aiftimiei (INFN) EGI Technical Forum, Amsterdam 17. Sept.2010.
Ian Bird LCG Project Leader OB Summary GDB 10 th June 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse Technical Director CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
Your university or experiment logo here The European Landscape John Gordon GridPP24 RHUL 15 th April 2010.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Fergusson, Emidio Giorgio, Gergely.
EGEE-III-INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-III All Activity Meeting Brussels,
Dieter European Grid Initiative Towards a sustainable production grid infrastructure.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director Technical Director EGEE-III 1GDB - December 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell NA3 Activity Manager 02.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI On the EGI Operational Level Agreement Framework Tiziana Ferrari, EGI.eu.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell NA3 Activity Manager 28.
WLCG Laura Perini1 EGI Operation Scenarios Introduction to panel discussion.
Update on HEP SSC WLCG MB, 18 th August 2009 Jamie Shiers Grid Support Group IT Department, CERN.
European Grid Initiative Design Study Current Status Luděk Matyska CESNET EGI_DS Project Director (With thanks to Juergen Knobloch for pictures)
PIC port d’informació científica EGEE – EGI Transition for WLCG in Spain M. Delfino, G. Merino, PIC Spanish Tier-1 WLCG CB 13-Nov-2009.
4 May 2009SSC Workshop, Athens1 User Community Services, SSCs, NGI International Tasks 04 May 2009 EGEE/EGI SSC Workshop – Athens, Greece Diana Cresti,
Enabling Grids for E-sciencE EGEE-III INFSO-RI NA1 EGI Task Transition All Activity Meeting – January 2009.
European Grid Initiative Design Study Current Status Luděk Matyska CESNET EGI_DS Project Director (With thanks to Juergen Knobloch for pictures)
Security Policy Update WLCG GDB CERN, 8 Dec 2010 David Kelsey STFC/RAL david.kelsey AT stfc.ac.uk.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA2 Networking support for EGEE III Xavier.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA5: Policy and International Cooperation.
Components Selection Validation Integration Deployment What it could mean inside EGI
E-science grid facility for Europe and Latin America CHAIN Proposal v0.1 EELA-2 compilation CERN e-Infrastructure projects Meeting ( )
Ian Bird LCG Project Leader Status of EGEE  EGI transition WLCG LHCC Referees’ meeting 21 st September 2009.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Plans for PY2 Steven Newhouse Project Director, EGI.eu 30/05/2011 Future.
EGI-InSPIRE RI EGI-InSPIRE RI EGI-InSPIRE 1 EGI Governance Model Yannick Legré Director, EGI.eu
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Funding Global Tasks.
SAFE SSCs for A&A, Fusion and ES Coordinator: Claudio Vuerli, INAF, Italy.
EGI-InSPIRE Project Overview1 EGI-InSPIRE Overview Activities and operations boards Tiziana Ferrari, EGI.eu Operations Unit Tiziana.Ferrari at egi.eu 1.
Setting up NGI operations Ron Trompert EGI-InSPIRE – ROD teams workshop1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI NA2: Community Engagement Steven Newhouse EGI.eu EGI-InSPIRE Review 2013.
EGI-InSPIRE EGI-InSPIRE RI The European Grid Infrastructure Steven Newhouse Director, EGI.eu Project Director, EGI-InSPIRE 29/06/2016CoreGrid.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Engagement meeting Gergely Sipos EGI.eu 1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI.eu Service Portfolio - EGI CF’13 - Apr 2013 EGI.eu Service Portfolio.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Sustainability & Business Models Sergio Andreozzi EGI.eu Policy Development.
SLAs with Software Provider. Scope “…declare the rights and responsibilities between EGI.eu and the Software Provider for a particular component.” Which.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support SSC and proposal Gergely Sipos
Options for association and collaboration with CERN
Luděk Matyska CESNET ERIC Survey Results Luděk Matyska CESNET
Steven Newhouse Project Director, EGI.eu
NA3: User Community Support Team
ROSCOE Robust Scientific Communities for EGI
Connecting the European Grid Infrastructure to Research Communities
EGI – Organisation overview and outreach
Steven Newhouse, EGI.eu EGI-InSPIRE Project Director
Operations sustainability
The EGI.eu Organisation
EGI-Engage T. Ferrari/EGI.eu.
Presentation transcript:

EGI InSPIRE Report to the EGI Council Steven Newhouse On behalf of the Editorial Board

Discussion points Letter of Support Conference Location Project Membership Project Structure Global Task Allocation Budget & Project Goals

Letters of Support All requests for LoS to be submitted by 16 th October All requests presented at EGI Council for approval on 23 rd October LoS written after EGI Council meeting Recognise different LoS types: –Middleware, Collaboration, SSCs Document with the Steering Committee for review Agree and provide feedback on the criteria

Conference Location Proposal to have two large annual meetings –User focussed –Infrastructure focussed Work with other providers to make this more focused on all e-infrastructures –User Forum continues in this direction Planning for a 600 person event needs to start now –Meet in Amsterdam Autumn 2010 –Future events decided by EGI through bidding European e-Infrastructure Meeting in Amsterdam, Autumn 2010

Project Structure & Membership 1.Requirement that ALL funded partners must be represented through the EGI Council –Restriction EGI-InSPIRE projects to ‘NGI’ JRUs or equivalent –Simplifies the management structure –Limits flexibility 2.EGI Council manages EGI.eu and EGI.eu is a partner in EC projects –Allows EGI.eu participation beyond EGI-InSPIRE –Complicates the management structure –Allows involvement in multiple projects

EGI-InSPIRE EGI.eu (Management) Management Issues EGI Council EGI Council Executive EGI.eu EGI.eu EGI.eu NGIs NGI/EIRO NGIs/EIROs NGIs & EIROs EGI-InSPIRE Collaboration Board Project Management Board Partners Project Partners EC Project n Collaboration Board Project Management Board Partners Project Partners EGI.eu/NGI/EIRO Staff Agree on single or multi-project model

Project Structure NA1: Project Management NA2: External Relations: Policy, Dissemination and Standards SA3 Software Support SA2 Middleware Unit SA1 Operations JRA1 Operational Tools SA4 Services for HUCs NA3 User Support Software Provisioning and Support Operations and Tools User Support and Services

Funding Project Activities EGI Global Tasks (EGI.eu functions) –Done by one on behalf of all –Primarily: NA1, NA2, NA3, SA1 & SA2 NGI International Tasks –Mainly SA1 –Small amount of effort in NA2 & NA3 Other EGI Activities (Effort in NGIs) –SA3, SA4, JRA1

Received NGI Information Spain Ireland Bulgaria Croatia Switzerland Finland Slovakia The Netherlands Greece Belgium Serbia Romania Latvia UK Armenia Georgia Moldova NGIs not providing information will not be in the project. Please provide details ASAP.

Global Task Allocation Recall the procedure: –Open bidding & review of proposals –74 proposals from 14 NGIs for 34 tasks Proposed allocations passed to EGI CSC –One proposal: Technical check –Competing Proposal: Check, Reviewed, Ranked Reviewers: Experts from NGIs & SSCs

Allocated Tasks (Single bid) TaskDescriptionOrganisation O-E-1GOCDBUK O-E-4Operations PortalFrance O-E-8User RequirementsGermany O-E-6Operation of a helpdeskGermany O-E-15Security PolicyUK & Netherlands U-E-5User Technical ServicesSpain & Portugal U-E-1User ForumEGI.eu U-E-3Event OrganisationEGI.eu O-E-5Grid Operation & OversightNetherlands & Poland Agree on allocation

Allocated Tasks (Contested) TaskDescriptionOrganisation O-E-9Middleware RolloutSpain & Portugal O-E-12Network SupportItaly O-E-14Core Grid ServicesGreece O-E-2Accounting RepositoriesUK & Spain O-E-10Resource AllocationPoland O-E-11InteroperationSweden O-E-13Best PracticesFinland O-E-16Security Incident ResponseUK & Netherlands U-E-6Informational & High-level toolsGreece Agree on allocation

Allocated Tasks (Contested) TaskDescriptionOrganisation U-E-2Coordination of SSCsEGI.eu E-E-1DisseminationEGI.eu E-E-3Industry UptakeEGI.eu E-E-4External RelationsEGI.eu U-E-9New Communities & Front DeskEGI.eu O-E-7Triage of Incoming ProblemsGermany & Netherlands U-E-8TrainingUK O-E-17Operational ToolsNot clear U-E-7Document ReviewNot clear Agree on allocation

Remaining Tasks - Middleware Technical: –Document Process (M-E-1) –Define & Verify Quality Criteria (M-E-3) Process Support: –Tools (M-E-2) –Repository (M-E-4) Coordination: –Execute Plan (M-E-4) –Grid Planning & MCB (U-E-4)

Middleware Tasks - Next Steps The Technical, Process Support & Coordination Tasks should be grouped The Coordination Tasks should be at EGI.eu The Technical tasks should not be co-located with a major software supplier to EGI Who should be allowed to bid? 1.NGIs that previously bid for any of these tasks 2.All NGIs ‘MU Coordination Tasks’ at EGI.eu ‘Technical Tasks’ not with Software Provider Agree on who is allowed to bid

Remaining Task – O-E-3 Repositories for monitoring and performance –Has changes considerably since the Blueprint –Move to regional monitoring structure –Move to ActiveMQ Bids: –France, Germany, Greece, Italy, Poland & Croatia Task description will be revised by SA1 during EGEE’09 Bidding NGIs will be asked to review their bids with the new task definition –Selection made using same process for other tasks Agree on process for O-E-3

Other ‘Global’ Tasks Support for deployed production middleware (SA3) –YES: Call for sites with production experience in all EGI related middleware (gLite, ARC, UNICORE) –Criteria: Minimal set that covers most middleware and deployment environments Operational Tools Maintenance & Development (JRA1) –NO: Maintenance driven by partners that are providing the relevant EGI tasks –YES: New development of operational tools should be agreed. NB: This may need to be in a different project Open bids for SA3 & new Operational Tools

New ‘Global’ Tasks Several new or missing activities have been defined: –Site Security Monitoring Tools –Software Vulnerability Group (a.k.a. GSVG) What is the process for defining other tasks? –Defining new tasks has a budget implication on EGI.eu Any new Global have equal EC/NGI contribution and assessed for inclusion as a persistent Global task in future projects

Budget & Project Goals What do we want out of the project? –Transition to a sustainable model –Keep an integrated worldwide model Demonstrate transition to self funding Need to consider what is core & non-core? –New Operational Tools –Developing Scientific Gateways

Global Task Funding Current expectation is not clear! –EGEE generally has 50% EC contribution Following financial models show increased EGI.eu contribution from NGIs Proposed funding model for Global Tasks –Decrease EC & NGI funding –Increase funding direct from EGI.eu as subcontract EGI.eu funds contracted back to NGIs that provide Global Tasks to the Community

NGI Budget Data Input from 31 NGIs Uncorrected International Tasks –7 (Armenia)  360 (Italy) PM a year –Total 2848PM (237FTE) a year Bids reviewed to assess reasonable effort –Decided a ‘reasonable’ level of effort –7 (Armenia)  190 (Italy) PM a year –Total 2281PM (190FTE) a year

Issues International Tasks are the EXTRA work an NGI has to do to support European collaboration –That does not mean 2 FTE to provide security coordination! O-N-5,6 & 7: NGI e-Infrastructure Oversight, Integration of NGI ticketing system, Triage and monitoring of the incoming tickets –Ranged from 0 (Switzerland)  120 (UK) –Cut to something reasonable... 24PM? –Cuts 360PM (12FTE) to 1921PM (160FTE) Agree on following Funding Model 1, 2 or 3

Opt 1:EGI V2 ActivityFTEME/yearEGI.euFrom ECFrom NGI EGI.eu NGI International NGI HUC NGI Other TOTAL ME, 24 month project Increase EGI.eu in Y2=2.6ME

Opt 2:EGI V2 (Reduce NGI Tasks) ActivityFTEME/yearEGI.euFrom ECFrom NGI EGI.eu NGI International NGI HUC NGI Other TOTAL Increase EGI.eu: Y2=2.5ME, Y3=4ME 30 month:~26.0ME NB: Still need to refine effort for 25ME 36 month:~29.9ME

Opt 3:EGI V2 (Minimal) ActivityFTEME/yearEGI.euFrom ECFrom NGI EGI.eu NGI International NGI HUC NGI Other TOTAL Use aligned EC projects (now or next year) New Operational Tools & development (~10 FTE) Gateway project (~6FTE) Cut SA4 (-10%) & SA3 (-25%) Increase EGI.eu: Y2=3M, Y3=5M 36 month: ~26.55ME

Other Options Move other activities into other projects –Gateways, New Operational Tools,... Reduce the level of activity in other areas: –NGI International Tasks –HUCs Increase the EC contribution for NGI tasks –5% increase a year? Availability of further funds in FP7 –YES: For EGI related projects –NO: For the support of EGI itself Further cuts to make a 4 year project?

Remaining Schedule 30/9/09: Comments on V2 draft 8/10/09: V3 draft: –Integrate comments and put into table format. –Send to consultant for high level feedback. 15/10/09: Comments on V3 draft 19/10/09: V4 draft: –Polished with completed effort tables and A2 forms. –Send to consultant for detailed feedback. 23/10/09: EGI Council (Brussels) 27/10/09: Comments on V4 draft 30/10/09: Version submitted into EPSS 6/11/09: Version submitted into EPSS 13/11/09: Version submitted into EPSS 20/11/09: Version submitted into EPSS 24/11/09: CALL CLOSES

Other Issues?

From the previous EGI Council Steering Committee meetings the following constraints have been imposed on the budget simulation: 4 year project EGI.eu contributions start at 1M€ in year 1 and increase linearly to 2M€ in year 4 90K€/year staff cost which includes indirect costs The Heavy User Communities funding is an average of 23FTE only over the first 3 years The minimum EC contribution to EGI.eu related activities is 25% The NGI contribution to EGI.eu related activities is 50% The NGI contribution to NGI International Tasks is 67%

The EGI-InSPIRE project has staff in four different categories: Activity A: EGI Global Tasks coordinated by EGI.eu on behalf of the community and undertaken by staff employed directly by EGI.eu. Activity B: EGI Global Tasks coordinated by EGI.eu on behalf of the community and undertaken by staff employed by NGIs. Activity C: NGI International Tasks undertaken by staff in each NGI in order to interface into the operations coordinated by EGI.eu Activity D: Other activities undertaken by staff within the project located within the NGIs (primarily HUCs)