Fabric and Storage Management GridPP Fabric and Storage Management GridPP 24/24 May 2001.

Slides:



Advertisements
Similar presentations
CERN STAR TAP June 2001 Status of the EU DataGrid Project Fabrizio Gagliardi CERN EU-DataGrid Project Leader June 2001
Advertisements

An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
24-May-01D.P.Kelsey, GridPP WG E: Security1 GridPP Work Group E Security Development David Kelsey CLRC/RAL, UK
GridPP7 – June 30 – July 2, 2003 – Fabric monitoring– n° 1 Fabric monitoring for LCG-1 in the CERN Computer Center Jan van Eldik CERN-IT/FIO/SM 7 th GridPP.
GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC GridPP2: Data and Storage Management.
Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.
Particle physics – the computing challenge CERN Large Hadron Collider –2007 –the worlds most powerful particle accelerator –10 petabytes (10 million billion.
Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.
Level 1 Components of the Project. Level 0 Goal or Aim of GridPP. Level 2 Elements of the components. Level 2 Milestones for the elements.
Tony Doyle GridPP2 Proposal, BT Meeting, Imperial, 23 July 2003.
GridPP Presentation to PPARC e-Science Committee 26 July 2001 Steve Lloyd Tony Doyle John Gordon.
The National Grid Service Mike Mineter.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
15 May 2006Collaboration Board GridPP3 Planning Executive Summary Steve Lloyd.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
EGEE statement EU and EU member states major investment in Grid Technology Several good prototype results Next Step: –Leverage current and planned national.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Cracow Grid Workshop, November 5-6, 2001 Towards the CrossGrid Architecture Marian Bubak, Marek Garbacz, Maciej Malawski, and Katarzyna Zając.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC WP2+5: Data and Storage Management.
ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.
Olof Bärring – WP4 summary- 6/3/ n° 1 Partner Logo WP4 report Status, issues and plans
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
DataGrid Applications Federico Carminati WP6 WorkShop December 11, 2000.
Robin Middleton RAL/PPD DG Co-ordination Rome, 23rd June 2001.
GRID IIII D UK Particle Physics GridPP Collaboration meeting - R.P.Middleton (RAL/PPD) 23-25th May Grid Monitoring Services Robin Middleton RAL/PPD24-May-01.
3 June 2004GridPP10Slide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
CRISP & SKA WP19 Status. Overview Staffing SKA Preconstruction phase Tiered Data Delivery Infrastructure Prototype deployment.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
InterGrid Meeting 7 Oct 2001 Tony Doyle. Tony Doyle - University of Glasgow GridPP Status  Financial Background  Deliverables  Recruitment  Regional.
GridPP Presentation to AstroGrid 13 December 2001 Steve Lloyd Queen Mary University of London.
EGEE is a project funded by the European Union under contract IST Middleware Planning for LCG/EGEE Bob Jones EGEE Technical Director e-Science.
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
1 Microsoft Project Solution Offerings and the next chapter of EPM September 17th, 2003 Brendan Giles, PMP Systemgroup Management Services.
GRID IIII D UK Particle Physics Tony Doyle - University of Glasgow GridPP Status Report  Executive Summary  News  “Unfunded” EU DataGrid Posts  Shadow.
October 30, 2001ATLAS PCAP1 LHC Computing at CERN and elsewhere The LHC Computing Grid Project as approved by Council, on September 20, 2001 M Kasemann,
…building the next IT revolution From Web to Grid…
11/5/2001WP5 UKHEPGRID1 WP5 Mass Storage UK HEPGrid UCL 11th May Tim Folkes, RAL
E-Science Research Councils awarded e-Science funds ” science increasingly done through distributed global collaborations enabled by the Internet, using.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
Unit – I Presentation. Unit – 1 (Introduction to Software Project management) Definition:-  Software project management is the art and science of planning.
David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.
LHC Computing, SPC-FC-CC-C; H F Hoffmann1 CERN/2379/Rev: Proposal for building the LHC computing environment at CERN (Phase 1) Goals of Phase.
CERN 1 DataGrid Architecture Group Bob Jones CERN.
LHC Computing at RAL PPD Dave Newbold RAL PPD / University of Bristol The LHC computing challenge PPD and the Grid Computing for physics PPD added value.
14 June 2001LHCb workshop at Bologna1 LHCb and Datagrid - Status and Planning F Harris(Oxford)
10-Feb-00 CERN HepCCC Grid Initiative ATLAS meeting – 16 February 2000 Les Robertson CERN/IT.
J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen
Hall D Computing Facilities Ian Bird 16 March 2001.
UK Grid: Moving from Research to Production
Grid related projects CERN openlab LCG EDG F.Fluckiger
UK GridPP Tier-1/A Centre at CLRC
Fabric and Storage Management
Testbed Software Test Plan Status
Grid Portal Services IeSE (the Integrated e-Science Environment)
Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002
Report on GLUE activities 5th EU-DataGRID Conference
Wide Area Workload Management Work Package DATAGRID project
LHC Computing Grid Project
I Datagrid Workshop- Marseille C.Vistoli
LHC Computing, RRB; H F Hoffmann
Presentation transcript:

Fabric and Storage Management GridPP Fabric and Storage Management GridPP 24/24 May 2001

Fabric and Storage Management GridPP Overview GridPP Proposal –Other UK Proposals EU-DataGrid US Activities Commercial Activities Timescales Commentary Lots of Activity Duplication? GridPP role

Fabric and Storage Management GridPP Compute & Mass Storage BlueChip HPC COTS HPC Clusters User Portal Storage No: Networks Brokerage Collective

Fabric and Storage Management GridPP GridPP Proposal Compute Develop Project Plan (UKDG) COTS system development (UKDG) Integration of existing Fabric(UKPP) Fabric Benchmarking(UKPP) User Portals(UKPP) Fabric Demonstrator cf EU-WP4 API design? Clear Model?

Fabric and Storage Management GridPP GridPP Proposal Mass Storage Evaluation and API design(EU) Prototype(EU) Refinement of API(UKDG) Definition of Metadata(UKDG) Metadata(UKDG)

Fabric and Storage Management GridPP DataGrid Information –Architecture Definition Documents –WP Milestones Month 9 Deliverables Note GridPP: ATF? reevaluate Deliverables

Fabric and Storage Management GridPP Other UK Proposals GenGrid EPSRC testbed –E-Commerce related Generic Grid Activities within Universities GridPP Are we really the leaders?

Fabric and Storage Management GridPP DataGrid(WP4) Tasks –Configuration management –Resource management –Gridification –Installation –Monitoring –Fault Tolerance

Fabric and Storage Management GridPP DataGrid(WP5) Originally –Mass Storage part of local fabric E.g. Part of a HSM at a large centre Post Architecture Task Force (ATF) –Storage Element Interfaces (SEs) Applicable at MORE than Tier-1 centres!!!! Directly accessible from the Grid –Tape and Disk Pools –Publishing Metadata UK Contribution Important: Edinburgh RAL

Fabric and Storage Management GridPP US Activities GriPhyN –Virtual Data Toolkits Particle Physics Data Grid (to 2004) – –Very WP4/WP5 based

Fabric and Storage Management GridPP Commercial Activities ICT companies monitoring Grid –Strategically placing themselves E.g. IBM –Development CISCO… We MUST not be blind to E-commerce relationships –resources –manpower

Fabric and Storage Management GridPP Commercial Activities E-commerce –Testbeds are vital –Companies or Consortia see 10-20% savings Can invest MUCH more than GridPP ever can by at least 2 orders of magnitude Have more access to trained software teams

Fabric and Storage Management GridPP WG-D Tasks Definitions 1.Integration of Existing Compute Fabric 2.COTS Compute System Development 3.DataGrid Common API 4.DataGrid Meta-data for Mass Storage 5.DataGrid Tape Exchange Design (!) 6.DataGrid Tape Exchange Implementation (!)

Fabric and Storage Management GridPP Current Delivery Schedule

Fabric and Storage Management GridPP Commentary GridPP Fabric + Storage Management –Priority: deploy effort to satisfy DataGrid contract for PPARC –Recommend 6 month report (Nov 2001?) Position GridPP relative to worldwide Grid activities and build NOT compete Evaluate Fabric Development Strategy in light of products and needs of LHC and E-commerce Time to engage Computer Scientists and commercial partners both as stakeholders and contractually Time to find the right people (we dont have enough) –(If cannot need to readjust goals!) –resources

Fabric and Storage Management GridPP Commentary Building something, no matter how bad it is, is better than nothing at all…(I disagree) National, international academic and commercial collaboration is vital Simplicity,robustness and useability are very important –Our lives depend on it –Note tendency to overambitious plans Skilled programmer crisis will kill the project –Must work with industry or subcontract deliverables

Fabric and Storage Management GridPP GridPP WG-D Objectives System software for integration of existing Grid components Develop system(s) for COTS integration Work with HPC supplier towards Grid enabled proprietary systems Build fabric management model allowing hot- swapping and hot-addition of new technologies Provide on-going benchmarking and cost- performance analysis of Grid components Produce 1 st level user portals to Grid fabric

Fabric and Storage Management GridPP Objectives Continued… Proof of concept for on thousand PC level of scaling to 10k level Define and implement mass storage API Devise method of moving physical tapes and associated meta-data between centres Tools and schema for meta data and mass storage information services (not physical datasets) Integrate with DataGrid WP4 and WP5 programmes