Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.

Slides:

Advertisements

Similar presentations

LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.

Advertisements

WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.

Fabric and Storage Management GridPP Fabric and Storage Management GridPP 24/24 May 2001.

LCFG overview and future Michael George University of Liverpool

Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.

Partner Logo UK GridPP Testbed Rollout John Gordon GridPP 3rd Collaboration Meeting Cambridge 15th February 2002.

29 June 2006 GridSite Andrew McNabwww.gridsite.org VOMS and VOs Andrew McNab University of Manchester.

OMII-Europe Repository Steven Newhouse Director, OMII-UK.

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.

4 th DataGRID Project Conference, Paris, 5 March 2002 Testbed Software Test Plan I. Mandjavidze on behalf of L. Bobelin – CS SI; F.Etienne, E. Fede – CPPM;

Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.

Site Authorization Service (SAZ) at Fermilab Vijay Sekhri and Igor Mandrichenko Fermilab CHEP03, March 25, 2003.

Andrew McNab - Manchester HEP - 29/30 March 2001 gridmapdir patch Overview of the problem Constraints from local systems Outline of how it works How to.

Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

Andrew McNab - Manchester HEP - 6 November Old version of website was maintained from Unix command line => needed (gsi)ssh access.

27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,

EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.

Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.

SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.

Framework for Automated Builds Natalia Ratnikova CHEP’03.

SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois

Integration of DataGrid Software for Testbed 1 Goal: combine the DataGrid middleware and the Globus core services. Phases: Preparation for Integration.

Andrew McNab - Manchester HEP - 26 June 2001 WG-H / Support status Packaging / RPM’s UK + EU DG CA’s central grid-users file grid “ping”

5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)

Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.

C. Loomis – Testbed Status – 28/01/2002 – n° 1 Future WP6 Tasks Charles Loomis January 28, 2002

Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.

Yannick Patois – CVS and Autobuild tools at CCIN2P3 – hepix - October, n° 1 CVS setup at CC-IN2P3 and Datagrid edg- build tools CVS management,

Olof Bärring – WP4 summary- 6/3/ n° 1 Partner Logo WP4 report Status, issues and plans

Crossgrid kick-off meeting, Cracow, March 2002 Santiago González de la Hoz, IFIC1 Task 3.5 Test and Integration (

A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -

Yannick Patois – Datagrid Repository Presentation- 2001/11/21 - n° 1 Partner Logo DataGrid Software Repository presentation A short presentation of the.

EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,

Andrew McNab - License issues - 10 Apr 2002 License issues for EU DataGrid (on behalf of Anders Wannanen) Andrew McNab, University of Manchester

DataGrid Applications Federico Carminati WP6 WorkShop December 11, 2000.

Grid Status - PPDG / Magda / pacman Torre Wenaus BNL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.

Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.

Security monitoring boxes Andrew McNab University of Manchester.

20-May-2003HEPiX Amsterdam EDG Fabric Management on Solaris G. Cancio Melia, L. Cons, Ph. Defert, I. Reguero, J. Pelegrin, P. Poznanski, C. Ungil Presented.

German Cancio/ WP4 -1 WP4 comments for the TestBed German Cancio / WP4

CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.

LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.

DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.

Andrew McNabSecurity Middleware, GridPP8, 23 Sept 2003Slide 1 Security Middleware Andrew McNab High Energy Physics University of Manchester.

6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.

Alain Roy Computer Sciences Department University of Wisconsin-Madison Condor & Middleware: NMI & VDT.

Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.

Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.

Andrew McNabGrid in 2002, Manchester HEP, 7 Jan 2003Slide 1 Grid Work in 2002 Andrew McNab High Energy Physics University of Manchester.

INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.

A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.

Maite Barroso - 10/05/01 - n° 1 WP4 PM9 Deliverable Presentation: Interim Installation System Configuration Management Prototype

ASIS + RPM: ASISwsmp German Cancio, Lionel Cons, Philippe Defert, Andras Nagy CERN/IT Presented by Alan Lovell.

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.

Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group

Grid Status - PPDG / Magda / pacman Torre Wenaus BNL DOE/NSF Review of US LHC Software and Computing Fermilab Nov 29, 2001.

LHCb Grid MeetingLiverpool, UK GRID Activities Glenn Patrick Not particularly knowledgeable-just based on attending 3 meetings.  UK-HEP.

DataGrid is a project funded by the European Commission under contract IST EDG Baseline API Document Document build description and current.

Andrew McNab - Globus Distribution for Testbed 1 Status of the Globus Distribution for Testbed 1 Andrew McNab, University of Manchester

SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR

JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.

Dave Newbold, University of Bristol14/8/2001 Testbed 1 What is it? First deployment of DataGrid middleware tools The place where we find out if it all.

II EGEE conference Den Haag November, ROC-CIC status in Italy

Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Developers’ Guide Maite Barroso 10/12/2002

Dave Newbold, University of Bristol21/3/2001 (Short) WP6 Update Where are we? Testbed 0 going (ish); some UK sites being tried out for production (mostly.

J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen

Testbed Software Test Plan Status

Leanne Guy EGEE JRA1 Test Team Manager

Presentation transcript:

Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication (web, mail lists) Documentation and software repositories Contacts with Globus Middleware API definitions Management of Grid partitions Getting it all to actually work...

Andrew McNab - Manchester HEP - 24 May 2001 Can we fix it? Yes we can! (Subject to available resources …)

Andrew McNab - Manchester HEP - 24 May 2001 Installation Tools Three layers of software: –a. Operating system - automated tools exist –b. Grid middleware - eg our RPM distribution –c. Applications - currently, the experiments all use different distribution methods a / b / c dont need to use same mechanisms, but they must work together. Need to be able to specify dependencies in the lower layers.

Andrew McNab - Manchester HEP - 24 May 2001 Interfaces with other groups Overlap with WorkGroup D (Fabric and Data) Need to agree package formats that will plug into fabric management systems. EU DataGrid WP4 (Fabric) is currently defining installation formats for EDG Testbed 1 - clearly this will be a major influence on LHC experiments policies. What about Babar / CDF / D0? Clearly, we need a flexible standard.

Andrew McNab - Manchester HEP - 24 May 2001 Installation proposal Carry on using RPMs –Support for source and binary packaging –Dependencies –Natural for Redhat Linux etc. –Portable to Solaris etc RPM is where WP4 seems to be going. Where necessary, use dumb tools to translate tar files to RPM - this mostly applies to HEP applications.

Andrew McNab - Manchester HEP - 24 May 2001 Support for installation etc WG-H provides support to local administrators - ultimately helpdesk? This means that we develop of pool of expertise within WG-H about common problems which everyone can draw on. Important to communicate bugs, design faults etc back to Middleware and Application authors.

Andrew McNab - Manchester HEP - 24 May 2001 Communication Tools Website - –Allows write access using Grid authentification. Mailing lists - ukhepgrid and ukhep-globus In other Open Source projects, WWW and lists allow users to aid in development. We should implement searchable list archives on the web, and make it easy for subgroups to start their own lists.

Andrew McNab - Manchester HEP - 24 May 2001 Documentation Need formal documentation if the Grid is to become pervasive (ie not just something for experts.) This is also something to offer for the Dissemination effort. Call these Guides? XYZ User Guide, XYZ Installation Guide etc. But also need informal HOWTOs for experts, which can keep up with rapidly changing code.

Andrew McNab - Manchester HEP - 24 May 2001 Software repository A central place where code (and documentation) can be stored and shared. Access via CVS and Web. Nightly builds? Problem reporting to module contact person? What about copyright issues? Follow same practice as Globus: if you contribute patches you are granting a COGS-compatible license?

Andrew McNab - Manchester HEP - 24 May 2001 Contacts with Globus Globus have opened up their internal developer lists and CVS. This means we can already participate in their development process to help with things we need. Weve also made direct links, partly via our participation in EU DataGrid. Globus appears very open to external collaborators, and the best way to get specific work done may be to send people to ANL or ISI to contribute effort?

Andrew McNab - Manchester HEP - 24 May 2001 Upper Middleware API WG-H also has to draw together the various APIs from other WorkGroups to specify the environment available to Applications. By agreeing common APIs for access to things like meta data, other WorkGroups can produce general components (eg super schedulers) with arent tied to a specific experiments database structure.

Andrew McNab - Manchester HEP - 24 May 2001 Management of partitions Especially near the beginning, were going to have incompatible requirements on what is installed. Short term solution is to divide the prototype Grid into appropriately configured partitions. Should bear this in mind when deciding on fabric management and installation mechanisms. Want to be able to reinstall machines in a partition in an automated, reliable way. In principle, this can be done in a few minutes.

Andrew McNab - Manchester HEP - 24 May 2001 Summary Most of the component activities of WorkGroup H have already been started: –Installation tools (RPMs) –Web site –Mailing lists –Contacts with Globus But documentation, co-ordination of APIs and active support are still just starting.