UKQCD Grid Status Report GridPP 13 th Collaboration Meeting Durham, 4th—6th July 2005 Dr George Beckett Project Manager, EPCC +44.

Slides:



Advertisements
Similar presentations
The Quantum Chromodynamics Grid James Perry, Andrew Jackson, Matthew Egbert, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Advertisements

UKQCD GridPP NeSCAC Irving, 4/2/041 9 th GridPP Collaboration Meeting QCDgrid: Status and Future Alan Irving University of Liverpool.
Tony Doyle GridPP2 Proposal, BT Meeting, Imperial, 23 July 2003.
18 April 2002 e-Science Architectural Roadmap Open Meeting 1 Support for the UK e-Science Roadmap David Boyd UK Grid Support Centre CLRC e-Science Centre.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
DataGrid is a project funded by the European Commission under contract IST WP2 – R2.1 Overview of WP2 middleware as present in EDG 2.1 release.
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
The science of simulation falsification algorithms phenomenology machines better theories computer architectures non-perturbative QFT experimental tests.
EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.
Edinburgh University Experimental Particle Physics Alasdair Earl PPARC eScience Summer School September 2002.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
The OMII Perspective on Grid and Web Services At the University of Southampton.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
CMS Report – GridPP Collaboration Meeting VI Peter Hobson, Brunel University30/1/2003 CMS Status and Plans Progress towards GridPP milestones Workload.
ILDG5QCDgrid1 QCDgrid status report UKQCD data grid Chris Maynard.
QCDgrid UKQCD Achievements and Future Priorities Who and what Achievements QCDgrid middleware Future priorities Demo of meta-data catalogue browser Alan.
Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.
INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.
CHEP 2000, Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, work in collaboration with A.
May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,
CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 1 D6.1 Integration with the European DataGrid.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Setting up a Pan-European Datagrid using QCDgrid technology Chris Johnson, James Perry, Lorna Smith and Jean-Christophe Desplat EPCC, The University Of.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
UKQCD QCDgrid Richard Kenway. UKQCD Nov 2001QCDgrid2 why build a QCD grid? the computational problem is too big for current computers –configuration generation.
Security Area in GridPP2 4 Mar 2004 Security Area in GridPP2 “Proforma-2 posts” overview Deliverables – Local Access – Local Usage.
3 June 2004GridPP10Slide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
Dan Tovey, University of Sheffield GridPP: Experiment Status & User Feedback Dan Tovey University Of Sheffield.
Neil Geddes GridPP-10, June 2004 UK e-Science Grid Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
INFSO-RI NA2 Status Update ETICS2 second AHM Isabel Matranga Engineering Ingegneria Informatica SpA Darmstadt, February 2009.
Training and the NGS Mike Mineter
WP9 – Earth Observation Applications – n° 1 WP9 report to Plenary ESA, KNMI, IPSL Presented by M. Petitdidier, IPSL DataGrid Plenary Session 5 th Project.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Δ Storage Middleware GridPP10 What’s new since GridPP9? CERN, June 2004.
ILDG Middleware Status Bálint Joó UKQCD University of Edinburgh, School of Physics on behalf of ILDG Middleware Working Group alternative title: Report.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Angela Poschlad (PPS-FZK), Antonio Retico.
1 ILDG Status in Japan  Lattice QCD Archive(LQA) a gateway to ILDG Japan Grid  HEPNet-J/sc an infrastructure for Japan Lattice QCD Grid A. Ukawa Center.
GridPP Presentation to AstroGrid 13 December 2001 Steve Lloyd Queen Mary University of London.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
The Experiments – progress and status Roger Barlow GridPP7 Oxford 2 nd July 2003.
EGEE is a project funded by the European Union under contract IST R-GMA: Production Services for Information and Monitoring in the Grid John.
Metadata Mòrag Burgon-Lyon University of Glasgow.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
1 OGSA-DAI Status Report Neil P Chue Hong 20 th May 2005.
Rutherford Appleton Lab, UK VOBox Considerations from GridPP. GridPP DTeam Meeting. Wed Sep 13 th 2005.
USQCD regional grid Report to ILDG /28/09ILDG14, June 5, US Grid Usage  Growing usage of gauge configurations in ILDG file format.  Fermilab.
A QCD Grid: 5 Easy Pieces? Richard Kenway University of Edinburgh.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
The GridPP DIRAC project DIRAC for non-LHC communities.
Sep 25, 20071/5 Grid Services Activities on Security Gabriele Garzoglio Grid Services Activities on Security Gabriele Garzoglio Computing Division, Fermilab.
May 2005 PPARC e-Science PG School1 QCDgrid Chris Maynard A Grid for UKQCD National collaboration for lattice QCD.
The GridPP DIRAC project DIRAC for non-LHC communities.
Towards deploying a production interoperable Grid Infrastructure in the U.S. Vicky White U.S. Representative to GDB.
INFSOM-RI Elisabetta Ronchieri INFN CNAF ETICS 2 nd EU Review (CERN) 15 February 2008 WP3 - Software Configuration Tools and Methodologies.
J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen
18/12/03PPD Christmas Lectures 2003 Grid in the Department A Guide for the Uninvolved PPD Computing Group Christmas Lecture 2003 Chris Brew.
Bob Jones EGEE Technical Director
EO Applications Parallel Session
Long-term Grid Sustainability
Fabric and Storage Management
Report on GLUE activities 5th EU-DataGRID Conference
Presentation transcript:

UKQCD Grid Status Report GridPP 13 th Collaboration Meeting Durham, 4th—6th July 2005 Dr George Beckett Project Manager, EPCC

GridPP 13, Durham 4th—6th July Activities QCDgrid Log Book Objective I: Improve, maintain and develop a simple and easy mechanism for UKQCD scientists to share and access each other’s data and compute resources.

GridPP 13, Durham 4th—6th July Improvements to software WP1.1: QCDgrid System Risk Analysis (Oct 2004): System readiness for QCDOC * output → stress testing of QCDgrid; Adequacy of testing infrastructure → creation of new Test Grid and preparation of formal testing plan; Level of availability of UKQCD Grid → review of support for critical nodes/services; * QCDOC is primary source of simulation data for the UKQCD. Has analogue with LHC for experimental data. Primary storage is 50 Tbyte SAN hosted by U. o. E., secondary storage is 4×12.5 Tbyte stores hosted by collaborators, plus other miscellaneous storage (e.g. 2 Tbyte hosted by Columbia),

GridPP 13, Durham 4th—6th July Improvements to software WP1.2/1.3: QCDgrid Load and Stress Testing (Feb 2005): QCDgrid is reliable/predictable, even under high stress → ready for QCDOC; Scalability of Data Grid component with multiple, concurrent write operations is suboptimal → to be investigated; Metadata Catalogue component engine (eXist) fails under (unrealistic) high loads → upgrade eXist / evaluate alternatives.

GridPP 13, Durham 4th—6th July Improvements to software WP1.2/1.3: QCDgrid Load and Stress Testing, cont’d: QCDgrid Stress/Load Test component developed. UKQCD Test Grid installed – 3 Linux and 1 Solaris storage nodes.

GridPP 13, Durham 4th—6th July Improvements to software WP1.4.1: QCDgrid Software Review (Mar 2005) Metadata Component – eXist database needs upgrading → await release of eXist Version 1.0, then re-evaluate. Underlying Grid tools – Globus 2.4 does a good job, though support and maintenance will soon end → consider replacement/upgrade to gLite / Globus 4. Security infrastructure – GT2 and EDG V/O is adequate at present, though for ILDG may need to enrich → evaluate EGEE VOMS.

GridPP 13, Durham 4th—6th July Software maintenance Problem reports, feature requests, etc. are now submitted/tracked/catalo gued by NeSCForge. Formal software versioning strategy has been defined – new releases produced approx. every four months: QCDgrid Version 1.2 released in May 2005 via NeSCForge

GridPP 13, Durham 4th—6th July New developments WP1.5: QCDgrid Version 1.2: support for QCDML Version 1.1; simplified installation process. WP2: Metadata Tools (in progress): Formalise procedure for preparing/storing ensembles/ configurations on grid – bring into line with ILDG targets. Extend current client tools to better support QCDML metadata schemas (ensemble and gauge configuration). Help scientists to create metadata, without worrying about XML!

GridPP 13, Durham 4th—6th July Dissemination UKQCD HackLatt 2005, Edinburgh (Apr 2005) – funded GridPP/NeSC: Two day workshop; 27 participants (from UK and beyond); Presentation/tutorial sessions on: –usage/administration of UKQCD Grid; –using QCDOC for science. Other activities: Lattice QCD simulations via international research networks, Shuzenji, Japan (Sep. 2004). ILDG 5, Tsukuba, Japan via Access Grid (Dec. 2004). PPARC UK e-Science Postgraduate School (May 2005).

GridPP 13, Durham 4th—6th July Activities QCDgrid Log Book Objective II: Provide a simple and easy mechanism for QCD scientists across different continents to share and access each other’s data

GridPP 13, Durham 4th—6th July Collaboration and dissemination QCDgrid team contributed to ILDG Middleware Workshop, Edinburgh (Oct. 2004): –ILDG community shared ideas/experiences of local software developments. –Provisional public interface definition for Datagrid component established. Olivier Brand-Foissac (French ILDG contribution) visited EPCC, Edinburgh (Oct. 2004) to learn about QCDgrid / ILDG. New UKQCD Grid storage node added at Columbia University, New York.

GridPP 13, Durham 4th—6th July Future work Development of QCDgrid: Complete metadata tools; Review/overhaul dependency software – eXist database, Globus 2.4, EDG VO; Continued support/direction for user community. International data sharing: Continue to contribute to ILDG: –ILDG 6 in Boston, USA via Access Grid (May 2005). –2 nd ILDG Middleware Workshop in Tsukuba, Japan (Oct. 2005). Develop Web Service interface to Datagrid component and Metadata component.

GridPP 13, Durham 4th—6th July Further information Project website for: reports; deliverables; presentations; multimedia; news; software.