Applications & a Reality Check Mark Hayes. Applications on the UK Grid Ion diffusion through radiation damaged crystal structures (Mark Calleja, Mark.

Slides:



Advertisements
Similar presentations
R. MiddletonGridPP8 – Bristol – 23 rd September 2003Slide 1 UK eScience BoF Session AHM – Nottingham - September 2003 Intersecting UK Grid and EGEE/LCG/GridPP.
Advertisements

18 April 2002 e-Science Architectural Roadmap Open Meeting 1 Support for the UK e-Science Roadmap David Boyd UK Grid Support Centre CLRC e-Science Centre.
02/07/03 Grid Support Centre 1 UK Grid Support Centre Alistair Mills CLRC e-Science Centre
© Geodise Project, University of Southampton, Short Message Service Aims Architecture Tools Future Work.
UK Campus Grid Special Interest Group Dr. David Wallom University of Oxford.
© Geodise Project, University of Southampton, Applications and Middleware Hakki Eres, Fenglian Xu & Graeme Pound.
2 July, Sakai VRE Portal Demonstrator Mark Baker School of Systems Engineering, University of Reading Tel:
The Community Authorisation Service – CAS Dr Steven Newhouse Technical Director London e-Science Centre Department of Computing, Imperial College London.
Dr. David Wallom Use of Condor in our Campus Grid and the University September 2004.
Monitoring and performance measurement in Production Grid Environments David Wallom.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Workload Management Massimo Sgaravatto INFN Padova.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Grid Enabled Optimisation and Design Search for Engineering (GEODISE)
OGSA Test Grid Dave Berry, Research Manager NeSC Review, 18 th March 2003.
Ashok Agarwal 1 BaBar MC Production on the Canadian Grid using a Web Services Approach Ashok Agarwal, Ron Desmarais, Ian Gable, Sergey Popov, Sydney Schaffer,
1 AHE Server Deployment and Hosting Applications Stefan Zasada University College London.
Nimrod/G GRID Resource Broker and Computational Economy David Abramson, Rajkumar Buyya, Jon Giddy School of Computer Science and Software Engineering Monash.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
20 October 2006Workflow Optimization in Distributed Environments Dynamic Workflow Management Using Performance Data David W. Walker, Yan Huang, Omer F.
Using ICENI to run parameter sweep applications across multiple Grid resources Murtaza Gulamali Stephen McGough, Steven Newhouse, John Darlington London.
CHEP 2003Stefan Stonjek1 Physics with SAM-Grid Stefan Stonjek University of Oxford CHEP th March 2003 San Diego.
Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK.
GRAM5 - A sustainable, scalable, reliable GRAM service Stuart Martin - UC/ANL.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
Grid Workload Management Massimo Sgaravatto INFN Padova.
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Stephen Pickles Technical Director, Grid Operations Support Centre University of Manchester Neil Geddes CCLRC Head of e-Science Director of the UK Grid.
NGS Innovation Forum, Manchester4 th November 2008 Condor and the NGS John Kewley NGS Support Centre Manager.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Giuseppe Codispoti INFN - Bologna Egee User ForumMarch 2th BOSS: the CMS interface for job summission, monitoring and bookkeeping W. Bacchi, P.
GridSAM - A Standards Based Approach to Job Submission Through Web Services William Lee and Stephen McGough London e-Science Centre Department of Computing,
“Grids and eScience” Mark Hayes Technical Director - Cambridge eScience Centre GEFD Summer School 2003.
The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.
NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Moving Beyond Campus Grids Steven Young Oxford NGS.
© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.
Grid Scheduler: Plan & Schedule Adam Arbree Jang Uk In.
Building the e-Minerals Minigrid Rik Tyer, Lisa Blanshard, Kerstin Kleese (Data Management Group) Rob Allan, Andrew Richards (Grid Technology Group)
Overview of Privilege Project at Fermilab (compilation of multiple talks and documents written by various authors) Tanya Levshina.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.
Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)
Testing Grid Software on the Grid Steven Newhouse Deputy Director.
Utility Computing: Security & Trust Issues Dr Steven Newhouse Technical Director London e-Science Centre Department of Computing, Imperial College London.
SPARRO Group, University of Regina 1 Portal Software: Browser-based Monte Carlo Zisis Papandreou University of Regina GlueX Collaboration Meeting JLab,
© Geodise Project, University of Southampton, Grid middleware for engineering design search and optimisation Graeme Pound.
© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.
AHM, Aug-30-Sept-2, 2004 Virtual Research in the UK: Advanced Portal Services Mark Baker and Hong Ong Distributed Systems Group University of Portsmouth.
© Geodise Project, University of Southampton, Integrating Data Management into Engineering Applications Zhuoan Jiao, Jasmin.
Condor Services for the Global Grid: Interoperability between OGSA and Condor Clovis Chapman 1, Paul Wilson 2, Todd Tannenbaum 3, Matthew Farrellee 3,
Tool Integration with Data and Computation Grid “Grid Wizard 2”
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
© Geodise Project, Scenario: Design optimisation v Model device, discretize, solve, postprocess, optimise Scripting.
Welcome Grids and Applied Language Theory Dave Berry Research Manager 16 th October 2003.
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
Intersecting UK Grid & EGEE/LCG/GridPP Activities Applications & Requirements Mark Hayes, Technical Director, CeSC.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 22 February 2006.
ETF and Level 2 Grid UK e-Science Grid Now up and running! Rob Allan David Boyd.
18 May 2006CCGrid2006 Dynamic Workflow Management Using Performance Data Lican Huang, David W. Walker, Yan Huang, and Omer F. Rana Cardiff School of Computer.
1 DIRAC Project Status A.Tsaregorodtsev, CPPM-IN2P3-CNRS, Marseille 10 March, DIRAC Developer meeting.
BaBar & Grid Eleonora Luppi for the BaBarGrid Group TB GRID Bologna 15 febbraio 2005.
Introduction to the Application Hosting Environment
UK Grid: Moving from Research to Production
BOSS: the CMS interface for job summission, monitoring and bookkeeping
UK e-Science OGSA-DAI November 2002 Malcolm Atkinson
BOSS: the CMS interface for job summission, monitoring and bookkeeping
Grid Portal Services IeSE (the Integrated e-Science Environment)
Presentation transcript:

Applications & a Reality Check Mark Hayes

Applications on the UK Grid Ion diffusion through radiation damaged crystal structures (Mark Calleja, Mark Hayes, Cambridge) Monte Carlo simulation lots of independent runs small input & output more CPU -> higher temperatures, better stats access to ~100 CPUs on the UK Grid Condor-G client tool for farming out jobs

Applications on the UK Grid GEODISE - Grid Enabled Optimisation & Design Search for Engineering (Simon Cox, Andy Keane, Hakki Eres, Southampton) Genetic algorithm to find the best design for satellite truss beams Java plugins to MATLAB for remote job submission to the Grid Used CPU at Belfast, Cambridge, RAL, London, Oxford & Southampton

Applications on the UK Grid GENIE - Grid Enabled Integrated Earth system model (Steven Newhouse, Murtaza Gulamali - Imperial) Ocean-atmosphere modelling How does moisture transport from the atmosphere effect ocean circulation? ~1000 independent 4000year runs (3 days real time!) on ~200 CPUs Flocked condor pools at London & Southampton

Applications on the UK Grid Reality Grid - see earlier talk BLAST on the Grid - John Watt, NeSC Nimrod/G - Jonathan Giddy, Cardiff DL_POLY - Rob Allan, Daresbury R-Matrix - Terry Harmer, Belfast GITS integration test scipt - David Baker, Southampton

Reality Check Lots of work to get accounts set up at remote sites Job monitoring and debugging is difficult MDS information providers could be richer MDS availability & poor performance GT2 interface to job schedulers is very poor GT2 version incompatibilities Software licences (e.g. for DL_POLY) Firewall port ranges (not just for Globus)

Work in progress Virtual Organization Management (VOM) portal will ease account requests & generation Single set of user terms & conditions. This must actually reduce the amount of paperwork involved to be worthwhile! XML database/web service alternative to MDS (+GT3?) Trusted host database for firewall configuration Accounting: web service tools for collection & query of usage info Documentation: papers in preparation. Perhaps also a user’s & administrator’s guide?