User requirements and use-cases JRA4 Face-to-Face Meeting – CERN 16 June 2004 Paul Mealor, UCL.

Slides:



Advertisements
Similar presentations
WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.
Advertisements

Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
Reporting of the Experiments Follow procedures set up for technical WP of EDG Spreadsheet report man month effort Pro-forma reply sheet Pro-forma sheet.
An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
GGF Toronto Spitfire A Relational DB Service for the Grid Peter Z. Kunszt European DataGrid Data Management CERN Database Group.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.
INFSO-RI Enabling Grids for E-sciencE Application Demonstrations C. Loomis, J. Moscicki, J. Montagnat EGEE European Review (CERN)
Application Use Cases NIKHEF, Amsterdam, December 12, 13.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
EDG Application The European DataGrid Project Team
EGEE (EU IST project) – Networking Activities 4: biomedical applications NA4 Biomedical Activities Johan Montagnat First EGEE Meeting Cork,
Zhiling Chen (IPP-ETHZ) Doktorandenseminar June, 4 th, 2009.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Don Quijote Data Management for the ATLAS Automatic Production System Miguel Branco – CERN ATC
3 Sept 2001F HARRIS CHEP, Beijing 1 Moving the LHCb Monte Carlo production system to the GRID D.Galli,U.Marconi,V.Vagnoni INFN Bologna N Brook Bristol.
A Grid Environment for Medical Imaging A Grid Environment for Medical Imaging LRMN Sorina POP, Tristan GLATARD.
Tiziana FerrariNetwork metrics usage for optimization of the Grid1 DataGrid Project Work Package 7 Written by Tiziana Ferrari Presented by Richard Hughes-Jones.
Grid Initiatives for e-Science virtual communities in Europe and Latin America DIRAC TEAM CPPM – CNRS DIRAC Grid Middleware.
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
NeSC Apps Workshop July 20 th, 2002 Customizable command line tools for Grids Ian Kelley + Gabrielle Allen Max Planck Institute for Gravitational Physics.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
GGF12 – 20 Sept LCG Incident Response Ian Neilson LCG Security Officer Grid Deployment Group CERN.
DataGrid Applications Federico Carminati WP6 WorkShop December 11, 2000.
Nick Brook Current status Future Collaboration Plans Future UK plans.
Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.
INFSO-RI Enabling Grids for E-sciencE DAGs with data placement nodes: the “shish-kebab” jobs Francesco Prelz Enzo Martelli INFN.
7April 2000F Harris LHCb Software Workshop 1 LHCb planning on EU GRID activities (for discussion) F Harris.
13 May 2004EB/TB Middleware meeting Use of R-GMA in BOSS for CMS Peter Hobson & Henry Nebrensky Brunel University, UK Some slides stolen from various talks.
GRID IIII D UK Particle Physics Tony Doyle - University of Glasgow GridPP Status Report  Executive Summary  News  “Unfunded” EU DataGrid Posts  Shadow.
Caitriana Nicholson, CHEP 2006, Mumbai Caitriana Nicholson University of Glasgow Grid Data Management: Simulations of LCG 2008.
…building the next IT revolution From Web to Grid…
INFSO-RI Enabling Grids for E-sciencE User Survey Objectives and Results F.Jacq CNRS-IN2P3 EGEE Conference - Athens 21 th April.
1 P.Kunszt LCGP Data Management on the GRID Peter Z. Kunszt CERN Database Group EU DataGrid – Data Management.
INFSO-RI Enabling Grids for E-sciencE Experience of using gLite for analysis of ATLAS combined test beam data A. Zalite / PNPI.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
EDG Applications The European DataGrid Project Team
CHEP 2006, February 2006, Mumbai 1 LHCb use of batch systems A.Tsaregorodtsev, CPPM, Marseille HEPiX 2006, 4 April 2006, Rome.
MEDIGRID project, DataGrid FR meeting, April 18, 2002, Johan Montagnat, WP10 ACI GRID 2002 MEDIGRID: high performance medical image processing on a computational.
WP 10 ATF meeting April 8, 2002 Data Management and security requirements of biomedical applications Johan Montagnat - WP10.
Interactive European Grid Environment for HEP Application with Real Time Requirements Lukasz Dutka 1, Krzysztof Korcyl 2, Krzysztof Zielinski 1,3, Jacek.
14-May-2003 AWG FH, JT, JJB DataGrig Barcelona 1 HEP GRID use cases Common GRID use cases F.Harris, J.Templon, J.J Blaising.
BOF at GGF5, Edinburgh, Scotland, July 21-24, 2002 CrossGrid Architecture Marian Bubak and TAT Institute of Computer Science & ACC CYFRONET AGH, Cracow,
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
18-May-04D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security Update (Report from the LCG Security Group) Barcelona 18 May 2004 David Kelsey CCLRC/RAL, UK
INFSO-RI Enabling Grids for E-sciencE V. Breton, 30/09/05, Génopôle Lille Presentation of DNA4.3.2 Vincent Breton On behalf of NA4.
Enabling Grids for E-sciencE CMS/ARDA activity within the CMS distributed system Julia Andreeva, CERN On behalf of ARDA group CHEP06.
Distributed Analysis Tutorial Dietrich Liko. Overview  Three grid flavors in ATLAS EGEE OSG Nordugrid  Distributed Analysis Activities GANGA/LCG PANDA/OSG.
EGEE is a project funded by the European Union under contract IST End-user requirements for network monitoring Paul Mealor JRA4 EGEE Kick-Off.
Enabling Grids for E-sciencE Experience Supporting the Integration of LHC Experiments Computing Systems with the LCG Middleware Simone.
Grid Activities in CMS Asad Samar (Caltech) PPDG meeting, Argonne July 13-14, 2000.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 Technical Overview Jakub T. Moscicki, CERN.
LCG Pilot Jobs + glexec John Gordon, STFC-RAL GDB 7 December 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES The Common Solutions Strategy of the Experiment Support group.
J. Templon Nikhef Amsterdam Physics Data Processing Group Large Scale Computing Jeff Templon Nikhef Jamboree, Utrecht, 10 december 2012.
LHCb computing model and the planned exploitation of the GRID Eric van Herwijnen, Frank Harris Monday, 17 July 2000.
Network Services Use Cases GHPN Research Group
David Kelsey CCLRC/RAL, UK
Moving the LHCb Monte Carlo production system to the GRID
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
INFN-GRID Workshop Bari, October, 26, 2004
Draft-ggf-ghpn-netservices-usecases-2.7
Gridifying the LHCb Monte Carlo simulation system
Leanne Guy EGEE JRA1 Test Team Manager
Network Requirements Javier Orellana
WLCG Collaboration Workshop;
Gridifying the LHCb Monte Carlo production system
Short to middle term GRID deployment plan for LHCb
Presentation transcript:

User requirements and use-cases JRA4 Face-to-Face Meeting – CERN 16 June 2004 Paul Mealor, UCL

JRA4 F2F Meeting – CERN – 16 June Sources of information LCG: Ian Bird (not really) NA4 people: Frank Harris (HEP)  Nick Brook (LHCb)  Roger Jones (Atlas)  Dave Newbold (CMS) Johan Montagnat (Biomed) NA4 documents Combined requirements from EDG Biomedical requirements They have use-cases, somewhere Peter Kunszt, Peter Clarke… GHPN

JRA4 F2F Meeting – CERN – 16 June HEP use cases Based around replica management Two main overview use-cases: User job submission  Middleware?  User requires a job to be done as quickly as possible Data reprocessing  Operations? Middleware?  Large number of jobs  Time-limited data reprocessing  Time-limited data transfer Probably also useful for Task 2 use-cases

JRA4 F2F Meeting – CERN – 16 June LCG Data Scheduler

JRA4 F2F Meeting – CERN – 16 June NA4 combined requirements Selection of requirements R3.11 Data access cost estimation  Yes yes R2.2 Parallel jobs execution  Requires MPI, can we do anything about this? R2.4 Multiple data jobs  Lots of similar data sets  Retrieved from the same place at the same time  Summed costs alter the optimisation scenario R2.6 Interactive Jobs  CLI, GUI, image manipulation, job steering?  Need low RTT, low jitter, minimum BW?  Time constrained – the user has to be there to use the job  Data required for user’s sites, as well as for CE/SE sites   Task 2 requirements, also R2.10 Job killing

JRA4 F2F Meeting – CERN – 16 June NA4 Biomedical use-cases Two pilot applications GATE Monte-Carlo simulation Based on GEANT4 Basically the same as HEP Monte-Carlo jobs GPCALMA Automatic analysis of mammographs Distributed data (mammographs stored at local hospitals) Distributed analysis  Pretty much ordinary job submission Interactive inspection  Could be interesting  Images are only 10MB Plus Content-based query of medical image databases Remote interactive segmentation algorithm (2 updates / s)

JRA4 F2F Meeting – CERN – 16 June GHPN use-cases GGF Grid High Performance Networking Working Group Mark Leese, Tiziana and I have been writing some use- cases for them Administrative interaction with monitoring systems HEP job submission Cost-estimation use-cases Aimed at API design Still useful for us Continues in parallel with JRA4 work

JRA4 F2F Meeting – CERN – 16 June Future work NA4 open meeting Much more info from HEP applications Much more info from biomed pilot applications Questionnaire/requirements template Fill in for current use-cases Extend the questions