KNMI Applications on Testbed 1 …and other activities.

Slides:



Advertisements
Similar presentations
DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
Advertisements

ESA Data Integration Application Open Grid Services for Earth Observation Luigi Fusco, Pedro Gonçalves.
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
LNL CMS M.Biasotto, Bologna, 29 aprile LNL Analysis Farm Massimo Biasotto - LNL.
1 CHEP 2000, Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week,
Job Submission The European DataGrid Project Team
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
EU 2nd Year Review – Jan – WP9 WP9 Earth Observation Applications Demonstration Pedro Goncalves :
The EDG Testbed Deployment Details The European DataGrid Project
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
WP9 – Earth Observation Applications – n° 1 Experiences with Testbed1, plans and objectives for Testbed 2 Testbed retreat th August 2002
3 Sept 2001F HARRIS CHEP, Beijing 1 Moving the LHCb Monte Carlo production system to the GRID D.Galli,U.Marconi,V.Vagnoni INFN Bologna N Brook Bristol.
Computational grids and grids projects DSS,
SLICE Simulation for LHCb and Integrated Control Environment Gennady Kuznetsov & Glenn Patrick (RAL) Cosener’s House Workshop 23 rd May 2002.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.
Nick Brook Current status Future Collaboration Plans Future UK plans.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
Nadia LAJILI User Interface User Interface 4 Février 2002.
UKQCD QCDgrid Richard Kenway. UKQCD Nov 2001QCDgrid2 why build a QCD grid? the computational problem is too big for current computers –configuration generation.
LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
DIRAC Review (13 th December 2005)Stuart K. Paterson1 DIRAC Review Exposing DIRAC Functionality.
WP9 – Earth Observation Applications – n° 1 WP9 report to Plenary ESA, KNMI, IPSL Presented by M. Petitdidier, IPSL DataGrid Plenary Session 5 th Project.
EU 2nd Year Review – Jan – WP9 WP9 Earth Observation Applications
C. Loomis – Integration Status- October 31, n° 1 Integration Status October 31, 2001
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Author - Title- Date - n° 1 Partner Logo WP5 Summary Paris John Gordon WP5 6th March 2002.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Data and storage services on the NGS Mike Mineter Training Outreach and Education
DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.
May http://cern.ch/hep-proj-grid-fabric1 EU DataGrid WP4 Large-Scale Cluster Computing Workshop FNAL, May Olof Bärring, CERN.
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2 [Including slides prepared by Lex Holt.]
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6
EC Review – 01/03/2002 – WP9 – Earth Observation Applications – n° 1 WP9 Earth Observation Applications 1st Annual Review Report to the EU ESA, KNMI, IPSL,
Data Management The European DataGrid Project Team
ESA DataGrid Review – 10 June 2002 – n° 1 Summary item 3  ESA and WP9 part 1 (45m)  DataGrid Frascati infrastructure (AT, 7.5m)  ESA GOME application.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
1 Application status F.Carminati 11 December 2001.
Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
14 June 2001LHCb workshop at Bologna1 LHCb and Datagrid - Status and Planning F Harris(Oxford)
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Earth Observation inputs to ATF Annalisa Terracina EU-DataGrid Project Work Package 9 – EO Applications April 2003 CERN.
DataGrid France 12 Feb – WP9 – n° 1 WP9 Earth Observation Applications.
Frascati, 2-3 July 2008 Slide 1 User Management compliance testing for G-POD HMA-T Phase 2 KO Meeting 2-3 July 2008, Frascati Andrew Woolf, STFC Rutherford.
WP 9.4 Use Case (ESA-ESRIN, IPSL, KNMI)
The EDG Testbed Deployment Details
Real Time Fake Analysis at PIC
Work Package 9 – EO Applications
Operating a glideinWMS frontend by Igor Sfiligoi (UCSD)
Moving the LHCb Monte Carlo production system to the GRID
EO Applications Parallel Session
INFN-GRID Workshop Bari, October, 26, 2004
EDG Final Review Demonstration
Data Management in Release 2
CMS report from FNAL demo week Marco Verlato (INFN-Padova)
Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF
Alice Software Demonstration
Presentation transcript:

KNMI Applications on Testbed 1 …and other activities

Contents: Test & Validation Plans: WP9: ESA, IPSL, KNMI KNMI test plans in more detail Goals for testbed 1 Current status Questions

WP9 tests All tests described in: DataGrid-09-TEN _2.doc Common time line defined at Frascati WS ESA, IPSL and KNMI have separate tests, which can be carried out independently: Test were presented at TWG meeting at CERN

Detailed Plans  Common WP9 template format for all partners & experiments  A ‘live’, evolving reference document  Designed to identify issues to be clarified  Used for testbed reporting Spreadsheet  Plans at a glance  Timelines  Overall plans and individual partner schemes Documents

KNMI test plans 1. Basic authentication and authorization tests 2. Run 'hello world' script (csh-script) 3. FORTRAN job submission 4. Test job life cylce (from WP1 doc) 5. Replica Catalogue 6. Run header extractor 7. test WP4 tools ? 8. Run OPERA code KNMI SGI farm is not part of Testbed 1 (only User Interface will run at KNMI)

KNMI plans in (much) more detail KNMI-1 Basic authorization and authentication tests KNMI-2 Run 'hello world' script (csh-script) KNMI-3a Run Fortran program printing "hello from Fortran" KNMI-3b Run FORTRAN program, forcing the CE KNMI-4 Test job life cylce KNMI-5a Use GDMP to register a GOME level 1 file (LFN) KNMI-5b Test what happens if same file is registered twice KNMI-5c Retrieve file from ReplicaCatalogue to local disk KNMI-5d Remove a file from the ReplicaCataloge KNMI-5e Remove the master copy of a file KNMI-6a Run script to retrieve the header of a level 1 file, Retrieve directly KNMI-6b Run script to retrieve the header of a level 1 file. Use SE for storage & retrieval KNMI-7a Start job and monitor the CE its executing on KNMI-7b Monitor an SE, use 6b as basis KNMI-7c Configure a node using WP4 tools KNMI-7d Configure node to run OPERA S/W KNMI-8a Use OPERA code to process one level 1 file KNMI-8b Use OPERA code to process one level 1 file, store result on SE (result availble for GRID) KNMI-8c Use OPERA code to process one day of data (14 files), store results on SE KNMI-8d Use OPERA code to process one week of data ((7*14 files), store results on SE

Simple job submission & monitoring Use of i/o sandboxes Data replication and LFN to PFN translation File open Application Environment Prepare & install RPMs Test case to select app environment Application deployment IDL, FORTRAN, OPERA app Goals for testbed 1

Goals for testbed 1 (II) Running OPERA code to retrieve ozone profiles from GOME level 1 data OPERA is a FORTRAN implementation of the DOAS ozone profile retrieval algorithm developed at KNMI. ESA will derive ozone profiles from the same data set. (with their own algorithm) IPSL will compare them (using ground based measurements)

Current status: Agreed on a common GOME dataset (November 28 to December 4, 1999) John is EO-VO admin Accounts on and Data set copied to compact Working on OPERA code on compact (Get OPERA code running) Agreed on a ‘workable situation’ with our IT department. (DataGrid UI machine outside firewall in other domain than KNMI) Writing test scripts

Questions Uncertainty about the attendance of the Testbed 1 tests at CERN. proxy’s and services needed by the DataGrid S/W in the future for firewall configuration

Validation plan timeline Doc review WP1 M.Reale WP2 J.Templon WP3 I.Augustin WP4 A.De Salvo WP5 JJ.Blaising Integration assessment 1 person / application Application integration + Test plan 1 person / application TWG + WP8-10 General Meeting Validation plans presented WP8 staff Basic testing, TB0 kits? (if everything ok) Message to WP9 & WP10 Software integration  WP8  WP9  WP10 Party!  Start writing 8.2