Partner: LMU (Atlas), GSI (Alice)

Slides:



Advertisements
Similar presentations
The High Energy Physics Community Grid Project Inside D-Grid ACAT 07 Torsten Harenberg - University of Wuppertal
Advertisements

GSIAF "CAF" experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.
CMS HLT production using Grid tools Flavia Donno (INFN Pisa) Claudio Grandi (INFN Bologna) Ivano Lippi (INFN Padova) Francesco Prelz (INFN Milano) Andrea.
1 PROOF & GRID Update Fons Rademakers. 2 Parallel ROOT Facility The PROOF system allows: parallel execution of scripts parallel analysis of trees in a.
The German HEP Community Grid for the German HEP Community Grid 27-March-2007, ISGC2007, Taipei Agenda: D-Grid in context HEP Community.
1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP Prague.
SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.
PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.
PROOF - Parallel ROOT Facility Kilian Schwarz Robert Manteufel Carsten Preuß GSI Bring the KB to the PB not the PB to the KB.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
CHEP – Mumbai, February 2006 The LCG Service Challenges Focus on SC3 Re-run; Outlook for 2006 Jamie Shiers, LCG Service Manager.
Interactive Data Analysis with PROOF Bleeding Edge Physics with Bleeding Edge Computing Fons Rademakers CERN.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.
David Adams ATLAS DIAL status David Adams BNL July 16, 2003 ATLAS GRID meeting CERN.
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
Grid Workload Management Massimo Sgaravatto INFN Padova.
Evolution of Parallel Programming in HEP F. Rademakers – CERN International Workshop on Large Scale Computing VECC, Kolkata.
Stuart Wakefield Imperial College London Evolution of BOSS, a tool for job submission and tracking W. Bacchi, G. Codispoti, C. Grandi, INFN Bologna D.
9 February 2000CHEP2000 Paper 3681 CDF Data Handling: Resource Management and Tests E.Buckley-Geer, S.Lammel, F.Ratnikov, T.Watts Hardware and Resources.
Ganga A quick tutorial Asterios Katsifodimos Trainer, University of Cyprus Nicosia, Feb 16, 2009.
The Experiments – progress and status Roger Barlow GridPP7 Oxford 2 nd July 2003.
1 PROOF The Parallel ROOT Facility Gerardo Ganis / CERN CHEP06, Computing in High Energy Physics 13 – 17 Feb 2006, Mumbai, India Bring the KB to the PB.
ROOT-CORE Team 1 PROOF xrootd Fons Rademakers Maarten Ballantjin Marek Biskup Derek Feichtinger (ARDA) Gerri Ganis Guenter Kickinger Andreas Peters (ARDA)
ARDA Prototypes Andrew Maier CERN. ARDA WorkshopAndrew Maier, CERN2 Overview ARDA in a nutshell –Experiments –Middleware Experiment prototypes (basic.
Summary Distributed Data Analysis Track F. Rademakers, S. Dasu, V. Innocente CHEP06 TIFR, Mumbai.
Distributed Analysis K. Harrison LHCb Collaboration Week, CERN, 1 June 2006.
WSV207. Cluster Public Cloud Servers On-Premises Servers Desktop Workstations Application Logic.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
1 Status of PROOF G. Ganis / CERN Application Area meeting, 24 May 2006.
ANALYSIS TOOLS FOR THE LHC EXPERIMENTS Dietrich Liko / CERN IT.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
September, 2002CSC PROOF - Parallel ROOT Facility Fons Rademakers Bring the KB to the PB not the PB to the KB.
Latest Improvements in the PROOF system Bleeding Edge Physics with Bleeding Edge Computing Fons Rademakers, Gerri Ganis, Jan Iwaszkiewicz CERN.
Latest Improvements in the PROOF system Bleeding Edge Physics with Bleeding Edge Computing Fons Rademakers, Gerri Ganis, Jan Iwaszkiewicz CERN.
WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
Alien and GSI Marian Ivanov. Outlook GSI experience Alien experience Proposals for further improvement.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
Gestion des jobs grille CMS and Alice Artem Trunov CMS and Alice support.
The German HEP-Grid initiative for the German HEP Community Grid 13-Feb-2006, CHEP06, Mumbai Agenda: D-Grid in context.
PROOF on multi-core machines G. GANIS CERN / PH-SFT for the ROOT team Workshop on Parallelization and MultiCore technologies for LHC, CERN, April 2008.
1-2 March 2006 P. Capiluppi INFN Tier1 for the LHC Experiments: ALICE, ATLAS, CMS, LHCb.
Lyon Analysis Facility - status & evolution - Renaud Vernet.
Workload Management Workpackage
Experience of PROOF cluster Installation and operation
(Prague, March 2009) Andrey Y Shevel
The EDG Testbed Deployment Details
L’analisi in LHCb Angelo Carbone INFN Bologna
Report PROOF session ALICE Offline FAIR Grid Workshop #1
PROOF – Parallel ROOT Facility
BOSS: the CMS interface for job summission, monitoring and bookkeeping
BOSS: the CMS interface for job summission, monitoring and bookkeeping
INFN-GRID Workshop Bari, October, 26, 2004
GSIAF & Anar Manafov, Victor Penso, Carsten Preuss, and Kilian Schwarz, GSI Darmstadt, ALICE Offline week, v. 0.8.
Introduction to Grid Technology
BOSS: the CMS interface for job summission, monitoring and bookkeeping
GSIAF "CAF" experience at GSI
April HEPCG Workshop 2006 GSI
RGLite A gLite plug-in for ROOT
G. Ganis, 2nd LCG-France Colloquium
LCG middleware and LHC experiments ARDA project
WLCG Collaboration Workshop;
The Ganga User Interface for Physics Analysis on Distributed Resources
Support for ”interactive batch”
The GENIUS portal and the GILDA t-Infrastructure
Wide Area Workload Management Work Package DATAGRID project
Presentation transcript:

Partner: LMU (Atlas), GSI (Alice) P.Malzacher@gsi.de Summary: HEP CG WP3 Distributed Interactive Data Analysis Partner: LMU (Atlas), GSI (Alice) unfunded: Uni Karlsruhe (CMS), MPI Heidelberg (LHCb), LRZ, MPI M, RZ Garching Optimise application specific job scheduling Analyse and test of software environment required Job management and Bookkeeping of distributed analysis Distribution of analysis, sum-up of results Interactive Analysis: Creation of a dedicated analysis cluster Dynamic partitioning of Grid analysis clusters

Deliverables: Interactive Analysis for Atlas: LMU Interactive Analysis for Alice: GSI Automated Jobmanagement System: LMU Application specific Scheduling: GSI PM 12 Report Gap Analysis and Design Proposals PM 24 Prototypes PM 35 Production Releases PM 36 Project Summary

Start with Gap Analysis LMU: Investigating Job-Scheduler requirements for distributed and interactive analysis GANGA (ATLAS/LHCb) project shows good features for this task Used for test MC production on LCG J. Elmsheuser GSI: Analysis based on PROOF Investigating different versions of PROOF clusters Connect ROOT and gLite: TGlite K. Schwarz, A. Manafov class TGrid : public TObject { public: … virtual TGridResult *Query ( … static TGrid *Connect ( const char *grid, const char *uid = 0, const char *pw = 0 ClassDef(TGrid,0) };

Job Split approach catalog files Storage queues jobs manager outputs G. Ganis, CHEP06, 13 Feb 2006 catalog files Storage queues query submit jobs data file splitting myAna.C merging final analysis manager outputs “static” use of resources jobs frozen: 1 job / worker node “manual” splitting, merging limited monitoring (end of single job)

The PROOF approach catalog files Storage scheduler MASTER G. Ganis, CHEP06, 13 Feb 2006 catalog files Storage scheduler query PROOF query: data file list, myAna.C final outputs (merged) feedbacks (merged) MASTER farm perceived as extension of local PC same macro, syntax as in local session more dynamic use of resources real time feedback automated splitting and merging

Deliverables: Interactive Analysis for Atlas: LMU advanced Interactive Analysis for Alice: GSI advanced Automated Jobmanagement System: LMU on track Application specific Scheduling: GSI in a very early stage, we learned a lot during this WS PM 12 Report Gap Analysis and Design Proposals PM 24 Prototypes PM 35 Production Release PM 36 Project Summary