James Cunha Job Submission for Babar Analysis James Werner Resources:

Slides:

Advertisements

Similar presentations

James Cunha Enabling Grid Computer for HEP Babar Team at University of Manchester Resources:

Advertisements

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EasyGrid: a job submission system for distributed.

B A B AR and the GRID Roger Barlow for Fergus Wilson GridPP 13 5 th July 2005, Durham.

EasyGrid: the job submission system that works! James Cunha Werner GridPP18 Meeting – University of Glasgow.

Grid in action: from EasyGrid to LCG testbed and gridification techniques. James Cunha Werner University of Manchester Christmas Meeting

Kalanand Mishra BaBar Coll. Meeting Sept 26, /12 Development of New SPR-based Kaon, Pion, Proton, and Electron Selectors Kalanand Mishra University.

David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.

1 N. Davidson E/p single hadron energy scale check with minimum bias events Jet Note 8 Meeting 15 th May 2007.

Implementing Metadata Using RLS/LCG James Cunha Werner University of Manchester

Validation of DC3 fully simulated W→eν samples (NLO, reconstructed in ) Laura Gilbert 01/08/06.

University of Gaziantep Department of Engineering Physics August 2006 Page 1/18 A.Beddall, A.Beddall and A. Bingül Department of Engineering Physics University.

1 Hadronic In-Situ Calibration of the ATLAS Detector N. Davidson The University of Melbourne.

1 BaBar Collaboration Randall Sobie Institute for Particle Physics University of Victoria.

The B A B AR G RID demonstrator Tim Adye, Roger Barlow, Alessandra Forti, Andrew McNab, David Smith What is BaBar? The BaBar detector is a High Energy.

HOW TO REGISTER A TEAM Version 1.04 Rev Season 1v1.04 Rev ASA’s Online Registration.

LHC’s Second Run Hyunseok Lee 1. 2 ■ Discovery of the Higgs particle.

L3 Filtering: status and plans D  Computing Review Meeting: 9 th May 2002 Terry Wyatt, on behalf of the L3 Algorithms group. For more details of current.

1 DAN FARRAR SQL ANYWHERE ENGINEERING JUNE 7, 2010 SCHEMA-DRIVEN EXPERIMENT MANAGEMENT DECLARATIVE TESTING WITH “DEXTERITY”

JetWeb on the Grid Ben Waugh (UCL), GridPP6, What is JetWeb? How can JetWeb use the Grid? Progress report The Future Conclusions.

Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.

10/2/2015C.Kourkoumelis,UoA1 WP3 Educational and Outreach Portal C. Kourkoumelis, UoA.

Marc Sangel Supervisor: Sebastian Johnert DESY Summer Student Programm Hamburg, DESY, 02. September 2011.

EasyGrid Job Submission System and Gridification Techniques James Cunha Werner Christmas Meeting University of Manchester.

03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.

Irakli Chakaberia Final Examination April 28, 2014.

8th November 2002Tim Adye1 BaBar Grid Tim Adye Particle Physics Department Rutherford Appleton Laboratory PP Grid Team Coseners House 8 th November 2002.

Nick Brook Current status Future Collaboration Plans Future UK plans.

ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.

Friday May 10th 2002 Alex Howard Imperial College LondonSlide 1 Experiences of Submitting UKDMC and LISA GEANT4 Jobs FIRST I should say thanks for the.

Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.

Z boson mass reconstruction Caroline Steiblin Prof. Al Goshaw Dr. Andrea Bocci Duke University 1.

A Technical Validation Module for the offline Auger-Lecce, 17 September 2009  Design  The SValidStore Module  Example  Scripting  Status.

Exceptions cs1043. Program Exceptions When a program detects an error, what should it do? – Nothing, simply allow the program to fail. – Implement a course.

Intermediate Condor: Workflows Rob Quick Open Science Grid Indiana University.

Detector Simulation Presentation # 3 Nafisa Tasneem CHEP,KNU  How to do HEP experiment  What is detector simulation?

ATLAS is a general-purpose particle physics experiment which will study topics including the origin of mass, the processes that allowed an excess of matter.

Intermediate Condor: Workflows Monday, 1:15pm Alain Roy OSG Software Coordinator University of Wisconsin-Madison.

HIGUCHI Takeo Department of Physics, Faulty of Science, University of Tokyo Representing dBASF Development Team BELLE/CHEP20001 Distributed BELLE Analysis.

M. Ellis - MICE Collaboration Meeting - Thursday 28th October Sci-Fi Tracker Performance Software Status –RF background simulation –Beam simulation.

Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.

Why A Software Review? Now have experience of real data and first major analysis results –What have we learned? –How should that change what we do next.

UTA MC Production Farm & Grid Computing Activities Jae Yu UT Arlington DØRACE Workshop Feb. 12, 2002 UTA DØMC Farm MCFARM Job control and packaging software.

Top mass error predictions with variable JES for projected luminosities Joshua Qualls Centre College Mentor: Michael Wang.

AI in HEP: Can “Evolvable Discriminate Function” discern Neutral Pions and Higgs from background? James Cunha Werner Christmas Meeting 2006 – University.

Peter Couvares Computer Sciences Department University of Wisconsin-Madison Condor DAGMan: Introduction &

AliRoot survey: Analysis P.Hristov 11/06/2013. Are you involved in analysis activities?(85.1% Yes, 14.9% No) 2 Involved since 4.5±2.4 years Dedicated.

How to… (a.k.a. Photon PID and Pizero Analysis) G. David, April 20, 2000 A report on the status and advertisement of the tools

Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.

INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.

Client installation DIRAC Project. DIRAC Client Software  Many operations can be performed through the Web interface  Even more to come  However, certain.

1 S, Fedele, Student Presentations, 2004/08/04S Amazing Title Slide Reworking the CES Cluster Reconstruction Algorithm By: Steve Fedele Advisor: Pavel.

Z & W Boson Reconstruction with Monte Carlo Simulations and ATLAS DATA Adam Lowery Supervisor: Dr. Jonas Strandberg Wednesday, August 11, 2010.

Alien and GSI Marian Ivanov. Outlook GSI experience Alien experience Proposals for further improvement.

Client installation Beijing, 13-15/11/2013. DIRAC Client Software Beijing, /11/2013 DIRAC Tutorial2  Many operations can be performed through the.

BESIII offline software group Status of BESIII Event Reconstruction System.

Monitoring the Readiness and Utilization of the Distributed CMS Computing Facilities XVIII International Conference on Computing in High Energy and Nuclear.

LHCb 2009-Q4 report Q4 report LHCb 2009-Q4 report, PhC2 Activities in 2009-Q4 m Core Software o Stable versions of Gaudi and LCG-AA m Applications.

SEARCH FOR DIRECT PRODUCTION OF SUPERSYMMETRIC PAIRS OF TOP QUARKS AT √ S = 8 TEV, WITH ONE LEPTON IN THE FINAL STATE. Juan Pablo Gómez Cardona PhD Candidate.

MONTE CARLO TRANSPORT SIMULATION Panda Computing Week 2012, Torino.

Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.

1 Overview of Benchmarking Tools Tim Barklow SLAC Oct 10, 2006.

MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.

Grid development at University of Manchester Hardware architecture: - 1 Computer Element and 10 Work nodes Software architecture: - EasyGrid to submit.

ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.

1 MC Production and Reconstruction Summary and Plans Valeria Bartsch, Fabrizio Salvatore, A.-M. Magnan, and Nigel Watson.

Yet another approach to the ToF-based PID at PANDA

EasyGrid: a job submission system for distributed analysis using grid

Data Analysis in Particle Physics

MonteCarlo production for the BaBar experiment on the Italian grid

Rare and Forbidden Decays in the Standard Model

Presentation transcript:

James Cunha Job Submission for Babar Analysis James Werner Resources:

James Cunha USERResources Reliable. Robust. Efficient. Optimal use of resources. Recover from fail conditions. Supply clear information about crashes. The ideal Job Submission System is the one users do not know it exists !!!

James Cunha Analysis Job Submission

James Cunha Matching MC with experiment 18,700,000 events!

James Cunha Analysis Submission to Grid Single command:./easygrid dataset_name Perform Handlers management and submission Software based in State-machine –Verify skimdata available: If not available perform BbkDatasetTCL to generate skimData. Each file will be a job. –Verify if there are handlers pending If not, script generation (gera.c) with edg-job-submit and ClassAdds, and script execution. Nest for submission policy and optimisation. If yes, verify job status. When the all jobs ended, recover results in user folder. (Prototype)

James Cunha Generation and submission babar]$./easygrid SP-1005-Tau11-R14 Invalid configuration filename: /opt/edg/etc/vomses Your identity: /C=UK/O=eScience/OU=Manchester/L=HEP/CN=james werner Enter GRID pass phrase for this identity: Creating temporary proxy Done Creating proxy Done Searching pre selected skimdata. Searching previous handlers. Handlers not found. Submiting to GRID. Wait end of process...

James Cunha Job Status babar]$./easygrid SP-1005-Tau11-R14 Invalid configuration filename: /opt/edg/etc/vomses Your identity: /C=UK/O=eScience/OU=Manchester/L=HEP/CN=james werner Enter GRID pass phrase for this identity: Creating temporary proxy Done Creating proxy Done Searching pre selected skimdata. Searching previous handlers. Checking if jobs finished. ### Handle -> Current Status: Scheduled still pendent. ### Handle -> Current Status: Scheduled still pendent. 4 jobs did not finished ! Try again later.

James Cunha Job Status and recovery babar]$./easygrid SP-1005-Tau11-R14 Invalid configuration filename: /opt/edg/etc/vomses Your identity: /C=UK/O=eScience/OU=Manchester/L=HEP/CN=james werner Enter GRID pass phrase for this identity: Creating temporary proxy Done Creating proxy Done Searching pre selected skimdata. Searching previous handlers. Checking if jobs finished. ### Handle -> Current Status: Done Exit code: 0 ### Handle -> Current Status: Done Exit code: 0 0 jobs did not finished ! Try again later. All jobs done. Recovering results in your folder. Results in the following folders: /home/jamwer/grid_sub/babar/jamwer_foRHhWyeDBnbqA9JkDADLg /home/jamwer/grid_sub/babar/jamwer_8DdK3xruxtevNpei3zZbaA

James Cunha Event Reconstruction using Monte Carlo simulation Obtain instable particles from combination of stables particles measured by Babar detector/MC. Recursive algorithm, easy to use and recurrent. The “background” effect due wrong combinations.

James Cunha Combination 2 particles/gammas Monte Carlo“Experiment”

James Cunha Combination 3 particles/gammas Monte Carlo“Experiment”

James Cunha Combination 4 particles/gammas Monte Carlo “Experiment”

James Cunha Event Reconstruction from Experimental data Pi 0 !

James Cunha 80,000,000 events !!! Pi 0

James Cunha Why EMC does not works for Charged Particles??? It is difficult to discriminate Pions (>90% of particles) from Kaons in the Electromagnetic Calorimeter. Why?

James Cunha Energy x Momentum from MC data Detector Transfer Function change mass hyperboles!

James Cunha Only Pions

James Cunha Only Kaons

James Cunha Could Artificial Intelligence… Obtain a non-linear discriminate function able to classify kaons / pions? Recover “not good” events (80% of the Database)? e.g. Tau11 80,000,000 events of 440,000,000.

James Cunha

James Cunha Goals of Pi 0 -roject Develop elementary programs and generate the documentation for future students. Study Pi 0 annihilation and quarks interaction. Quark energy spectroscopy from energy histogram.

James Cunha My goals are… develop a submission system fail proof. write web pages with all elementary tasks in HEP/Babar, to help students and newbie. Understand q-qbar interaction through Pi 0. I am looking for partners to study Pi-zeros from Tau decays.