Points from DPD task force First meeting last Tuesday (29 th July) – Need to have concrete proposal in 1 month – Still some confusion and nothing very.

Slides:



Advertisements
Similar presentations
GEOSS Data Sharing Principles. GEOSS 10-Year Implementation Plan 5.4 Data Sharing The societal benefits of Earth observations cannot be achieved without.
Advertisements

Work Plan Development Guidelines and Schedule.
Work Plan Development Guidelines and Schedule.
Response to Intervention (RtI) in Primary Grades
Releases & validation Simon George & Ricardo Goncalo Royal Holloway University of London HLT UK – RAL – 13 July 2009.
SLUO LHC Workshop, SLACJuly 16-17, Analysis Model, Resources, and Commissioning J. Cochran, ISU Caveat: for the purpose of estimating the needed.
Trigger Data Formats From CBNT to ESD and/or DPD June 11, 2008 Fabrizio Salvatore, Ricardo Gonçalo, RHUL.
Gu & Maher University of Sydney, October 2004 DECO2005 Monitoring Team Process.
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
Lecture 2b: Software Project Management CSCI102 - Introduction to Information Technology B ITCS905 - Fundamentals of Information Technology.
PRESENTATION The Structured Dialogue. What? A participative process for young people and decision-makers to discuss and elaborate recommendations jointly.
TRIGGER DATA FOR PHYSICS ANALYSIS ATLAS Software Tutorial – 22 nd to 24 th April 2009 Ricardo Gonçalo – Royal Holloway.
Biostatistics Analysis Center Center for Clinical Epidemiology and Biostatistics University of Pennsylvania School of Medicine Minimum Documentation Requirements.
Hall D Online Data Acquisition CEBAF provides us with a tremendous scientific opportunity for understanding one of the fundamental forces of nature. 75.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
Event Metadata Records as a Testbed for Scalable Data Mining David Malon, Peter van Gemmeren (Argonne National Laboratory) At a data rate of 200 hertz,
ATLAS Data Periods in COMA Elizabeth Gallas - Oxford ATLAS Software and Computing Week CERN – April 4-8, 2011.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
TRIGGER-AWARE ANALYSIS TUTORIAL ARTEMIS Workshop – Pisa – 18 th to 19 th June 2009 Alessandro Cerri (CERN), Ricardo Gonçalo – Royal Holloway.
News from the Beatenberg Trigger Workshop Ricardo Gonçalo - 18 February 2009 Higgs WG Meeting during ATLAS Week.
The New TrigDecision Nicolas Berger, Till Eifert, Ricardo Gonçalo Physics Analysis Tools session ATLAS Software Workshop – Munich, March 2007.
What’s in the ATLAS data : Trigger Decision ATLAS Offline Software Tutorial CERN, August 2008 Ricardo Gonçalo - RHUL.
Trigger validation for Event size TrigDecision Jets Electrons Ricardo Gonçalo, RHUL Physics Validation Meeting – 9 October 2007.
Ricardo Gonçalo (RHUL) Higgs WG meeting – 28 th August, 2007 Outline: Introduction & release plans Progress in menus for cm -2 s -1 Workshop on trigger.
PRESENTATION IV Cycle of the Structured Dialogue.
Plans for Trigger Software Validation During Running Trigger Data Quality Assurance Workshop May 6, 2008 Ricardo Gonçalo, David Strom.
1 Trigger “box” and related TDAQ organization Nick Ellis and Xin Wu Chris Bee and Livio Mapelli.
1 김 수 동 Dept. of Computer Science Soongsil University Tel Fax
Overview of the RBS Plan Review Process Leslie Ann Hay, Implementation Lead Megan Stout, CDSS Analyst.
NATIONAL STEERING COMMITTEE MONITORING AND INFORMATION SYSTEMS FOR CMAs TASK TEAM 31 May 2013.
Level 2 ID-tracking truth association Trigger AOD discussion 13 December 2006 Ricardo Gonçalo - RHUL.
Overall Goal of the Project  Develop full functionality of CMS Tier-2 centers  Embed the Tier-2 centers in the LHC-GRID  Provide well documented and.
DPDs and Trigger Plans for Derived Physics Data Follow up and trigger specific issues Ricardo Gonçalo and Fabrizio Salvatore RHUL.
Future Framework John Baines for the Future Framework Requirements Group 1.
Targets for project progress 2015: graduation review – clear documentation and PoC implementation specify general framework and API requirements gap analysis.
ATLAS: Heavier than Heaven? Roger Jones Lancaster University GridPP19 Ambleside 28 August 2007.
Status of trigger software and EDM Ricardo Gonçalo, RHUL – on behalf of ATLAS TDAQ.
The ATLAS Trigger: High-Level Trigger Commissioning and Operation During Early Data Taking Ricardo Gonçalo, Royal Holloway University of London On behalf.
TDAQ Upgrade Software Plans John Baines, Tomasz Bold Contents: Future Framework Exploitation of future Technologies Work for Phase-II IDR.
Organisation of the Beatenberg Trigger Workshop Ricardo Gonçalo Higgs WG Meeting - 22 Jan.09.
CERN-IT Oracle Database Physics Services Maria Girone, IT-DB 13 December 2004.
Latest News & Other Issues Ricardo Goncalo (LIP), David Miller (Chicago) Jet Trigger Signature Group Meeting 9/2/2015.
Artemis School On Calibration and Performance of ATLAS Detectors Jörg Stelzer / David Berge.
AOD/ESD plans Status and plans focusing on LVL2 e/  and some items for discussion On behalf of: J.Baines, P.Casado, G.Comune, A.DiMattia, S.George, R.Goncalo,
Moritz Backes, Clemencia Mora-Herrera Département de Physique Nucléaire et Corpusculaire, Université de Genève ATLAS Reconstruction Meeting 8 June 2010.
Southend Together Secretariat 21 st February Developing Southend Together’s Sustainable Community Strategy
1 Future Circular Collider Study Preparatory Collaboration Board Meeting September 2014 R-D Heuer Global Future Circular Collider (FCC) Study Goals and.
The ATLAS TAGs Database - Experiences and further developments Elisabeth Vinek, CERN & University of Vienna on behalf of the TAGs developers group.
Performance DPDs and trigger commissioning Preparing input to DPD task force.
David Adams ATLAS Datasets for the Grid and for ATLAS David Adams BNL September 24, 2003 ATLAS Software Workshop Database Session CERN.
Trigger Input to First-Year Analysis Model Working Group And some soul searching… Trigger Open Meeting – 29 July 2009.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
The Worldwide LHC Computing Grid Introduction & Housekeeping Collaboration Workshop, Jan 2007.
Victoria, Sept WLCG Collaboration Workshop1 ATLAS Dress Rehersals Kors Bos NIKHEF, Amsterdam.
PCAP Close Out Feb 2, 2004 BNL. Overall  Good progress in all areas  Good accomplishments in DC-2 (and CTB) –Late, but good.
Planning sample T Ricardo Gonçalo, RHUL. What we’re doing… We are putting together a wish list for: – Signal MC samples to be generated when there are.
Analysis Performance and I/O Optimization Jack Cranshaw, Argonne National Lab October 11, 2011.
Commissioning and run coordination CMS week Commissioning plenary 28-February 2007 DQM and monitoring workshop MandateGoals.
REVIEW OF EARLY YEARS, CHILDREN’S CENTRES AND FAMILY SUPPORT PROPOSALS FOR CHANGE.
Trigger release and validation status and plans David Strom (Oregon), Simon George (RHUL), Ricardo Gonçalo (RHUL)
Marco Cattaneo, 3-June Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
Introduction 08/11/2007 Higgs WG – Trigger meeting Ricardo Gonçalo, RHUL.
Marco Cattaneo, 20-May Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
MICE Computing and Software
Concluding discussion on Commissioning, Etmiss and DPD
Tracker Upgrade Simulations Software Harry Cheung (Fermilab)
UQ Course Site Design Guidelines
Finance & Planning Committee of the San Francisco Health Commission
ATLAS DC2 & Continuous production
Presentation transcript:

Points from DPD task force First meeting last Tuesday (29 th July) – Need to have concrete proposal in 1 month – Still some confusion and nothing very concrete yet – Caveat: I wasn’t there… What can be done in DPDs: – Skimming – remove un-interesting events – Slimming – remove un-needed containers – Thinning – remove un-necessary object details – Add information – detector and user data Some points: DPDs to be made from ESD/AOD not expected from BS Produced in RecExCommon environment: effort to reduce multiplication of DPDMakers… Not doing N(streams)xM(phys groups) DPDs: do sparse matrix as needed Ricardo GoncaloTrigger Coordination Group 11/08/081

Ricardo GoncaloTrigger Coordination Group 11/08/082

Trigger information in DPDs We’ve been collecting input from slices: reported by Fabrizio in Menus meeting last week (23 July) Which triggers passed/failed, prescale, passthrough Enough info to allow tag-and-probe (match trigger and offline objects) Benchmark for minimal trigger info being requested! Possibility: use for selection optimisation Trigger navigation: – For 2008 run: store as is, no thinning – For 2009 run: Thin down to contain only requested chains Tomasz and Harvard group interested Not clear how to deal with trigger features attached to deleted chains (in progress) Matching between offline and online objects – Some interest from physics groups Ideas: List of triggers passed attached to offline objects “External” map to chains and offline objects – Can we provide common solution? Ricardo GoncaloTrigger Coordination Group 11/08/083

Loose ends How many DPDs – more concrete examples needed Monte Carlo DPDs – Noted that stream reproducibility depends on trigger – Truth info will be needed Duplicate event removal – Potential for blunders when running DPD making on several streams – On PAT to-do list Use of RecExCommon not a peaceful decision Generic physics DPD – Maarten to present proposal in tomorrow’s meeting (“first shot” for data production) Performance DPDs (T0 and T1): – Size is likely to hit the 100 kB/ev (AOD size… which begs the question of DPD usefulness) – Overlap between offline commissioning and performance DPDs not clear Ricardo GoncaloTrigger Coordination Group 11/08/084

Backup Ricardo GoncaloTrigger Coordination Group 11/08/085

DPD task force: The DPD task-force is being set up to address urgently the requirementsfor DPDs for detector and object performance understanding, especiallyin the early data. The expectation is that "Performance DPDs" should bemade at the Tier-0 for this purpose: these can contain parts of the ESDand/or AOD content, and might be highly skimmed subsets of the standardevent-filter streams. The specific goals are as follows: – Establish how many performance DPDs are required, and define their content. This must be done in consultation with detector, trigger, and combined performance groups.- Implement and demonstrate the making of these DPDs at the Tier-0, for example in an FDR follow-up exercise, if possible before the end of August meeting days. – Ensure, in collaboration with the production team, that such performance DPD-making also works in the production system at Tier-1s. – Identify additional object slimming priorities, to be implemented in consultation with relevant experts and PAT. An example is an effective slimming of trigger information. – Understand and document the expected distribution requirement for the performance DPDs to Tier- 1's and Tier-2's. – Complete recommendations by, and report to, the end-August physics/performance clustered- meeting days (26-29 August). Further refinements may be needed following these meetings, which the task-force should consider and implement. The work for the period until the August workshop should be focused on the definition and implementation of performance DPDs. Some of thetests at the Tier-0 and in the production system may need to extend beyond that date. The task-force should define its own detailed schedule. A second-phase task force is foreseen afterwards to define the common physics group DPDs, which will normally be made at Tier-1s. Nonetheless, all members of the group should be engaged in all phases of the work of the task force: there are many issues which will be common to both performance and physics group DPDs. Ricardo GoncaloTrigger Coordination Group 11/08/086

EDM migration allowed improvements in data size on file Overall size of trigger data depends strongly on data type and on menu Running menu for L=10 31 cm -2 s -1 (no Bphysics): – AOD total size: 48 kB/event – ESD total size: 86 kB/event The HLTResult may be reduced further to 1-2 kB/event by slimming out navigation information - (e.g. for inclusion in DPDs) Ricardo Goncalo, RHULTrigger Software - Atlas Week Bern7 13.7HLTResult 12.1Rec::TrackParticleContainer 9.9TrigInDetTrackCollection 3.6CaloClusterContainer 2.1TrigElectronContainer 1.9egDetailContainer 1.2Trk::VxContainer 0.7TrigTauClusterContainer

Ricardo GoncaloTrigger Coordination Group 11/08/088

Ricardo GoncaloTrigger Coordination Group 11/08/089

Ricardo GoncaloTrigger Coordination Group 11/08/0810