Download presentation
Presentation is loading. Please wait.
Published byReynold Douglas Modified over 9 years ago
1
David Adams ATLAS DIAL status David Adams BNL November 21, 2002 ATLAS software meeting GRID session
2
David Adams ATLAS November 21, 2002DIAL status ATLAS SW – GRID session2 Goals of DIAL Demonstrate the feasibility of interactive analysis of large datasets Large means too big for interactive analysis on a single CPU Set requirements for GRID middleware Provide ATLAS with a tool to analyze DC1 and DC2 event data More that just ntuples Large samples Distributed data and processing
3
David Adams ATLAS November 21, 2002DIAL status ATLAS SW – GRID session3 What is DIAL? Distributed Data and processing Interactive Prompt response (seconds rather than hours) Analysis of Histograms, event selection, … Large datasets Any event data (not just ntuples or tag)
4
David Adams ATLAS November 21, 2002DIAL status ATLAS SW – GRID session4 What is DIAL? (cont) DIAL provides a connection between Interactive analysis framework –ROOT –Afrodita? Data processing application –Athena User supplies task Defines result –E.g. histogram C++ code snippet to fill result
5
David Adams ATLAS November 21, 2002DIAL status ATLAS SW – GRID session5 What is DIAL? (cont) Scheduler Accepts dataset, task and application from user Splits dataset along event boundaries Creates and submits a job for each sub-dataset Concatenates results from jobs Makes combined result available to the user Provides status reports –Fraction of events processed –Estimated time to completion –Partial results
6
David Adams ATLAS November 21, 2002DIAL status ATLAS SW – GRID session6 DIAL interactions Analyzer Job 1 Job 2 ApplicationTask Dataset 1 Scheduler 1. Create or locate 2. select3. Create or select 4. select 8. create(app,tsk,ds1) 5. submit(app,tsk,ds) 8. create(app,tsk,ds2) 6. split Dataset Dataset 2 7. create e.g. ROOT e.g. ATHENA (Afrodita?) Result 9. fill 10. cat
7
David Adams ATLAS November 21, 2002DIAL status ATLAS SW – GRID session7 Status Datasets Generic implementation in place –http://www.usatlas.bnl.gov/~dladams/datasethttp://www.usatlas.bnl.gov/~dladams/dataset Includes AthenaRoot MC track and vertex DIAL All components in place –http://www.usatlas.bnl.gov/~dladams/dialhttp://www.usatlas.bnl.gov/~dladams/dial Simple scheduler –local (same node) –creates a single processing job
8
David Adams ATLAS November 21, 2002DIAL status ATLAS SW – GRID session8 Future Dataset Zebra hits and digits (DC1-1) AthenaRoot reco objects (DC1-2) POOL EventCollection all objects (DC2) Scheduler Remote processing Multiple jobs (splitting input dataset) GRID integration –Big deal
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.