1. 29 July 2008Elizabeth Gallas1 An introduction to “TAG”s for ATLAS analysis Elizabeth Gallas Oxford Oxford ATLAS Physics Meeting Tuesday 29 July 2008

2. 29 July 2008Elizabeth Gallas2 Outline  Introduction: ATLAS TAGs in the ATLAS Computing model  TAG database application content and tools  Important TAG related hyperlinks  ELSSI – Event Level Selection Service Interface A Web based interface to ATLAS event selection Browser Panes guide user through selection criteria Supported browsers: Firefox and Safari (not IE ) Requires Grid Certificate All this … as I understand it…

3. 29 July 2008Elizabeth Gallas3 The TAG Development Group Argonne: David Malon, Jack Cranshaw, Qizhi Zhang Glasgow: MikeKenyon, HelenMcGlone, TomDoherty CERN: Florbela Viegas, Trivan Pal Chicago: Marco Mambelli Oxford: Elizabeth Gallas Grenoble: Solveig Albrand Help with Draw, Analyze selection… from Julius Hrivnac Thanks to everyone above and to all users with feedback !

4. 29 July 2008Elizabeth Gallas4 What’s a TAG (in this talk)  “TAG” overload: Not an acronym (retrospectively TAGs Are Great !) Not a CVS tag or a release tag or a project tag Not tracked by the ATLAS Tag Collector Not a COOL (Conditions Database) TAG Not a B, flavor, or muon tag  In this talk: ATLAS TAG application is A system supporting Event-level metadata  About 200 indexed variables for each event Stored in a ‘database’ (Oracle or file based)  1 kB/event -> 1 TB/year PURPOSE: Facilitates event selection for analysis

5. 29 July 2008Elizabeth Gallas5 ATLAS TAGs in the ATLAS Computing model  Stages of ATLAS reconstruction  RAW data file  ESD (Event Summary Data) ~ 500 kB/event  AOD (Analysis Object Data) ~ 100 kB/event  TAG (not an acronym) ~ 1 kB/event  TAGs Produced in reconstruction Can be re-produced in re-processing Customized TAGs can be defined/produced TAG formats:  File based: AthenaAwareNtuple format  Database: available globally through network connection Used by the TAG Browser (ELSSI)

6. 29 July 2008Elizabeth Gallas6 TAG related hyperlinks:  TWiki: TAG content in ATLAS release: TagForEventSelection TagForEventSelection GangaTNT: Using TNT (Tag Navigator Tool) in Ganga  TagNavigatorToolGangaPlugin (see notes in Summary) TagNavigatorToolGangaPlugin Tutorial TWiki(s):  EventTagTutorials – Start Here EventTagTutorials  EventTagTutorialJuly2008Browser - browser-based exercises EventTagTutorialJuly2008Browser  EventTagTutorialJuly2008Files- file-based exercises EventTagTutorialJuly2008Files  EventTagTutorial – June 2006 EventTagTutorial includes ways to use TAGS Make your own AANT (AthenaAwareNTuple) Build an AOD with your selected events Make your own POOL file catalog Web browser based queries (ELSSI) – today’s demo …  Official production version of ELSSI: ELSSI - Event Level Selection Service Interface: ELSSI - Event Level Selection Service Interface https://tagservices.web.cern.ch

7. 29 July 2008Elizabeth Gallas7 “TAG content”: Your selection variables  PAT (Physics Analysis Tools) group supports ‘official’ TAG content based on input from physics groups  (YOU !)  ‘TAG Database’ Application includes ~200 variables/event:  Event identification (run, event, lumi block numbers, timestamp, …)  Global quantities (e.g., missing eT)  Trigger decisions at all three levels (now bit encoded)  Numbers of electrons, muons, photons, taus, and jets pT, eta, phi for highest-pT objects  Detector status and quality words  Physics and performance group status words ‘Run Metadata’ at Temporal, Fill, Run, Lumi-block levels references to AOD,ESD,RAW for back-navigation A variety of supporting tools and infrastructure  ELSSI is a web based supporting tool Helps you navigate through “TAG content“ Uses other supporting tools and infrastructure Retrieve results in a number of forms

8. 29 July 2008Elizabeth Gallas8 ELSSI: TAG Browser Basics  An interface to the TAG Database  Allows pre-selection of events for analysis  Guides the user through the selection process: User Input Stream Temporal QualityPhysicsTrigger COUNT events SELECT attributes RETRIEVE events

9. 29 July 2008Elizabeth Gallas9 ELSSI: Implementation & Features  Running on server at CERN PHP and Javascript on backend  Features: Query caching Event counting Display Results (graphical and tabular form) Retrieve events in ROOT file Register collection in AMI (at Glasgow for now…) Integrating GangaTNT functionality into ELSSI:  [Optionally] run a query on the TAG database to generate a ROOT file.  Run an Athena job on input ROOT file.

10. 29 July 2008Elizabeth Gallas10 ELSSI GatewayELSSI Gateway https://tagservices.web.cern.ch

11. 29 July 2008Elizabeth Gallas11 Browser front page for FDR2 – ‘Temporal Tab’

12. 29 July 2008Elizabeth Gallas12 Browser – ‘Stream Tab’

13. 29 July 2008Elizabeth Gallas13 Browser – ‘ Trigger Tab’

14. 29 July 2008Elizabeth Gallas14 ‘Physics Attributes Tab’

15. 29 July 2008Elizabeth Gallas15 ‘Review Query tab’

16. 29 July 2008Elizabeth Gallas16 ‘Perform Query’: Count tab Count events meeting criteria … revise criteria… count again… revise criteria …

17. 29 July 2008Elizabeth Gallas17 ‘Perform Query’: Display Results tab  Get an idea of the attribute distributions  Draw histograms – new functionality from Julius (still in development)

18. 29 July 2008Elizabeth Gallas18 Retrieve Events  After refining query, generate a ROOT TAG file with selected events

19. 29 July 2008Elizabeth Gallas19 Left Frame: about your Session(s)  Save/Share Session(s) Can now save a query session for later use Uses cookies  Browser specific Share saved sessions with others  Selection Summary Displays selection criteria of your session

20. 29 July 2008Elizabeth Gallas20 Working on … (1)  Incorporating Detector Status (DQ)  Loading online Runs Even in the absence of TAG production  An ELSSI “skim” button (Skimming Service) using GangaTNT: From your selected TAG events, generate an AOD dataset with only those events Output registered as new dataset Runs GANGA on the server to run the job on behalf of the user  User proxy is delegated to the server  Monitoring loop checks job status and notifies user of job completion / failure  Integrate GangaTNT into GangaGUI.

21. 29 July 2008Elizabeth Gallas21 Ganga TNT

22. 29 July 2008Elizabeth Gallas22 Working on … (2)  Using TAGs with PAthena: Steps create an event collection (events.root) with ELSSI setup Pathena and the Grid environment use a joboption like the one you'd use to run a local analysis based on TAGs submit the Pathena job use Panda monitoring to check for completion use DQ2 enduser clients (dq2-get) to retrieve the output files  Problem: AOD to AOD (copy) is problematic in some releases

23. 29 July 2008Elizabeth Gallas23 TAG job with Pathena Panda TAG DB ELSSI or POOL Collection Utilities ELSSI or POOL Collection Utilities events.root POOL Collection Utilities events.root events1.root Output Dataset DQ2 Catalogues Pathena DQ2 Client jobOption

24. 29 July 2008Elizabeth Gallas24 Summary  Metadata in a database is a powerful tool A great variety of dynamic selection criteria and reporting become possible  Development is ongoing to improve Interfaces  Functionality  Usability Integrate infrastructure tools  For comments/suggestions: ATLAS Physics Metadata Hypernews