DØ Data Handling & Access The DØ Meta-Data Browser Pushpa Bhat Fermilab June 4, 2001.

Slides:



Advertisements
Similar presentations
Database Management Using Microsoft Access Xinhua Chen, Ph.D. Chinese Association of Professionals in Science and Technology March 23, 2003.
Advertisements

Guide to Oracle10G1 Introduction To Forms Builder Chapter 5.
A Guide to Oracle9i1 Introduction To Forms Builder Chapter 5.
Jonathan Voigt University of Michigan Soar Workshop 25
Using the Visual Basic Editor Visual Basic for Applications 1.
1 SYSTEMS DESIGN Pertemuan 13 s.d 20 Matakuliah: A0554/Analisa dan Perancangan Sistem Informasi Akuntansi Tahun: 2006.
Attribute databases. GIS Definition Diagram Output Query Results.
Accelerated Computer Technologies Company Overview.
Business Computer Information Systems Microsoft Office XP Access Review Lessons 1 through 5.
The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.
Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.
MS Access Advanced Instructor: Vicki Weidler Assistant:
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Tev4LHC Workshop, QCD, Emily Nurse, UCL for the CEDAR collaboration (Andy Buckley, Jon Butterworth, James Monk, Ben Waugh, Mike Whalley,
© URENIO Research Unit 2004 URENIO Online Benchmarking Application Thessaloniki 7 th of October 2004 Isidoros Passas BEng Computer System Engineering.
L3 Filtering: status and plans D  Computing Review Meeting: 9 th May 2002 Terry Wyatt, on behalf of the L3 Algorithms group. For more details of current.
4-1 INTERNET DATABASE CONNECTOR Colorado Technical University IT420 Tim Peterson.
The NetBeans IDE CSIS 3701: Advanced Object Oriented Programming.
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
Chapter 11: Introduction to the Visual Basic Environment Spreadsheet-Based Decision Support Systems Prof. Name Position (123) University.
GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.
Copyright © 2007, Oracle. All rights reserved. Managing Concurrent Requests.
Automating Database Processing Chapter 6. Chapter Introduction Design and implement user-friendly menu – Called navigation form Macros – Automate repetitive.
Global Monitoring Pushpa Bhat Fermilab Shifter Tutorial Feb. 3, 2003.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
Belle II Data Management System Junghyun Kim, Sunil Ahn and Kihyeon Cho * (on behalf of the Belle II Computing Group) *Presenter High Energy Physics Team.
Program Design and Coding
Microsoft Visual Basic 2012 CHAPTER THREE Program Design and Coding.
Microsoft Visual Basic 2010 CHAPTER THREE Program Design and Coding.
Framework for Raw Data Thomas Kuhr Offline Week 29/06/2004.
Microsoft Office 2007 Intermediate© 2008 Pearson Prentice Hall1 PowerPoint Presentation to Accompany GO! With Microsoft ® Office 2007 Intermediate Chapter.
Searching Business Data with MOSS 2007 Enterprise Search Presenter: Corey Roth Enterprise Consultant Stonebridge Blog:
Bookkeeping Tutorial. Bookkeeping & Monitoring Tutorial2 Bookkeeping content  Contains records of all “jobs” and all “files” that are created by production.
Key Applications Module Lesson 21 — Access Essentials
The Project – Database Design. The following is the high mark band for the Database design: Analysed a given situation and produced and analysed a given.
GridPP18 Glasgow Mar 07 DØ – SAMGrid Where’ve we come from, and where are we going? Evolution of a ‘long’ established plan Gavin Davies Imperial College.
CIS 250 Advanced Computer Applications Introduction to Access.
 Agenda 2/20/13 o Review quiz, answer questions o Review database design exercises from 2/13 o Create relationships through “Lookup tables” o Discuss.
Datasets on the GRID David Adams PPDG All Hands Meeting Catalogs and Datasets session June 11, 2003 BNL.
The Region 10 STORET Legacy System Provides for Dynamic Real-Time Analysis of Legacy STORET Data via the Web Go Dynamically From: Interactive Web Maps.
Sexy Science User Interfaces June 17, 2011 GRITS III, Pasadena, CA John Good.
Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.
Computer Science Project Criteria. Computer Science Project The project is intended to simulate the analysis, design, progamming and documentation stages.
SAM - Sequential Data Access via Metadata Schema Metadata Functionality Workshop Glasgow University April 26-28,2004.
Microsoft Access Lesson 2 Lexington Technology Center February 13, 2003 Bob Herring On the Web at
D. Heynderickx DH Consultancy, Leuven, Belgium 22 April 2010EuroPlanet, London, UK.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
LIGO-G Z 5 June 2001L.S.Finn/LIGO Scientific Collaboration1 LDAS Camp.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
Word 2003 The Word Screen. Word 2003 Screen File Menu –Holds the options for creating a new document, opening a document, saving a document, printing.
IST 220 – Intro to Databases Lecture 2 Touring Microsoft Access.
Bookkeeping Tutorial. 2 Bookkeeping content  Contains records of all “jobs” and all “files” that are produced by production jobs  Job:  In fact technically.
Lesson 29: Building a Database. Learning Objectives After studying this lesson, you will be able to:  Identify key database design techniques  Open.
CPSC 203 Introduction to Computers T43, T46 & T68 By Jie (Jeff) Gao.
Online/offline integration - Aart Heijboer - sector/soft - Cern june 2002 Integration Online and Offline software Run Control Ligier (dispatcher) Data.
CPSC 203 Introduction to Computers Lab 66 By Jie Gao.
Andrea Valassi (CERN IT-DB)CHEP 2004 Poster Session (Thursday, 30 September 2004) 1 HARP DATA AND SOFTWARE MIGRATION FROM TO ORACLE Authors: A.Valassi,
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
Finding Data in ATLAS. May 22, 2009Jack Cranshaw (ANL)2 Starting Point Questions What is the latest reprocessing of cosmics? Are there are any AOD produced.
Processing large data sets Brad Abbott. Now J/Psi Starting with root-tuples Add 4-momentum to look for candidates Pick events (raw) -> reconstruct event.
1 PSI/PhUSE Single Day Event – SAS Applications – June 11, 2009 SAS Drug Development from the Inside Magnus Mengelbier Director.
Jianming Qian, UM/DØ Software & Computing Where we are now Where we want to go Overview Director’s Review, June 5, 2002.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
IST 220 – Intro to Databases
Existing Perl/Oracle Pipeline
Searching Business Data with MOSS 2007 Enterprise Search
Microsoft Access Illustrated
Searching Business Data with MOSS 2007 Enterprise Search
1) What is a Database? A database is an organized collection of information about a subject. Examples: Address Book, Telephone Book.
Presentation transcript:

DØ Data Handling & Access The DØ Meta-Data Browser Pushpa Bhat Fermilab June 4, 2001

Pushpa Bhat June 4, The DØ Meta-Data Browser (DMDB)  We need ONE user-interface to get any information needed about any type of DØ data  Intuitive and Physics-based interface  Minimize Computer Science jargon  Provide a unified access to the Meta- data available in the Federation of DØ databases  Run Info, Trigger, Luminosity, SAM File/Tape database  The users need not know where it comes from  Web-style logical expression queries  Generate data summary reports, summary plots, tables for a list of runs/files, macros needed as input in analyses

Pushpa Bhat June 4, The DMDB Interface Data Summary Run Info DataMonte Carlo Get Summary Plots Get Data Summary DØ Data Summary June 4, 2001 Number of runs to date: Run number range: Total Integrated Luminosity: Number of global runs: Number of special runs: Number of runs processed: Total data size: xxx Tb (Reco), xxx Gb (TMB) Print Summary to File Scroll down for more info

Pushpa Bhat June 4, DMDB Run Info Query should help find runs for detector or trigger debugging Query results can be self-limiting, inform the user of how many records were found and display a limited number of records, as in case of web search Data Summary Run Info Data Monte Carlo Data Summary HelpGo Logical Query Find run < and det SMT+MUON And trigger 15 Start Date Go End Run Go Start Run End Date

Pushpa Bhat June 4, DMDB Run Info DØ Run Information June 4, 2001 Print to File Run number: GOOD RUN Start Date: End Date: Begin Inst. Lum.: End Inst. Lum.: Total Integrated Luminosity: Triggers Used: Detectors Used: Number of Files written: Shifters: Problems Recorded: Pages thru Results of the search for all runs satisfying criteria Output in a table format is another option

Pushpa Bhat June 4, Monte Carlo Info Data Summary Run Info Data Monte Carlo Data Summary Process PYTHIA ISAJET HERWIG Color Code Samples Available In Pipeline Not Available

Pushpa Bhat June 4, DMDB Monte Carlo Info DØ Monte Carlo June 4, 2001 Save File List/ Create Sam.bash Monte Carlo Sample: Date Generated: Number of Events: Total Integrated Luminosity: Cross Section: (Calculated by the Generator) Cuts Used in Generator: Level of Processing: Level of Processing: Generator, Full or fast Detector simulation, Reco etc. Note Scroll-bar List continues

Pushpa Bhat June 4, Data Data Data Summary Run Info Data Monte Carlo Data Summary ROOTtuples Reco Status Streams HelpGo Logical Query Find rootfile reco p09.00 and xx zmumu ThumbNails Query: When you get results from the query, have option to write results to a file Help: Gives you keywords available for query, their definitions and query syntax Follow SLAC Spires model for queries Reco Certification Samples Raw Data

Pushpa Bhat June 4, Data Data Summary Run Info Data Monte Carlo Data Summary It is useful to have similar interfaces for real And MC data Example: Stream RECO TMB ROOT QCD W(e) ee Stream-4 Stream-5 Streams Info

Pushpa Bhat June 4, Summary What exists through SAM query pages are already useful! But, the examples shown are to illustrate the look and feel of a UNIFIED user window to DØ data. (The goal is to render it easier, intuitive and physics- based!) Specifications for DMDB can evolve and technical implementation details should be worked out Thanks to Harry Melanson and Harrison Prosper for useful input.

Pushpa Bhat June 4, Other Thoughts & Comments Layering the information and using key words to make logical queries Web technologies have proven the sophistication that can be attained in searches for information Filenames can be simple and the file internally be self-describing. –The database can provide the mapping –One can have a tool that can be run on the file to get the header information. We will have to handle data for many years to come; in the meantime, computing technology will advance tremendously!