Presentation is loading. Please wait.

Presentation is loading. Please wait.

IceCube Collaboration Meeting March, 2005 Data Handling.

Similar presentations


Presentation on theme: "IceCube Collaboration Meeting March, 2005 Data Handling."— Presentation transcript:

1 IceCube Collaboration Meeting March, 2005 Data Handling

2 Berkeley IceCube Meeting 21-23 March 3 Data Handling

3 Berkeley IceCube Meeting 21-23 March 4 2004 South Pole Test System (SPTS) operational South Pole System (SPS) assembled at PSL SPS shipped to the South Pole SPS installed at the South and operational with 1 string SPADE operational moving summer data and TestDAQ data now

4 Berkeley IceCube Meeting 21-23 March 5 2005 Data input methods for Data Warehouse Web interface for Data Warehouse Upgrade data storage facility Implement IceCube Metadata standard and directory structure Upgrade SPS and SPTS for 05/06 season

5 Berkeley IceCube Meeting 21-23 March 6 Data Warehouse Well organized, accessible, catalogued, and controlled data repository The basis for cataloging is metadata Data input (ingestion) via application (Ingest) or direct write Access via application (web) or direct read Controls to ensure conformity to cataloging requirements and access control

6 Berkeley IceCube Meeting 21-23 March 7 Ingest Methods Solution is 4 models (Mackenzie) Direct write, catalogued by directory and metadata supplied by user Direct write, catalogued by directory and metadata supplied by application Direct write, catalogued by file and metadata supplied by user Via application, catalogued by file and metadata supplied by application

7 Berkeley IceCube Meeting 21-23 March 8 Ingest Methods Long term Web application for metadata creation, modification, and catalog searching Interfaces to standard simulation and analysis Short term Manual creation of directory locations by Data Center via help@icecube.wisc.edu request Metadata by filling out templates SPADE adapted for application based ingestion

8 Berkeley IceCube Meeting 21-23 March 9 Directory Structure /(exp|sim|ana)/ / / /[subcategory/] \[mmdd/]filename Examples /data/exp/IceCube/2005/TestDAQ/0314 /data/sim/AMANDA/2000/corama

9 Berkeley IceCube Meeting 21-23 March 10 Metadata Group: DIF Entry_ID: 12345 Entry_Title: AMANDA Data Group: Data_Center Data_Center_Name: UWI-MADISON > University of Wisconsin-Madison AMANDA/IceCube Group Data_Center_URL: http://icecube.wisc.edu/datacenter Group: Personnel Role: Data Center Contact End_Group End_Group Group: Parameters Category_Topic_Term_Variable: PHYSICS > ASTROPHYSICS > NEUTRINOS > ATMOSPHERIC End_Group Summary: Data from the South Pole Sensor_Name: AMANDA > Antarctic Muon and Neutrino Detector Array Group: Temporal_Coverage Start_Date: 2000-01-01 Stop_Date: 2001-12-31 End_Group End_Group

10 Berkeley IceCube Meeting 21-23 March 11 Metadata 12345 AMANDA Data UWI-MADISON > University of Wisconsin-Madison AMANDA/IceCube Group http://icecube.wisc.edu/datacenter Data Center Contact PHYSICS > ASTROPHYSICS > NEUTRINOS > ATMOSPHERIC Data from the South Pole AMANDA > Antarctic Muon and Neutrino Detector Array 2000-01-01 2001-12-31

11 Berkeley IceCube Meeting 21-23 March 12 Data Handling


Download ppt "IceCube Collaboration Meeting March, 2005 Data Handling."

Similar presentations


Ads by Google