1. Data Management Workshop
More Data Center Tools
Rick Benson
IRIS DMC
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

2. SHAPE Software SEED Header Assembly and Preparation Engine
SHAPE - Build dataless SEED files from SEED RESP and other info
Controlled with a Header Assembly Template (HAT) file in XML format wherein SHAPE finds the needed details for building a SEED file including names of RESP files and blockette field values
Easily used in scripts, good for batch creation of dataless SEED, complimentary to PDCC at this point
Good for templating (common components defined once)
Java, runs anywhere a JVM is available
Available from
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

3. SHAPE HAT Examples SHAPE Header Assembly Template examples
Field substitution:
Very simple example:
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

4. Portable SEED File Reading
Jrdseed - Java port of the IRIS-DMC’s ‘rdseed’
Reads full SEED, dataless SEED and Mini-SEED+dataless
Writes SEED, SAC, AH, CSS, SEGY, SEED RESP
Time-window and other output selection possible
Runs anywhere a JVM is available
Based on generic JavaSeed classes available separately
Not as complete as ‘rdseed’ yet
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

5. libmseed - Mini-SEED Library
Allows reading and writing of Mini-SEED records
Written in C
Supports all structures of SEED 2.4 with a few minor caveats (blockette 2000 and blockette 405)
Supports all valid record lengths and big or little endian
Supports ASCII, int-16, int-32, float-32, float-64, Steim-1 and Steim-2 encoding formats for reading and writing; supports SRO/ASRO, DWWSSN and GEOSCOPE encoding formats read-only
Manages arbitrarily long continuous trace segments and groups of continuous trace segments composed, for example, of many Mini-SEED records
Tested on Solaris, Linux, Mac OSX and MS-Windows
Available from:
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

6. Example libmseed programs
msi - Mini-SEED Inspector
Parse and print useful information about Mini-SEED in one or many files. Including continuous segment construction, data sample printing, etc.
msstat - Calculate minimum, maximum, arithmetic mean, standard deviation and RMS for Mini-SEED in one or many files.
msrouter - Sort Mini-SEED records based on one or many format details (network, station, location, start time, sample rate, quality, etc.), for example “%s-%c.mseed”
PQLII/PQLX - Data visualization/analysis program using libmseed.
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

7. Data Management Workshop
Example converters
seisan2mseed - SeisAn to Mini-SEED converter
mars2mseed - MARS 88/lite to Mini-SEED converter
gse2mseed - GSE 2.0/2.1 or IMS 1.0 to Mini-SEED converter, supports both INT and CM6 data encoding
sac2mseed - SAC to Mini-SEED converter
mseed2sac - Mini-SEED converter to SAC converter
All run on Linux, Solaris, Mac OSX and MS-Windows
Available from:
* Many other converters are available at the IRIS-DMC, IRIS-PASSCAL, ORFEUS, etc.
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

8. Data Management Workshop
PQLII/PQLX Software
The evolution of the PASSCAL Quick Look software for data viewing and analysis
Key new features:
- Data display organized as continuous time series (by channel), large data sets
- User-defined filters
- Integrate and differentiate time series
- Remove mean from trace
- Read "RESP" format metadata
- PDF plots
Coming soon:
- Compute cross-correlation coefficient between selected traces
- PSD plots for selected data
- Remove instrument response
- Event-orient analysis: predicted arrivals, alignment, sorting
PQLII:
PQLX:
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

9. Real-time Data Exchange
A number of open-source and commercial data exchange systems exist, the bridges between them are illustrated below. 
Earthworm
SeedLink
NRTS
LISS
Antelope
NAQS
Scream!
Yes
Possible
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia

10. Data Management Workshop
IRIS-DMC Contact Information
Administration, cooperative agreements, etc.
Tim Ahern, Program Manager, Data Management System
Operations: submitting and/or requesting data and metadata
Rick Benson, Director of Operations
Software details
Robert Casey, Director of Software engineering
Quality control and related bits
Chad Trabant, USArray Lead Data Control Analyst
October 21-26, 2007
Data Management Workshop
Kuala Lumpur, Malaysia