Facilitate – Collaborate – Educate Tuesday, January 10, 11:05am Data Management Workshop Bangkok Thailand, January 2011.

Slides:



Advertisements
Similar presentations
Luquillo Experimental Forest Information Management: a Long-Term Ecological Research system to deposit documented data ready for analysis and synthesis.
Advertisements

ASL QC Procedures Status and plans. GSN ANSS Traditional Waveform Review  The “morning run” Daily summarizes problems with availability, timing,
March 25, 2002EarthScope CSIT Workshop Data Archiving and IT Issues for PBO Douglas Neuhauser UC Berkeley Seismological Lab Northern California Earthquake.
SUPERSITES COORDINATION WORKSHOP Monday 10 June 2013
Dataloggers. Records voltage, current, or circuit closing Environmental variables must be converted to electronic signal.
Elements of a Data Management Plan Alison Boyer Environmental Sciences Division Oak Ridge National Laboratory.
August 13-19, 2010Data Management Workshop Foz do Iguassu- Brazil Seismic Quality Assurance Rick Benson IRIS DMC Rick Benson IRIS DMC.
Trends in seismic instrumentation Based on the book Instrumentation in Earthquake Seismology Jens Havskov, Institute of Solid Earth Physics University.
By Tim Ahern, Program Manager IRIS DMS A “Short” Introduction to the IRIS Data Management Center Data Holdings, Data Organization, and Data Access.
An introduction to PDCC the Portable Data Collection Center.
Copyright © 2002 by The McGraw-Hill Companies, Inc. Information Technology & Management 2 nd Edition, Thompson Cats-Baril Chapter 8 I/S and Organizational.
ORFEUS coordination workshop, Nov 2012, Istanbul Accelerometric Station Book Stephanie Godey (EMSC) Reinoud Sleeman (KNMI/ORFEUS) NERA NA3 team: EMSC,
IRIS workshop on “Managing Waveform Data and Related Metadata from Seismic Networks” Hotel Windsor Suites, Bangkok, Thailand 08-13, January, 2012 Ashvin.
Elements of a Data Management Plan Bill Michener University Libraries University of New Mexico Data Management Practices for.
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
Web Services at IRIS Implementations, Directions, and International Coordination Tim Ahern, Director of Data Services, IRIS Web Services Team: Bruce Weertman,
CC&E Best Data Management Practices, April 19, 2015 Please take the Workshop Survey 1.
COMPILATION OF STRONG MOTION DATA FROM EASTERN CANADA FOR NGA-EAST PROJECT Lan Lin Postdoctoral Fellow, Geological Survey of Canada.
8-13 January 2012, Bangkok, Thailand Institute of Seismology, National Academy of Sciences, Kyrgyz Republic.
Portable Data Collection Center (PDCC) and the Nominal Response Library (NRL) Tim Ahern.
Tuesday Nov 10, 13:30 November 8-17, 2009Data Management Workshop Cairo, Egypt.
October 21-26, 2007Data Management Workshop Kuala Lumpur, Malaysia Using SEED Using: Jrdseed PQL SAC RESP JPlotResp Using: Jrdseed PQL SAC RESP JPlotResp.
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
Allegra Huxtable Manager Government Recordkeeping Tasmanian Archives and Heritage Office.
PBO Strainmeter Products Strainmeter Short Course Earthscope Meeting May 12, 2009 Strainmeter Short Course Earthscope Meeting May 12, 2009.
By Tim Ahern, Program Manager IRIS DMS A “Short” Introduction to the IRIS Data Management Center Data Holdings, Data Organization, and Data Access.
Database System Introduction to Database Environment October 31, 2009 Software Park, Bangkok Thailand Pree Thiengburanathum College of Arts and Media Chiang.
Automated (meta)data collection – problems and solutions Grete Christina Lingjærde and Andora Sjøgren USIT, University of Oslo.
Rick Benson Saturday, Aug 14, 14:00 August 13-19, 2010Data Management Workshop Foz do Iguassu- Brazil.
By Tim Ahern, Director of Data Services, IRIS A short introduction to the IRIS Data Management System Data Holdings, Data Organization, and Data Access.
SIG: Synthetic Seismogram Exchange Standards (formats & metadata) Is it time to establish exchange standards for synthetic seismograms? IRIS Annual Workshop.
CHAPTER 19 Data Conversion. Objectives Describe and Analyze: Analog vs. Digital Signals Resolution Digital-to-Analog Conversion Analog-to Digital Conversion.
November 16, 2009 Page 1 of 28 Data and Data Management: Introduction to the BCO-DMO Presented to Professor Keiichi Uchida November 16, 2009 Robert C.
WGS Data management course Try-out , Hugo Besemer.
1 Tools for Seismic Network QC or Other Uses of Computer Programs in Seismology Robert B. Herrmann Saint Louis University INGV 24/06/08.
1 BCS, Oxfordshire, 19 February, 2004 WEB ARCHIVING issues and challenges Deborah Woodyard Digital Preservation Coordinator.
By Tim Ahern, Director of Data Services, IRIS An Overview of IRIS Incorporated Research Institutions for Seismology.
Tim Ahern The IRIS GSN and PASSCAL “Networks”. FDSN Archive for Continuous Data at the IRIS DMC FDSN Backbone Network 200 stations currently Plans to.
Current Works Corrected unit conversions in code Found an error in calculating offset (to zero sensors) – Fixed error, but still not accurately integrating.
Building a Network Dataless SEED Volume with PDCC.
Seismograph Networks in Japan
Building Station Metadata with PDCC
SAC: An Overview SAC ( “Seismic Analysis Code” ) was originally developed by LLNL An interactive program for time-series data with emphasis placed on.
FDSN Working Group II Data Exchange and Data Centers By Bernard Dost, ORFEUS Data Centre, deBilt Netherland Tim Ahern FDSN Data Center for Continuous Data.
July 27, 2014Metadata Workshop, Bogotå Metadata Help from the DMC Our motivation is to enable networks to perpetually archive their data in open and accessible.
Station Metadata The NRL (Nominal Response Library) Dr. Mary Templeton IRIS Data Management Center Managing Data from Seismic Networks September
Understanding SEED Headers. SEED is an international standard for the exchange of digital seismological data SEED was designed for use by the earthquake.
Future: PDCC and Spreadsheets Information About a New “Branch” of PDCC.
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.
Chang, Wen-Hsi Division Director National Archives Administration, 2011/3/18/16:15-17: TELDAP International Conference.
Data Management: Data Processing Types of Data Processing at USGS There are several ways to classify Data Processing activities at USGS, and here are some.
SAC: An Overview SAC ( “Seismic Analysis Code” ) was originally developed by LLNL SAC ( “Seismic Analysis Code” ) was originally developed by LLNL An interactive.
Thurs Nov 12, 12:45 Nov 8-17, 2009Data Management Workshop Cairo, Egypt.
Station Metadata: What do I Need?
Data Formats & Data Structures
Digital Stewardship Curriculum
Data Flow Diagrams.
An Overview of IRIS and IRIS Data Services
The FDSN and International Data Exchange
Requesting a Standardized Data Set for the FDSN Network
Requesting a Standardized Data Set for the FDSN Network
Station Metadata: What do I Need?
Records Management & ARIMS
Monday January 10, 14:05 Metadata Workshop, Bangkok, Thailand
FDSN MEMBERSHIP.
Coordination of Products, Tools and Services
Long-Lived Data Collections
Presentation transcript:

Facilitate – Collaborate – Educate Tuesday, January 10, 11:05am Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate SEED Notes and Shortcuts Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate Data Preservation is Important EOS Policy Statement Data Management Workshop Bangkok Thailand, January 2011 “Because the state of natural systems is never repeated, data losses, or missed data collection opportunities can never be corrected. Consequently, the value of Earth and space science data grows with time, placing a premium on long-term data curation.” “Earth and space science data is a world heritage. properly documented and archived, they will help future scientists understand the system that comprises the Earth’s interior…………..and space environment.” Closes by stating: “Taking proper care of such data is our responsibility and our obligation to future generations”.

Facilitate – Collaborate – Educate Why is metadata important? Data Management Workshop Bangkok Thailand, January 2011 They are the Rosetta Stone- making it possible to decode information well into the future Increases accessibility: “tell me where sites are in a region”, or “what are station names in an area”, or “what instruments operate in a region”, etc. Retention of context- who operates instruments, etc Remember: People forget! Carefully created, they create both short and long-term benefits by capturing “tribal knowledge” when it’s still available, like equipment (serial numbers), sample rates, gains, documenting an accurate history of ground motion

Facilitate – Collaborate – Educate Data Management Workshop Bangkok Thailand, January 2011 Metadata In(di)gestion Functionally, we use “technical” metadata, in that it is used to describe how the seismic system behaves, and limited software description (like compression, etc) Functionally, we use “technical” metadata, in that it is used to describe how the seismic system behaves, and limited software description (like compression, etc) metadata can be shared in dataless SEED, which makes metadata “portable” amongst heterogeneous systems Whenever anything changes at a site, new metadata should be exchanged with archives or other networks using it

Facilitate – Collaborate – Educate First: Registering Network and Stations To request a FDSN network code, start here for either a permanent or temporary network code: To register your stations with the World Data Centers ISC and NEIC, start here: This should be done before sharing data or parametric data with other agencies. Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate SEED Comments: SEED format designed for data exchange and archiving. Only now becoming more common in processing, so format conversion likely required. Coordinates in decimal degrees and NOT ’6’’ Elevation in Meters Velocity and displacement in Meters Acceleration in meters/sec 2 Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate SEED v2.4 Manual Data Management Workshop Bangkok Thailand, January

Facilitate – Collaborate – Educate Introduction to SEED Recommended reading for an overview of SEED is this Chapter from the SEED manual, which is also located on your USB stick. Includes notes about Design Goals and Strategies, Recommended Uses, and conventions. Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate Channel naming convention for common sensors: Data Management Workshop Bangkok Thailand, January 2011 A gain of 250 V/m/s was somewhat arbitrarily chosen as the division between 'High gain' and 'Low gain' for velocity sensors. Those 250 V/m/s and higher would use “H” as the instrument code, those less than 250 V/m/s would use “L”.

Facilitate – Collaborate – Educate High Gain vs. Low Gain Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate Notes about SEED “channels” For consistency with the SEED manual, “L” is recommended as the instrument code for the 4.5 Hz geophone sensor, though in practice it is considered a geophone. Example: LLE, LLN, LLZ The SEED manual recommends “P”, the geophone code, for sensors with a natural frequency of Hz and higher. Example: LPE, LPN, LPZ For accelerometers, the use of the broad-band band codes "H" and "B" for the band code of the channel name are recommended. While the term "broad-band" is typical with respect to the flat portion of the response curve of velocity sensors, its use is logical for accelerometers, considering their responses are flat with respect to acceleration. Example: HNE,HNN, HNZ Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate RESP format files and info The program RDSEED creates and supports the format – For Windows Users: Jrdseed – Created on command line with syntax like this –Rdseed –fR ‘SEED_volume’ OR –rdseed -f IU.CHTO.dataless –R gives the same output but using the dataless SEED volume on your USB drive. Data Management Workshop Bangkok Thailand, January 2011 Files are named like this: RESP.IU.CHTO.00.BHZ or RESP.IU.CHTO..BHZ without location code.

Facilitate – Collaborate – Educate What’s in a RESP file? The Response is carefully derived from first principles: ground motion (meters) -> sensor -> Volts -> electronics -> volts -> Analog-to-digital converter -> counts -> digital filters -> counts Therefore, RESP files contain all the digital filter information, Something that SAC Pole/Zero (PZ) files do not Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate Example RESP file, cascade Data Management Workshop Bangkok Thailand, January 2011 Stage 1= Sensor In this case, KS Borehole in Chiang Mai, Thailand Goes from M/S ground Motion to Volts

Facilitate – Collaborate – Educate Stage 2 = Datalogger Data Management Workshop Bangkok Thailand, January 2011 Volts are converted To counts

Facilitate – Collaborate – Educate Stage 3-n = Digital Filtering & Downsampling Data Management Workshop Bangkok Thailand, January 2011 Transfer function type

Facilitate – Collaborate – Educate Reporting Filter Delays & Decimation Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate Overall Gain (also called Sensivitity) Data Management Workshop Bangkok Thailand, January 2011 The very last stage in the response cascade is the overall gain of the whole system, which is the Multiple of all stage gains at the same frequency, and called Stage 0

Facilitate – Collaborate – Educate Where can I get RESP files? These are produced using ‘rdseed’: –Rdseed –fR SEED.volume (either dataless or full) Viewed using “metadata aggregator” or at the channel level. IRIS also has a Web Service located at where one service is RESP file returns at Data Management Workshop Bangkok Thailand, January 2011

Facilitate – Collaborate – Educate The End Data Management Workshop Bangkok Thailand, January 2011