ISPAQ: IRIS System for Portable Assessment of Quality

Slides:



Advertisements
Similar presentations
COMPUTER PROGRAMMING Task 1 LEVEL 6 PROGRAMMING: Be able to use a text based language like Python and JavaScript & correctly use procedures and functions.
Advertisements

Memory & Storage Architecture Seoul National University Computer Architecture “ Bomb Lab Hints” 2nd semester, 2014 Modified version : The original.
ATM 315 Environmental Statistics Course Goto Follow the link and then choose the desktop application.
Arc: Programming Options Dr Andy Evans. Programming ArcGIS ArcGIS: Most popular commercial GIS. Out of the box functionality good, but occasionally: You.
By Tim Ahern, Rick Benson, Rob Casey, Chad Trabant and Bruce Weertman and many more talented people at the IRIS DMC.
An introduction to PDCC the Portable Data Collection Center.
Introduction to Git and Discussion on assignment 1 Gang Luo Sept. 14, 2010.
Python From the book “Think Python”
Information Services Portal Downloading, Saving and Printing Reports.
Higher-Level Clients to Leverage MUSTANG Metrics Dr. Mary Templeton IRIS Data Management Center Managing Data from Seismic Networks September
Getting Started with MATLAB 1. Fundamentals of MATLAB 2. Different Windows of MATLAB 1.
Rick Benson Saturday, Aug 14, 14:00 August 13-19, 2010Data Management Workshop Foz do Iguassu- Brazil.
Configuring IQmol for Windows machines, use version!
1 GIT NOUN \’GIT\ A DISTRIBUTED REVISION CONTROL AND SOURCE CODE MANAGEMENT (SCM) SYSTEM WITH AN EMPHASIS ON SPEED. INITIALLY DESIGNED AND DEVELOPED BY.
Automated Data Quality Assurance: QUACK and MUSTANG Mary Templeton IRIS Data Management Center Mary Templeton IRIS Data Management Center.
Reading and Mapping Aerosol Data From a MODIS HDF4 File
Track Short Course: TrackRT Installation Thomas Herring, MIT Room A
Pipeline Basics Jared Crossley NRAO NRAO. What is a data pipeline?  One or more programs that perform a task with reduced user interaction.  May be.
Greenstone Building your own collection. Overview Installation Usage Building a collection.
How to Install Eclipse Click hereClick here to download Eclipse.
MUSTANG Quality Assurance Gillian Sharer TA Team Meeting November 9-10, 2015 With contributions from Rob Casey, Bruce Weertman, Laura Hutchinson, and Mary.
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
Building Station Metadata with PDCC
Practical Kinetics Exercise 0: Getting Started Objectives: 1.Install Python and IPython Notebook 2.print “Hello World!”
Station Metadata The NRL (Nominal Response Library) Dr. Mary Templeton IRIS Data Management Center Managing Data from Seismic Networks September
Install CB 1.8 on Ubuntu. Steps Followed Install Ubuntu (Ubuntu LTS) on Virtual machine – (VMware Workstation) (
Tivoli Provisioning Manager V5.1 FP1 © 2006 IBM Corporation L2 GO Training Local TCA Install Przemyslaw Maciolek
Downloading the MAXENT Software
Instructions You can easily edit the text and images on these Pinterest viral quotes by selecting either the text box or picture and working with that.
An Introduction to Designing and Executing Workflows with Taverna Part 2 – Importing and exporting data Norman Morrison University of Manchester Credits:
9/21/04 James Gallagher Server Installation and Testing: Hands-on ● Install the CGI server with the HDF and FreeForm handlers ● Link data so the server.
Presented by Dave Mawdsley, DACS Linux Workshop Leader/Member
Version Control Systems
Station Metadata: What do I Need?
Presented by Dave Mawdsley, DACS Linux Workshop Leader/Member
Development Environment
Code Management With Github & Straw Resistance Measurements
GIT AND GITHUB WORKSHOP
Instructions to run scripts for 1D histograms and ML
Network Interactions with MUSTANG: MUSTANG Clients and Network Reports
CSC/FAR 020, Computer Graphics, August 31, 2011
Perspectives on the intersection between computer science and psychology Developing reproducible – and reusable – methods through research software engineering.
Systems Thinking: Systems modeling feedback quick start
Introduction to R Commander
Intro to Ethical Hacking
Version Control Systems
Computer Architecture “Bomb Lab Hints”
Teaching Computing to GCSE
SPSS Overview COM 631/731.
Getting Started – Associate Laptop Set-up
Python I/O.
Systems Thinking: Systems modeling quick start
TransCAD Route Systems 2018/11/22.
CCR Advanced Seminar: Running CPLEX Computations on the ISE Cluster
CSC/FAR 020, Computer Graphics, August 26, 2013
Intro to Ethical Hacking
Executable Jars Dan Fleck Fall /27/2018.
This is where R scripts will load
Task 1 Computer Programming LEVEL 6 PROGRAMMING:
Monday January 10, 14:05 Metadata Workshop, Bangkok, Thailand
Git CS Fall 2018.
Introduction to Git and GitHub
Instructions You can easily edit the text and images on these Pinterest viral quotes by selecting either the text box or picture and working with that.
Amos Introduction In this tutorial, you will be briefly introduced to the student version of the SEM software known as Amos. You should download the current.
Scripts In Matlab.
This is where R scripts will load
This is where R scripts will load
MUSTANG Training Session for North American Regional Networks
Computational Environment Management
Presentation transcript:

ISPAQ: IRIS System for Portable Assessment of Quality Dr. Mary Templeton IRIS Data Management Center Managing Data from Seismic Networks August 20-26, 2017 Pretoria, South Africa

What is ISPAQ? A python program that can calculate most MUSTANG metrics for data not archived at IRIS Data Services (Seattle), or Metrics calculations for local files assumes day-long files archived at any FSDN data center (including Seattle) runs under MacOS Linux MUSTANG only runs on data in Seattle When using local files, if data ends prior to the day boundary, completeness metrics will report a final gap and <100 percent_availability ISPAQ doesn’t run under Windows ”Data” refers to both time series and metadata – either can be from local files or from an FDSN data center

How Do I Get ISPAQ? To download ISPAQ To install ISPAQ Install the git software on your machine (https://git-scm.com/downloads) Type git clone https://github.com/iris-edu/ispaq.git To install ISPAQ Follow the instructions in the README file README.html arrives when your “git clone …”

Running ISPAQ Command line (great for scripting) ./run_ispaq.py -M percent_availability,num_gaps,max_gaps (metrics to run) -S AT06.XL..HH* (stations, networks, locations and channels to process) --sncl_format S.N.L.C (order for –S argument) --dataselect_url ./mydata (location of files or FDSN data center name) --csv_dir ./measurements (output directory for CSV files) --starttime 2015-001 --endtime 2015-008 2 ways to run ISPAQ depending on your needs Here –dataselect_url is pointing to local files ISPAQ writes the results of these metrics as CSV files

Running ISPAQ The possibilities (a LOT!) ./run_ispaq.py -h Nearly anything can be specified on the command line

ISPAQ Preference Files Assigns nicknames to command-line options cat preference_files/metprefs.txt nickname Using nicknames creates a more compact command. ISPAQ comes with a default.txt preference file which shows how you can get the most from a preferences file

Running ISPAQ With a preference file (simplifies typing) ./run_ispaq.py -P preference_files/metprefs.txt (preference file name) -M completeness -S local --starttime 2015-001 --endtime 2015-031 Preference files help save typing on the command line (see –M, -S) Because changing parameters requires editing a file, they aren’t a good choice for batch processing You can use command line flags and preference files together; command line flags will override preference file definitions

ISPAQ Output Metrics values(CSV) PSD frequency-power values (CSV) PDF plots (PNG) ISPAQ creates CSV files to hold most metrics results, including text versions of PSD curves and PDF data Once the text version of the PDF file has been created, ISPAQ can also make PNG plots of PDFs