Team LYF: Applying Python to Waveform Matching Detection Xin Liu (USC), Dongdong Yao(GT), Lili Feng(CU-Boulder)

Slides:



Advertisements
Similar presentations
Standardized Threat Indicators Tenable Formatted Indicator Export Adversary Analysis (Pivoting) Private and Community Incident Correlation ThreatConnect.
Advertisements

Poor Mans Cluster (PMC) Johny Balian. Outline What is PMC How it works Concept Positive aspects Negative aspects Good and Bad Application ideas Monte.
Improvement of Audio Capture in Handheld Devices through Digital Filtering Problem Microphones in handheld devices are of low quality to reduce cost. This.
Programming Types of Testing.
Facial feature localization Presented by: Harvest Jang Spring 2002.
Using Cabal and the Hackage Package Database. Hackage Hackage is a database of Haskell packages (or modules) written by others and available for public.
Reducing the Energy Usage of Office Applications Jason Flinn M. Satyanarayanan Carnegie Mellon University Eyal de Lara Dan S. Wallach Willy Zwaenepoel.
Data Analysis (and User Interaction) GEOG 463 5/7/04.
Parallel Reconstruction of CLEO III Data Gregory J. Sharp Christopher D. Jones Wilson Synchrotron Laboratory Cornell University.
New Challenges in Cloud Datacenter Monitoring and Management
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
August 13-19, 2010Data Management Workshop Foz do Iguassu- Brazil Seismic Quality Assurance Rick Benson IRIS DMC Rick Benson IRIS DMC.
Brennan Ireland Rochester Institute of Technology Astrophysical Sciences and Technology December 5, 2013 LIGO: Laser Interferometer Gravitational-wave.
An Example Use Case Scenario
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES High Performance Computing applications in GEON: From Design to Production Dogan Seber.
Systems Support for End-to-End Performance Management Sandip Agarwala PhD Advisor: Karsten Schwan College of Computing Georgia Tech.
Winrunner Usage - Best Practices S.A.Christopher.
Presented to the Induced Seismicity Consortium, USC 2013 Stephen Holtkamp Michael Brudzinski Brian Currie Miami University, Oxford OH Department of Geology.
Implementing a Speech Recognition System on a GPU using CUDA
Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering Nithya N. Vijayakumar, Beth Plale DDE Lab, Indiana University {nvijayak,
Learningcomputer.com SQL Server 2008 – Profiling and Monitoring Tools.
CRUD Matrix Presented by Trisha Cummings. Background to a CRUD Matrix CRUD stands for :- Create, Read, Update and Delete. A CRUD Matrix is very useful.
EGEE is a project funded by the European Union under contract IST HEP Use Cases for Grid Computing J. A. Templon Undecided (NIKHEF) Grid Tutorial,
Event Detection Python Application Emily Morton, Nicole McMahon, Leah Langer, Grace Barcheck.
Software Engineering Laboratory, Department of Computer Science, Graduate School of Information Science and Technology, Osaka University July 21, 2008WODA.
PGP Project Viktor Yarmolenko Lewis Mackenzie Paul Cockshott Ewan Borland.
Faucets Queuing System Presented by, Sameer Kumar.
Project18’s Communication Drawing Design By: Camilo A. Silva BIOinformatics Summer 2008.
GEO++ Online Detector Characterization System. LIGO-G Z GEO++ working group GEO++ working group Cardiff University: Birmingham University Cardiff.
SPEECH CODING Maryam Zebarjad Alessandro Chiumento Supervisor : Sylwester Szczpaniak.
Experiences Running Seismic Hazard Workflows Scott Callaghan Southern California Earthquake Center University of Southern California SC13 Workflow BoF.
Time-frequency analysis of thin bed using a modified matching pursuit algorithm Bo Zhang Graduated from AASP consortium of OU in 2014 currently with The.
EarthScope Short Course 2015: Pick Repository Team Picks 4.0 Tiku Ravat (Kentucky) Yenjoe Tan (Columbia) Stefanie Whittaker (Alaska) Yao Yao (Utah)
AUTOMATON A Fuzzy Logic Automatic Picker Paul Gettings 1 UTAM 2003 Annual Meeting 1 Thermal Geophysics Research Group, University of Utah.
Design and implementation Chapter 7 – Lecture 1. Design and implementation Software design and implementation is the stage in the software engineering.
Early Aftershock Detection of the 2013 Mw6.6 Lushan in Longmenshan Sichuan, China Jing Wu, Dongdong Yao, Xiaofeng Meng, Zhigang Peng Jinrong Su, Feng Long,
We are :- Soma Datta, Pramit Ghosh and Debotosh Bhattacherjee
Presents YO!sCV Recruitment App. Topics Problem and The Need –Solution – 1 Slide CV Infographic Resume Capture your Core Skills, Expertise Showcase your.
TREND DAQ BASIC PRINCIPLES … Antennas DAQ ADC Trigger condition: Max > N.σ ??? First level trigger: Nant > 3 antennas ? -By antenna : - 1 data file (Nevent.
Advanced Higher Computing Science The Project. Introduction Worth 60% of the total marks for the course Must include: An appropriate interface using input.
Thurs Nov 12, 12:45 Nov 8-17, 2009Data Management Workshop Cairo, Egypt.
What is SeisFlows? -Provides a complete, customizable waveform inversion workflow -So far, has been used for 3D production runs with up to 10 9 model parameters.
SQL Database Management
Big Data Analytics and HPC Platforms
Introduction to Infrasonic Data Processing
Exploiting Sharing for Data Center Consolidation
Get to know SQL Manager SQL Server administration done right 
The Q Pipeline search for gravitational-wave bursts with LIGO
Parallel Shared Memory
Introduction to Computational and Biological Vision Keren shemesh
DS595/CS525 Team#2 - Mi Tian, Deepan Sanghavi, Dhaval Dholakia
The Scheduling Strategy and Experience of IHEP HTCondor Cluster
Microsoft Build /20/2018 5:17 AM © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY,
Introduction to Ms-Access Submitted By- Navjot Kaur Mahi
Image Segmentation Techniques
Massively Parallel Astronomic Event Detection using GPU’s
Nicolas Rothbacher University of Puget Sound
Low Level RF Status Outline LLRF controls system overview
Search for gravitational waves from binary black hole mergers:
Spark and Scala.
Get your ETL flow under statistical process control
Review CSE116 2/21/2019 B.Ramamurthy.
Low Level RF Status Outline LLRF controls system overview
CSSE463: Image Recognition Day 30
CrawlBuddy The web’s best friend.
Understanding the TigerSHARC ALU pipeline
CSSE463: Image Recognition Day 30
CyberShake Study 18.8 Technical Readiness Review
Fig. 1 Comparison of earthquake detection methods in terms of three qualitative metrics: Detection sensitivity, general applicability, and computational.
Auto-location and manual location in Antelope
Presentation transcript:

Team LYF: Applying Python to Waveform Matching Detection Xin Liu (USC), Dongdong Yao(GT), Lili Feng(CU-Boulder)

Bottlenecks:  Large disk usage for saving event and continuous waveforms (up to TB or more)  Large potential computational cost (up to months, even years computation)  Quality control of the available data (Need to be done...) Proposed Solutions:  Dynamically fetcing the data and getting the result without saving tons of data  Parallel computing (mpi, gpu)  Monitoring the data quality while fetcing the data (Need to be done...) Motivation

Our Goal Write a simple, concise and reusable package for detecting earthquake events and future work Use object-oriented Python and divide a big job of multiple stages to multiple classes Use IRIS FDSN web service and get stacked detection trace with a single run

sliding window cross-correlation:  fetch template waveform  predict arrivals, and compute SNR  check corresponding continuous data(hourly/daily)  operate the cross-correlation select study region:  choose available earthquakes(template)  search nearby stations  determine study period stack and output:  stack over all channels  output positive detections(MAD) Work Flow

Algorithm Template (35 sec): P(t) Continuous data (one day here): C(t) Correlation with template (frequency domain) Apply moving average filter F(t) (35 sec) all 1s!

6 35 s 1 day Waveform Correlation coefficient (CC) trace courtesy Xiaofeng Meng

7 Stacked CC trace courtesy Xiaofeng Meng

Classes Design

Simple Test Event: 2015/04/12 02:23:05.15 Ohio M3.2

Stacking

Any question or comment? Future work  More interactive quality control of the waveforms  Utilize the parallel computing  Improve the current code (stacking, etc.)  Store detection information in SQL database