ITW2007, Tokyo Infrasound Data Processing at Geoscience Australia David J Brown.

Slides:



Advertisements
Similar presentations
More on Processes Chapter 3. Process image _the physical representation of a process in the OS _an address space consisting of code, data and stack segments.
Advertisements

Exceptional Control Flow Processes Today. Control Flow Processors do only one thing: From startup to shutdown, a CPU simply reads and executes (interprets)
© Vera Castleman Software Grade 10. What is software? A program is a collection of instructions to do a job. Programs are collectively known as SOFTWARE.
THE AUSTRALIAN NATIONAL UNIVERSITY Infrasound Technology Workshop, November 2007, Tokyo, Japan OPTIMUM ARRAY DESIGN FOR THE DETECTION OF DISTANT.
Guide to Oracle10G1 Introduction To Forms Builder Chapter 5.
Figure 2.8 Compiler phases Compiling. Figure 2.9 Object module Linking.
A Guide to Oracle9i1 Introduction To Forms Builder Chapter 5.
Inter Process Communication:  It is an essential aspect of process management. By allowing processes to communicate with each other: 1.We can synchronize.
Chapter 6: An Introduction to System Software and Virtual Machines
Process Description and Control A process is sometimes called a task, it is a program in execution.
Fundamentals of Python: From First Programs Through Data Structures
Process. Process Concept Process – a program in execution Textbook uses the terms job and process almost interchangeably A process includes: – program.
Chapter 6: An Introduction to System Software and Virtual Machines Invitation to Computer Science, C++ Version, Fourth Edition ** Re-ordered, Updated 4/14/09.
Process Description and Control Chapter 3. Major Requirements of an OS Interleave the execution of several processes to maximize processor utilization.
1 Chap 10 Malicious Software. 2 Viruses and ”Malicious Programs ” Computer “Viruses” and related programs have the ability to replicate themselves on.
Hands-On Microsoft Windows Server 2008
CS 221 Analysis of Algorithms Data Structures Dictionaries, Hash Tables, Ordered Dictionary and Binary Search Trees.
October, 2002 Infrasonic Signal Detection Using The Hough Transform D. J. Brown, B.L.N. Kennett, C. Tarlowski Research School of Earth Sciences, Australian.
LSC Segment Database Duncan Brown Caltech LIGO-G Z.
Infrasound Case Studies Paul Golden Southern Methodist University ITW 2008 With contributions from Eugene Herrin, Petru Negraru, David Anderson and Breanna.
Introduction to Processes CS Intoduction to Operating Systems.
Course Presentation EEL5881, Fall, 2003 Project: Network Reliability Tests Project: Network Reliability Tests Team: Gladiator Team: Gladiator Shuxin Li.
Copyright © 2007, Oracle. All rights reserved. Managing Concurrent Requests.
CSE 781 – DATABASE MANAGEMENT SYSTEMS Introduction To Oracle 10g Rajika Tandon.
Eurotrace Hands-On The Eurotrace File System. 2 The Eurotrace file system Under MS ACCESS EUROTRACE generates several different files when you create.
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
Exec Function calls Used to begin a processes execution. Accomplished by overwriting process imaged of caller with that of called. Several flavors, use.
Citrix MPS 3.0 Licensing Douglas A. Brown President
Windows Vista Inside Out Chapter 22 - Monitoring System Activities with Event Viewer Last modified am.
Tools Menu and Other Concepts Alerts Event Log SLA Management Search Address Space Search Syslog Download NetIIS Standalone Application.
Lecture 3 Process Concepts. What is a Process? A process is the dynamic execution context of an executing program. Several processes may run concurrently,
6 Memory Management and Processor Management Management of Resources Measure of Effectiveness – On most modern computers, the operating system serves.
Lesson Objective Understand how we can Simulate activities that have an element of chance using probabilities and random numbers Be able to use the random.
Term 2, 2011 Week 1. CONTENTS Problem-solving methodology Programming and scripting languages – Programming languages Programming languages – Scripting.
Detection, Propagation, and Modeling Infrasound Technology Workshop Bermuda, 2008.
1 5. Abstract Data Structures & Algorithms 5.2 Static Data Structures.
THE ANALYSIS OF THE INFRASOUND SIGNALS FROM MAY 12 EARTHQUAKE WENCHUAN CHINA Wang Xiaohang Signal Processing Department North China Institute of Computing.
LHCb Software Week November 2003 Gennady Kuznetsov Production Manager Tools (New Architecture)
11/13/20151 Processes ICS 240: Operating Systems –William Albritton Information and Computer Sciences Department at Leeward Community College –Original.
Exceptional Control Flow Topics Exceptions except1.ppt CS 105 “Tour of the Black Holes of Computing”
CE Operating Systems Lecture 2 Low level hardware support for operating systems.
1 Location and Characterization of Infrasonic Events Roger Bowman 1, Greg Beall 1, Doug Drob 2, Milton Garces 3, Claus Hetzer 3, Michael O’Brien 1, Gordon.
Lecture 18 Windows – NT File System (NTFS)
October The Woomera Infrasound and Seismic Experiment David Brown 1 ; Clive Collins 1 ; Brian Kennett 2 1. Geoscience Australia 2. Australian National.
CE Operating Systems Lecture 2 Low level hardware support for operating systems.
Chapter 5 Introduction To Form Builder. Lesson A Objectives  Display Forms Builder forms in a Web browser  Use a data block form to view, insert, update,
1 Description and Analysis of Infrasound Signals Recorded from the North Pacific Event of February 22, 2003 Joydeep Bhattacharyya 1, Claus Hetzer 2,Milton.
A Study on Characteristics of Seasonally Dependent Infrasound Propagation Based on the Ground-Truth Events from a Long- Term Experiment at a Quarry mine.
Chapter 2 Process Management. 2 Objectives After finish this chapter, you will understand: the concept of a process. the process life cycle. process states.
Analysis of regional infrasound signals at IMS infrasound array in Mongolia a RCAG/MAS P.O.B-152, Ulaanbaatar-51Mongolia b CEA/DASE BP12, Bruyeres-le-Chatel,
Oracle Architecture - Structure. Oracle Architecture - Structure The Oracle Server architecture 1. Structures are well-defined objects that store the.
Sets and Maps Chapter 9. Chapter Objectives  To understand the Java Map and Set interfaces and how to use them  To learn about hash coding and its use.
Milton Garces, Claus Hetzer, and Mark Willis University of Hawaii, Manoa Source modeling of microbarom signals generated by nonlinear ocean surface wave.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
GSU Indoor Navigation Senior Project Fall Semester 2013 Michael W Tucker.
Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.
111 State Management Beginning ASP.NET in C# and VB Chapter 4 Pages
Process Management Process Concept Why only the global variables?
PRISM: PROCESSING AND REVIEW INTERFACE FOR STRONG MOTION DATA SOFTWARE
Physical Database Design and Performance
Chapter 25: Advanced Data Types and New Applications
Lecture 2d1: Quality of Measurements
PL/SQL Scripting in Oracle:
Structure of Processes
Lecture 2: Processes Part 1
Chap 10 Malicious Software.
Process & its States Lecture 5.
Process Description and Control
Chap 10 Malicious Software.
(presentor: jee-weon Jung)
Presentation transcript:

ITW2007, Tokyo Infrasound Data Processing at Geoscience Australia David J Brown

ITW2007, Tokyo Current State of the automatic infrasound processing system operating at GA. –signal detection –source location –job queuing –example –summary Overview

ITW2007, Tokyo Image Space, S Parameter Space, P Hough Transform Signal Detection

ITW2007, Tokyo Initial state M=0.24 Iteration one M=0.24 Iteration two M=0.004 Iteration three M=0.004 The Neighbourhood algorithm: minimise the misfit Source location distribute points in computational domain find the region about each point that is closer to that point than any other (voronoi cell) distribute the same number of points randomly in the first few voronoi cells with the smallest values of misfit

ITW2007, Tokyo ( , ) ( , ) ( , ) Unique 16-digit string –access travel-time data using lat/lon information via a minimal perfect hash Source location data file generated for each station and stored as a shared memory segment on the host travel-time and azimuthal deviation information assuming each grid point is a source location and acoustic propagation for some prescribed climatological model is determined and stored in a vector accessible using an index that is a hash of the lat/lon string

ITW2007, Tokyo job queuing main operation controlled by the Infer Listener GUI –an instance will need to run on each host that wants to process data colour panel shows state of processing for each hour for each station Start/Stop button to toggle operation of the current instance. Stop All button to stop operation of all instances Infer Listener is constantly trawling the infer noticeboard looking for jobs to run. Currently processing jobs are displayed in this panel

ITW2007, Tokyo job queuing main operation controlled by the Infer Listener GUI –an instance will need to run on each host that wants to process data Infer Listener is constantly trawling the infer noticeboard looking for jobs to run. Currently processing jobs are displayed in this panel

ITW2007, Tokyo job1.x arg1 arg1 arg3 arg4 - date s - job2.x arg1 arg1 arg3 - date m job3.x arg1 arg1 - date m 60 - job4.x arg1 arg1 arg3 arg4 - date s - noticeboard job1.x arg1 arg2 arg3 arg4 hostname1 date s pid=1234 job2.x arg1 arg2 arg3 hostname2 date m 300 pid=2345 job3.x arg1 arg2 hostname3 date m 60 pid=3456 job4.x arg1 arg2 arg3 arg4 hostname1 date s pid=4567 noticeboard hostname1 listener hostname2 listener hostname3 listener listener grabs job from noticeboard listener updates noticeboard hostname1 forks child pid job queuing

ITW2007, Tokyo noticeboard hostname1 listener hostname2 listener hostname3 listener listener updates noticeboard if job is re-entrant job2.x arg1 arg2 arg3 - date m job3.x arg1 arg2 - date m 60 - listener constantly checking for defunct child processes (i.e. zombies) job queuing

ITW2007, Tokyo INFER_LISTNER/bin/check_alert alert_type=Volcano Region=‘New Britain’ sta_list IS04 IS05 IS07 INFER_LISTNER/bin/check_alert alert_type=Volcano Region=‘Java’ sta_list IS04 IS05 IS07 INFER_LISTNER/bin/check_alert alert_type=Volcano Region=‘Lesser Sunda’ sta_list IS04 IS05 IS07 INFER_LISTNER/bin/check_alert alert_type=Standard Region=‘All’ sta_list IS04 IS05 IS07 INFER_LISTNER/bin/check_event INFER_LISTNER/bin/infer_det INFER_LISTNER/bin/infer_loc sta_list IS04 IS05 IS07 INFER_LISTNER/bin/tickle_man INFER_LISTNER/bin/remove_logs job queuing Infer Noticeboard –starting jobs list

ITW2007, Tokyo job queuing Infer Noticeboard –starting jobs list 1 23 INFER_LISTNER/bin/check_alert alert_type=Volcano Region=‘Java’ sta_list IS04 IS05 IS07 checks the arrival table for significant signals from a volcanic region for the sta list 4 INFER_LISTNER/bin/check_alert alert_type=Standard Region=‘All’ sta_list IS04 IS05 IS07 checks the arrival table for significant signals from any region

ITW2007, Tokyo Alert Name: Volcano ================================================= Region: New Britain lat lon Location: name: Manam name: Rabaul name: Langila name: Garbuna_Group name: Pago name: Ulawun name: Lolabau Region: Java Location: name: Merapi name: Ruang name: Kelut Region: Lesser Sunda Location: name: Batu_Tara name: Soputan Alert Name: Standard ================================================== Region: All lat lon Location: name: All - - job queuing regions file

ITW2007, Tokyo job queuing alert issued –alert name + region name in subject heading Volcano Alert: New Britain ================================================= Station: IS04 Azimuth: 56.4 Frequency: 1.0 Time(UTC): :38:23 Fstat: 24.8 Duration: Arid: 37829

ITW2007, Tokyo job queuing Infer Noticeboard –starting jobs list 5 INFER_LISTNER/bin/check_event checks the origin table for formed events+sends alert 6 INFER_LISTNER/bin/infer_det checks the wfdisc table for unprocessed data, places entries onto noticeboard to initiate detector Infrasonic Event: ================================================= Lat: Lon: Time(UTC): :22:18 Ndef: 3

ITW2007, Tokyo job queuing Infer Noticeboard –starting jobs list 7 INFER_LISTNER/bin/infer_loc sta_list IS04 IS05 IS07 queues consecutive four hour intervals for location for stations in the sta_list 8 INFER_LISTNER/bin/tickle_man tickle shared memory segment used in source location if non-constant velocity model used 9 INFER_LISTNER/bin/remove_logs remove processing log files

ITW2007, Tokyo noticeboard logfile Oracle arrival detection infra_features site wfdisc lastid affiliation origin hostname1 listener hostname2 listener hostname4 listener hostname3 listener job queuing NFS atomic-level file-locking (discretionary)

ITW2007, Tokyo job queuing: software design –no commercial software or expert knowledge to install –standard languages ANSI-C python fortran –free-ware FFTW Oracle 10gXE database/xe/htdocs/102xelinsoft.html python2.4, Pmw NA LockFile April/ html

ITW2007, Tokyo Large explosion woke residents along northern NSW coast Significant acoustic signals recorded on IS05, IS07 IS deg 19:24:08 IS deg 18:27:48 Example: The Taree Bolide, December 06, 2004

ITW2007, Tokyo Example: The Taree Bolide, December 06, 2004 wfdisc data for 7 hours known to contain signals is loaded into Oracle db Listener ready to start

ITW2007, Tokyo Example: The Taree Bolide, December 06, 2004 infer_det has run and has queued all hours for processing. Alert checking code continually being re-loaded. each instance is limited to two concurrent processes.

ITW2007, Tokyo Example: The Taree Bolide, December 06, 2004 after some time 5 hours of data have successfully passed detection, one hour is currently processing and one hour is queued for processing check alert has run and found several significant signals: IS deg 2.0 Hz IS deg 2.0 Hz IS deg 0.06 Hz IS deg.0.06 Hz Infrasound Automatic Alert ========================================= Station: IS05 Azimuth: 23.8 Frequency: 2.0 Time(UTC): :27:48 Fstat: 24.8 Duration: 60.0 Arid: 2010

ITW2007, Tokyo Example: The Taree Bolide, December 06, 2004 all hours have successfully passed detection and infer_loc has queued them for location needs 4 consecutive hours that have passed detection

ITW2007, Tokyo Example: The Taree Bolide, December 06, 2004 processing complete: one event formed and check_event has generated Infrasonic Event: ========================================= Lat: Lon: Time(UTC): :11:07 Ndef: 2

ITW2007, Tokyo Summary Purpose of the infrasound processing system is to provide non-expert users: –a facility for detecting significant acoustic signals in IMS array data –an alert via for significant signals –an estimate of when and where the event occurred for multiple station recordings Ease of installation and use: –no software engineering knowledge required or a necessity to resort to commercial software

ITW2007, Tokyo Summary Automatic infrasound processing system is maturing –signal detection is rugged population of arrival, detection and infra_features table is reliable need to incorporate uncertainty estimatefor az+time –source location process is maturing occasionally NA location algorithm gets trapped in local minima conflict resolution in the association phase needs further testing need to provide uncertainty in location

ITW2007, Tokyo Summary Automatic infrasound processing system is maturing –python queuing code works in general a few idiosyncrasies –possible in rare circumstances for two hosts to execute the same job. –need mechanism to restore lost jobs when host dies need to add extra features to the GUI: –user selectable detector/locator parameter selection –waveform display –improved error reporting