Development of KAGRA Burst Pipeline

Slides:



Advertisements
Similar presentations
GWDAW 16/12/2004 Inspiral analysis of the Virgo commissioning run 4 Leone B. Bosi VIRGO coalescing binaries group on behalf of the VIRGO collaboration.
Advertisements

Applications in Signal and Image Processing
LIGO-G Z Update on the Analysis of S2 Burst Hardware Injections L. Cadonati (MIT), A. Weinstein (CIT) for the Burst group Hannover LSC meeting,
GWDAW-10 (December 14, 2005, University of Texas at Brownsville, U.S.A.) Data conditioning and veto for TAMA burst analysis Masaki Ando and Koji Ishidoshiro.
LIGO- G Z AJW, Caltech, LIGO Project1 Use of detector calibration info in the burst group
Waveburst DSO: current state, testing on S2 hardware burst injections Sergei Klimenko Igor Yakushin LSC meeting, March 2003 LIGO-G Z.
LIGO-G Z Detector characterization for LIGO burst searches Shourov K. Chatterji for the LIGO Scientific Collaboration 10 th Gravitational Wave.
LIGO- G Z AJW, Caltech, LIGO Project1 Use of detector calibration info in the burst group
New data analysis for AURIGA Lucio Baggio Italy, INFN and University of Trento AURIGA.
S.Klimenko, G Z, December 21, 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida.
Data Characterization in Gravitational Waves Soma Mukherjee Max Planck Institut fuer Gravitationsphysik Golm, Germany. Talk at University of Texas, Brownsville.
LIGO- G Z 03/23/2005LSC Meeting March BlockNormal Near-Online S4 Burst Analysis Keith Thorne Penn State University Relativity Group (Shantanu.
A coherent null stream consistency test for gravitational wave bursts Antony Searle (ANU) in collaboration with Shourov Chatterji, Albert Lazzarini, Leo.
LIGO-G Z Peter Shawhan, for the LIGO Scientific Collaboration APS Meeting April 25, 2006 Search for Gravitational Wave Bursts in Data from the.
Image Processing Architecture, © 2001, 2002, 2003 Oleh TretiakPage 1 ECE-C490 Image Processing Architecture MP-3 Compression Course Review Oleh Tretiak.
Multidimensional classification of burst triggers from the fifth science run of LIGO Soma Mukherjee CGWA, UTB GWDAW11, Potsdam, 12/18/06 LIGO-G
The Analysis of Binary Inspiral Signals in LIGO Data Jun-Qi Guo Sept.25, 2007 Department of Physics and Astronomy The University of Mississippi LIGO Scientific.
S.Klimenko, December 2003, GWDAW Performance of the WaveBurst algorithm on LIGO S2 playground data S.Klimenko (UF), I.Yakushin (LLO), G.Mitselmakher (UF),
Searching for Gravitational Waves with LIGO Andrés C. Rodríguez Louisiana State University on behalf of the LIGO Scientific Collaboration SACNAS
G030XXX-00-Z Excess power trigger generator Patrick Brady and Saikat Ray-Majumder University of Wisconsin-Milwaukee LIGO Scientific Collaboration.
Singer Similarity Doug Van Nort MUMT 611. Goal Determine Singer / Vocalist based on extracted features of audio signal Classify audio files based on singer.
Searching for Gravitational Waves from Binary Inspirals with LIGO Duncan Brown University of Wisconsin-Milwaukee for the LIGO Scientific Collaboration.
GEO++ Online Detector Characterization System. LIGO-G Z GEO++ working group GEO++ working group Cardiff University: Birmingham University Cardiff.
T.Akutsu, M.Ando, N.Kanda, D.Tatsumi, S.Telada, S.Miyoki, M.Ohashi and TAMA collaboration GWDAW10 UTB Texas 2005 Dec. 13.
S.Klimenko, G Z, December 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida for.
APPLICATION OF A WAVELET-BASED RECEIVER FOR THE COHERENT DETECTION OF FSK SIGNALS Dr. Robert Barsanti, Charles Lehman SSST March 2008, University of New.
May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech.
S.Klimenko, G Z, March 20, 2006, LSC meeting First results from the likelihood pipeline S.Klimenko (UF), I.Yakushin (LLO), A.Mercer (UF),G.Mitselmakher.
LIGO-G Z Confidence Test for Waveform Consistency of LIGO Burst Candidate Events Laura Cadonati LIGO Laboratory Massachusetts Institute of Technology.
Data Analysis Algorithm for GRB triggered Burst Search Soumya D. Mohanty Center for Gravitational Wave Astronomy University of Texas at Brownsville On.
S.Klimenko, March 2003, LSC Burst Analysis in Wavelet Domain for multiple interferometers LIGO-G Z Sergey Klimenko University of Florida l Analysis.
LIGO-G Z GWDAW9 December 17, Search for Gravitational Wave Bursts in LIGO Science Run 2 Data John G. Zweizig LIGO / Caltech for the LIGO.
1 Unbiased All-Sky Search (Michigan) [as of August 17, 2003] [ D. Chin, V. Dergachev, K. Riles ] Analysis Strategy: (Quick review) Measure power in selected.
S.Klimenko, December 2003, GWDAW Burst detection method in wavelet domain (WaveBurst) S.Klimenko, G.Mitselmakher University of Florida l Wavelets l Time-Frequency.
Results From the Low Threshold, Early S5, All-Sky Burst Search Laura Cadonati for the Burst Group LSC MIT November 5, 2006 G Z.
LIGO-G Z r statistics for time-domain cross correlation on burst candidate events Laura Cadonati LIGO-MIT LSC collaboration meeting, LLO march.
LIGO-G ZSearle LSC Mtg Aug A Coherent Network Burst Analysis Antony Searle (ANU) in collaboration with Shourov Chatterji, Albert Lazzarini,
LIGO- G Z 11/13/2003LIGO Scientific Collaboration 1 BlockNormal Performance Studies John McNabb & Keith Thorne, for the Penn State University.
Double Star Active Archive - STAFF-DWP Data errors and reprocessing Keith Yearby and Hugo Alleyne University of Sheffield Nicole Cornilleau-Wehrlin LPP.
LIGO-G Z The Q Pipeline search for gravitational-wave bursts with LIGO Shourov K. Chatterji for the LIGO Scientific Collaboration APS Meeting.
LIGO-G05????-00-Z Detector characterization for LIGO burst searches Shourov K. Chatterji For the LIGO Scientific Collaboration 10 th Gravitational Wave.
PERFORMANCE OF A WAVELET-BASED RECEIVER FOR BPSK AND QPSK SIGNALS IN ADDITIVE WHITE GAUSSIAN NOISE CHANNELS Dr. Robert Barsanti, Timothy Smith, Robert.
Andreas Horneffer for the LOFAR-CR Team
A 2 veto for Continuous Wave Searches
KAGRA Detector Characterization
S4 Pulsar Search Results from PowerFlux
WAVELET VIDEO PROCESSING TECHNOLOGY
Bounding the strength of gravitational radiation from Sco-X1
Cluster Active Archive – Wideband data BM2 mode
S4 Pulsar Search Results from PowerFlux
The Q Pipeline search for gravitational-wave bursts with LIGO
Soma Mukherjee Centre for Gravitational Wave Astronomy
Controlling a large CPU farm using industrial tools
By: Mohammadreza Meidnai Urmia university, Urmia, Iran Fall 2014
Bounding the strength of gravitational radiation from Sco-X1
A.M. Sintes for the pulgroup
Status of the Hough CW search code - Plans for S2 -
TwoSpect Scorpius X-1 mock data challenge, September 2013 Evan Goetz (AEI—Hannover), Grant David Meadors, Keith Riles (University of Michigan) TwoSpect.
Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.
KAGALI PE code development
KAGALI PE code development
SLOPE: A MATLAB Revival
University of Wisconsin-Milwaukee
Excess power trigger generator
First look at Injection of Burst Waveforms prior to S1
Coherent Coincident Analysis of LIGO Burst Candidates
Environmental Monitoring: Coupling Function Calculator
Chapter 7 Finite Impulse Response(FIR) Filter Design
Performance of the WaveBurst algorithm on LIGO S2 playground data
Upper limits on gravitational wave bursts
Presentation transcript:

Development of KAGRA Burst Pipeline Kazuhiro Hayama on behalf of KAGRA Burst Group

KAGRA Burst Group Hayama Arima, Kanda,Yokozawa The burst pipeline is being developed using KAGALI, LAL (C-based) HasKAL (Haskel-based) The role of HasKAL is mainly two As a wrapper of KAGALI, LAL As a detector characterization library Speed is 1~1/2 x C Code is quite compact. (typically 1/5~1/10 smaller than C) Parallelization is very easy!

Flow Chart

Data from KAGRA IFO Kamioka Mine Analysis Building

Data from KAGRA Data is transferred to the analysis building via optical fiber lines. The data is first stored in a server with 200Tib storage. The data will be ~TByte/day. So we need to have a database system as a part of the KAGRA DAQ system.

Database Two methods are being developed. The approach to be adopted will be decided with DMG subsystem. framecache Database

framecache Format of the framecache is not defined yet. What parameters should be included?

Database UpdateFrameDB The information of the file is inserted into a database as soon as a frame file is stored in a specific directory. The database engine is MySQL.

Accessing Database Command line tools kagraDataFind If you give GPS start time, duration, channel_name, you can get a list of corresponding frame files. e.g. kagraDataFind 1113212555 100 "K1:PEM-EX_MAG_Z_FLOOR"

The software MySQL 5.6.24 http://www.mysql.com Generation of framecache https://github.com/gw-analysis/detector- characterization/blob/master/HasKAL/src/HasKAL/FrameUtils/FileManipulation.hs Database using MySQL https://github.com/gw-analysis/detector- characterization/tree/master/HasKAL/src/HasKAL/DataBaseUtils

Data Structure The data is defined below https://github.com/gw-analysis/detector- characterization/tree/master/HasKAL/src/HasKAL/WaveUtils https://github.com/gw-analysis/detector-characterization/blob/master/HasKAL/src/HasKAL/WaveUtils/Data.hs

Handling data Every processed data comes with GPS time, its sampling frequency… So that we can avoid careless miss like wrong sampling frequency, time shift etc.

Data Conditioning KAGRA Data Clean Data Data Conditioning - Whitening - Line Removal Conditioned Data Clean Data Finder (Yokozawa) To find “stationary” data without any tangients Whitening (Hayama) To remove frequency dependency from the data Line Removal (Asano) To remove narrow-band artifacts s.t. violin modes

Data Conditioning Linear Prediction Error Filter Estimating IIR filter coefficients that obtain a transfer function having inverse of the PSD. Very stable

The software https://github.com/gw-analysis/detector-characterization/blob/master/HasKAL/src/HasKAL/SignalProcessingUtils/LinearPrediction.hs Line removal : https://github.com/gw-analysis/detector-characterization/tree/master/HasKAL/src/HasKAL/LineUtils/LineRemoval

As a wrapper of KAGALI FIR, IIR Filter by Ueno

Parallelization in Haskell If you replace computeS to computeP, then codes are parallelized!

Event Trigger Generation Conditioned Data Event Trigger Generation - T-F Transform - Event Selection Event Triggers Excess power based method to find signal Detection on Time-Frequency maps Short Fourier Transform (Hayama) Constant Q-Transform (Hayama) Wavelet Packet Transform (Yokozawa) Event Selection Pixel clustering Other method needed!

Event Trigger Generation

Event Selection: Simple clustering method may not work

The software

Background Study Injection (Soft, Hard) Event Triggers - Software and Hardware Injection - Setting Threshold Vetoed data

Injection KAGRA Data Clean Data Data Conditioning - Whitening - Line Removal Injection (Soft, Hard) Conditioned Data Injection (Hayama) To estimate background noise and set detection threshold. Software Injection Currently implemented using S5 burstMDC Hardware Injection To be discussed with DGS group (?)

The Software https://github.com/gw-analysis/detector- characterization/tree/master/HasKAL/src/HasKAL/SimulationUtils/Injection

Calculation of antenna pattern (Hayama) https://github.com/gw-analysis/detector-characterization/tree/master/HasKAL/src/HasKAL/DetectorUtils

Parameter Estimation Not yet implemented One of featured parameter estimation of the burst analysis in KAGRA is Hilbert-Huang Transform. (Kaneyama)

Alert Not yet determined. VOEvent is one of good candidates. Duration, Power, Frequency, Waveform, Sky region