Soma Mukherjee LSC, Hanford, Aug.19 '04 Generation of realistic data segments: production and application. Soma Mukherjee Centre for Gravitational Wave.

Slides:



Advertisements
Similar presentations
Median Based Line Tracker Soumya D. Mohanty Max Planck Insitut für Gravitationsphysik LIGO-G Z.
Advertisements

Noise Floor Non-stationarity Monitor Roberto Grosso*, Soma Mukherjee + + University of Texas at Brownsville * University of Nuernburg, Germany Detector.
LIGO-G Z External Triggers Circulation only within LIGO I authorship list Status of the Triggered Burst Search (highlights from LIGO DCC# T Z,
LIGO-G Z Coherent Coincident Analysis of LIGO Burst Candidates Laura Cadonati Massachusetts Institute of Technology LIGO Scientific Collaboration.
Soma Mukherjee, GWDAW7, Kyoto, Japan, 19/12/02, LIGO-G Z1 Robust Detection of Noise Floor Drifts in Interferometric Data Soma Mukherjee Max Planck.
2015 AprilUNIVERSITY OF HAIFA, DEPARTMENT OF STATISTICS, SEMINAR FOR M.A 1 Hastie, Tibshirani and Friedman.The Elements of Statistical Learning (2nd edition,
The “probability event horizon” and probing the astrophysical GW background School of Physics University of Western Australia Research is funded by the.
沈致远. Test error(generalization error): the expected prediction error over an independent test sample Training error: the average loss over the training.
LIGO-G Z Detector characterization for LIGO burst searches Shourov K. Chatterji for the LIGO Scientific Collaboration 10 th Gravitational Wave.
LIGO- G Z AJW, Caltech, LIGO Project1 Use of detector calibration info in the burst group
Soma Mukherjee GWDAW8, Milwaukee, Dec '03 Interferometric Data Modeling: Issues in realistic data generation. Soma Mukherjee CGWA University of Texas.
New data analysis for AURIGA Lucio Baggio Italy, INFN and University of Trento AURIGA.
S.Klimenko, G Z, December 21, 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida.
Data Characterization in Gravitational Waves Soma Mukherjee Max Planck Institut fuer Gravitationsphysik Golm, Germany. Talk at University of Texas, Brownsville.
T – Biomedical Signal Processing Chapters
A coherent null stream consistency test for gravitational wave bursts Antony Searle (ANU) in collaboration with Shourov Chatterji, Albert Lazzarini, Leo.
The Role of Data Quality in S5 Burst Analyses Lindy Blackburn 1 for the LIGO Scientific Collaboration 1 Massachusetts Institute of Technology, Cambridge,
LIGO-G Z Peter Shawhan, for the LIGO Scientific Collaboration APS Meeting April 25, 2006 Search for Gravitational Wave Bursts in Data from the.
1 Spectral filtering for CW searches S. D’Antonio *, S. Frasca %&, C. Palomba & * INFN Roma2 % Universita’ di Roma “La Sapienza” & INFN Roma Abstract:
LIGO-G Z The AURIGA-LIGO Joint Burst Search L. Cadonati, G. Prodi, L. Baggio, S. Heng, W. Johnson, A. Mion, S. Poggi, A. Ortolan, F. Salemi, P.
Applications of change point detection in Gravitational Wave Data Analysis Soumya D. Mohanty AEI.
Analysis of nonstationarity in LIGO S5 data using the NoiseFloorMon output A proposal for a seismic Data Quality flag. R. Stone for the LSC The Center.
Multidimensional classification of burst triggers from the fifth science run of LIGO Soma Mukherjee CGWA, UTB GWDAW11, Potsdam, 12/18/06 LIGO-G
S.Klimenko, August 2005, LSC, G Z Constraint likelihood analysis with a network of GW detectors S.Klimenko University of Florida, in collaboration.
S.Klimenko, July 14, 2007, Amaldi7,Sydney, G Z Detection and reconstruction of burst signals with networks of gravitational wave detectors S.Klimenko,
18/01/01GEO data analysis meeting, Golm Issues in GW bursts Detection Soumya D. Mohanty AEI Outline of the talk Transient Tests (Transient=Burst) Establishing.
LIGO-G D Status of Stochastic Search with LIGO Vuk Mandic on behalf of LIGO Scientific Collaboration Caltech GWDAW-10, 12/15/05.
0 - 1 © 2007 Texas Instruments Inc, Content developed in partnership with Tel-Aviv University From MATLAB ® and Simulink ® to Real Time with TI DSPs Spectrum.
Dec 16, 2005GWDAW-10, Brownsville Population Study of Gamma Ray Bursts S. D. Mohanty The University of Texas at Brownsville.
Multidimensional classification of burst triggers from LIGO S5 run Soma Mukherjee for the LSC Center for Gravitational Wave Astronomy University of Texas.
Marwan Al-Namari 1 Digital Representations. Bits and Bytes Devices can only be in one of two states 0 or 1, yes or no, on or off, … Bit: a unit of data.
Searching for Gravitational Waves from Binary Inspirals with LIGO Duncan Brown University of Wisconsin-Milwaukee for the LIGO Scientific Collaboration.
LIGO-G Z Status of MNFTmon Soma Mukherjee +, Roberto Grosso* + University of Texas at Brownsville * University of Nuernberg, Germany LSC Detector.
1 Status of Search for Compact Binary Coalescences During LIGO’s Fifth Science Run Drew Keppel 1 for the LIGO Scientific Collaboration 1 California Institute.
LIGO-G Z The Q Pipeline search for gravitational-wave bursts with LIGO Shourov K. Chatterji for the LIGO Scientific Collaboration APS Meeting.
T.Akutsu, M.Ando, N.Kanda, D.Tatsumi, S.Telada, S.Miyoki, M.Ohashi and TAMA collaboration GWDAW10 UTB Texas 2005 Dec. 13.
S.Klimenko, G Z, December 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida for.
APPLICATION OF A WAVELET-BASED RECEIVER FOR THE COHERENT DETECTION OF FSK SIGNALS Dr. Robert Barsanti, Charles Lehman SSST March 2008, University of New.
S.Klimenko, G Z, December 21, 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida.
S.Klimenko, LSC, August 2004, G Z BurstMon S.Klimenko, A.Sazonov University of Florida l motivation & documentation l description & results l.
S.Klimenko, G Z, March 20, 2006, LSC meeting First results from the likelihood pipeline S.Klimenko (UF), I.Yakushin (LLO), A.Mercer (UF),G.Mitselmakher.
LIGO-G Z Confidence Test for Waveform Consistency of LIGO Burst Candidate Events Laura Cadonati LIGO Laboratory Massachusetts Institute of Technology.
Data Analysis Algorithm for GRB triggered Burst Search Soumya D. Mohanty Center for Gravitational Wave Astronomy University of Texas at Brownsville On.
Multidimensional classification analysis of kleine Welle triggers in LIGO S5 run Soma Mukherjee for the LSC University of Texas at Brownsville GWDAW12,
S.Klimenko, March 2003, LSC Burst Analysis in Wavelet Domain for multiple interferometers LIGO-G Z Sergey Klimenko University of Florida l Analysis.
LIGO-G Z GWDAW9 December 17, Search for Gravitational Wave Bursts in LIGO Science Run 2 Data John G. Zweizig LIGO / Caltech for the LIGO.
Search for bursts with the Frequency Domain Adaptive Filter (FDAF ) Sabrina D’Antonio Roma II Tor Vergata Sergio Frasca, Pia Astone Roma 1 Outlines: FDAF.
ALLEGRO GWDAW-9, Annecy 16 December, Generating time domain strain data (h(t)) for the ALLEGRO resonant detector or calibration of ALLEGRO data.
Comparison of filters for burst detection M.-A. Bizouard on behalf of the LAL-Orsay group GWDAW 7 th IIAS-Kyoto 2002/12/19.
Validation of realistically simulated non-stationary data. Soma Mukherjee Centre for Gravitational Wave Astronomy University of Texas at Brownsville. GWDAW9,
S.Klimenko, LSC, Marcht 2005, G Z BurstMon diagnostic of detector noise during S4 run S.Klimenko University of Florida l burstMon FOMs l S4 run.
Soma Mukherjee GWDAW8, Milwaukee, December'03 Interferometric Data Modeling: Issues in realistic data generation. Soma Mukherjee CGWA Dept. of Physics.
WAVELET NOISE REMOVAL FROM BASEBAND DIGITAL SIGNALS IN BANDLIMITED CHANNELS Dr. Robert Barsanti SSST March 2010, University of Texas At Tyler.
LIGO- G Z 11/13/2003LIGO Scientific Collaboration 1 BlockNormal Performance Studies John McNabb & Keith Thorne, for the Penn State University.
Digital Image Processing Lecture 10: Image Restoration II Naveed Ejaz.
2 June 2003Soumya D. Mohanty et al, LIGO-G D1 LASER INTERFEROMETER GRAVITATIONAL WAVE OBSERVATORY - LIGO – CALIFORNIA INSTITUTE OF TECHNOLOGY.
Adv DSP Spring-2015 Lecture#11 Spectrum Estimation Parametric Methods.
SEARCH FOR INSPIRALING BINARIES S. V. Dhurandhar IUCAA Pune, India.
MNFT : Robust detection of slow nonstationarity in LIGO Science data Soma Mukherjee Max Planck Institut fuer Gravitationsphysik Germany. LSC Meeting, Livingston,
LIGO-G Z The Q Pipeline search for gravitational-wave bursts with LIGO Shourov K. Chatterji for the LIGO Scientific Collaboration APS Meeting.
LIGO-G05????-00-Z Detector characterization for LIGO burst searches Shourov K. Chatterji For the LIGO Scientific Collaboration 10 th Gravitational Wave.
A 2 veto for Continuous Wave Searches
The Q Pipeline search for gravitational-wave bursts with LIGO
Soma Mukherjee Centre for Gravitational Wave Astronomy
Igor Yakushin, LIGO Livingston Observatory
LIGO Scientific Collaboration meeting
Soma Mukherjee for LIGO Science Collaboration
SLOPE: A MATLAB Revival
Coherent Coincident Analysis of LIGO Burst Candidates
A Waveform Consistency Test for Binary Inspirals using LIGO data
Presentation transcript:

Soma Mukherjee LSC, Hanford, Aug.19 '04 Generation of realistic data segments: production and application. Soma Mukherjee Centre for Gravitational Wave Astronomy D ept. of Physics and Astronomy University of Texas Brownsville LIGO G Z

Soma Mukherjee LSC, Hanford, Aug.19 '04 Motivation An effort to simulate segments of detector noise such that it shares same statistical characteristics as the data itself, i.e. it shows same kind of non-stationarity as present in the data. We can not predict the nature of non–stationarity at a prior time, but we can characterize the variation to construct simulated data. Astrophysical searches estimate efficiency and tune parameters of search algorithms from playground data. Data is non-stationary. E.g. a 60 s stretch of data may not have same value of variance as another 60 s at a later time. Thus any comparison or any estimation work carried out with sampled real data will have bias introduced in it. Certain search algorithms require comparison of different data segments. These are different quantities when data is non-stationary.

Soma Mukherjee LSC, Hanford, Aug.19 '04 Outline : Description of the model. Results. Existing modeled data. Examples. Future.

Soma Mukherjee LSC, Hanford, Aug.19 '04 Model description Each data segment is divided into three independent components viz. lines, transients and noise floor. Each component is characterized by low order ARMA model with mutual exclusion in time domain. Modeled noise generated from the three independent components are added back together to construct the final product.

Soma Mukherjee LSC, Hanford, Aug.19 '04 Characterizing noise floor variation Results obtained by running MNFT 1 on a stretch of LIGO S2 data.[ 1 Mukherjee, CQG, 2003 ] Low pass and resample Estimate spectral Noise floor with Running Median Use estimate to whiten data using FIR whitening Filter. Clean lines and Highpass Compute Running Median of the Squared output Set threshold

Soma Mukherjee LSC, Hanford, Aug.19 '04

II : Modeling ALL lines MBLT: Non-parametric Line estimation. [ Mohanty CQG, 2001 ]

Soma Mukherjee LSC, Hanford, Aug.19 '04 Non-parametric change point detector. KSCD : Kolmogorv-Smirnov test based Change point Detector Mohanty, GWDAW (2002); PSDCD, Mohanty, PRD (2000); III : Transient Classification 12 top wavelet coefficients of data surrounding each KSCD trigger. Visualized using GGobi. (Preliminary). Mukherjee, 2003, Amaldi, Pisa

Soma Mukherjee LSC, Hanford, Aug.19 '04 Algorithm 1. Low pass and resample given time series x(k). 2. Construct FIR filter that whitens the noise floor. Resulting time series : w(k) 3. Remove lines using notch filter. Cleaned time series : c(k) 4. Model variation in second moment of c(k) using Running Median and apply smoothing (SRM).

Soma Mukherjee LSC, Hanford, Aug.19 '04 Model Noise Generation Estimate lines using MBLT, ARMA model amplitude and phase, add reconstructed lines to synthetic data. Classify transients, model and add. Use MNFT to model variation in second moment Fit ARMA to it Characterize MNFT output with low order ARMA. Pass white noise thru’ this filter

Soma Mukherjee LSC, Hanford, Aug.19 '04 ARMA (p,q) A(T) y[k]= C(T) e[k] Y[k]: Output e[k] : White noise T: Time shift operator, T(x[k])=x[k-1] A and C : Polynomials of order p and q respectively. Example ARMA(2,1): A 1 y[k-1] + A 0 y[k]= C 0 e[k]

Soma Mukherjee LSC, Hanford, Aug.19 '04 Testing the model Apply statistical test of hypothesis Kolmogorov-Smirnov To avoid overfitting : Akaike Information criterion (AIC) I akaike (p,q) = ln  2 p,q + 2 (p+q)/N

Soma Mukherjee LSC, Hanford, Aug.19 '04 Result I : Noise floor model – ARMA (12,7)

Soma Mukherjee LSC, Hanford, Aug.19 '04

More work To add transients in the modeled data. Generation of band limited noise if required. To write the output in Frames. To generate S3/S4 segments. To carry out known waveform injection studies.

Soma Mukherjee LSC, Hanford, Aug.19 '04 Existing modeled data 20,000 s modeled S2 data generated in April Contains 330 s.mat files of noise floor and lines separately. Script exists to allow the user to combine the noise floor and lines in the desired way.