May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech.

Slides:

Advertisements

Similar presentations

For the Collaboration GWDAW 2005 Status of inspiral search in C6 and C7 Virgo data Frédérique MARION.

Advertisements

Calibration of the gravitational wave signal in the LIGO detectors Gabriela Gonzalez (LSU), Mike Landry (LIGO-LHO), Patrick Sutton (PSU) with the calibration.

GWDAW, Dec 2003 Shawhan, Christensen, Gonzalez1 LIGO Inspiral Veto Studies Peter Shawhan (LIGO Lab / Caltech) Nelson Christensen (Carleton College) Gabriela.

G Z 1 Block-Normal, Event Display and Q-scan Based Glitch and Veto Studies Shantanu Desai for Penn. State Burst Group And Glitch Working Group.

S5 Data Quality Investigation Status John Zweizig LIGO/Caltech LSC/Virgo DetChar Session Baton Rouge, March 21, 2007.

LIGO Reduced Data Sets E7 standard reduced data set RDS generation for future runs decimation examples LIGO-G Z Isabel Leonor (w/ Robert Schofield)

LIGO Data Quality Monitoring Keith Riles University of Michigan.

LIGO-G0200XX-00-M DMT Monitors: Beyond the FOM John Zweizig LIGO/Caltech LLO August 18, 2006.

LIGO-G Z Detector Characterization Summary K. Riles - University of Michigan 1 Summary of Detector Characterization Sessions Keith.

Glitch Group S5 Activities LSC LSU, Baton Rouge August 15, 2006 G Z L. Blackburn, L. Cadonati, S. Chatterji, J. Dalrymple, S. Desai,

LIGO-G E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004.

D Q 19 March. 2008LSC-Virgo meeting1 Status of Data Quality in Virgo D. Verkindt, LAPP-CNRS on behalf of the Virgo DQ team (M. Bizouard, L. Bosi, S. Chatterji,

LIGO-G Z NSF Review LIGO Scientific Collaboration - University of Michigan 1 LSC Participation in Initial LIGO Detector Characterization.

LIGO-G DM. Landry – Amaldi5 July 9, 2003 Laser Interferometer Gravitational Wave Observatory Monitoring LIGO Data During the S2 Science Run Michael.

Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut) Institut für Atom- und Molekülphysik Detector Characterization of GEO 600 during.

LSC Segment Database Duncan Brown Caltech LIGO-G Z.

LIGO-G Z Detector characterization for LIGO burst searches Shourov K. Chatterji for the LIGO Scientific Collaboration 10 th Gravitational Wave.

LIGO-G Z Detector Characterization NeedsK. Riles - University of Michigan 1 Detector Characterization Needs Keith Riles (University of Michigan)

3 May 2011 VESF DA schoolD. Verkindt 1 Didier Verkindt Virgo-LAPP CNRS - Université de Savoie VESF Data Analysis School Data Quality and vetos.

LIGO- G Z 03/23/2005LSC Meeting March BlockNormal Near-Online S4 Burst Analysis Keith Thorne Penn State University Relativity Group (Shantanu.

LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech.

We have developed a GUI-based user interface for Chandra data processing automation, data quality evaluation, and control of the system. This system, known.

THE EVENT DISPLAY TOOL Shantanu Desai Penn. State University Scimon Camp, Livingston, LA August 18, 2006.

The Role of Data Quality in S5 Burst Analyses Lindy Blackburn 1 for the LIGO Scientific Collaboration 1 Massachusetts Institute of Technology, Cambridge,

LIGO-G Z Peter Shawhan, for the LIGO Scientific Collaboration APS Meeting April 25, 2006 Search for Gravitational Wave Bursts in Data from the.

Data Quality Vetoes in LIGO S5 Searches for Gravitational Wave Transients Laura Cadonati (MIT) For the LIGO Scientific Collaboration LIGO-G Z.

1 Data quality and veto studies for the S4 burst search: Where do we stand? Alessandra Di Credico Syracuse University LSC Meeting, Ann Arbor (UM) June.

The Analysis of Binary Inspiral Signals in LIGO Data Jun-Qi Guo Sept.25, 2007 Department of Physics and Astronomy The University of Mississippi LIGO Scientific.

Glitch Group S5 Activities Laura Cadonati for the Glitch Working Group LSC meeting, Hanford March 21, 2006 G Z.

LIGO-G D Global Diagnostics and Detector Characterization 9 th Marcel Grossmann Meeting Daniel Sigg, LIGO Hanford Observatory.

LIGO-G Z April 2006 APS meeting Igor Yakushin (LLO, Caltech) Search for Gravitational Wave Bursts in LIGO’s S5 run Igor Yakushin (LLO, Caltech)

LSC glitch group report Shourov K. Chatterji for the LSC glitch group LSC/Virgo meeting 2007 October 24 Hannover, Germany LIGO-G Z.

Searching for Gravitational Waves from Binary Inspirals with LIGO Duncan Brown University of Wisconsin-Milwaukee for the LIGO Scientific Collaboration.

D Q 20 Oct. 2007Quality flags, D.Verkindt1 Quality flags in Virgo Data Base D. Verkindt, LAPP On behalf of the Virgo « data quality task force »

S5 BNS Inspiral Update Duncan Brown Caltech LIGO-G Z.

Jan 12, 2009LIGO-G Z1 DMT and NDS2 John Zweizig LIGO/Caltech Ligo PAC, Caltech, Jan 12, 2009.

A Data/Detector Characterization Pipeline (What is it and why we need one) Soumya D. Mohanty AEI January 18, 2001 Outline of the talk Functions of a Pipeline.

LIGO-G Z Data Quality Segments Repository K. Riles - University of Michigan 1 Data Quality Segments Repository Keith Riles (University.

S5 Data Quality John Zweizig LIGO/Caltech. Contents ● Segment Database ● Automatically generated segments ● Other segments ● Segment summary.

LIGO-G Z Detector Characterization SummaryK. Riles - University of Michigan 1 Summary of Detector Characterization Sessions Keith Riles (University.

S.Klimenko, March 2003, LSC Burst Analysis in Wavelet Domain for multiple interferometers LIGO-G Z Sergey Klimenko University of Florida l Analysis.

LIGO-G Z GWDAW9 December 17, Search for Gravitational Wave Bursts in LIGO Science Run 2 Data John G. Zweizig LIGO / Caltech for the LIGO.

Results From the Low Threshold, Early S5, All-Sky Burst Search Laura Cadonati for the Burst Group LSC MIT November 5, 2006 G Z.

LSC meeting – Mar05 Livingston, LA A. Di Credico Syracuse University Glitch investigations with kleineWelle Reporting on work done by several people: L.

Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM.

LIGO-G050197LSC Collab. Mtg, LHO, August 16,20051 S4 Data Quality & S5 Preview John Zweizig LIGO/Caltech.

LIGO-G Z Detector Characterization Summary K. Riles - University of Michigan 1 Summary of the Detector Characterization Sessions Keith.

LIGO-G9900XX-00-M DMT Monitor Verification with Simulated Data John Zweizig LIGO/Caltech.

LIGO-G E Data Simulation for the DMT John Zweizig LIGO/Caltech.

Online DQ Segments and Triggers John Zweizig LIGO/Caltech.

LIGO-G E S2 Data Quality Investigation John Zweizig Caltech/LIGO.

Igor Yakushin, December 2004, GWDAW-9 LIGO-G Z Status of the untriggered burst search in S3 LIGO data Igor Yakushin (LIGO Livingston Observatory)

LIGO-G Z Report on the S2 RunK. Riles / S. Whitcomb 1 Report on the S2 Run Keith Riles (University of Michigan) Stan Whitcomb (LIGO–Caltech)

LIGO- G Z 11/13/2003LIGO Scientific Collaboration 1 BlockNormal Performance Studies John McNabb & Keith Thorne, for the Penn State University.

S.Klimenko, LSC meeting, March 2002 LineMonitor Sergey Klimenko University of Florida Other contributors: E.Daw (LSU), A.Sazonov(UF), J.Zweizig (Caltech)

3/21/2007 LIGO-G Z S5 Data Quality Investigation Status John Zweizig LIGO/Caltech LSC/Virgo DetChar Session MIT, July 25, 2007.

November, 2009 STAC - Data Analysis Report 1 Data Analysis report November, 2009 Gianluca M Guidi Università di Urbino and INFN Firenze for the Virgo Collaboration.

LIGO-G Z Introduction to QScan Shourov K. Chatterji SciMon Camp LIGO Livingston Observatory 2006 August 18.

LIGO-G E S2/S3 Data Quality Flagging John G. Zweizig LIGO/Caltech.

S5 Data Quality John Zweizig LIGO/Caltech Hanover, October 25, 2007.

LSC Meeting, June 3, 2006 LIGO-G Z 1 Status of inspiral search reviews Alan Weinstein (LIGO Laboratory / Caltech) For the LSC Internal review.

LIGO-G Z The Q Pipeline search for gravitational-wave bursts with LIGO Shourov K. Chatterji for the LIGO Scientific Collaboration APS Meeting.

LIGO-G05????-00-Z Detector characterization for LIGO burst searches Shourov K. Chatterji For the LIGO Scientific Collaboration 10 th Gravitational Wave.

Status of KAGRA detector characterization

S5 First Epoch BNS & BBH Inspiral Update

Detector Characterization

LIGO S6 Detector Characterization Studies

Report on the S2 Run Keith Riles (University of Michigan)

John Zweizig LIGO/Caltech

LIGO Scientific Collaboration - University of Michigan

Presentation transcript:

May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech

May 29, 2006 GWADW, Elba, May 27 - June 22 LIGO-G0200XX-00-M Good Data? Before doing scientific analysis one must know how good are the data  Calibration stability (optical gain, etc.)  Interferometer state  Physical environment (seismic noise, wind, acoustic noise)  Control loop transients  Oops (you did What during science running?)  Astrophysical search sensitivities Mechanism to do this finally set (after ~10 engineering runs, 4 science runs!)  year run: Must keep up with data!  LSC in general and Detector Characterization (DetChar) group specifically have dedicated many hours to concurrent understanding of data  Science monitor shifts, data quality investigations, DetChar group and subgroup meetings.

May 29, 2006 GWADW, Elba, May 27 - June 23 LIGO-G0200XX-00-M How Does LSC Acquire and Use DQ Information? On-line Data Monitoring  Constant automatic monitor of IFO state, sensitivity, calibration, transients, environmental noise, etc.  Science monitors and operators note running conditions in eLog Concurrent Data Quality Investigations  “Glitch group” has shifts, weekly meetings to run through noisiest events  Calibration monitored, time variation parameterized. Tabulate run epoch information  Define time segments that have specific (good or bad) properties.  Record segment in online database Use in analysis  Analyse epochs determined to be “safe” for a particular analysis

May 29, 2006 GWADW, Elba, May 27 - June 24 LIGO-G0200XX-00-M Epochs or Vetoes? In theory  Epochs used to handle exceptional conditions that are –Long term several second to hours –Affect reliability or alter noise spectrum greatly –Disable analysis of data in time epoch.  Vetoes used for transients (short term effects) –Analyse data, but reject any GW candidate. –Minimizes dead-time –Simplifies analysis job submission In practice  Difficult to determine extent of effects (e.g. are signals really linear around PD overflows?)  Epoch easier to use than vetoes (much better tools)  Most data quality flags used to define epochs (at discretion of analysis groups)

May 29, 2006 GWADW, Elba, May 27 - June 25 LIGO-G0200XX-00-M Online Data Monitoring (DMT) Real-time data monitoring software  Infrastructure & run support from LIGO Lab  Monitor code, configuration LSC/DC responsibility Monitor environment/performance parameters, e.g.  Inspiral range  Lock State  Strain noise spectrum  Calibration Line sptrngts  Band-limited seismic noise Display real-time results  Graphical output  html summary pages.

May 29, 2006 GWADW, Elba, May 27 - June 26 LIGO-G0200XX-00-M Online Monitoring (Graphics)

May 29, 2006 GWADW, Elba, May 27 - June 27 LIGO-G0200XX-00-M Real-Time Strain Noise Spectra

May 29, 2006 GWADW, Elba, May 27 - June 28 LIGO-G0200XX-00-M Online Monitoring (cont’d) Record statistical quantities in “trend frames”  Machine readable record of performance/noise statistics –1.4 × 1.4 Msun binary NS inspiral range – Band-limited seismic noise Record triggers  Transient noise LSC Science Monitor (SciMon) Shifts  On shift 20 hours per day (two 10 hour shifts, every day)  Watch/summarize online data monitor display  Investigate source of any unusual noise  Several fall-back projects during smooth running.

May 29, 2006 GWADW, Elba, May 27 - June 29 LIGO-G0200XX-00-M Data Quality Investigations DetChar group subdivided into teams. Investigate:  Calibration  Transients  Line features  Data quality Example: Transients (Glitch) group:  Glitch shifts (1 person per week) –Summarize electronic log notes –Summarize running conditions –Investigate loud single-IFO triggers from analysis pipelines  Automatic displays of loudest triggers –Event display (S. Desai): Spectrograms of many channels –Q-Scan (S. Chatterji): Q-Transform, select channels with loud noise clusters  Weekly discussion with DetChar Glitch group

May 29, 2006 GWADW, Elba, May 27 - June 210 LIGO-G0200XX-00-M Example: Calibration Line Errors Calibration lines  Used to monitor IFO optical gain.  Inject three sinusoids (~50, ~550, ~1100Hz) into differential length control channel.  Injected signals written to frames Several problem with injection process discovered  Single sample drop-outs  1-second dropouts  Repeated 1-second segments Monitoring to detect future errors  Calibrations notched out  5σ excursions generate triggers  Trigger identified (offline script) Segments produced to cover triggers

May 29, 2006 GWADW, Elba, May 27 - June 211 LIGO-G0200XX-00-M Q-Scan Display (snapshot) Whitened Spectrograms Whitened Time Series

May 29, 2006 GWADW, Elba, May 27 - June 212 LIGO-G0200XX-00-M Data Quality Segments Segments:  Tag run periods with a given common property  Defined by automatically by DMT monitor or inserted manually from tabulated segments. DB2 database contains:  Segment data –Start, stop times –Type, Version –IFOs  Provenance data –Program name, version –User ID

May 29, 2006 GWADW, Elba, May 27 - June 213 LIGO-G0200XX-00-M Segment Database Database interfaces  LSCSegFind: Command line database query  Text files –Available over web –Used by SegWizard and automated analysis pipelines  SegWizard GUI –User selects single or multiple IFOs in science mode –Remove any combination of data quality segments (click on segment name) –Prints a list of time ranges to be analysed Example segment types  IFO states, e.g. Science or Injection mode  Environmental noise sources: Unusual seismic noise, High winds  IFO conditions: PD saturation, ADC overflows, Calib line dropouts

May 29, 2006 GWADW, Elba, May 27 - June 214 LIGO-G0200XX-00-M Data Quality Segment Types

May 29, 2006 GWADW, Elba, May 27 - June 215 LIGO-G0200XX-00-M Use of Data Quality in Analyses Segments defined with no guarentees  No guarantee of efficacy  Could cause some GW signals to self-veto Analysis groups must  Decide which segments are appropriate  Test segment safety (does it veto loud injections?)  Decide whether to analyse data from segment, treat as a trigger veto or ignore.

May 29, 2006 GWADW, Elba, May 27 - June 216 LIGO-G0200XX-00-M Summary LIGO Detector Characterization group monitors data quality with online software and concurrent investigations “Segments” define epochs of data with specific (good or bad) properties. Analysis groups use run epochs as appropriate to their search