Jan 12, 2009LIGO-G091234-00-Z1 DMT and NDS2 John Zweizig LIGO/Caltech Ligo PAC, Caltech, Jan 12, 2009.

Slides:

Advertisements

Similar presentations

Sundanc e High-tech DSP solutions. Giving you the freedom to design Multiprocessor Technology Ltd SOFTWARE UTILITY TOOLS.

Advertisements

Oracle9i Database Administrator: Implementation and Administration 1 Chapter 2 Overview of Database Administrator (DBA) Tools.

Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved Managing Server.

LIGO-G Z 23 October 2002NSF Review of LIGO Laboratory1 The Penn State LIGO Data Analysis Center Lee Samuel Finn Penn State.

André Augustinus ALICE Detector Control System  ALICE DCS is responsible for safe, stable and efficient operation of the experiment  Central monitoring.

This work is supported by the National Science Foundation under Grant Number DUE Any opinions, findings and conclusions or recommendations expressed.

Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.

LIGO Reduced Data Sets E7 standard reduced data set RDS generation for future runs decimation examples LIGO-G Z Isabel Leonor (w/ Robert Schofield)

Figure 1.1 Interaction between applications and the operating system.

LIGO-G0200XX-00-M DMT Monitors: Beyond the FOM John Zweizig LIGO/Caltech LLO August 18, 2006.

NPACI: National Partnership for Advanced Computational Infrastructure August 17-21, 1998 NPACI Parallel Computing Institute 1 Cluster Archtectures and.

F Fermilab Database Experience in Run II Fermilab Run II Database Requirements Online databases are maintained at each experiment and are critical for.

1 Network Statistic and Monitoring System Wayne State University Division of Computing and Information Technology Information Technology.

LIGO-G E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004.

LIGO-G Z Detector Characterization Summary K. Riles - University of Michigan 1 Summary of Detector Characterization Activities Keith.

Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.

1 10 THE INTERNET AND THE NEW INFORMATION TECHNOLOGY INFRASTRUCTURE.

LIGO-G DM. Landry – Amaldi5 July 9, 2003 Laser Interferometer Gravitational Wave Observatory Monitoring LIGO Data During the S2 Science Run Michael.

Trigger design engineering tools. Data flow analysis Data flow analysis through the entire Trigger Processor allow us to refine the optimal architecture.

LSC Segment Database Duncan Brown Caltech LIGO-G Z.

GDS Software Status John Zweizig LIGO/Caltech LSC/Virgo DetChar Session Cambridge, July 25, 2007 LIGO-G Z.

1 Liquid Software Larry Peterson Princeton University John Hartman University of Arizona

Update on the LIGO Data Analysis System LIGO Scientific Collaboration Meeting LIGO Hanford Observatory August 19 th, 2002 Kent Blackburn Albert Lazzarini.

Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.

Source: George Colouris, Jean Dollimore, Tim Kinderberg & Gordon Blair (2012). Distributed Systems: Concepts & Design (5 th Ed.). Essex: Addison-Wesley.

LIGO-G Z Detector Characterization NeedsK. Riles - University of Michigan 1 Detector Characterization Needs Keith Riles (University of Michigan)

The Red Storm High Performance Computer March 19, 2008 Sue Kelly Sandia National Laboratories Abstract: Sandia National.

Chapter 2 Operating System Overview

LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech.

Srihari Makineni & Ravi Iyer Communications Technology Lab

Towards Exascale File I/O Yutaka Ishikawa University of Tokyo, Japan 2009/05/21.

Management of the LHCb DAQ Network Guoming Liu * †, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.

LIGO-G D Global Diagnostics and Detector Characterization 9 th Marcel Grossmann Meeting Daniel Sigg, LIGO Hanford Observatory.

LIGO-G Z April 2006 APS meeting Igor Yakushin (LLO, Caltech) Search for Gravitational Wave Bursts in LIGO’s S5 run Igor Yakushin (LLO, Caltech)

Overview of DAQ at CERN experiments E.Radicioni, INFN MICE Daq and Controls Workshop.

Peter Chochula ALICE Offline Week, October 04,2005 External access to the ALICE DCS archives.

5-Oct-051 Tango collaboration status ICALEPCS 2005 Geneva (October 2005)

LIGO-G Z Detector Characterization Software Tools K. Riles - University of Michigan 1 Status Report on CW Discriminator Work Keith.

LIGO-G Z 5 June 2001L.S.Finn/LIGO Scientific Collaboration1 LDAS Camp.

S5 BNS Inspiral Update Duncan Brown Caltech LIGO-G Z.

LIGO-G Z Detector Characterization Summary K. Riles - University of Michigan 1 Summary of the Detector Characterization Sessions Keith.

GEO++ Online Detector Characterization System. LIGO-G Z GEO++ working group GEO++ working group Cardiff University: Birmingham University Cardiff.

A Data/Detector Characterization Pipeline (What is it and why we need one) Soumya D. Mohanty AEI January 18, 2001 Outline of the talk Functions of a Pipeline.

State of LSC Data Analysis and Software LSC Meeting LIGO Hanford Observatory November 11 th, 2003 Kent Blackburn, Stuart Anderson, Albert Lazzarini LIGO.

The GEO Online Detector Characterization System David Churches Cardiff University 21 st August 2003 LSC meeting – Hannover – 18,21 August 2003 LIGO-G Z.

Gregory Mendell, LIGO Hanford Observatory LIGO-G WLIGO-G WLIGO-G W LIGO S5 Reduced Data Set Generation March 2007.

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Access to Data from the LIGO Engineering Runs Peter Shawhan (LIGO Lab / Caltech)

Group Communication Theresa Nguyen ICS243f Spring 2001.

Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.

GEO Online Detector Characterization System R. Balasubramanian Cardiff University LSC March 2003 LIGO-G Z.

LIGO-G Z DMT Status for UL Analysis K. Riles - University of Michigan 1 DMT Monitors -- Status Update for Upper Limits Analysis.

May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech.

LIGO-G Z Detector Characterization Issues K. Riles - University of Michigan 1 Detector Characterization Issues -- S2 Analysis & S3 Planning.

LIGO-G W Use of Condor by the LIGO Scientific Collaboration Gregory Mendell, LIGO Hanford Observatory On behalf of the LIGO Scientific Collaboration.

LIGO-G Z Detector Characterization Software Tools K. Riles - University of Michigan 1 Introduction to Detector Characterization Sessions.

The DCS Databases Peter Chochula. 31/05/2005Peter Chochula 2 Outline PVSS basics (boring topic but useful if one wants to understand the DCS data flow)

LIGO-G Z Detector Characterization Summary K. Riles - University of Michigan 1 Summary of the Detector Characterization Sessions Keith.

Online DQ Segments and Triggers John Zweizig LIGO/Caltech.

LIOProf: Exposing Lustre File System Behavior for I/O Middleware

DBS Monitor and DAN CD Projects Report July 9, 2003.

January 2010 – GEO-ISC KickOff meeting Christian Gräf, AEI 10 m Prototype Team State-of-the-art digital control: Introducing LIGO CDS.

 Computer hardware refers to the physical parts of a computer and related devices. Internal hardware devices include motherboards, hard drives,

Retele de senzori EEMon Electrical Energy Monitoring System.

LSC Z000.0 LSC at LLO LIGO Scientific Collaboration - University of Wisconsin - Milwaukee 1 LSC Software Coordinator Report Alan Wiseman University.

1 InspiralMon Duncan Brown California Institute of Technology LIGO-G Z.

LIGO-G Z Introduction to QScan Shourov K. Chatterji SciMon Camp LIGO Livingston Observatory 2006 August 18.

Data Acquisition, Diagnostics & Controls (DAQ)

Software Architecture in Practice

Software Implementation

KIT visit to Cascina , 22 March 2019

Presentation transcript:

Jan 12, 2009LIGO-G Z1 DMT and NDS2 John Zweizig LIGO/Caltech Ligo PAC, Caltech, Jan 12, 2009

Jan 12, 2009LIGO-G Z2 Overview DMT and NDS2 are niche tools that provide data and some analysis S/W for: »Data quality monitoring »Detector characterization »Online analysis

Jan 12, 2009LIGO-G Z3 DMT Overview Control room access to data, instrument status High bandwidth data distribution Minimal latency: data driven Provides »Immediate status information to operators, Science Monitors, others »Data products –Trend frames (statistics)‏ –Online calibrated h(t)‏ –Transient signal detections (for vetos) –Data quality flag segments.

Jan 12, 2009LIGO-G Z4 DMT

Jan 12, 2009LIGO-G Z5 DMT Data Distribution Data frames are broadcast to all DMT nodes »Currently broadcast over dedicated network by CDS frame broadcaster. »aLigo alternative: All DMT nodes could connect to CDS network. Data push process on each node copies frames to shared memory. Monitor processes register as consumers, read data directly from shared memory Total latency <1s from end of data collection

Jan 12, 2009LIGO-G Z6 DMT Hardware Server node »File server »DMT control services –Alarm manager –Trigger manager –monitor name service Communications node »Web server »Monitors/services needing external connectivity Computation engines »SMP nodes located in MSR »Current work-horse: Sun X4600 (8-core 2.8GHz Opteron running Solaris)‏

Jan 12, 2009LIGO-G Z7 DMT Software C++ class libraries from LIGO »I/O »Signal processing »Monitor base classes Code imported from LAL (e.g. h(t) calibration function)‏ Data monitors written by LSC collaborators (mostly DetChar group)‏ Packaged by DASWG for offline use

Jan 12, 2009LIGO-G Z8 Monitor Displays

Jan 12, 2009LIGO-G Z9 DMT Status DMT has been running for ~10 years »Highly reliable, up-time > 99% »DMT displays used routinely by operators, SciMons, etc. New online analysis support features tested in M9 (Dec 20-21, 2008)‏ »h(t) generation »Multi-channel wavelet-based transient search (kleineWelle)‏

Jan 12, 2009LIGO-G Z10 NDS2 NDS2 provides NDS functionality to users outside of control room »Client/server model »User authentication »No direct connection to CDS (won't affect data flow)‏ »Serve online, cached and archived data »Exchange of data between Ligo->Virgo for coherent analysis

Jan 12, 2009LIGO-G Z11 NDS2 Server Development Prototype ( β ) NDS2 server software »Authentication by LIGO.ORG Kerberos »Memory buffering of recently used data. »I/O drivers implemented –File systems –GDS online shared memory partitions.

Jan 12, 2009LIGO-G Z12 NDS2 Clients Existing client implementations »C library (nds1/nds2 client API)‏ »C++ classes »NDS2Frame: write data as frames Planned/In progress »Matlab client functions () –will allow use by existing matlab tools, e.g. ldv »Port existing control room tools –dtt –dv

Jan 12, 2009LIGO-G Z13 NDS2 Status Test servers now running »S5 RDS data (from CIT archive)‏ »A5 online data (from LHO CDS)‏ »Test server installed at Syracuse Use limited by scarcity of client software »No testing under heavy use »Usage patterns not determined »Expect I/O bandwidth (network and archive access) to be the only performance bottleneck.