1. Jan 12, 2009LIGO-G091234-00-Z1 DMT and NDS2 John Zweizig LIGO/Caltech Ligo PAC, Caltech, Jan 12, 2009

2. Jan 12, 2009LIGO-G091234-00-Z2 Overview DMT and NDS2 are niche tools that provide data and some analysis S/W for: »Data quality monitoring »Detector characterization »Online analysis

3. Jan 12, 2009LIGO-G091234-00-Z3 DMT Overview Control room access to data, instrument status High bandwidth data distribution Minimal latency: data driven Provides »Immediate status information to operators, Science Monitors, others »Data products –Trend frames (statistics)‏ –Online calibrated h(t)‏ –Transient signal detections (for vetos) –Data quality flag segments.

4. Jan 12, 2009LIGO-G091234-00-Z4 DMT

5. Jan 12, 2009LIGO-G091234-00-Z5 DMT Data Distribution Data frames are broadcast to all DMT nodes »Currently broadcast over dedicated network by CDS frame broadcaster. »aLigo alternative: All DMT nodes could connect to CDS network. Data push process on each node copies frames to shared memory. Monitor processes register as consumers, read data directly from shared memory Total latency <1s from end of data collection

6. Jan 12, 2009LIGO-G091234-00-Z6 DMT Hardware Server node »File server »DMT control services –Alarm manager –Trigger manager –monitor name service Communications node »Web server »Monitors/services needing external connectivity Computation engines »SMP nodes located in MSR »Current work-horse: Sun X4600 (8-core 2.8GHz Opteron running Solaris)‏

7. Jan 12, 2009LIGO-G091234-00-Z7 DMT Software C++ class libraries from LIGO »I/O »Signal processing »Monitor base classes Code imported from LAL (e.g. h(t) calibration function)‏ Data monitors written by LSC collaborators (mostly DetChar group)‏ Packaged by DASWG for offline use

8. Jan 12, 2009LIGO-G091234-00-Z8 Monitor Displays

9. Jan 12, 2009LIGO-G091234-00-Z9 DMT Status DMT has been running for ~10 years »Highly reliable, up-time > 99% »DMT displays used routinely by operators, SciMons, etc. New online analysis support features tested in M9 (Dec 20-21, 2008)‏ »h(t) generation »Multi-channel wavelet-based transient search (kleineWelle)‏

10. Jan 12, 2009LIGO-G091234-00-Z10 NDS2 NDS2 provides NDS functionality to users outside of control room »Client/server model »User authentication »No direct connection to CDS (won't affect data flow)‏ »Serve online, cached and archived data »Exchange of data between Ligo->Virgo for coherent analysis

11. Jan 12, 2009LIGO-G091234-00-Z11 NDS2 Server Development Prototype ( β ) NDS2 server software »Authentication by LIGO.ORG Kerberos »Memory buffering of recently used data. »I/O drivers implemented –File systems –GDS online shared memory partitions.

12. Jan 12, 2009LIGO-G091234-00-Z12 NDS2 Clients Existing client implementations »C library (nds1/nds2 client API)‏ »C++ classes »NDS2Frame: write data as frames Planned/In progress »Matlab client functions () –will allow use by existing matlab tools, e.g. ldv »Port existing control room tools –dtt –dv

13. Jan 12, 2009LIGO-G091234-00-Z13 NDS2 Status Test servers now running »S5 RDS data (from CIT archive)‏ »A5 online data (from LHO CDS)‏ »Test server installed at Syracuse Use limited by scarcity of client software »No testing under heavy use »Usage patterns not determined »Expect I/O bandwidth (network and archive access) to be the only performance bottleneck.