Presentation is loading. Please wait.

Presentation is loading. Please wait.

LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech.

Published byFay Jacobs Modified over 9 years ago

Similar presentations

Presentation on theme: "LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech."— Presentation transcript:

1 LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech

2 LIGO-G9900XX-00-M DMT Overview DMT – Detector characterization platform in C++ »Written for monitoring IFO state, sensitivity, noise, etc. »Signal processing, detector characterization class libraries. Online use (in LIGO control room) »Run continuously on ~10 Solaris SMP nodes (reference platform) »Stream of current IFO data received directly from DAQ. »Real-time, low latency response »Operator feedback: alarms, IFO state, sensitivity, noise/transient summaries »Output: real-time triggers (transient descriptors), Statistics trends

3 LIGO-G9900XX-00-M Online DMT Data Flow

4 LIGO-G9900XX-00-M Growing Use – Offline Analysis Offline analysis uses »Run “monitors” with different configurations on entire raw data samples. –Data quality investigations –Transient detection »Use detector specific codes in offline GW search pipelines. Impediments to offline use »Linux installation difficult (no binary distribution, no reference platform). –Impacts development as well as universal use »No standard offline environment defined »Unable to use LSC computational clusters »Global data access and publication not provided »Sensitive data – administrative nightmare »Local job submission only »Single data stream input (multiple inputs useful for IFO correlations). ITR2003 DMT sub-project will enable this use

5 LIGO-G9900XX-00-M Offline DMT Data Flow

6 LIGO-G9900XX-00-M ITR2003 Mission Grid enable DMT »Improve portability »Interface to Globus tools and LDR »Condor enable »Develop remote submission capabilities »Install on LSC clusters Without adversely affecting the primary DMT mission »Maintain Solaris compatibility »Transparent access to DAQ broadcast stream »Interface to ROOT Graphics »Operator feedback, Database Interfaces

7 LIGO-G9900XX-00-M Participants Erik Katsavounidis (MIT PI) Lee Samuel Finn (PSU PI) John G. Zweizig (Caltech) Junwei Cao (MIT, ITR2003) Anonymous Hire (PSU) Part time hire (UWM) »25% for deployment, other time as available

8 LIGO-G9900XX-00-M Technical Linux portability »Autoconfigure/automake »Rpm generation »Periodic build »Standardize offline runtime environment. »Decouple from CERN Root package Data access transparency »Interface to directory / LDR Running on the grid »Use Condor features (checkpointing, etc) »Process management »Remote submission

9 LIGO-G9900XX-00-M Technical 2 Maintaining clusters »Installation / maintenance »Usage prioritization. »Clusters at observatories & tier 2 centers. Validation »Component tests for nightly build Nuts ‘n Bolts »Multiple data streams »Rationalize dependencies (fftw-3, …) »Etc?

10 LIGO-G9900XX-00-M Stakeholders LSC »Extend DMT availability to LSC offline analysis. –Improve portability. –Formalize use of DMT on LSC Linux clusters –Enable remote submission. »Protect data access. Grid community »Demonstrate gridification of an existing Scientific software package »Grid middleware use in real scientific applications allows feedback to grid community e.g. which tools/features are useful/needed »Productive readjustment of priorities, more useful middleware

11 LIGO-G9900XX-00-M Plans (2004) Improve portability & versioning of DMT software »Implement build procedure using autoconfigure, automake. »Automate periodic builds & tests of current version. »Build & maintain binary RPMs (APTs?) for LSC reference platform. »Define standard execution environment. Interface DMT to grid utilities »Data access / publishing »User certification? Verification »Build library of component tests for periodic verification. Cluster support (MIT, PSU, UWM) »Installation

12 LIGO-G9900XX-00-M Plans (2005) Set up DMT to use Condor features »Disable message system (alarms, graphics) »Set up to run as “standard” Condor job Remote submission architecture »Wrapper/supervisor? for condor jobs »Web interface for submission. Cluster support (PSU, UWM, MIT)

13 LIGO-G9900XX-00-M Plans (2006-7) Continue development of remote submission architecture »Wrapper/supervisor? for condor jobs »Web interface for submission Cluster support (MIT, PSU, UWM)

Download ppt "LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech."

Similar presentations

CPSCG: Constructive Platform for Specialized Computing Grid Institute of High Performance Computing Department of Computer Science Tsinghua University.

CPSCG: Constructive Platform for Specialized Computing Grid Institute of High Performance Computing Department of Computer Science Tsinghua University.
11/12/2003LIGO Document G030554-00-Z1 Data reduction for S3 I Leonor (UOregon), P Charlton (CIT), S Anderson (CIT), K Bayer (MIT), M Foster (PSU), S Grunewald.

11/12/2003LIGO Document G Z1 Data reduction for S3 I Leonor (UOregon), P Charlton (CIT), S Anderson (CIT), K Bayer (MIT), M Foster (PSU), S Grunewald.
AQS Futures (Where is AQS Heading?) AQS Conference August 22, 2012 Robert Coats.

AQS Futures (Where is AQS Heading?) AQS Conference August 22, 2012 Robert Coats.
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.

Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
LIGO-G020484-00-Z 23 October 2002NSF Review of LIGO Laboratory1 The Penn State LIGO Data Analysis Center Lee Samuel Finn Penn State.

LIGO-G Z 23 October 2002NSF Review of LIGO Laboratory1 The Penn State LIGO Data Analysis Center Lee Samuel Finn Penn State.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance

DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
LIGO-G040337-00-Z Camp orientation / overview -- 2004.8.20K. Riles - University of Michigan 1 Orientation and Overview Keith Riles (University of Michigan)

LIGO-G Z Camp orientation / overview K. Riles - University of Michigan 1 Orientation and Overview Keith Riles (University of Michigan)
Noise Floor Non-stationarity Monitor Roberto Grosso*, Soma Mukherjee + + University of Texas at Brownsville * University of Nuernburg, Germany Detector.

Noise Floor Non-stationarity Monitor Roberto Grosso*, Soma Mukherjee + + University of Texas at Brownsville * University of Nuernburg, Germany Detector.
The middleware that makes real time integration a reality.

The middleware that makes real time integration a reality.
LIGO-G0200XX-00-M DMT Monitors: Beyond the FOM John Zweizig LIGO/Caltech LLO August 18, 2006.

LIGO-G0200XX-00-M DMT Monitors: Beyond the FOM John Zweizig LIGO/Caltech LLO August 18, 2006.
Cross Cluster Migration Remote access support Adianto Wibisono supervised by : Dr. Dick van Albada Kamil Iskra, M. Sc.

Cross Cluster Migration Remote access support Adianto Wibisono supervised by : Dr. Dick van Albada Kamil Iskra, M. Sc.
November 2011 At A Glance GREAT is a flexible & highly portable set of mission operations analysis tools that increases the operational value of ground.

November 2011 At A Glance GREAT is a flexible & highly portable set of mission operations analysis tools that increases the operational value of ground.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.

LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.

The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.

QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
LIGO-G040245-00-E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004.

LIGO-G E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004.
GIG Software Integration: Area Overview TeraGrid Annual Project Review April, 2008.

GIG Software Integration: Area Overview TeraGrid Annual Project Review April, 2008.
LIGO-G030307-00-DM. Landry – Amaldi5 July 9, 2003 Laser Interferometer Gravitational Wave Observatory Monitoring LIGO Data During the S2 Science Run Michael.

LIGO-G DM. Landry – Amaldi5 July 9, 2003 Laser Interferometer Gravitational Wave Observatory Monitoring LIGO Data During the S2 Science Run Michael.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.

National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.

Similar presentations

Ads by Google