Running LIGO workflows on the OSG

Slides:



Advertisements
Similar presentations
LIGO-G ZLSC Meeting March 2004 Search Pipelines for Binary Inspiral Duncan Brown Inspiral Working Group University of Wisconsin-Milwaukee LIGO-G Z.
Advertisements

S3/S4 BBH report Thomas Cokelaer LSC Meeting, Boston, 3-4 June 2006.
A walk through some statistic details of LSC results.
1 Science Opportunities for Australia Advanced LIGO Barry Barish Director, LIGO Canberra, Australia 16-Sept-03 LIGO-G M.
LIGO Status and Advanced LIGO Plans Barry C Barish OSTP 1-Dec-04.
Louis J. Rubbo Neil Cornish and Olivier Poujade. The LISA Simulator Capabilities –Valid for an arbitrary gravitational wave at any frequency in the LISA.
Calibration Accuracy of LIGO Interferometers Brian O’Reilly LIGO Livingston Observatory Rana Adikhari (MIT), Peter Fritschel (MIT), Gabriela Gonzalez(LSU),
1 Observing the Most Violent Events in the Universe Virgo Barry Barish Director, LIGO Virgo Inauguration 23-July-03 Cascina 2003.
Gravitational-waves: Sources and detection
The LIGO Project ( Laser Interferometer Gravitational-Wave Observatory) Rick Savage – Scientist LIGO Hanford Observatory.
R. Frey Student Visit 1 Gravitational Waves, LIGO, and UO GW Physics LIGO
LIGO -- Studying the Fabric of the Universe LIGO-GOxxxx Barry C. Barish National Science Board LIGO Livingston, LA 4-Feb-04.
Parameter Estimation Using 3.5 post-Newtonian Inspiral Waveforms GWDAW, December 15-18, 2004, Annecy K. Arun, B.R. Iyer, B.S. Sathyaprakash and P. Sundarajan.
The Search for a Stochastic Background of Gravitational Radiation Part I Rosa M. Luna, D. Auzmus, M. Casquette, C.W. Torres, M.C. Diaz, J.D. Romano, and.
Brennan Ireland Rochester Institute of Technology Astrophysical Sciences and Technology December 5, 2013 LIGO: Laser Interferometer Gravitational-wave.
Systematic effects in gravitational-wave data analysis
GridLab, Eger, 31 Mar-1 Apr Potential Gravitational Applications of Grid B.S. Sathyaprakash GridLab conference, 31.
Patrick R Brady University of Wisconsin-Milwaukee
G Z LIGO Scientific Collaboration Grid Patrick Brady University of Wisconsin-Milwaukee LIGO Scientific Collaboration.
Gravitational Wave Arezu Dehghafnar Physics Department SUT.
OSG Area Coordinators’ Meeting LIGO Applications (NEW) Kent Blackburn Caltech / LIGO October 29 th,
Adapting matched filtering searches for compact binary inspirals in LSC detector data. Chad Hanna – For the LIGO Scientific Collaboration.
LIGO- G D Status of LIGO Stan Whitcomb ACIGA Workshop 21 April 2004.
TAMA binary inspiral event search Hideyuki Tagoshi (Osaka Univ., Japan) 3rd TAMA symposium, ICRR, 2/6/2003.
Koji Arai – LIGO Laboratory / Caltech LIGO-G v1.
Reducing False Alarms in Searches for Gravitational Waves from Coalescing Binary Systems Andrés C. Rodríguez Louisiana State University M.S. Thesis Defense.
Status of Standalone Inspiral Code Duncan Brown University of Wisconsin-Milwaukee LIGO Scientific Collaboration Inspiral Working Group LIGO-G Z.
The Analysis of Binary Inspiral Signals in LIGO Data Jun-Qi Guo Sept.25, 2007 Department of Physics and Astronomy The University of Mississippi LIGO Scientific.
Searching for Gravitational Waves with LIGO Andrés C. Rodríguez Louisiana State University on behalf of the LIGO Scientific Collaboration SACNAS
Veto Selection for Gravitational Wave Event Searches Erik Katsavounidis 1 and Peter Shawhan 2 1 Massachusetts Institute of Technology, Cambridge, MA 02139,
Status of coalescing binaries search activities in Virgo GWDAW 11 Status of coalescing binaries search activities in Virgo GWDAW Dec 2006 Leone.
7 th Edoardo Amaldi Conference on Gravitational Waves 8-14 July 2007 Sydney Australia Data from gravitational wave detectors like LIGO will be analysed.
Searching for Gravitational Waves from Binary Inspirals with LIGO Duncan Brown University of Wisconsin-Milwaukee for the LIGO Scientific Collaboration.
Searches for Compact Binary Coalescences in LIGO and Virgo data Gabriela González For the LIGO Scientific Collaboration and the Virgo Collaboration APS.
1 Status of Search for Compact Binary Coalescences During LIGO’s Fifth Science Run Drew Keppel 1 for the LIGO Scientific Collaboration 1 California Institute.
LIGO-G Z The Q Pipeline search for gravitational-wave bursts with LIGO Shourov K. Chatterji for the LIGO Scientific Collaboration APS Meeting.
Searching for Binary Black Holes with Spin Aligned with Orbital Angular Momentum 1 Deborah L. Hamm – Northern Arizona University LIGO SURF 2013 Mentors:
The 9th Gravitational Wave Data Analysis Workshop (December 15-18, 2004, Annecy, France) Results of the search for burst gravitational waves with the TAMA300.
LIGO-G W Use of Condor by the LIGO Scientific Collaboration Gregory Mendell, LIGO Hanford Observatory On behalf of the LIGO Scientific Collaboration.
First Year S5 Low Mass Compact Binary Coalescences Drew Keppel 1 representing the LIGO/VIRGO Compact Binary Coalescence Group 1 California Institute of.
LIGO-G Z1 Using Condor for Large Scale Data Analysis within the LIGO Scientific Collaboration Duncan Brown California Institute of Technology.
LIGO: The Laser Interferometer Gravitational-wave Observatory Sarah Caudill Louisiana State University Physics Graduate Student LIGO Hanford LIGO Livingston.
LIGO G M Intro to LIGO Seismic Isolation Pre-bid meeting Gary Sanders LIGO/Caltech Stanford, April 29, 2003.
G Z The LIGO gravitational wave detector consists of two observatories »LIGO Hanford Observatory – 2 interferometers (4 km long arms and 2 km.
LIGO-G M Press Conference Scientific Operation of LIGO Gary H Sanders Caltech (on behalf of a large team) APS April Meeting Philadelphia 6-April-03.
Searching the LIGO data for coincidences with Gamma Ray Bursts Alexander Dietz Louisiana State University for the LIGO Scientific Collaboration LIGO-G Z.
Gravitational Wave Data Analysis  GW detectors  Signal processing: preparation  Noise spectral density  Matched filtering  Probability and statistics.
24 th Pacific Coast Gravity Meeting, Santa Barbara LIGO DCC Number: G Z 1 Search for gravitational waves from inspiraling high-mass (non-spinning)
LIGO-G Z Results from LIGO Observations Stephen Fairhurst University of Wisconsin - Milwaukee on behalf of the LIGO Scientific Collaboration.
GRB triggered Inspiral Searches in the fifth Science Run of LIGO Alexander Dietz Cardiff University for the LIGO Scientific Collaboration LIGO-G Z.
Search for gravitational waves from binary inspirals in S3 and S4 LIGO data. Thomas Cokelaer on behalf of the LIGO Scientific Collaboration.
Search for compact binary systems in LIGO data Thomas Cokelaer On behalf of the LIGO Scientific Collaboration Cardiff University, U.K. LIGO-G Z.
Thomas Cokelaer for the LIGO Scientific Collaboration Cardiff University, U.K. APS April Meeting, Jacksonville, FL 16 April 2007, LIGO-G Z Search.
Brennan Hughey MIT Kavli Institute Postdoc Symposium
Detecting a Galactic Supernova with H2 or GEO
Low-latency Selection of Gravitational-wave Event Candidates
2017 Nobel Prize in Physics: Discovery of Gravitational Waves
The Q Pipeline search for gravitational-wave bursts with LIGO
GW150914: The first direct detection of gravitational waves
On Behalf of the LIGO Scientific Collaboration and VIRGO
Pegasus and Condor Gaurang Mehta, Ewa Deelman, Carl Kesselman, Karan Vahi Center For Grid Technologies USC/ISI.
Gravitational wave detection and the quantum limit
Background estimation in searches for binary inspiral
University of Wisconsin-Milwaukee
Excess power trigger generator
OK Alexander Dietz Louisiana State University
Detection of Gravitational Waves with Interferometers
A Waveform Consistency Test for Binary Inspirals using LIGO data
Observing Gravitational Waves(GW) by LIGO
Search for Ringdowns in LIGO S4 Data
Presentation transcript:

Running LIGO workflows on the OSG Britta Daudert OSG-Users meeting Fermilab July 26/27 207 Laser Interferometer Gravitational Wave Observatory G070489-00-R

What are Gravitational Waves? Gravitational waves are ripples in the fabric of space and time Emitted by accelerating masses Sources: Compact Binaries, Bursts, Continuous Wave Source, Stochastic Background G070489-00-R

The Interferometer GW decreases distance between test masses in one arm of the L, increasing it in the other Distance is measured by bouncing high-power laser light beams between test masses L1, H1, H2 detectors G070489-00-R

Workflow Generation Analysis Parameters Metadata Describing Raw Data PIPELINE Glue Pipeline Modules LALApps LAL LDR Data Location Service DAG DAGMan DAX Pegasus DAG G070489-00-R ldas-grid OSG

Inside The Pipeline G070489-00-R Event Candidates L1 Data H1Data Each chunk Of data is analyzed against Each template Tmpltbank Generates bank of waveform parameters Inspiral Signal to noise ratio test Veto testing H1Trigger L1 Trigger H2 Trigger Trigbank Converts triggers into template bank Inca Consistency tests G070489-00-R Event Candidates

Workflow Size Each observatory produces data Each chunk of data is analyzed with each of the templates A chunk of data takes about 5 minutes to be analyzed Each template bank job takes about 5 minutes Work Templates + Segments G070489-00-R

Running Workflows on the OSG Dax DX x Dag G070489-00-R

The Inspiral Pipeline On UWMilwaukee Number of Jobs Local (No DT) Number of Jobs OSG (DT) Run Time Local OSG Rescue Dags OSG Disk Usage 189 363 0:52 2:39 1 8.1G 374 717 3:18 3:05 17G 828 1585 3:07 3:24 39G 2167 4117 10:46 15:46 96G 3956 7487 16:52 37:14 2 173G G070489-00-R

Monitoring with monALISA G070489-00-R

Challenges and Solutions Large Data Sets Long Data Transfer Times Disk Space Problems G070489-00-R

Challenges and Solutions Compressing data (LIGO) Large Data Sets SRM G070489-00-R

Challenges and Solutions Work Flow Design Cleanup issues Disk space problems G070489-00-R

Challenges and Solutions Dynamic Cleanup (Pegasus 2.0) Work Flow Design Depth First (Condor_G) G070489-00-R

G070489-00-R