LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G020065-00-E Access to Data from the LIGO Engineering Runs Peter Shawhan (LIGO Lab / Caltech)

Slides:

Advertisements

Similar presentations

Chapter 20 Oracle Secure Backup.

Advertisements

SSRS 2008 Architecture Improvements Scale-out SSRS 2008 Report Engine Scalability Improvements.

11/12/2003LIGO Document G Z1 Data reduction for S3 I Leonor (UOregon), P Charlton (CIT), S Anderson (CIT), K Bayer (MIT), M Foster (PSU), S Grunewald.

Archive Systems What you always wanted to know but were afraid to ask: What’s available? Who’s doing what? PAL EPICS Meeting Oct

Custom Page State Reporting Installer Walk Through and Q and A March 4, 2014.

Query Manager. QM is a collection of tools you can use to obtain information from the AS/400 database Used to –select, arrange, and analyze information.

Gu & Maher University of Sydney, September 2004 DECO2005 Co-Authoring and Changes Management in ArchiCAD Teamwork.

Searching for correlations in global environmental noise Karl Wette, Susan Scott and Antony Searle ACIGA Data Analysis Centre for Gravitational Physics.

CCC/WNUG Exchange Update May 5, 2005 Nate Wilken Web and Messaging Applications Information Technology Arizona State University.

LIGO Reduced Data Sets E7 standard reduced data set RDS generation for future runs decimation examples LIGO-G Z Isabel Leonor (w/ Robert Schofield)

LIG O HW S Introduction to Bicoherence Monitors: BicoViewer & BicoMon Steve Penn (HWS)

11 MONITORING MICROSOFT WINDOWS SERVER 2003 Chapter 3.

LIGO-G0200XX-00-M DMT Monitors: Beyond the FOM John Zweizig LIGO/Caltech LLO August 18, 2006.

LIGO- GXXXXXX-XX-X Advanced LIGO Data & Computing Material for the breakout session NSF review of the Advanced LIGO proposal Albert Lazzarini Caltech,

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 11 Managing and Monitoring a Windows Server 2008 Network.

Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.

CN1260 Client Operating System Kemtis Kunanuraksapong MSIS with Distinction MCT, MCITP, MCTS, MCDST, MCP, A+

Virtual Memory Tuning   You can improve a server’s performance by optimizing the way the paging file is used   You may want to size the paging file.

1 Introducing Windows Backup There are different methods for starting Windows 2000 Backup. Requirements for running Windows 2000 Backup All users can back.

This presentation will guide you though the initial stages of installation, through to producing your first report Click your mouse to advance the presentation.

LIGO-G E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004.

Electronic Public Record What is it, and Where Can Agency Lawyers Find It?

G R AJW, Caltech, LSC Meeting, 3/20/02 Discussion of Statistical Methods, Tools, and Simulations  Review of tools and methods  (I am only familiar.

CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.

15 Maintaining a Web Site Section 15.1 Identify Webmastering tasks Identify Web server maintenance techniques Describe the importance of backups Section.

LSC Segment Database Duncan Brown Caltech LIGO-G Z.

LSC General Meeting LIGO Scientific Collaboration - University of Wisconsin - Milwaukee 1 UWM Data Analysis Facility LSC General Meeting, August.

Update on the LIGO Data Analysis System LIGO Scientific Collaboration Meeting LIGO Hanford Observatory August 19 th, 2002 Kent Blackburn Albert Lazzarini.

Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.

Update on a New EPICS Archiver Kay Kasemir and Leo R. Dalesio 09/27/99.

Module 9: Preparing to Administer a Server. Overview Introduction to Administering a Server Configuring Remote Desktop to Administer a Server Managing.

Guide to Linux Installation and Administration, 2e1 Chapter 10 Managing System Resources.

IT 456 Seminar 5 Dr Jeffrey A Robinson. Overview of Course Week 1 – Introduction Week 2 – Installation of SQL and management Tools Week 3 - Creating and.

LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech.

Section 5: Troubleshooting and Backing Up GPOs Using Group Policy Troubleshooting Tools Integration of RSoP Functionality Using Logging Options Backing.

1 Chapter Overview Preparing to Upgrade Performing a Version Upgrade from Microsoft SQL Server 7.0 Performing an Online Database Upgrade from SQL Server.

Part Four: The LSC DataGrid Part Four: LSC DataGrid A: Data Replication B: What is the LSC DataGrid? C: The LSCDataFind tool.

McGraw-Hill/Irwin The O’Leary Series © 2002 The McGraw-Hill Companies, Inc. All rights reserved. Microsoft Access 2002 Lab 3 Analyzing Tables and Creating.

LIGO-G Z 5 June 2001L.S.Finn/LIGO Scientific Collaboration1 LDAS Camp.

LIGO-G Z Detector Characterization Summary K. Riles - University of Michigan 1 Summary of Detector Characterization Sessions Keith.

NSF Review, 18 Nov 2003 Peter Shawhan (LIGO/Caltech)1 How to Develop a LIGO Search Peter Shawhan (LIGO / Caltech) NSF Review November 18, 2003 LIGO-G E.

Jan 12, 2009LIGO-G Z1 DMT and NDS2 John Zweizig LIGO/Caltech Ligo PAC, Caltech, Jan 12, 2009.

1Antonella Bozzi – LSC/Virgo meeting Amsterdam Ligo/Virgo Data Transfer Bulk data replication tools and plans for S6 data replication Antonella.

Module 9 Planning and Implementing Monitoring and Maintenance.

State of LSC Data Analysis and Software LSC Meeting LIGO Hanford Observatory November 11 th, 2003 Kent Blackburn, Stuart Anderson, Albert Lazzarini LIGO.

Scott Koranda, UWM & NCSA 14 January 2016www.griphyn.org Lightweight Data Replicator Scott Koranda University of Wisconsin-Milwaukee & National Center.

11/12/2003LIGO-G Z1 Data reduction for S3 P Charlton (CIT), I Leonor (UOregon), S Anderson (CIT), K Bayer (MIT), M Foster (PSU), S Grunewald (AEI),

LIGO- G D E7: An Instrument-builder’s Perspective Stan Whitcomb LIGO Caltech LSC Meeting Upper Limits Plenary Session 22 May 2002 LIGO Livingston.

Gregory Mendell, LIGO Hanford Observatory LIGO-G WLIGO-G WLIGO-G W LIGO S5 Reduced Data Set Generation March 2007.

Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.

LIGO-G Z Data Quality Segments Repository K. Riles - University of Michigan 1 Data Quality Segments Repository Keith Riles (University.

1 of 6 This document is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS DOCUMENT. © 2007 Microsoft Corporation.

D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, R. Brock,T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina,

LIGO-G W Interferometer and modecleaner transients during the E2 run Rauha Rahkola and Ray Frey University of Oregon Rick Savage LIGO Hanford.

LIGO-G Z Report on the S2 RunK. Riles / S. Whitcomb 1 Report on the S2 Run Keith Riles (University of Michigan) Stan Whitcomb (LIGO–Caltech)

S.Klimenko, LSC meeting, March 2002 LineMonitor Sergey Klimenko University of Florida Other contributors: E.Daw (LSU), A.Sazonov(UF), J.Zweizig (Caltech)

ICT Disaster Recovery Plan Monitoring & Audit Committee 23 rd November 2010.

Data Infrastructure in the TeraGrid Chris Jordan Campus Champions Presentation May 6, 2009.

1 InspiralMon Duncan Brown California Institute of Technology LIGO-G Z.

Report on the FCT MDC Stuart Anderson, Kent Blackburn, Philip Charlton, Jeffrey Edlund, Rick Jenet, Albert Lazzarini, Tom Prince, Massimo Tinto, Linqing.

E835 Computing at FNAL fn835 systems are old running older operating systems fn835 administration –Time to maintain –Security issues –Thanks to Gabriele.

SQL Database Management

Module 9: Preparing to Administer a Server

Gregory Mendell LIGO Hanford Observatory

TYPES OF SERVER. TYPES OF SERVER What is a server.

Report on the S2 Run Keith Riles (University of Michigan)

湖南大学-信息科学与工程学院-计算机与科学系

Module 9: Preparing to Administer a Server

Presentation transcript:

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Access to Data from the LIGO Engineering Runs Peter Shawhan (LIGO Lab / Caltech) LSC Meeting March 22, 2002

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Data, Data, Data LIGO engineering runs produce several types of data… Raw RDS (selected channels of raw data) Second-trend Minute-trend …which are stored in various places CDS Network Data Server LDAS systems at observatories RAID disks on fortress & decatur HPSS robotic tape archive at Caltech

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Tools, Tools, Tools See LIGOtools “Frequently Asked Questions” page View / process remote data (from Network Data Server) Diagnostic Test ToolsData Viewer View / process data on local disk (on fortress, decatur, etc.) Diagnostic Test ToolsStandalone DMT monitor Data ViewerROOT with DMT library MatlabROOT with Frame library Retrieve data to local disk getFrames lidax guild can retrieve from LDAS Analyze data with LDAS can retreive from HPSS archive, LDAS, and certain RDS datasets on fortress / decatur FAQ write- ups needed

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Data Availability E1-E5: Raw and second-trend data is retrievable from archive using getFrames or lidax (Part of E5 RDS data still exists on fortress & decatur RAID disks) Minute-trend data is remotely viewable with Data Viewer, and retrievable from archive using getFrames or lidax E6: Raw and second-trend data are currently not available Minute-trend data is remotely viewable with Data Viewer E7: Raw data is retrievable from LDAS using getFrames, lidax, guild RDS frames have been created on LDAS disks (cross-mounted to fortress & decatur) but are not yet remotely retrievable or usable by LDAS jobs Second-trend data is not currently available Minute-trend data is remotely viewable with Data Viewer Retrievable data is listed under the “Universal Dataset Names (UDNs), time ranges, channel lists, and links to servers” link on the LIGOtools home page

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Recommendations for Retrieving Data If you want to look at data with DTT or Data Viewer: Use getFrames with the “ -1 ” option This forces the output to be in the form of one-second-long frame files, which is the form required by DTT / Data Viewer (see LIGOtools FAQ) If you want to look at data with any other tool: It is generally preferable to use getFrames without the “ -1 “ option, to minimize the number of files If the data is coming from the HPSS archive or from LARS-served datasets on fortress & decatur, you will get a single file containing multiple frames If the data is coming from LDAS, you will get multiple 16-second-long frames lidax may be handy in special cases guild lets you check what data is available from LDAS

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Upcoming Changes Soon, the E7 raw data will be deleted from LDAS disks E7 RDS data will remain on disk, and will be made available for analysis by LDAS jobs and for retrieval by getFrames, lidax, and guild LARS will be upgraded to serve the E6 & E7 data in the archive for retrieval by getFrames and lidax

LSC Meeting, March 22, 2002 Peter Shawhan (LIGO/Caltech)LIGO-G E Issues We still have no good viewer for old second-trend data Much of the basic infrastructure exists to do this (in multiple ways!) Trend data generated by DMT monitors is inaccessible This has been identified as a priority DAQ system is being modified to serve these out to Data Viewer Will need to archive DMT trend data for later retrieval