Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Slides:



Advertisements
Similar presentations
Components of GIS.
Advertisements

Stefan Hild S4 Data Workshop, Hannover, May 2005 Title 1 kHz Glitches in S4 Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)
Stefan Hild Ilias WG1 meeting, Hannover, April 2005 Title Hot topic: 1 kHz Glitches in S4 Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)
Snort & ACID. UTSA IS 6973 Computer Forensics SNORT.
Max-Planck-Institut für Gravitationsphysik - Albert-Einstein-Institut DC Meeting Golm - Karsten Kötter1 Current status of DAQ System
Stefan Hild Ilias WG1 meeting, Casina, Januar 2005 Title Scattered Light at GEO 600 Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)
A PROCESS DEVELOPMENT TOOL FOR THERMAL SPRAYING Developed by Mattias Ottosson Stefan Björklund © 2011.
23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.
Stefan Hild S4 Data Workshop, Hannover, Mai 2005 Title MU3 glitches Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)
LIGO-G0200XX-00-M DMT Monitors: Beyond the FOM John Zweizig LIGO/Caltech LLO August 18, 2006.
INTRUSION DETECTION SYSTEMS Tristan Walters Rayce West.
Control and monitoring of on-line trigger algorithms using a SCADA system Eric van Herwijnen Wednesday 15 th February 2006.
New Features of APV-SRS-LabVIEW Data Acquisition Program Eraldo Oliveri on behalf of Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer] NYC,
Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
Data Acquisition at the NSLS II Leo Dalesio, (NSLS II control group) Oct 22, 2014 (not 2010)
2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.
Detector Characterization in GEO 600 by Alicia M. Sintes-Olives on behalf of the GEO-DC team Universitat de les Illes Balears
GEO600 Harald Lück Ruthe, Worldwide Interferometer Network.
LIGO-G DM. Landry – Amaldi5 July 9, 2003 Laser Interferometer Gravitational Wave Observatory Monitoring LIGO Data During the S2 Science Run Michael.
Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut) Institut für Atom- und Molekülphysik Detector Characterization of GEO 600 during.
Andreas Freise ILIAS WG1 Meeting CERN (29-Mar-07) GEO 600 Simulation Group.
ATLAS Off-Grid sites (Tier-3) monitoring A. Petrosyan on behalf of the ATLAS collaboration GRID’2012, , JINR, Dubna.
21 Feb 2002Soumya D. Mohanty, AEI1 DCR Plan of presentation Soumya Mohanty: Overview, aims & work done R. Balasubramanian: Details of Hardware, Database.
Module 7: Fundamentals of Administering Windows Server 2008.
+ discussion in Software WG: Monte Carlo production on the Grid + discussion in TDAQ WG: Dedicated server for online services + experts meeting (Thusday.
Windows NT Chapter 13 Key Terms By Bill Ward NT Versions NT Workstation n A desktop PC that both accesses a network and works as a stand alone PC NT.
Potsdam, Germany Identification and removal of glitches in GEO 600 Joshua Smith ILIAS WG
Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
Stefan Hild 1Ilias WG1 meeting, June 2005 Title Beam clipping Problems in GEO 600 ?? Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)
Platinu m Sponsor s Silver Sponsors Gold Sponsor s.
Measurement Fundamentals Rajesh Vaidya DAQ Software Engineer Wed 10:15a, 12:45p, and 3:30p Colorado (6A) Rajesh Vaidya DAQ Software Engineer.
The GEO Line detection Monitor Thomas Cokelaer Cardiff University 22 nd August 2003 LIGO-G Z LSC meeting – Hannover – 18,21 August 2003.
6-10 Oct 2002GREX 2002, Pisa D. Verkindt, LAPP 1 Virgo Data Acquisition D. Verkindt, LAPP DAQ Purpose DAQ Architecture Data Acquisition examples Connection.
Data Submittals to AQS Nate Herbst Southern Ute Indian Tribe.
7. CBM collaboration meetingXDAQ evaluation - J.Adamczewski1.
Stefan Hild 1GWDAW 10, Brownsville, December 2005 Status of GEO 600 Stefan Hild, AEI Hannover for the GEO-team.
Martin Hewitson Data access for GEO600. GEO DC workshop June Overview A variety of tools exist for on-line and off-line analyses Aux info.
Jean Slaughter –April 5, 2004 – all experimenters’ meeting Purposes of SDA Store to store monitoring of performance Long term trends Analysis of specific.
Samantha. What is it? –It is a Wi-Fi interface for the Lego Mindstorms –It replaces the Bluetooth connection for running matches It is mostly for running.
Preparing GEO600 for Gravitational Wave astronomy (A status report) Martin Hewitson, AEI Hannover for GEO600.
James R. Cash SCADA System. Main Functions Acquire remote data Permit centralized control of pipeline Keep historical record of operation Provide automated.
High Speed Detectors at Diamond Nick Rees. A few words about HDF5 PSI and Dectris held a workshop in May 2012 which identified issues with HDF5: –HDF5.
ITGS Network Architecture. ITGS Network architecture –The way computers are logically organized on a network, and the role each takes. Client/server network.
HACR at Virgo: implementation and results Gabriele Vajente 12 th ILIAS WG1 meeting Geneva, March 29 th -30 th 2007.
GEO++ Online Detector Characterization System. LIGO-G Z GEO++ working group GEO++ working group Cardiff University: Birmingham University Cardiff.
A Data/Detector Characterization Pipeline (What is it and why we need one) Soumya D. Mohanty AEI January 18, 2001 Outline of the talk Functions of a Pipeline.
Martin Hewitson and the GEO team Measuring gravitational waves with GEO600.
The GEO Online Detector Characterization System David Churches Cardiff University 21 st August 2003 LSC meeting – Hannover – 18,21 August 2003 LIGO-G Z.
GEO Online Detector Characterization System R. Balasubramanian Cardiff University LSC March 2003 LIGO-G Z.
Gabriele Vajente ILIAS WG1 meeting - Frascati Noise Analysis Tools at Virgo.
4/26/2017 Use Cloud-Based Load Testing Service to Find Scale and Performance Bottlenecks Randy Pagels Sr. Developer Technology Specialist © 2012 Microsoft.
May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech.
1 Locking in Virgo Matteo Barsuglia ILIAS, Cascina, July 7 th 2004.
SFT data preparation using GEO E7 data m.alessandra papa max planck institut f. gravitationasphysik.
NEMO-O DE NEMO First results from the NEMO Test Site G. Riccobene, for the NEMO Collaboration The NEMO Collaboration is performing the Phase 1 of the project,
ATLAS Off-Grid sites (Tier-3) monitoring A. Petrosyan on behalf of the ATLAS collaboration GRID’2012, , JINR, Dubna.
Retele de senzori EEMon Electrical Energy Monitoring System.
Martin Hewitson and the GEO team Measuring gravitational waves with GEO600.
Data Acquisition, Diagnostics & Controls (DAQ)
Peer 2 Peer & Client Server
Introduction to Operating Systems
Giorgio Riccobene, INFN-LNS
Calibrating ALICE.
Detector Characterization
TYPES OF SERVER. TYPES OF SERVER What is a server.
Development of built-in diagnostics in the RADE framework (EN2746)
Measurement & Automation Explorer
Very brief update on the GEO mystery noise investigations
Preparing GEO600 for Gravitational Wave astronomy (A status report)
Data acquisition at GEO600
Presentation transcript:

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Data acquisition fast -24-bit ADC interface: 32 + (2*) 16 channels up to 16kSample/sec slow -12-bit ADC interface: 64 channels with 512 Sample/s control -LabView system acquires ~ 1000 ~1Hz  ca. 60 GB/day

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Data collection DCU (alchemist) DCU (alchemist) vDCU (control) vDCU (control) central DCU (pandora) DCU (pandora) east DCU (thot) DCU (thot) north Data collector Raw data server coch 32f/64s chans 1 MB/s 16f 500 kB/s 1000us 5 kB/s To frame-maker and the rest of the world Fast data access for commissioners

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 File formats Raw data files (1 second duration) –fs <= Hz Frame files (1 minute duration) –fs <= Hz –60 frames per file, one second per frame –All channels in one file Hour trends files (1 hour duration) –fs = 1 Hz –Min, max, av Day trend files (1 day duration) –fs = 1/60 Hz –Min, max, av 20 days of data 20 days (Han) 100 days (Golm) 1 year of data

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DAQS web interface Informations about the current DAQS setup Channel configuration (sampling, filters)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 GEO++ and Triana Developed at Cardiff University Idea: To get a tool that can deal with a large amount of data Software environment - GEO++ –Process large number of channels with many algorithms –Store faithful summary –Triana Tools for retrieval of results from the database GEO++ Monitors Saturations Power fluctuations Lines Glitches Cross-correlations Time-frequency Raw Frame Data Environmental sensors Instrumental monitors Main h(t) channel Data Mining using Triana Display results stored in the database

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 GEO++ Main Monitors InspiralSenseMon GlitchMon HACRMon LineMon PowerTrackerMon SaturationMon AmplitudeCouplingMon PhaseCouplingMon CoherenceMon BicoherenceMon Used for ‚real‘ data analysis Online running monitors, that can be used for detector charaterisation For various reasons we do not often use GEO++ / Triana for commissioning (?)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Monitors Not ‚real‘ data tools, but can give us useful hints for commissioning Alarm.vi Vacuum.vi Drift.vi Temperature.vi

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Labview Oscilloscope

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Data access with Matlab

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Noise projections

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Tracking lines

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Spectrograms

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Transfer functions

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Sensitivity per frequency band

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 General Tool: Matlab Dataviewer Matlab-compiler => Stand alone version

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Possible data exchange (discussion) At the moment data access for the use of commissioning seems only to be sensible, if the commissioners are personally at the site (???) In future maybe data access for the use of commisioning should also be possible from a different antenna site (???)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Data access at the site 1.Use one of the computers at the site: No problem No problem at all Everything is in place 2.Use of your personal computer: You need to install the software on your computer We provide all tools (matlab-files, oscilloscope.vi) Access to raw data and frame server Stand alone data viewer

Stefan Hild Ilias WG1 meeting, Hannover, September 2004 Data access from outside the side (need ?) No problem Allow server access for your personal IP adress Probably only access to the hannover frame server available (due to our security philosophy no access to the raw data server in Ruthe) But now you are outside our domain and behind several firewalls! Only use your personal computer (???) You need software We provide all tools (matlab-files, labview oscilloscope) Stand alone data viewer