Interim Data Capture & Format (IDCAF) Walter Brisken 2006 Dec 6.

Slides:



Advertisements
Similar presentations
HARP-B HARP Software Demo July CAN Node Emulator Using the Vector CAN-Tech CANalyzer Raj Atwal CAN Node Emulator.
Advertisements

14-Jun-2004EVLA Software Design Review Transition Plan Bill Sahr 1 EVLA Hybrid Array & Transition Plan.
National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
Lecture 4. US Systems. Advanced Mobile Phone System Analog Signal Processing at the sender side Compress Pre Emphasize Limit Low Pass Filter + Frequency.
5-6 Dec, 2006EVLA M&C Critical Design ReviewRich Moeser 1 Alerts Rich Moeser.
MONITOR AND CONTROL EXECUTOR REAL TIME PROGRAM.
Bill SahrEVLA M&C Transition System Software CDR December 5-6, EVLA Monitor & Control Transition System Software Overview.
EOVSA Data Volume / Data Rates Gordon Hurford Nov 8, 2011 EOVSA Technical Design Meeting - NJIT.
LIGO-G0200XX-00-M DMT Monitors: Beyond the FOM John Zweizig LIGO/Caltech LLO August 18, 2006.
Check Disk. Disk Defragmenter Using Disk Defragmenter Effectively Run Disk Defragmenter when the computer will receive the least usage. Educate users.
RHEA Phase 1 Storyboard. Purpose This provides a high level overview of the solution, in a simple story format.
The Prototype Correlator Sonja Vrcic Socorro, 5. December, 2006.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Emmanuel Momjian (NRAO)
RFid Technology TELE 480 Presentation. What is RFid? RFid is an ADC technology that uses radio- frequency waves to transfer data between a reader and.
5-6 Dec, 2006EVLA M&C Critical Design ReviewRich Moeser 1 User Interfaces Rich Moeser.
Nov 1, 2011 RN - 1 Jet Propulsion Laboratory California Institute of Technology Implementation Issues and Choices for VLBI data Acquisition System in DSN.
Hichem Ben Frej 5-Dec-2006 EVLA M&C Transition Software CDR CMP: Control Monitor Processor 1 Hichem Ben Frej Kevin Ryan.
June 14, 2004EVLA Software Communications Infrastructure Kevin Ryan 1 EVLA Software Communications Infrastructure.
ALMA Integrated Computing Team Coordination & Planning Meeting #2 Santiago, January 2014 Control Group Planning Rafael Hiriart, Control Group Lead.
Overall Data Processing Architecture Review EVLA Monitor and Control Interfaces July , 2002EVLA Data Processing PDR Bill Sahr.
Correlator Growth Path EVLA Advisory Committee Meeting, March 19-20, 2009 Michael P. Rupen Project Scientist for WIDAR.
Bill SahrEVLA Advisory Committee Meeting May 8-9, EVLA Monitor & Control.
Bill Sahr EVLA M&C EVLA Advisory Committee Meeting December 14-15, EVLA Monitor & Control.
Software Status Sonja Vrcic Socorro,
Attack signatures derived from Metasploit Final Presentation E. Ramirez A. Zoghbi
Long Term Transition Plan Gareth Hunt EVLA M&C PDR 2002 May 15.
R MoeserCorrelator f2f Meeting1 MCAF (Metadata Capture and Formatting) Rich Moeser.
EOVSA STATE FRAME ASSEMBLY, DISTRIBUTION, AND SYNCHRONIZATION Gelu Nita NJIT MARCH 2012 EOVSA PDR MEETING 1.
EVLA Monitor & Control Transition System Software
14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan.
Introduction to EVLA Software Bryan Butler. 2006Dec05/06EVLA M&C Transition Software CDR2 EVLA Computing (Terse) History The original EVLA Phase I proposal.
18-19 July, 2002Correlator Backend System OverviewTom Morgan 1 Correlator Backend System Overview Tom Morgan, NRAO.
Configuration Mapper Sonja Vrcic Socorro,
Output Formats Part I Bryan Butler NRAO Oct-31EVLA Correlator f2f2 Overview 2 types of data: –Monitor data - of interest to engineers and system.
DiFX Overview Adam Deller NRAO 3rd DiFX workshop, Curtin University, Perth.
M.P. RupenCorrelator Face-to-Face Meeting 31 Oct 2006 Output Formats Part II Michael P. Rupen.
EOVSA Pipeline Processing System J. McTiernan EOVSA Prototype Review 24-Sep-2012.
5 June 2002DOM Main Board Engineering Requirements Review 1 DOM Main Board Software Engineering Requirements Review June 5, 2002 LBNL Chuck McParland.
EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.
EVLA Monitor & Control Software PDR Status. May 15, 2002EVLA Monitor & Control Software PDR Bill Sahr 2 Requirements, Schedule Requirements (High Level,
Software Requirements for the Testing of Prototype Correlator Sonja Vrcic Socorro, December 11, 2007.
Bill SahrNSF Review May , EVLA Monitor & Control.
Author Wayne M. Koski EVLA Monitor & Control Hardware CDR October 20, EVLA Monitor and Control Monitor & Control Transition.
Author Wayne M. Koski EVLA Monitor & Control Hardware PDR March 13, EVLA Monitor and Control Monitor & Control Transition.
Master Correlator Control Computer (MCCC) Requirements & Status Sonja Vrcic Socorro, December 12, 2007.
M.P. Rupen, Synthesis Imaging Summer School, 18 June Cross Correlators Michael P. Rupen NRAO/Socorro.
EVLA M&C CDR EVLA Monitor Data Archive System John Benson, Chunai Cai NRAO Dec 6, 2006.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array ALMA Correlator.
Scalable Readout System Data Acquisition using LabVIEW Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
Troubleshooting Directories and Files Debugging
Highly Accurate Wide-Range FM-CW Radar Altimeter
Software Overview Sonja Vrcic
Chapter 11 Designing Inputs, Outputs, and Controls.
Archiving and Document Transfer Utilities
Operating System (OS) QUESTIONS AND ANSWERS
Computing Architecture
RHEA Phase 1 Storyboard.
Monitor and Control Software
Correlator – Backend System Overview
EVLA Advisory Committee Meeting System Status
Obs2script Bryan Butler.
VCI Overview Sonja Vrcic
PTC Setup at VLA B. Carlson
Bryan Butler (for Bill Sahr)
EVLA Monitor & Control System
Speaker : 施 賢 孝 Adviser :Quincy Wu Date :2007/01/22
EVLA M&C Components Observation Executor, Interim & Final Obs2script
Correlator Growth Path
EVLA Monitor & Control Bill Sahr NSF Review May , 2006
Requirements Bryan Butler.
Presentation transcript:

Interim Data Capture & Format (IDCAF) Walter Brisken 2006 Dec 6

IDCAF Summary A single C program running on Linux Collects control data from Executor Collects monitor data from CMP Listens for antenna alerts (for flags) Collects visibility data from vispipe Writes VLA Archive Data Format Replaces some Modcomp functionality

Place in the System

Block Diagram Diagram by Bill Sahr

Listeners Each data source has a listener Each runs in its own thread Mutual exclusion locks protect data A time-tagged dump trigger causes appropriate data to be copied to a public area –Except for the visibility listener

Visibility Data TCP connection to VisPipe Vis. Data is sent each correlator dump –All sub-arrays sent together –Format and byte-order is same as in current archive data format –Max size : ~800 kB

Monitor data Multicast from the CMP using the o-stream Sent as XML documents Monitor data includes: –Weather –Back end sync detector voltage –Back end total power

Flagging Flagging is built into IDCAF EVLA antenna MIBs multicast alerts CMP multicasts alerts for VLA antennas Alerts are XML documents Some alerts are: –LO out of lock –Pointing error –Total power out of range

Control Data 1 : UVW Executor multicasts the UVW (baseline vector) data and rates every 10s Data in binary format, ~1kB for all antennas –Contains byte-order tag UVW is linear-interpolated to the center of the integration time.

Control Data 2 : Scans Executor multicasts an Observation XML document at each scan change Includes: –Source (name, RA, Dec) –Scan start time –Band and frequency for each IF pair

Control Data 3 : Subarrays, Antennas & Correlator Mode One listener for 3 types of XML documents Subarray document –List of all subarrays at each subarray change Antenna properties document –Locations, DCS numbers & subarray membership –Sent when antennas enter or leave subarrays Correlator mode document –Correlator mode and integration time

Dump IDCAF will initiate a dump when T mod Tint = 0 Each listener copies relevant data to public area When the visibility data arrives the Archive Data Format is constructed IDCAF output will emulate existing system –Data will be sent to Data Manager via TCP –Optionally the data will be archived to DAT

Archive Format To be written in same format as existing VLA format –In network byte order –Floating point numbers in Modcomp format Revision number to be bumped to 30 Some changes will be needed –Some values won't be populated –Some reinterpretation of flagging for EVLA ants.

Status on 2006/12/01 General structure written 5/6 listeners written –4 tested Archive records can be written and read To do –Visibility Listener –Subarray support –Fill in remaining 30% of parameters