Presentation is loading. Please wait.

Presentation is loading. Please wait.

Science Data Capture Jim Aloise Nov , 2004 System Programmer

Published byNils Jakobsson Modified over 5 years ago

Similar presentations

Presentation on theme: "Science Data Capture Jim Aloise Nov , 2004 System Programmer"— Presentation transcript:

1 Science Data Capture Jim Aloise Nov 16 - 17, 2004 System Programmer
Nov , 2004

2 My Documents\DMR_SOC_Req.ppt
DMR – SOC Requirements Science Data Processing, Archiving and Distribution Each SOC shall provide the necessary facility, software, hardware and staff to receive, process, archive and distribute the science data generated by its instruments. Implementation is a Joint SOC (JSOC) for HMI and AIA Emphasis here is on Science Data Capture My Documents\DMR_SOC_Req.ppt

3 SDO Ground System Architecture
HMI and AIA Joint Science Operations Center Acquisition Data Observatory Commands Housekeeping Telemetry Tracking Data Station Status Ka-Band: 150 Mbps Science Data S-Band: Cmd & HK Tlm Station Control Same Interfaces as Prime Ground Station DDS Control DDS Status Data Distribution System Flight Dynamics SDO Mission Operations Center Telemetry & Command Ground Station Control System DDS Control System Mission Planning Trending S band Ground System Ka band SDO Ground Site #2 White Sands SDO Ground Site #1 HMI Science Data 55 Mbps HMI & AIA Instrument Commands and Loads Ka Science Data Stanford University Science Data Processing Lockheed Martin Instrument Operations AIA Science Data 67 Mbps Science Planning and FDS Products HMI, AIA & S/C

4 Network Context Diagram
SDOGS WSGT Ka-band STGT Ka-band WSGT S-band STGT S-band FEP FEP FEP FEP RRCP RRCP RRCP RRCP Legend OC3 fiber Ethernet Ethernet T3 T1 / FT1 EVE JSOC Stanford HMI AIA SDO Network Devices Draft v13e last updated 10/18/04 Fibre Channel SDOGSsr-3a SDOGSsr-3b SDOr14-2a SDOr14-2b SDOGSsr-1a SDOGSsr-1b SDOr14-1a SDOGSsr-6a SDOsr-6a SDOsr-6b SDODDSsr-4a SDODDSsr-4b SDODDSsr-5a SDODDSsr-5b ant. ctlr 30-day archive DDS SDODDSsr-3a SDODDSsr-3b SDOr14-1b SDOsr14-4a SDOsr14-4b SDOsr14-5a SDOsr14-5a R/T #1 MOC R/T #2 SDODDSr-1a firewall-a SDODDSr-2a Support segment DMZ SDOsr14-3a SDOsr14-3b firewall-b FlatSat Open IOnet SDOJSOCr-2b SDOJSOCr-2a SDOEVEr-2a SDOJSOCr-1b SDOJSOCr-1a SDOEVEr-1a SDOEVEr-1b HMI AIA EVE JSOC Lockheed SOC SDP SOC T&C

5 SOC SDP Data Flows SDO Network Devices Legend DDS SOC T&C SOC SDP MOC
EVE JSOC Lockheed HMI AIA Open IOnet DMZ 30-day archive Legend OC3 fiber Ethernet Ethernet T3 T1 / FT1 JSOC Stanford SDO Network Devices Draft v13e last updated 10/18/04 Fibre Channel SDOGSsr-3a SDOGSsr-3b SDOr14-2a SDOr14-2b SDOGSsr-1a SDOGSsr-1b SDOr14-1a SDOGSsr-6a SDOsr-6a SDOsr-6b SDODDSsr-4a SDODDSsr-4b SDODDSsr-5a SDODDSsr-5b SDODDSsr-3a SDODDSsr-3b SDODDSr-1a SDODDSr-2a firewall-b firewall-a SDOJSOCr-1b SDOJSOCr-1a SDOEVEr-1a SDOEVEr-1b SDOEVEr-2a SDOJSOCr-2b SDOJSOCr-2a SDOsr14-3a SDOsr14-3b DDS SOC T&C R/T #2 R/T #1 SOC SDP MOC Support segment FlatSat ant. ctlr SDOr14-1b SDOsr14-5a SDOsr14-4a SDOsr14-4b RRCP FEP SDOGS STGT S-band WSGT Ka-band

6 Stanford/Lockheed Connections
DDS JSOC Disk array NASA AMES LMSAL 1 Gb Private line MOC “White” Net

7 JSOC Data Capture Front End
Front End Server Tape Robot Duplicate Front End Disk array 40TB (30days) Relational Database I D C Analysis Server Dedicated LAN OC3 HMI OC3 AIA DDS [etc.] Analysis Cluster jim\My Documents\datacapture_frontend Back End Data Base Server

8 JSOC Data Capture Front End
Two OC3 lines from DDS for AIA and HMI science data Lines can be switched to either of two redundant Data Capture Front Ends Tape robot will create a copy of input tlm files for offsite storage Telemetry data is passed to the back end server where it is again archived to tape and cataloged in a database Telemetry data is not marked delete pending until an ack is received from both the offsite location and the backend archiving Disk array can retain 30 days of data online Relational data base tracks tlm file datasets and tape locations Separate dedicated LAN for front end machines A backend pipeline creates lev0 and higher data products

9 EGSE Configuration Screen

10 EGSE Run Screens

11 EGSE Run Screens The egse run screen shows the files as they are received from the SSIM (/egse/ssim2soc) These file are moved into the SOC for processing (/egse/soc2soc) The telemetry files are cataloged and decoded and the level 0 images are made and cataloged A third screen displays the status as images are complete or abnormal conditions occur The “Display log” button will put up a separate window showing all the logging activity of the program The “Readme” button is an extensive man page and background charts

12 EGSE Raw and Lev0 Datasets

13 EGSE Raw and Lev0 Datasets
Two types of datasets are created in the EGSE. One is level:raw the other is level:lev0 The series name is “egse_[hostname]” The level:raw consists of the .tlm and .qac file that is sent by the SSIM every minute. Its series number is a unique index number of seconds since 2000 The level:lev0 is a fitz file for a filtergram and an empty file giving the dataset name. The series number is the unique filtergram serial number (fsn) associated with evey filtergram hmi0:/PDS1/D46470> ls -l total 136 -rw-r--r production SOI Nov 1 12: fitz -rw-rw-r production SOI Nov 1 12:16 prog:hmi_ground,level:lev0[42],series:egse_hmi0[35]

14 Decode Image

15 EGSE Archiver csh> egsearc Usage: egsearc [ - v] [ d] [ q] [
a archive_dir] database_name v = verbose mode d = run in debug mode q = query only to see what's available for archive a = give the dir to cp the archived ds to the default archive_dir is /hmi0/archive Use /dev/null to not archive but make del pend Use /dev/mt to write to tape csh>

16 EGSE S/W Components

17 JSOC Service Structure

18 Test Schedule Milestones
Ground System Integration and Testing Tasks and Start Dates Delivery of First EGSE SDP /04/04 Testing with DDS Prototype 02/07/05 Delivery of Flight EGSE SDP 06/06/05 SOC Integration with MOC /27/06 Prototype Data Capture System Ready 06/05/06 GSRT#1- Telemetry and Command Test 06/19/06 AIA SOC White Sands Complex(WSC) 07/25/06 Production Data Capture System Ready 09/04/06 SOC Network Ready /01/06 DDS-SOC Testing /04/06 GSRT#2- Science Data Processing Test (Ka-band) 01/31/07 HMI Connectivity, Dataflow, Retransmissions Test 02/07/07 AIA Connectivity, Dataflow, Retransmissions Test 02/14/07 GSRT#3-Mission Operations& RF Communications Test 02/26/07 GSRT#4-Fully Integrate Ground System /26/07 Ground System Freeze 01/18/08 GSRT#4-Launch Readiness Test 02/01/08 Launch Site End-to-End Test 03/14/08

Download ppt "Science Data Capture Jim Aloise Nov , 2004 System Programmer"

Similar presentations

Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.

Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.
HMI - Page 1HMI Team Meeting – Jan 26, 2005 JSOC Implementation HMI Team Meeting 26 Jan 2005 Jim Aloise System Programmer

HMI - Page 1HMI Team Meeting – Jan 26, 2005 JSOC Implementation HMI Team Meeting 26 Jan 2005 Jim Aloise System Programmer
Page 1JSOC Peer Review – AIA Science Center – March 17, 2005 AIA Science Data Processing Infrastructure Neal Hurlburt AIA Data Scientist

Page 1JSOC Peer Review – AIA Science Center – March 17, 2005 AIA Science Data Processing Infrastructure Neal Hurlburt AIA Data Scientist
Page 1HMI/AIA Joint Sciemce Meeting – AIA Science Center – Feb 2006 AIA Visualization Center N. Hurlburt.

Page 1HMI/AIA Joint Sciemce Meeting – AIA Science Center – Feb 2006 AIA Visualization Center N. Hurlburt.
JSOC Overview - 1HMI/AIA Team Meeting – Feb 2006 JSOC Summary- Phil Scherrer Pipeline Processing - Rasmus Larsen Data Access - Rick Bogart Data Visualization.

JSOC Overview - 1HMI/AIA Team Meeting – Feb 2006 JSOC Summary- Phil Scherrer Pipeline Processing - Rasmus Larsen Data Access - Rick Bogart Data Visualization.
GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Aug. 14, 2001 Scott Williams 1 GLAST Large Area Telescope: Instrument Operations Center Scott.

GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Aug. 14, 2001 Scott Williams 1 GLAST Large Area Telescope: Instrument Operations Center Scott.
GLAST LAT ProjectOnline Peer Review – July 21, 2004 4.1.9 - Integration and Test J. Panetta 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope:

GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test J. Panetta 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope:
Page 1JSOC for SDO MOR October 2007 CARL (6)Level-0 Processing (b) HK Processing i. Hk Processing on HSB ii. RT HK Extraction Iii Dayfile HK Processing.

Page 1JSOC for SDO MOR October 2007 CARL (6)Level-0 Processing (b) HK Processing i. Hk Processing on HSB ii. RT HK Extraction Iii Dayfile HK Processing.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR-03213-01 Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.

GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.
Page 1HMI Team Meeting – January 26, 2005 HMI Mission Operations Rock Bush HMI Stanford Program Manager Stanford University

Page 1HMI Team Meeting – January 26, 2005 HMI Mission Operations Rock Bush HMI Stanford Program Manager Stanford University
25 September 2007eSDO and the VO, ADASS 2007Elizabeth Auden Accessing eSDO Solar Image Processing and Visualisation through AstroGrid Elizabeth Auden ADASS.

25 September 2007eSDO and the VO, ADASS 2007Elizabeth Auden Accessing eSDO Solar Image Processing and Visualisation through AstroGrid Elizabeth Auden ADASS.
JSOC Networks Stanford public net Stanford private net Private “g” net NASA Open IONet Private JSOC net Private IB net Private LMSAL link.

JSOC Networks Stanford public net Stanford private net Private “g” net NASA Open IONet Private JSOC net Private IB net Private LMSAL link.
March 2004 At A Glance ITOS is a highly configurable low-cost control and monitoring system. Benefits Extreme low cost Database driven - ITOS software.

March 2004 At A Glance ITOS is a highly configurable low-cost control and monitoring system. Benefits Extreme low cost Database driven - ITOS software.
Module 10 Configuring and Managing Storage Technologies.

Module 10 Configuring and Managing Storage Technologies.
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.

Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
CHIPSat Cosmic Hot Interstellar Plasma Spectrometer Spacecraft Julius-Maximilians-Universität Würzburg S: Telematik in der Raumfahrt Prof. Dr. Schilling.

CHIPSat Cosmic Hot Interstellar Plasma Spectrometer Spacecraft Julius-Maximilians-Universität Würzburg S: Telematik in der Raumfahrt Prof. Dr. Schilling.
Page No. 1 Kelvin Nichols Payload Operations and Integration Center EO50 Delay Tolerant Networking (DTN) Implementation on the International Space Station.

Page No. 1 Kelvin Nichols Payload Operations and Integration Center EO50 Delay Tolerant Networking (DTN) Implementation on the International Space Station.
ASI-Eumetsat Meeting Matera, 4-5 Feb 2009. CNM Context Matera, February 4-5, 20092ASI-Eumetsat Meeting.

ASI-Eumetsat Meeting Matera, 4-5 Feb CNM Context Matera, February 4-5, 20092ASI-Eumetsat Meeting.
ONE Concept. ONE Work area & lab setup ONE Goals Provide single network interface regardless of physical link Provide reliable, isochronous message transport.

ONE Concept. ONE Work area & lab setup ONE Goals Provide single network interface regardless of physical link Provide reliable, isochronous message transport.

Similar presentations

Ads by Google