1. JSOC Pipeline Processing System Components
Pipeline Program, “module”
Record Management
Keyword Access
Data Access
DRMS Library
Link Management
Utility Libraries
JSOC Science Libraries
Record Cache
Pipeline processing plan
Pipeline Operator
SUMS Disks
Processing script, “mapfile”
List of pipeline modules with needed datasets for input, output
PUI
Pipeline User Interface
SUMS
Storage Unit
Management System
DRMS
Data Record
Management System
SUMS Tape Farm
Processing History Log
Database Server

2. Storage Unit Management Sybsystem (SUMS) API
SUM *SUM_open(char *dbname)
Start a session with the SUMS
int SUM_close(SUM *sum)
End a session with the SUMS
int SUM_alloc(SUM *sum)
Allocate a storage unit on the disks
int SUM_get(SUM *sum)
Get the requested storage units
int SUM_put(SUM *sum)
Put a previously allocated storage unit
int SUM_poll(SUM *sum)
Check if a previous request is complete
int SUM_wait(SUM *sum)
Wait until previous request is complete

3. SUM_get() API Call Sequence

4. HMI Dataset Sequence tlm packets filtergrams observables tlm lev1 lev0
Ancillary
Data
tlm packets
filtergrams
observables
HMI
55Mbs
camera
n:m
n:1
& hk data
32MB
32MB
~1700
Image
Image
bytes HK
tlm
lev1
lev0
/home/jim/soffice/user/work/dataset_seq3.sxd

5. Pipeline User Interface (PUI) Block Diagram
PUI GUI
Data Product
Plan Table
Data Query
Map Building
Scripts
Map Execution
pui_svc
pipeline
execution
Oracle DB

6. Pipeline User Interface (PUI)

7. Pipeline User Interface (PUI)

8. Pipeline User Interface (PUI)

9. Pipeline User Interface (PUI)

10. Pipeline User Interface (PUI)

11. HK Data Flow DDS MOC Science SOC T & C SOC WSC GSFC Stanford Lockheed
FDS/PLANNING
MOC
daily LR APID
ftp
realtime LR APID
socket
ftp
realtime
HR APID
realtime
LR APID
daily LR
FDS/PLAN
Stanford
Lockheed
Science SOC
T & C SOC
HK Definition
Tables
HK Keyword DB

12. CM with CVS