JSOC Overview - 1HMI/AIA Team Meeting – Feb 2006 JSOC Summary- Phil Scherrer Pipeline Processing - Rasmus Larsen Data Access - Rick Bogart Data Visualization.

Slides:



Advertisements
Similar presentations
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 27 September 2006 HELAS Workshop Nice.
Advertisements

STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center Phase E Kickoff Meeting February 23, 2007.
Page 1JSOC for SDO MOR October 2007 JSOC Status Review.
HMI - Page 1HMI Team Meeting – Jan 26, 2005 JSOC Implementation HMI Team Meeting 26 Jan 2005 Jim Aloise System Programmer
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
Page 1JSOC Peer Review – AIA Science Center – March 17, 2005 AIA Science Data Processing Infrastructure Neal Hurlburt AIA Data Scientist
Page 1HMI/AIA Joint Sciemce Meeting – AIA Science Center – Feb 2006 AIA Visualization Center N. Hurlburt.
HMI Data Access Jeneen Sommers September 8, /23/2015HMI Team Meeting, Stanford CA.
Page 1JSOC for SDO MOR October 2007 CARL (6)Level-0 Processing (b) HK Processing i. Hk Processing on HSB ii. RT HK Extraction Iii Dayfile HK Processing.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.
Page 1JSOC Review – 17 March 2005 HMI – AIA Joint Science Operations Center “Peer” Overview, 17 March AM HEPL Conference Room, Stanford Overview.
APPLICATION DEVELOPMENT BY SYED ADNAN ALI.
Page 1HMI Team Meeting – January 26-27, 2005 HMI Investigation Overview Philip Scherrer
SDO/AIA science plan: prioritization and implementation: Five Objectives in 10 steps [session no.] HMI/AIA science teams meeting; Monterey; Feb
Investigation Overview, Scherrer, Page 1SDO Science Writers Workshop – 16 Dec 2009 HMI Investigation Overview Philip Scherrer HMI Principal Investigator.
Page 1HMI Team Meeting – January 26, 2005 HMI Mission Operations Rock Bush HMI Stanford Program Manager Stanford University
25 September 2007eSDO and the VO, ADASS 2007Elizabeth Auden Accessing eSDO Solar Image Processing and Visualisation through AstroGrid Elizabeth Auden ADASS.
Advanced Technology Center 1 HMI Rasmus Larsen / Processing Modules Stanford University HMI Team Meeting – May 2003 Processing Module Development Rasmus.
Karen TianHMI/AIA Science Teams Meeting February 13-17, 2006 Virtual Solar Observatory VSO provides a unified view of data from diverse solar sources
March 2004 At A Glance ITOS is a highly configurable low-cost control and monitoring system. Benefits Extreme low cost Database driven - ITOS software.
STEREO Science Center SWG – Dec 2004 William Thompson NASA Goddard SFC Code Greenbelt, MD
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 21 September 2006 AHM 2006 Nottingham.
GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
SECCHI Consortium Meeting, July 2001 SECCHI Ground Data Systems and Data Processing Nathan Rich NRL/Interferometrics
OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Overview Michael Meisinger Life Cycle Architecture Review.
AIA Core-Team Meeting April 2009 JSOC Stuff Phil Scherrer.
Final Review of ITER PBS 45 CODAC – PART 1 – 14 th, 15 th and 16 th of January CadarachePage 1 FINAL DESIGN REVIEW OF ITER PBS 45 CODAC – PART 1.
What is the VSO? (and what isn’t it?). The VSO …  Allows you to search multiple archives in a single search  Keeps you from needing to keep track of.
Page 1LWS Teams Day JSOC Overview HMI-AIA Joint Science Operations Center Science Data Processing a.k.a. JSOC-SDP Overview.
Page 1GS CDR May 2005 JSOC SDP Agenda Significant Level 4 requirements SDP Architecture Decomposition –Datacapture System –Datacapture System Components.
Metadata Management of Terabyte Datasets from an IP Backbone Network: Experience and Challenges Sue B. Moon and Timothy Roscoe.
July 2010Cospar10 BremenSlide 1 SDO Data Access and Distribution in Europe and the WisSDOm Data Centre in ROB, Brussels Authors David Boyes, Benjamin Mampaey,
Page 1JSOC Peer Review 17Mar2005 HMI & AIA JSOC Architecture Science Team Forecast Centers EPO Public Catalog Primary Archive HMI & AIA Operations House-
Nov JWST Data Management Systems Gretchen Greene.
Page 1JSOC Peer Review 17Mar2005 HMI & AIA JSOC Architecture Science Team Forecast Centers EPO Public Catalog Primary Archive HMI & AIA Operations House-
Near Real-Time Verification At The Forecast Systems Laboratory: An Operational Perspective Michael P. Kay (CIRES/FSL/NOAA) Jennifer L. Mahoney (FSL/NOAA)
Page 1JSOC Overview August 2007 HMI Status HMI is virtually done. –Virtually  similar to but not in fact –Front window issue resolved, flight window now.
William Thompson L-3 Communications NASA Goddard Space Flight Center STERE The STEREO Science Center.
LaHave House Project 1 LaHave House Project Automated Architectural Design BML + ARC.
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Heliophysics Projects Division SDO Flight Operations Readiness Review (FORR) July 21-22, 2009 SOC Operations Readiness HMI-AIA JSOC Science Data.
Page 1SDO Teams Meeting, March 2008 Status and Overview of HMI–AIA Joint Science Operations Center (JSOC) Science Data Processing (SDP) P. Scherrer Science.
Page 1JSOC Review – 17 March 2005 JSOC 17 March 2005 “Peer” Review Stanford SDP Development Plan Philip Scherrer
ESDO: UK Access to the Solar Dynamics Observatory 1. Mullard Space Science Laboratory, University College London. Holmbury St. Mary, Dorking, Surrey SM2.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Monitoring and Information Services Core Infrastructure (MIS-CI) Service Description Mark L. Green OSG Integration Workshop at UC Feb 15-17, 2005.
Science Gateway- 13 th May Science Gateway Use Cases/Interfaces D. Sanchez, N. Neyroud.
Architecture Review 10/11/2004
AGENDA JSOC-SDP Overview JSOC-SDP Status (H/W, S/W)
WP18, High-speed data recording Krzysztof Wrona, European XFEL
JSOC Status at SDO PSR-1 January 21-22, 2009 GSFC
Code Generation from SEDS
Existing Perl/Oracle Pipeline
DSP Operation Management Center (DOMC)
HMI JSOC Science Data Processing Art Amezcua
Current SOC-Ground System Integration Schedule (Jan )
HMI Science Investigation Overview
HMI/AIA Joint Science Operations Center (JSOC) Design
JDAT Production Hardware
Status and Overview of HMI–AIA Joint Science Operations Center (JSOC) Science Data Processing (SDP) April 22, 2008 P. Scherrer.
GSRT Critical Design Peer Review
Jim Aloise System Programmer
GLAST Large Area Telescope
Launch and On-orbit Checkout
JSOC Pipeline Processing System Components
Technology for a NASA Space-based Science Operations Grid Internet2 Members Meeting Advanced Applications Track Session April, 2003 Robert N. Bradford.
Science Data Capture Jim Aloise Nov , 2004 System Programmer
HMI – AIA Joint Science Operations Center “Peer” Overview, 17 March AM HEPL Conference Room, Stanford Overview of JSOC Parts (Phil, 5 min.) JSOC.
Presentation transcript:

JSOC Overview - 1HMI/AIA Team Meeting – Feb 2006 JSOC Summary- Phil Scherrer Pipeline Processing - Rasmus Larsen Data Access - Rick Bogart Data Visualization - Neal Hurlburt JSOC Overview

JSOC Overview - 2HMI/AIA Team Meeting – Feb 2006 JSOC Scope The HMI/AIA Joint SOC consists of two parts: –Science Data Processing (SDP) – at Stanford and LMSAL –Joint Operations Center (JOC) – at LMSAL JSOC JOC includes: –HMI and AIA Commanding and Health Monitoring –HMI and AIA Engineering support as needed JSOC SDP includes: –HMI and AIA Telemetry Data capture (from DDS) and archive –HMI and AIA Level-0 processing and archive –HMI processing through to level-2 with archiving of end products –AIA processing through level-1a with online archive at Stanford –AIA level-2 processing at LMSAL –Data export of the above and other HMI and AIA products as needed JSOC does not include tasks such as: –Science analysis beyond level-2 products –HMI and AIA EPO –HMI & AIA Co-I science support

JSOC Overview - 3HMI/AIA Team Meeting – Feb 2006 SDO Ground System Architecture 10/21/03

JSOC Overview - 4HMI/AIA Team Meeting – Feb 2006 HMI & AIA JSOC Architecture Redun dant Data Captur e System AIA HMI 30-Day Archive Science Team Forecast Centers EPO Public Catalog Primary Archive HMI & AIA Operations House- keeping Database Offsite Archiv e Offline Archiv e JSOC Pipeline Processing System HMI/AIA Level-0, 1, HMI-level2 Data Export & Web Service Stanford LMSAL High-Level Data Import AIA Analysis System Local Archive Quicklook Viewing MOC DDS housekeeping GSFC White Sands World

JSOC Overview - 5HMI/AIA Team Meeting – Feb 2006 JSOC Data Requirements

JSOC Overview - 6HMI/AIA Team Meeting – Feb 2006 JSOC Systems

JSOC Overview - 7HMI/AIA Team Meeting – Feb 2006 Operations HW Architecture HMIQL QL image display Planning Analysis SPAREOPS1 SPAREOPS2 SPARE EGSE Dedicated T1/FT1 Lines (redundant pair) External network Tlm RT HK PBK HK Cmd socket 1 Tlm socket 1Tlm socket 2 DDS OC3 Lines SDP QL image production StanfordUniversity HMI & AIA Web Server (PC or Sun) HMI LMSAL EGSE HMIOPS1 (Sun) HMIOPS2 (Sun) AIA LMSAL EGSE AIAOPS1 (Sun) AIAOPS2 (Sun) Tlm socket 2 Cmd socket 1 Tlm socket 1 HMIOPS3 LMSAL EGSE LMSAL (Room in B. 252 ) AIAQL QL image display Planning Analysis AIAOPS3 LMSAL EGSE Cmds Cmd logs Tlm RT HK PBK HK Cmd logs Tlm RT HK PBK HK MOC (GSFC) DDS Routers (WSC)

JSOC Overview - 8HMI/AIA Team Meeting – Feb 2006 JSOC Pipeline Processing System Components Database Server SUMS Storage Unit Management System DRMS Data Record Management System SUMS Tape Farm SUMS Disks Pipeline Program, “module” Record Manage ment Keyword Access Data Access DRMS Library Link Manage ment Utility Libraries JSOC Science Libraries Record Cache PUI Pipeline User Interface Pipeline processing plan Processing script, “mapfile” List of pipeline modules with needed datasets for input, output Pipeline Operato r Processing History Log

JSOC Overview - 9HMI/AIA Team Meeting – Feb 2006 HMI Processing Pipeline and Standard Products

JSOC Overview - 10HMI/AIA Team Meeting – Feb 2006 JSOC Data Export System DRMS Package Format Custom Keywords Utilities Selecte d Data Records API Drilldown Overview New/Avail Statistics Keywords Range Search Browse Researcher A General Public Grid Adaptor Grid VSO Adaptor VSO CoSEC CoSEC Adaptor Researcher B Script Access Space Weather VSO – Virtual Solar Observatory DRMS – Data Record Mgmt Sys

JSOC Overview - 11HMI/AIA Team Meeting – Feb 2006 JSOC SDP Development Milestones HMI and AIA Data EGSE installed –Prototype for I/F testing with GSMarch 2005 –Version 2 to support flight inst.June 2005 JSOC Capture System –Purchase computersFall 2006 –Final system installedSpring 2007 –Support DDS testingSummer 2007 JSOC SDP Infrastructure, SUMS, DRMS, PUI –Prototype testing of core systemJune 2005 –Fully functionalJan, 2006 Purchase computers for JSOC Spring, 2007 Infrastructure OperationalSummer, 2007 Data Product ModulesSpring, 2008 Test in I&T and with DDS,MOC as called for in SDO Ground System schedule

JSOC Overview - 12HMI/AIA Team Meeting – Feb 2006 CY05 Launch Ground System Readiness Testing DDS to SOCs Science I/F Tests T&C GSRT #1 4/06-04/07 CY06CY07 CY08 MOC to SOCs T/C I/F Tests Element Acceptance Testing CTVE-T-E GSRT #4 8/07-4/08 Launch Site GSRT #5 4-6/08 SCI GSRT #2 1/07-04/08 RF GSRT #3 3-12/07 CTV72 Day E-T-E Performance Test 2-4/08 REL #1 AT Complete 12/05 REL #2 AT Complete 6/06 REL #3 AT Complete 12/06 REL #4 AT Complete 10/07 EVE 6-9/06 HMI 2-3/07 AIA 3-4/07 SDO Testing Timeline Support needed from SOC(s) All actual dates and test durations are included in the SDO Project Schedule EVE 2-9/07 HMI 07-08/07 AIA 8-9/07

JSOC Overview - 13HMI/AIA Team Meeting – Feb 2006 JSOC SDP Development Plan