Nov 26 2012 JWST Data Management Systems Gretchen Greene.

Slides:



Advertisements
Similar presentations
CASDA Project Management A presentation to the CASDA Preliminary Design Review IM&T / CASS Dan Miller | CASDA Project Manager 11 March 2014.
Advertisements

Dec 2, 2014 The HST Online Cache: Changes to the User Experience Karen Levay Faith Abney Mark Kyprianou.
School of Engineering & Technology Computer Architecture Pipeline.
HP Quality Center Overview.
Mission Engineering and Science Analysis (MESA) Jeff Valenti What is MESA?
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
User Office Status Overview Elder Matias Canadian Light Source.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
Coda file system: Disconnected operation By Wallis Chau May 7, 2003.
JSOC Overview - 1HMI/AIA Team Meeting – Feb 2006 JSOC Summary- Phil Scherrer Pipeline Processing - Rasmus Larsen Data Access - Rick Bogart Data Visualization.
NGAO Management Update Peter Wizinowich NGAO Meeting #11 November 5, 2007.
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
MIRI software; implementation plan Peter Roelfsema.
NASA Goddard Space Flight Center Direct Readout Laboratory NPP/JPSS HRD/LRD Status Patrick Coronado NASA Goddard Space Flight Center directreadout.sci.gsfc.nasa.gov/ipopp.
STEREO Science Center SWG – Dec 2004 William Thompson NASA Goddard SFC Code Greenbelt, MD
Nov Introduction and Highlights Rick White Karen Levay.
Upcoming Enhancements to the HST Archive Mark Kyprianou Operations and Engineering Division Data System Branch.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Transiting Exoplanet Survey Satellite Daryl Swade September 24, 2014 TESS DMS Management Meeting.
RUP Fundamentals - Instructor Notes
6e-1 Science Data Products Daryl Swade DMS Systems Engineer S&OC System Design Review #1.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
DMS Systems Design Review 3
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Dec 2, 2014 MAST Data Discovery Portal Tom Donaldson Tony Rogers.
Transiting Exoplanet Survey Satellite Daryl Swade Archive Peer Review June 18, 2014.
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
2-1 DMS Requirements Status Daryl Swade DMS Systems Engineer Nov. 6, 2013 S&OC Data Management System Design Review 3.
Implementation Review1 Deriving Architecture Requirements March 14, 2003.
Mars 2020 Project Matt Wallace Deputy Project Manager August 3, 2015.
CAPACITY Operational Atmospheric Chemistry Monitoring Missions CAPACITY Final Meeting - WP Ground Segment synthesis Final Meeting ESTEC02/06/05.
1 Description and Benefits of JWST Commanding Operations Concept TIPS/JIM Meeting 17 July 2003 Vicki Balzano.
Nov HST Data Processing Operations and Engineering Division Data Systems Branch Mark Kyprianou.
APT Standard Target Name Agenda: History of APT Standard Target Name PR DMS Level 3 Data File Names SANTA: MAST Name Resolver Pros/Cons of adding Standard.
OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Overview Michael Meisinger Life Cycle Architecture Review.
Global Forest Observations Initiative Methods and Guidance Portal SDCG – Oslo – 24 th October 2014.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
CRISP & SKA WP19 Status. Overview Staffing SKA Preconstruction phase Tiered Data Delivery Infrastructure Prototype deployment.
European New HST & MMI Demo Nacho León María Arévalo Jonas Haase Jesús Salgado Deborah Baines Bruno Merín ESAC 20 January 2015.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
21-1 MAVEN IPSR October 30,31, 2012 Particles and Fields Package Pre-Ship Review October 30,31, : Flight Software Peter R Harvey Mars Atmosphere.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)
Swift HUG April Swift data archive Lorella Angelini HEASARC.
1 JWST Functional Flow Diagrams and Schematic Block Diagrams.
PDS M/C August 2012 PPI Node Report PDS Management Council August 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi.
NASA/Air Force Cost Model presented by Keith Smith Science Applications International Corporation 2002 SCEA National Conference June
1 Space Telescope Science Institute JWST S&OC JWST S&OC Contract Peter Stockman TIPS March 20, 2003.
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
National Archives and Records Administration Status of the ERA Project RACO Chicago Meg Phillips August 24, 2010.
PDS Geosciences Node Page 1 Archive Status MRO and Phoenix Ed Guinness PDS Management Council August 13, 2007 Ed Guinness.
JWST PRDS Project Mangement Case Study Jesse Doggett Project Engineer, ITEB/OED.
1 Transiting Exoplanet Survey Satellite Daryl Swade Archive Team Meeting June 16, 2014.
Transiting Exoplanet Survey Satellite December 8, 2014 TESS Kickoff.
An Early Release Science Program Janice C. Lee STScI Science Mission Office JWST Science Working Group Meeting 29 April 2015.
Tracing the JWST Proposal from User Interface to Commanding of an Instrument Margaret Meixner & WIT Balzano, Robinson & CMD.
Implementation Review1 Archive Ingest Redesign March 14, 2003.
TERRA UPDATE Launch Date NSIDC DAAC Launch Readiness MODIS Snow and Ice Products General Product Release Timeline.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
23-Nov-1999STScI Projects Monthly Status Review1 of 8 SpaceTelescopeScienceInstitute COS Status Report for period December, 1998 to November, 1999 Tony.
1 Future Directions in HST Data Processing 19 November 2004.
DSN CCSDS SLE SM Prototype Plan Erik Barkley December 2006.
Software Architecture Architecture represents different things from use cases –Use cases deal primarily with functional properties –Architecture deals.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
HST Spectroscopic Legacy Working Group Areas for Recommended Work in FY2014 and Beyond Meeting 26 Jun 2013.
Joseph JaJa, Mike Smorul, and Sangchul Song
Ground Segment for WSO/UV
COMPASS Database SPACE TELESCOPE SCIENCE INSTITUTE Gretchen Greene
Iowa College Aid Processing System (ICAPS)
Presentation transcript:

Nov JWST Data Management Systems Gretchen Greene

Nov JWST Mission Hierarchy for DMS

Nov DMS Estimated Archived Data Volumes – Baseline DataPer Yr (TB) 5.5 yr Mission (TB) 10 yr Mission (TB) Recorded engineering Level Level-1a Level-1b Level-2a (compressed 2:1) Level-2b (compressed 2:1) Level-3 (compressed 2:1) WSS Archive package (compressed 2:1) Total

Nov JWST DMS Interface Context Project Level Agreements will be defined ~L-24mo Dec

Nov JWST vs. HST DMS… Many Similarities, systems reuse (DADS, MAST), and lessons learned, however there are… Key Basic Differences: – Order of magnitude increase in computational and I/O DMS throughputs – Flight Operations System interfaces to DMS will support direct transfer at STScI of DSN telemetry data and require priority data processing for Wavefront Sensing and Control Functional Decisions: – As a result of Trade Studies, BOTH HST and JWST will be moving toward scalable distributed architecture Data Processing Workflow Management system (OWL-CONDOR) Dynamic Reprocessing of Data Products with CRDS Online Data Product File CACHE – Higher Level data product generation assumed fundamental – Service based architecture to support multi-mission DMS

Nov MAST + JWST STScI Archive Access systems include the intersection between the JWST mission operations & MAST – Distribution Services – Archive User Interface (MAST Portal) – User Authentication – Archive Catalog (CAOM) – Online Data Product Cache

Nov Multi mission Functional Architecture Overview – SDR1

Nov JWST SOC DMS Requirements and Design Phases Completed formal Systems Level 4 Requirements – ~ 650 requirements for I&T verification Beginning DMS I&T for internal Build 1 Currently in year 2+ of design and development – Systems Design Review 2 – Dec 6-7, ’12 Designing for Launch Readiness Data (LRD) 2018 with 95% level of current STScI DMS capability

Nov S&OC Science Systems Engineering, Flight Operations, and Systems Development Timeline for a JWST 2018 LRD

Nov DMS Build Plan Build Name Build Description Components enabled Supported Systems Targeted Delivery Status 0 Internal Build Workflow Manager, Minimal Ramp Processing Pipeline, SID DMS Design & Development Dec-11Completed 1 DMS Level 1 Internal I&T DMS Workflow, Baseline Level- 2a Pipeline, Baseline Level-2b Imaging Pipeline, CRDS, SID, Baseline SDP-1a DMS, ISIM CV1RR Sept-12In Test 2 DMS I&T ISIM Cryo 2 (OSIM) DMS SDP WFS&C, Baseline WSS Pipeline, Baseline Level-2b Spectrographic Pipeline, SID, Baseline SDP-1b DMS, ISIM Cryo 2 Sept-13In Dev 3 DMS I&T ISIM Cryo 3 (OSIM) DMS - All SIs SDP, Baseline Operations Archive, Baseline Level-3 Imaging Pipeline, SID DMS, ISIM Cryo 3 (?) Sept-14 4 DMS I&T SOC Integration DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic SOC with DMS internal Sept-15 5 DMS I&T JSC/OTIS DMS, CAL, SDP, EDP, CRDS, Baseline Archive Access, Baseline Level-3 Spectrographic Pipeline, SID SOC1,DMS, JSC/OTIS Testing June-16 6 DMS CST2&3 + Flight Release Fully Functional DMS SOC2,DMS Flight Release Feb-17 (test cycle +L-12) 6.1 DMS Pre-Flight Updates Fully Functional DMS Updates SOC Pre-Flight Updates Jan-18