3/3/20021 HRD In-Situ Ground System Bridging Technologies Between EOS, NPP and the Future International TOVS Study Conference - XII PI: Patrick Coronado Code 935/Applied Information Sciences Branch Presented by: Gail Reichert Code 935 /Applied Information Sciences Branch

3/3/20022 Who? NPP Direct Readout Lab (DRL) We are the NPP In-Situ Ground System element. As part of the NPP, our job is to design & prototype a Direct Readout Ground System, which will –Serve as an advanced technology test bed –Act as a compatibility test unit for pre-launch spacecraft (e.g., NPP) –Be back compatible with EOS spacecrafts and instruments

3/3/20023 The Problem More satellites more complex instruments + larger more complex data sets more complex processing requirements ++ = big headache (!) for general users Our Goals: DesignDevelopIntegrateTest Hardware/Software technologies needed to acquire/process DB data Make available via release to public domain technology transfer Overall : Be a bridge between satellite missions (Terra, Aqua, NPP…) & general user community & “Pave the road” to NPP Mission

3/3/20024 Real-Time Software Telemetry Processing System (RTSTPS) Outline Real-Time Instrument Data Streaming (Simulcasting) Mobile NISGS: Advanced Technology Test Bed –Phase 1: Land-going Web site for distribution of software algorithms –Level 0 (RTSTPS) + other protocol processing –MODIS Level 1 (geolocation & calibration) –Institutional & DB Level 2 NPP ESTO Portal for Science, Technology and Environmental Research (NEpster) –Phase 1: Level 0 & Level 1 data * Charts with asterisks next to their page numbers signify pages with supplemental information. *

3/3/20025 Direct Readout Roadmap to NPP POES/DMSP/SeaStar TerraAqua AVHRR SeaWiFS OLS MODIS AIRS AMSU HSB NPP VIIRS CrIS ATMS Evolution of Concurrent Ground System Supporting Technologies and Algorithm Development Standardization & Increasing RF, Modulation & Bandwidth Requirements S/C & Instrument Evolution Custom Frame Formatters & Ingest software Analog Custom Receivers NOAA Level1B (AVHRR) Limited Data Distribution mechanisms L,S-band Mbps Bi-Phase L X-band 13.1Mbps Viterbi OQPSK X-band 15Mbps OQPSK NRZM X-band 15Mbps QPSK NRZM Viterbi Compression S/C specific STPS Level-0 Return Link Processor Analog Configurable Receiver MODIS Level-1 DAAC & MODIS Simulcast Reconfigurable RT-STPS Return Link Processor Digital re-Configurable Receiver MODIS & AIRS Level-1 DAAC & NEpster with L0 & L1 data Reconfigurable RT-STPS Digital re-Configurable Receiver (PC-based) ALL Instru. Level-1 Software DAAC & NEpster with L0, L1 & EDRs Simulcast of all Instruments Now

3/3/20026 Standalone processing software system Real-Time Software Telemetry Processing System Takes raw satellite data stream from receiver & processes to EOS Level-0 in real time: –Synchronizes frames (CCSDS version 2) –Applies Reed-Solomon error detection and correction –Reassembles packets into 1+ Level 0 format data files (by SCID, VCID &/or APID) Written in Java (runs on any computer with JRE 1.3+) Modular design, easy to reconfigure –Processing modules linked by data pathways as set in configuration file –Interactive control via graphical application viewer Runs in batch &/or server mode *

3/3/20027 Multi-threaded server: –Runs continuously –1st thread listens for TCP/IP packets (unsynchronized telemetry) – 2nd thread listens for user commands (load, shut down, get status info) RTSTPS Major Components Graphical application viewer –Runs on remote computer or user’s local machine –Sends load & shutdown commands –Updates & displays status info Web viewer (planned) –Connected to STPS server, shows status info Graphical editor (under development) –Users may create/edit configuration files –Config files may be on user's or server's computer *

3/3/20028 Real-Time STPS Context Raw Telemetry FramesCADUsVCDUsB_PDUsPackets Frame Synchronizer RS/CRC/PN Decoders CCSDS Services CORE Acquisition Board SERVER Network Ports Viewer Editor Setup Files StatusSetup Remote User Interfaces Web Status see

3/3/20029 Real-Time STPS versus STPS RTSTPSSTPS written in JavaC speed as fast or faster reconfigurable Yes (most CCSDS compliant s/c) Not easily interface Java toolsimple text create PDS “on the fly”? YesNo process AQUA data? YesNo sort by time? NoYes remove duplicate packets? NoYes detect VCDU header errors ? NoYes handle NRZ-L/NRZ-M correction? next releaseYes *

3/3/ Simulcasting Rate Buffer Level-0 Ingest Computer (PC/NT) Real-Time Server Real-Time Clients Realtime Flow Low Rate Flow Receiver Products Purpose: Distribute & visualize DB data in real time Current System: Prototype, tested using Terra MODIS data Planned: Multi-mission, multi-instrument see

3/3/ Web site: Distribution of Software Algorithms Currently available in standalone mode: –Level 0 (RTSTPS) + other protocol processing (STPS, Sorcerer, MODIS band extractor, DPREP) –MODIS Level 1: DAAC, IMAPP (offsite), winIMAPP (offsite) –MODIS Fire Detection (Level 2) –NEpster interface (NOI) –Simulcasting Server/Client Soon to be available: –MODIS NDVI (Level 2) –Level 1, Fire Map, NDVI Viewers Planned: –Institutional Level-2 algorithms (by Institution, not converted to standalone mode) –MODIS BRDF converted to standalone mode, with lessons learned

3/3/ Distribution of Software Algorithms (continued) To download any DRL-provided algorithm, user must fill out User Account Form (for authentication purposes only) To download any software algorithm, user must electronically sign software disclosure form for each algorithm –Member LogIn Page –Only have to sign form for each algorithm once Algorithms for Future Missions: With Terra (& Aqua), we are “ paving the road ” to NPP in terms of –Conversion of institutional algorithms to DB standalone mode –Algorithm & product staging –Distribution & version management *

3/3/ Algorithms for Future Missions (continued) Don ’ t miss the following poster: “Weather and Climate Information Available from EOS and NPP Direct Broadcasts”, J. Dodge (NASA) Highlights algorithm & product roadmap from EOS spacecrafts to NPP: –MODIS As Real Time Camera - vegetation, coastal conditions, flooding, fires, weather phenomena, … –New Sensor Data For AQUA DB –AIRS Temperature/Moisture Soundings –AMSR-E Over US To Be Available –Some Potential New Uses For AQUA Data –NPP Data Products *

3/3/ NPP ESTO Portal … (NEpster) Impetus: Unprecedented requirements for –(for DB) Geographically dispersed collection –Complex processing –Very large data volumes (for NPP Level 0 estimate 1 Gbyte/day/site) Concept: –Virtually connected network of data archive systems that share & exchange remote sensing data –Peer-to-peer architecture –Borrows from Napster, but relevant to other science areas as well (Particle Physics, Medical Imaging, Astronomy…) Will be developed in 2 phases *

3/3/ NEpster Phase I RODIN (metadata) NOI Metadata Extractor Broker Peer-to-peer data sharing Temporary staging archive see

3/3/ Nepster Phase I (continued) Metadata Extractor: –Automated, runs at DRL and remote archive sites –Extracts metadata as new data is collected –(or: remote site may choose to have regular downloads via ftp) Intelligent Broker: –Maps extracted metadata to RODIN database –Resolves remote site policies (transparent to user) Components: RODIN: Direct Readout Lab database (MYSQL) –Stores extracted metadata –Allows searches on metadata fields (e.g., time, geolocation station) Nepster Observation Interface (NOI): –Web-based data search interface Temporary Staging Archive: –Stages remote data at DRL for possible future requests –Convenient for remote sites with narrow “ pipes ” *

3/3/ NEpster Phase II Provides: Real-Time notification of data acquisition at a remote site A web-based query mechanism for all participating acquisition sites and data repositories A temporary archive for remote sites with limited bandwidth Automatic routing between the user and data source DAAC “deep” archive Real Time “Deep” archive metadata store *

3/3/ See gov/projects/mobile_nisgs/mobile_nisgs.htm 1. Advanced technology testbed 2. Compatibility test unit for pre-launch spacecraft Will act as: 1. RTSTPS 2. Simulcasting 3. NEpster Will include: Mobile NISGS