MPS - Archive Structure

Slides:

Advertisements

Similar presentations

Patient information extraction in digitized X-ray imagery Hsien-Huang P. Wu Department of Electrical Engineering, National Yunlin University of Science.

Advertisements

1 Metadata Tools for JISC Digitisation Projects of still images and text Ed Fay BOPCRIS, Hartley Library University of Southampton.

Components of a Data Analysis System Scientific Drivers in the Design of an Analysis System.

Rosetta Magnetic Field PDS Review B. J. Anderson.

Rachel Klima (on behalf of the MASCS team) JHU/APL MASCS/VIRS Data Users’ Workshop LPSC 2014, The Woodlands, TX March 17,2014 MASCS/VIRS Data Record Structure.

Introduction to Cameras Jim Rasche Samba Danfa Jaya Joseph 1.

ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,

MetImage : Image Analysis Software. The MetImage LX workstation is a complete image analysis system developed specifically to increase the speed, accuracy.

WFDB / PhysioNet Formats George B. Moody Harvard-MIT Division of Health Sciences and Technology Cambridge, Massachusetts.

Tandridge Photographic Society Workshop on PhotoShop Elements presented by Nick Withers.

6e-1 Science Data Products Daryl Swade DMS Systems Engineer S&OC System Design Review #1.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.

Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.

Technology Choices for the JSTOR Online Archive Presented by Chang Feng Department of Computer Engineering and Computer Science, University of Missouri-Columbia,

CFR 250/590 Introduction to GIS, Autumn 1999 Data Conversion & Export © Phil Hurvitz, data_export.ppt 1 Overview Why export? Converting feature.

1. ARCHIVE (camera capture file) 2. MASTER (corrected & adjusted) 3. MR SID (wavelet compressed) 4. ‘LARGE’ (full-frame P’Point) 5. ‘SMALL’ (1/2 frame.

EOVSA Data and Database System Gordon Hurford and Jim McTiernan EOVSA Prototype Readiness Review 24-Sept-2012.

Inshore Image collection standards Purpose  Based of the growth in use of images, suggest ‘Standard Practices’ for discussion.  Adopt and recommend these.

WSL Workshop The Long and Winding Road to MODIS Data.

Headwall Instrument Overview Laboratory Characterizations Geo-Location Field Characterization Data Product Description References.

Page 1JSOC Peer Review 17Mar2005 HMI & AIA JSOC Architecture Science Team Forecast Centers EPO Public Catalog Primary Archive HMI & AIA Operations House-

HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.

All rights reserved © Altec ExoMars 2018 Rover Operations Control Centre Science instruments data pipeline G. Martucci.

Network Analyzer :- Introduction to Wireshark. What is Wireshark ? Ethereal Formerly known as Ethereal GUINetwork Protocol Analyzer Wireshark is a GUI.

Digital Packaging Processor - Overview Gordon Hurford Nov 7, 2011 EOVSA Technical Design Meeting - NJIT.

ISUAL Data Formats & Science Data Processing S. Geller.

1 Policy Discussion: Data Processing Levels PDS Management Council March 26, 2010 PDS 2010 Data Design WG.

Digital Media Lecture 0: It’s all just bits! Georgia Gwinnett College School of Science and Technology Dr. Jim Rowan.

Managing Digital Assets File Naming and Resizing.

THEMIS SOCScience Data Products − 1March 29, 2006 Science Data Products Timothy Quinn.

Chapter – 8 Software Tools.

Zou Ziming 1 Ma Wenzhen Li Lei Zhao Hua Wang Chi 1: Center for Space Science and Applied Research Chinese Academy of Sciences Moscow ·

1 German Aerospace Center HRSC Data Products Thomas Roatsch, DLR 22-May-2008.

Hayabusa data archive, format, and tools N. Hirata.

WEC meeting TED status and WEC timing.

PLASTIC Post Launch Data Flow Lynn Kistler & Lorna Ellis May 2006.

NASA Earth Science Data Stewardship

OSIRIS Solar System Simulator

28° ROSETTA SWT, Data Archiving Working Group, May 19, 2010

Calibration meeting summary

Max-Planck-Institut für Sonnensystemforschung

MPEG-4 Binary Information for Scenes (BIFS)

Stubbe F. Hviid OSIRIS Team Meeting November 2005

Eiger-Related Development at

OSIRIS Full Team Meeting Welcome, Introduction, Logistics

Topics Introduction Hardware and Software How Computers Store Data

OSIRIS Calibration Report (Lab Calibration)

Post-Operation Status: Archiving, Calibration & Science

Geometric information for VIRTIS-M data

OSIRIS flight calibrations so far

Calibration Pipeline.

EDI – CAA STATUS REPORT EDI CAA Status

Detlef Koschny Research and Scientific Support Department ESA/ESTEC

CAA-OR (End of Phase 1) CAA DWP Operations Review

3 Be able to repurpose and test a range of digital media assets

Multimedia: Digitised Sound Data

(Dectris Eiger) HDF5 Stream Writer

HDF5 format at European XFEL

Overview What is Multimedia? Characteristics of multimedia

VCI Overview Sonja Vrcic

ELECTRONIC MAIL SECURITY

ELECTRONIC MAIL SECURITY

Team 9 Our completed project will have the following:

Network Analyzer :- Introduction to Wireshark

COMS 161 Introduction to Computing

Current DAPS Status Observations

Current DAPS Status EUV contains 3.3 gb in observations

IPDA July 2013 CDF and PDS Todd King, Joseph Mafi, Steven Joy.

GESMES and SDMX-ML - Practical issues

Presentation transcript:

MPS - Archive Structure <Osiris Archive>/Spacecraft/fm <Mission phase> <Sub phase> <recorder> <logs> <tmi> <pds> <level 1> <level 2> <level 3> <uax> <shutter>

Filename structure <Camera>_<SCET>_ID<LEVEL><PID>_<ID>_F<FWM1><FWM2>.img <Camera> - NAC or WAC <SCET> - Acquisition time in UTC (YYYY-MM-DDTHH.MM.SS.SSSZ) <LEVEL> - CODMAC processing level <PID> - DPU Processing ID <ID> - User defined image ID (10 digits) FWM# - Filter Wheel position Example: WAC_2004-08-05T19.33.16.805Z_ID17_3080001004_F12.img

Filename structure 2 CODMAC Levels: Level 0: TMI formatted uncalibrated data (header un-calibrated – Non PDS - Decoded) Level 1: Raw PDS images (header calibrated – Image data in raw DN) Level 2: Radiometric calibrated PDS images (header calibrated – Image data in Wm-2sr-1nm-1) Level 3: Geometric calibrated PDS images (header calibrated – Image data in Wm-2sr-1nm-1 – Geometry Corrected)

Filename structure 3 PID: - Instance ID of image The DPU can transmit the same image in multiple formats 0: Raw 1: Raw 2x2 bin 2: Raw 4x4 bin 3: Raw 8x8 bin 7: Wavelet Compressed Image 8: Thumbnail image 9: Software rebinned image ID: - User defined image ID Numbering Convention: FFFUUUUIII FFF = FCP ID Number UUUU = User specified ID number III = Image index within FCP

EDR format PDS Images PDS formated labels with embedded image data Header human readable (in text editor) PDS compliant labels Same format as we need to deliver to the PDS imaging node in the end.

PDS - IDL Library An IDL library exists for handling the Osiris PDS files (Work in progress ) Syntax compatible with OsirSoft Can extract the various binary objects from the PDS files Delivers motion calibrated shutter pulse data Can modify and save PDS files OsirSoft function d_xxx() replaced by p_xxx() but with same syntax. Will accept OsirSoft header macros for header access

Osiris Data Flow - Overview Osiris MMB/IM Osiris Packetizer S/C SSMM S/C ESA Osiris GSEOS TM Decoder + Level 0 TMI generator ESOC SCOS 2000 archive DDS I/F TMI Level 0 to PDS level 1 converter (tmi2pds.exe) Level 1 to Level 2 converter (IDL Based) Level 2 to Level 3 converter (IDL Based) Science  Level 1 Archive Level 2 Archive Level 3 Archive

Calibration Pipeline Structure Level 0 -> Level 1 No image data conversion, but header data calibrated. Output in PDS format. Level 1 -> Level 2 Image data radiometric calibrated, but still with 1:1 pixel correlation to the raw data Level 2 -> Level 3 Image data geometrically calibrated. No longer 1:1 pixel correlation with raw data.