DADS Ingest and Distribution Support for WFC3 Daryl Swade

Slides:



Advertisements
Similar presentations
Kongsberg Spacetec AS Archiving Activities and Solutions CEOS WGISS-ATT May
Advertisements

TV CONTENT CREATION MULTIFACETED DEVELOPMENTS J K CHANDIRA DOORDARSHAN.
Dec 2, 2014 The HST Online Cache: Changes to the User Experience Karen Levay Faith Abney Mark Kyprianou.
CP1610: Introduction to Computer Components Archival Storage Devices.
1 HST Pipeline Project Review March 14, Review Objectives Re-familiarize Project (and others) with production data processing done by STScI Familiarize.
CIS 240 Introduction to UNIX Instructor: Sue Sampson.
Management is not a Natural Act Megan Winget - Co-Project Manager Managing the Digital University Desktop: Introduction and Preliminary Findings.
Implementation Review1 Moving Archive Data to the EMC Storage Array March 14, 2003 Faith Abney.
Linux+ Guide to Linux Certification Chapter 12 Compression, System Backup, and Software Installation.
Linux+ Guide to Linux Certification, Third Edition Chapter 11 Compression, System Backup, and Software Installation.
Hardware and Software Basics. Computer Hardware  Central Processing Unit - also called “The Chip”, a CPU, a processor, or a microprocessor  Memory (RAM)
What is Data Storage? ‘Storing’ data, we mean putting the data in a known place. ‘ Writing ’ data or ‘ saving ’ data are other ways of saying ‘storing’
Hubble Legacy Archive Lee Quick - TIPS meeting July 19, 2012 Goals Data History Current Work Demo.
Chapter 11 Compression, System Backup, and Software Installation.
Upcoming Enhancements to the HST Archive Mark Kyprianou Operations and Engineering Division Data System Branch.
Linux+ Guide to Linux Certification
Offline File Storage. Module 12 Offline File Storage ♦ Introduction Backup is usually done by first collecting all the data in a single archive file,
Transiting Exoplanet Survey Satellite Daryl Swade September 24, 2014 TESS DMS Management Meeting.
Changing the culture: Ethiopia’s commitment to dissemination and the multi-media approach By Yakob Mudesir Seid
Submitting data to (and getting data from!) BODC Adam Leadbetter British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool.
6e-1 Science Data Products Daryl Swade DMS Systems Engineer S&OC System Design Review #1.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Transiting Exoplanet Survey Satellite Daryl Swade Archive Peer Review June 18, 2014.
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
2-1 DMS Requirements Status Daryl Swade DMS Systems Engineer Nov. 6, 2013 S&OC Data Management System Design Review 3.
Implementation Review1 Deriving Architecture Requirements March 14, 2003.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
DDN & iRODS at ICBR By Alex Oumantsev History of ICBR  Campus wide Interdisciplinary Center for Biotechnology Research  Core Facility  Funded by the.
Introduction to the ESA Planetary Science Archive  Jose Luis Vázquez (ESAC/ESA)  Dave Heather (ESTEC/ESA)  Joe Zender (ESTEC/ESA)
COS PIPELINE PDR Daryl Swade December 7, 2000OPUS / OTFR Space Telescope Science Institute 1 of 24 Science Data Processing
Sharing Spatially-Organized Urban Data via University Library Databases. Dowell Myers School of Policy,
Major League Baseball Archive. MLB Archives 150,000 Hours of Legacy Material Migrated to BetaSX from older formats Dates back to the 1900’s!
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA WFC3 and StarView
Swift HUG April Swift data archive Lorella Angelini HEASARC.
Start Typical student project Advanced student project Level of final response.
RAINEX Data Management UCAR Joint Office for Science Support José Meitín Jim Moore Dick Dirks UCAR Joint Office for Science Support José Meitín Jim Moore.
Data Management Planning Session Kevin Gomes Michael Meisinger Arcot Rajasekar Michael Wan October 19, 2007.
29 Nov 2006PDS MC NSSDC MOU history PDS-NSSDC MOU circa 1994 Reviewed in Jan 2003, June 2004, Oct 2005, Nov 2006 Add words to remove HQ changes Change.
Chapter 4 File Basics. 2Practical PC 5 th Edition Chapter 4 Getting Started In this Chapter, you will learn: − What is a file − How to save a file − How.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan Florida Center for Library Automation (FCLA)
An HDF-EOS Data Server Based on OPeNDAP and ECHO Bob Bane, Mohammad Rabi, Weijun Su, Richard Ullman, Jingli Yang, Zhangshi Yin Data Usability Group, NASA/GSFC.
Transiting Exoplanet Survey Satellite December 8, 2014 TESS Kickoff.
3 Storage devices and media Backing store devices.
Software in the Data Protector Architecture
WFC3 PIPELINE CDR Jim Rose October 16, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 13 Science Data Processing
Storage devices 1. Storage Storage device : stores data and programs permanently its retained after the power is turned off. The most common type of storage.
Implementation Review1 Archive Ingest Redesign March 14, 2003.
COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 1 of 14 Keywords and Associations.
Distributed Archives Interoperability Cynthia Y. Cheung NASA Goddard Space Flight Center IAU 2000 Commission 5 Manchester, UK August 12, 2000.
Faculty meeting - 13 Dec 2006 The Hubble Legacy Archive Harald Kuntschner & ST-ECF staff 13 December 2006.
Preservation Functionality in a Digital Archive Erik Oltmans Koninklijke Bibliotheek Raymond J. van Diessen IBM Business Consulting Services Hilde van.
Copyright Prentice Hall, Inc. 1 Computers: Information Technology in Perspective, 11e Larry Long and Nancy Long Chapter 5 Storing and Retrieving Information.
HST and JWST Pipelines and Reference Files
The Hubble Legacy Archive (HLA) Slitless Spectroscopy Project
DMG internal tools currently in use and plans to ingest requirements to ICT deliverables E. Villard.
Hollywood Post Alliance
Chapter 7 Installing Program &Backup Tool
Product Retrieval Statistics Canada / Statistique Canada Title page
Big Brother Production
File Formats File Name Conventions File Contents File Sizes
Video Retention and Metadata Guidelines CIO Council Update
التأهيل التربوي المملكة العربية السعودية جامعة الملك عبدالعزيز
The Linux Command Line Chapter 18
Overview - UIS Retention Dataset System (RDS)
The New Face of Information Retrieval: The Ankara University Open Access Platform Prof. Dr. Sekine Karakaş Prof. Dr. Doğan.
WFC3 Pipeline Critical Design Review October 16, 2001
Data Systems Environment at SM4
Social Research Methodology and Supplementary Documentation John Kallas University of the Aegean, Department of Sociology.
Robin Dale RLG OAIS Functionality Robin Dale RLG
Discussion on intermediate data storage for inter-calibration activities Prepared by S. Wagner.
Presentation transcript:

DADS Ingest and Distribution Support for WFC3 Daryl Swade

DADS Ingest and Distribution for WFC3 WFC3 support in DADS will be based on the redesigned ingest and distribution system. Processing will be on UNIX platforms – no VMS. No changes to the OPUS/DADS interface will be needed to support WFC3.

DADS Ingest for WFC3 WFC3 ingest is similar to NICMOS, ACS, and COS. There are no issues that require special attention. Only POD files and uncalibrated data sets are permanently archived to optical media. Metadata are extracted from the calibrated datasets and used to populate the archive catalog.

DADS Distribution for WFC3 There are no special distribution considerations for WFC3. On-the-fly-reprocessing (OTFR) will be supported for WFC3. DADS distribution will support retrievals via electronic transfer as well as tape, CDROM, and DVD. Gzip compression will be an option for retrievals (typically about 20% compression for calibrated dataset). Standard file retrieval options will be defined for WFC3 such as: Final (drizzle) product only Calibrated dataset (default to not generate intermediate products) Uncalibrated dataset Jitter files

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.