The Data Information and Management System (DIMS)

Slides:

Advertisements

Similar presentations

ARIZONA DEPARTMENT OF ADMINISTRATION INFORMATION SERVICES DIVISION - DATA CENTER.

Advertisements

1 The 5 Minute Rule Jim Gray Microsoft Research Kilo10 3 Mega10 6 Giga10 9 Tera10 12 today,

Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.

DLR/DFD Report > Bernhard Buckl > DLR/DFD Report CEOS WGISS-24, Oberpfaffenhofen, Oct. 19th, 2007 Bernhard Buckl DLR/DFD.

DFDs Data and Information Management System a Brief Introduction Joint WGISS Subgroup Meetings ICS Task Team Session Toulouse, May 14th,2003 Bernhard Buckl.

Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.

Preserving for the Future Mike King Systems Manager UK Data Archive (University of Essex)

Welcome to Who Wants to be a Millionaire

£1 Million £500,000 £250,000 £125,000 £64,000 £32,000 £16,000 £8,000 £4,000 £2,000 £1,000 £500 £300 £200 £100 Welcome.

International Polar Year: STG DLR ground segment operations capabilities Erhard Diedrich Head of Division International Ground Segment DLR – German Remote.

IGARSS 2011, Vancouver, Canada Session: TU4.T Ionospheric Effects on SAR, PolSAR and InSAR, Tuesday, July 26, 15: :00 Ionospheric Effects in.

Antenna Chetumal: System and Data Eva Mañas Iñiguez Workshop Antenna Chetumal México City, 22nd – 24th April 2008 German Remote.

Techniques for High Accuracy Relative and Absolute Localization of TerraSAR-X / TanDEM-X Data U. Balss, M. Eineder, T. Fritz, H. Breit, and C. Minet German.

$100 $200 $300 $400 $100 $200 $300 $400 $100 $200 $300 $400 $100 $200 $300 $400 $100 $200 $300 $400.

Computing Infrastructure

Tasks in Setting Up a Hard Disk

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

Tertiary Storage Devices

Silberschatz and Galvin Operating System Concepts Module 14: Tertiary-Storage Structure Tertiary Storage Devices Operating System Issues Performance.

Peripheral Storage Devices

GETTING BITS OFF DISKS Using Open Source Tools to Prepare Born-Digital Materials for Long-Term Preservation and Access To connect to the audio portion.

Professor Michael J. Losacco CIS 1150 – Introduction to Computer Information Systems Secondary Storage Chapter 7.

1 Disks Introduction ***-. 2 Disks: summary / overview / abstract The following gives an introduction to external memory for computers, focusing mainly.

Basic Principles of PACS Networking Emily Seto Medical Engineering/SIMS Center for Global eHealth Innovation April 29, 2004.

Storing Data Chapter 4.

Describing Storage Devices Store data when computer is off Two processes –Writing data –Reading data Storage terms –Media is the material storing data.

Digital Collections: Storage and Access Jon Dunn Assistant Director for Technology IU Digital Library Program

BT Managed Compute Solution Overview April 2013 Chris Faulkner Head of Managed Hosting Rob Ellison Managed Hosting Architect.

Writing CDs & DVDs Dave BotherwayDecember A g e n d a Why Write CD / DVDs ? Types of CDs, DVDs PC Hardware / Software File Types & Demonstration.

Activities in the ANU Supercomputer Facility ANUSF

10 Year Old Topic 2 9 Year Old Topic 4 8 Year Old Topic 5 8 Year Old Topic 6 7 Year Old Topic 7 7 Year Old Topic 8 6 Year Old Topic 9 6 Year Old Topic.

Are You Smarter Than a 5 th Grader? 1,000,000 5th Grade Topic 1 5th Grade Topic 2 4th Grade Topic 3 4th Grade Topic 4 3rd Grade Topic 5 3rd Grade Topic.

XenData SX-520 LTO Archive Servers A series of archive servers based on IT standards, designed for the demanding requirements of the media and entertainment.

XenData SX-10 LTO Archive Appliance An Archive Appliance based on IT standards, designed for the demanding requirements of the media and entertainment.

Page 1 / 18 Internet Traffic Monitor IM Page 2 / 18 Outline Product Overview Product Features Product Application Web UI.

Requirements for EO Data Processing Farms ESA Workshop “Models for Scientific Exploitation of EO Data” ESA ESRIN, Oct 11-12, 2012 Stephan Kiemle German.

Objectives: Chapter 9: Data Centre Architecture VLAN definition and benefits * VLANs and broadcast domains * Routers role in VLANs * Types of VLANs * VLANs.

Networks : What is a network?

TS7700 User Day, Nov. 11 Welcome Marco Ceresoli, DP&R Sales leader, Europe

Introduction to Storage Area Network (SAN) Jie Feng Winter 2001.

Deutsches Zentrum für Luft- und Raumfahrt e.V. Bench mark study for new technology archiving devices H.-J. Wolf K.-D Mißling, G. M.Pinna CEOS Subgroup.

Vorlesung Speichernetzwerke Teil 2 Dipl. – Ing. (BA) Ingo Fuchs 2003.

DLR IPY Data Portfolio: TerraSAR-X High Resolution SAR Data from Space Erhard Diedrich Head of Division International Ground Segment DLR – German Remote.

Designing Storage Architectures for Preservation Collections Library of Congress, September 17-18, 2007 Preservation and Access Repository Storage Architecture.

Mass RHIC Computing Facility Razvan Popescu - Brookhaven National Laboratory.

XenData Digital Archives Simplify your video archive workflow XenData LTO Video Archive Solutions Overview © Copyright 2013 XenData Limited.

Costing. Life 2 Model Research (JISC Project) Application to whole operation of Library Attempts to cost common factors Does not take into account certain.

Secondary Storage Chapter 7.

Solar-B Global DataGrid 21 st September 2006 UK e-Science All Hands Meeting 2006 RALMSSL Tim Folkes Elizabeth Auden Jens Jensen Paul Lamb Matthew WildMatthew.

CDF data production models 1 Data production models for the CDF experiment S. Hou for the CDF data production team.

Lower Storage projects Alexander Moibenko 02/19/2003.

Backup Library Comparison

GStore: GSI Mass Storage ITEE-Palaver GSI Horst Göringer, Matthias Feyerabend, Sergei Sedykh

Overview of Physical Storage Media

Solar-B Global DataGrid Update for AstroGrid SAG 10 RALMSSL Tim Folkes Elizabeth Auden Jens Jensen Paul Lamb Matthew WildMatthew Whillock Len Culhane Elizabeth.

21 st October 2002BaBar Computing – Stephen J. Gowdy 1 Of 25 BaBar Computing Stephen J. Gowdy BaBar Computing Coordinator SLAC 21 st October 2002 Second.

Satellites, Ground Segment, and Data Access Evolution at DLR K

CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)

Storage Why is storage an issue? Space requirements Persistence Accessibility Needs depend on purpose of storage Capture/encoding Access/delivery Preservation.

Australian Synchrotron Data curatorship for protein crystallography Julian Adams & Richard Farnsworth.

This courseware is copyrighted © 2016 gtslearning. No part of this courseware or any training material supplied by gtslearning International Limited to.

XenData SX-10 LTO Archive Appliance

Data Handling and Preservation of the TanDEM-X Satellite Mission

LONG TERM DATA PRESERVATION

Technology for Long Term Digital Preservation Workshop ESA 22/09/2017

Airbus Archive Technologies

Data Management Components for a Research Data Archive

ESA EO Data Preservation System: CBA Infrastructure and its future

Computer Storage.

Presentation transcript:

The Data Information and Management System (DIMS) Wilhelm Wildegger, DLR, DFD Version 2007-10-15

Earth Observation from Space Data Acquisition Application Distribution Archiving Product Generation Calibration DFD, W. Wildegger 2007-10-15

Support for Numerous Missions EnMAP Support for Numerous Missions TanDEM-X Mission Examples TerraSAR-X National Missions European Missions International Missions METOP ENVISAT Airborne Imaging Terra & Aqua CHAMP SRTM Product Examples DFD, W. Wildegger 2007-10-15

Specific and General Tasks Users User Information Services EOWEB® DIMS Product Library Archive Inventory Order Manage-ment Online/ Offline Delivery Data Information and Management System (DIMS) General tasks, common to all missions and sensors Multi-Mission System Production Control Atmospheric Radar Specific tasks: Processing of data Processing Systems Optical DFD, W. Wildegger 2007-10-15

DIMS Facility DIMS Short, Medium and Long Term Archiving User Systems Pickup Point EOWEB® User Information Service DIMS Operating Tool UIS Loader/ Interface Ordering Control Online/Offline Prod. Gen.& Delivery Product Library Short, Medium and Long Term Archiving Production Control Monitoring & Alarm Ingestion System Processing System Post-Processing Data Flow Pickup Point Control Flow DFD, W. Wildegger 2007-10-15

DIMS, some numbers Today (Oberpfaffenhofen and Neustrelitz) ca. 50 processing systems connected to DIMS ca. 60.000 product transfers per month ca. 100 product types ca. 1,000,000 products ca. 6.7 Mio. files ca. 200 TByte of data DFD, W. Wildegger 2007-10-15

C-AF Production Network New DIMS Hardware MSG Proc. System(s) ERS-2 GOME L2/L3 Proc. System(s) SRTM X-SAR Proc. Systems Terra/Aqua MODIS Proc. Systems AIR OS Proc. System(s) ... TerraSAR-X TVSP Proc. System Processing Systems Product Library Ordering Control Production Control Name/Web/ SW Service Sun Cluster DIMS Ordering Control Server Production Control Server DIMS Operations Server Product Library / Inventory Server Archive Server Secondary Copy Robot Library (remote) FC Switch FC Sw. FC Sw. FC Sw. ... 8* LTO-3 SAN Storage System 25 TByte FC Switch LX fiber links Online/Offline Product Gen. & Delivery Tape SAN Primary Copy Robot Library Disk SAN ... User Inform. Services Post Processing 13* 9940B High Availability High Availability Server UIS Server Post Processing Server CD/ DVD Writing System Online/ Offline Product Gen. Server 2* LTO-2 AMU C-AF Production Network CAF Firewall to DLR Backbone Switch DFD, W. Wildegger 2007-10-15

Hierarchical Storage Management a r c h i v e 1st Copy migrate write stage Quantum AML-2 2nd Copy (remote) read Disk Cache Online Nearline Quantum i2000 2200 TByte archiving capacity, 10 TByte disk cache DFD, W. Wildegger 2007-10-15

New versus Old DIMS Hardware Archive Tape Drives and Media Type Native Capacity Total Capacity of Robot Library Read / Write Speed Connec-tion old primary copy Sony AIT-2 50 GByte ca. 6000 slots 300 TByte 5 MByte/s SCSI new primary copy Sun / STK 9940B 200 GByte ca. 10,000 slots 2 PByte 30 MByte/s SAN old secondary copy DLT7000 35 GByte ca. 1000 slots 35 TByte + off robot storage 3 MByte/s new secondary copy IBM LTO-3 400 GByte ca. 1000 slots 400 TByte up to 80 MByte/s DFD, W. Wildegger 2007-10-15

DFD, W. Wildegger 2007-10-15

DFD, W. Wildegger 2007-10-15