Presentation is loading. Please wait.

Presentation is loading. Please wait.

Technology for Long Term Digital Preservation Workshop ESA 22/09/2017

Published byBrit Johannessen Modified over 6 years ago

Similar presentations

Presentation on theme: "Technology for Long Term Digital Preservation Workshop ESA 22/09/2017"— Presentation transcript:

1 Technology for Long Term Digital Preservation Workshop ESA 22/09/2017
Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp Long Term Archive for Earth Observation Data in DLR (German Aerospace Center) Technology for Long Term Digital Preservation Workshop ESA 22/09/2017 Stephan Schropp Charlotte Wehn Earth Observation Center DLR

2 What do we archive? Earth observation data, mainly satellite data
Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp What do we archive? Earth observation data, mainly satellite data Sources: German national missions e.g. TerraSAR-X/TanDEM-X European / ESA missions e.g. Envisat, Sentinel 1/3/5p Other missions e.g. NOAA Currently about 12 PByte of data

3 Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp
What do we archive?

4 How do we archive? Oracle Solaris 2 Copies
Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp How do we archive? Oracle Solaris EO Data DIMS In-House Software Data Oracle HSM (SAM-FS) 2 Copies Metadata Informix

5 How do we archive? Oracle Sparc T4 2 Copies Two buildings
Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp How do we archive? Two buildings Two different tape drive technologies Oracle Sparc T4 2 Copies 1st Copy STK SL 8500 Library T10000C drives 2nd Copy STK SL 3000 Library LTO drives

6 Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp
How do we archive?

7 What’s the problem? No more development for T10000 drives:
Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp What’s the problem? No more development for T10000 drives: What storage technology can replace it? How long will we get reliable support for existing drives? What about Oracle / STK tape libraries? Massive layoffs of Oracle Solaris / SPARC developers: What about the future of Solaris? What about the future of Oracle HSM?

8 What can we do about it? Looking for good ideas LTO only FastLTA
Long Term Archive for Earth Observation Data in DLR • 22/09/2017 • Charlotte Wehn, Stephan Schropp What can we do about it? LTO only FastLTA Virtual Tape Library Disks powered down when not in use Proof of Concept with Oracle HSM successful Ceph Distributed Object Storage Do It Yourself? First tests promising Looking for good ideas

Download ppt "Technology for Long Term Digital Preservation Workshop ESA 22/09/2017"

Similar presentations

Grid Workshop-Padova 12/2/2000 Giovanni Aloisio Massimo Cafaro Paolo Falabella UNIV. OF LECCE-Italy Roy Williams CACR/CALTECH Carl Kesselman ISI/USC SARA/Digital.

Grid Workshop-Padova 12/2/2000 Giovanni Aloisio Massimo Cafaro Paolo Falabella UNIV. OF LECCE-Italy Roy Williams CACR/CALTECH Carl Kesselman ISI/USC SARA/Digital.
The Data Information and Management System (DIMS)

The Data Information and Management System (DIMS)
DFDs Data and Information Management System a Brief Introduction Joint WGISS Subgroup Meetings ICS Task Team Session Toulouse, May 14th,2003 Bernhard Buckl.

DFDs Data and Information Management System a Brief Introduction Joint WGISS Subgroup Meetings ICS Task Team Session Toulouse, May 14th,2003 Bernhard Buckl.
CEOS WGISS & Subgroup Meeting Beijing, September, 2004. 1 CEOS WGISS Technology & Services Subgroup Overview Wyn Cudlip British National Space Centre/QinetiQ.

CEOS WGISS & Subgroup Meeting Beijing, September, CEOS WGISS Technology & Services Subgroup Overview Wyn Cudlip British National Space Centre/QinetiQ.
Requirements for EO Data Processing Farms ESA Workshop “Models for Scientific Exploitation of EO Data” ESA ESRIN, Oct 11-12, 2012 Stephan Kiemle German.

Requirements for EO Data Processing Farms ESA Workshop “Models for Scientific Exploitation of EO Data” ESA ESRIN, Oct 11-12, 2012 Stephan Kiemle German.
The minnesota digital library coalition Achieving Digital Preservation Through Collaboration Museum Computer Network 32 nd Annual Meeting Keith Ewing St.

The minnesota digital library coalition Achieving Digital Preservation Through Collaboration Museum Computer Network 32 nd Annual Meeting Keith Ewing St.
Deutsches Zentrum für Luft- und Raumfahrt e.V. Bench mark study for new technology archiving devices H.-J. Wolf K.-D Mißling, G. M.Pinna CEOS Subgroup.

Deutsches Zentrum für Luft- und Raumfahrt e.V. Bench mark study for new technology archiving devices H.-J. Wolf K.-D Mißling, G. M.Pinna CEOS Subgroup.
Digital Preservation Infrastructure in the University of Alberta Libraries Peter Binkley Digital Initiatives Technology Librarian

Digital Preservation Infrastructure in the University of Alberta Libraries Peter Binkley Digital Initiatives Technology Librarian
Section 108 Study Group Update Questions from the March Roundtables.

Section 108 Study Group Update Questions from the March Roundtables.
1 CS 502: Computing Methods for Digital Libraries Lecture 22 Repositories.

1 CS 502: Computing Methods for Digital Libraries Lecture 22 Repositories.
What is it? Hierarchical storage software developed in collaboration with five US department of Energy Labs since 1992 Allows storage management of 100s.

What is it? Hierarchical storage software developed in collaboration with five US department of Energy Labs since 1992 Allows storage management of 100s.
Designing Storage Architectures for Preservation Collections Library of Congress, September 17-18, 2007 Preservation and Access Repository Storage Architecture.

Designing Storage Architectures for Preservation Collections Library of Congress, September 17-18, 2007 Preservation and Access Repository Storage Architecture.
Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, S. Kindermann, M. Lautenschlager,

Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, S. Kindermann, M. Lautenschlager,
Harvard’s Digital Repository Service (DRS) Architecture Harvard University Library (HUL) Andrea Goethals, Randy Stern December 10, 2009.

Harvard’s Digital Repository Service (DRS) Architecture Harvard University Library (HUL) Andrea Goethals, Randy Stern December 10, 2009.
Costing. Life 2 Model Research (JISC Project) Application to whole operation of Library Attempts to cost common factors Does not take into account certain.

Costing. Life 2 Model Research (JISC Project) Application to whole operation of Library Attempts to cost common factors Does not take into account certain.
Coming revolutions in mass storage: implications for image archives Christopher D. Elvidge, Ph.D. NOAA-NESDIS National Geophysical Data Center E/GC2 325.

Coming revolutions in mass storage: implications for image archives Christopher D. Elvidge, Ph.D. NOAA-NESDIS National Geophysical Data Center E/GC2 325.
Archiving Techniques Frank Klaproth EMANI – Project Meeting February 14 th - 16 th, 2002 Springer-Verlag Heidelberg Göttingen State and University Library.

Archiving Techniques Frank Klaproth EMANI – Project Meeting February 14 th - 16 th, 2002 Springer-Verlag Heidelberg Göttingen State and University Library.
23 rd CEOS Plenary I Phuket, Thailand I 3-5 November 2009 Status of the ESA Earth Observation Programmes Dr. Simonetta Cheli Head of Earth Observation.

23 rd CEOS Plenary I Phuket, Thailand I 3-5 November 2009 Status of the ESA Earth Observation Programmes Dr. Simonetta Cheli Head of Earth Observation.
Elements of a Data Management Plan: Roles and Responsibilities Ruth Duerr National Snow and Ice Data Center Version 1.0 Review Date.

Elements of a Data Management Plan: Roles and Responsibilities Ruth Duerr National Snow and Ice Data Center Version 1.0 Review Date.
Dipl.-Ing. Martin Ruhé German Aerospace Center (DLR) Institute of Transportation Research Workshop “Satellite based Traffic Measurement” Berlin, September.

Dipl.-Ing. Martin Ruhé German Aerospace Center (DLR) Institute of Transportation Research Workshop “Satellite based Traffic Measurement” Berlin, September.

Similar presentations

Ads by Google