DSS/Db Backups/HSM Overview David Wolfe. DSS-I 102 CD ROM set –POSS-I red XE plates –SERC-J blue S plates –Compressed ~10X –http://archive.stsci.edu/cgi-bin/dss_form.

Slides:



Advertisements
Similar presentations
COMPUTERS: TOOLS FOR AN INFORMATION AGE Chapter 3 Operating Systems.
Advertisements

Tertiary Storage Devices
Lesson 6. The Computer Operation Computer Operating Systems GUI vs. Command line The Microsoft Windows Family File Systems – How Computers Manage Data.
ClearCube Data Failover 3.0 Overview and Demonstration Rev
Mukesh A Pund Scientist NISCAIR
A new standard in Enterprise File Backup. Contents 1.Comparison with current backup methods 2.Introducing Snapshot EFB 3.Snapshot EFB features 4.Organization.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS TSM CERN Daniele Francesco Kruse CERN IT/DSS.
1 Deciding When to Forget in the Elephant File System University of British Columbia: Douglas. S. Santry, Michael J. Feeley, Norman C. Hutchinson, Ross.
Optimizing Windows There are several ways to optimize (perform regular maintenance) Windows to keep it performing smoothly and quickly. Most of these discussed.
11 BACKING UP AND RESTORING DATA Chapter 4. Chapter 4: BACKING UP AND RESTORING DATA2 CHAPTER OVERVIEW Describe the various types of hardware used to.
FILE SYSTEMS. File Names 1 to 255 characters in length  This includes the path You can use uppercase and lowercase (case-aware, but not case-sensitive)
Internet Backup Michael White Ross Schneider Jordan Divine.
Chapter 7: Configuring Disks. Configuring File Systems Fat32 –First used with Windows 95 OSR2 –Smaller cluster sizes, more efficient storage up to 32.
The Operating System and the User Interface
Intermediate GNVQ ICT Backing Storage Backing storage is used to store programs and data when they are not being used or when a computer is switched off.
1 Chapter Overview Managing Compression Managing Disk Quotas Increasing Security with EFS Using Disk Defragmenter, Check Disk, and Disk Cleanup.
PRO-TECH Users’ Group (day 1) Database Backup Backup *.fdb files daily Three methods – Operating system (o/s) – Firebird nbackup utility – Firebird.
XP Practical PC, 3e Chapter 12 1 Accessing Databases.
Security and Backup Avoid disasters – have a good backup policy Avoid disasters – have a tight security scheme in place UK law dictates the board of directors.
Backup Rationalisation Reorganisation of the CERN Computer Centre Backups David Asbury IT/DS Friday 6 December 2002.
1 Objectives Discuss the Windows Printer Model and how it is implemented in Windows Server 2008 Install the Print Services components of Windows Server.
Utility Programs  A type of system software that is used to solve a particular problem is called utility program. Many operating system provides different.
Information Security Principles Supervised By Ms. Eman El Ajramy Presented by Moamer.T.Sawafiri Steps To Secure Your Data.
The Mass Storage System at JLAB - Today and Tomorrow Andy Kowalski.
6 th Annual GSC-II Project Meeting C B A S GSC-II and DSS-II Projects 2000 Annual Report Brian McLean 19 th October 2000.
Computers Are Your Future Eleventh Edition Chapter 4: System Software Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall1.
Buffalo Data Storage Expansion June As organizations grow the amount of data storage capacity required to support it grows as well Increased data.
Managing Files for Personal Computing Part 2 – File Management.
1 AQA ICT AS Level © Nelson Thornes 2008 Operating Systems What are they and why do we need them?
Drive Imaging Richard Woods March 14, Major Disaster Recovery What if?  Major software corruption  Hard disk failure You could spend 1-2 days.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Chapter 1- Visual Basic Schneider1 Chapter 1 An Introduction to Computers and Visual Basic.
1 Maintain System Integrity Maintain Equipment and Consumables ICAS2017B_ICAU2007B Using Computer Operating system ICAU2231B Caring for Technology Backup.
January Backing Up Your PC’s Hard Drive Dr. Michael Stachiw.
Disk Fragmentation 1. Contents What is Disk Fragmentation Solution For Disk Fragmentation Key features of NTFS Comparing Between NTFS and FAT 2.
Unit R005: Understanding Computer Systems Introduction System Software Software (i.e., programs) used to control the hardware directly Used to run the.
OCLC Online Computer Library Center Digital Preservation with OCLC Digitization Standards: Issues & Updates Taylor Surface, OCLC.
Win202 Database Administration. Introduction Welcome to OpenEdge. Type 2 Storage Areas. One of the big selling points for the OpenEdge platform and Win202.
Selling the Storage Edition for Oracle November 2000.
Chapter 15 Relational Implementation with DB2 David M. Kroenke Database Processing © 2000 Prentice Hall.
GSC-II Plate Processing Pipeline Status C. Loomis, C. Sturch, F. Guglielmetti.
* Property of STI Page 1 of 18 Software: Systems and Applications Basic Computer Concepts Software  Software: can be divided into:  systems software.
7 th Annual GSC-II Project Meeting C B A S GSC-II and DSS-II Projects 2001 Annual Report Brian McLean 22 nd October 2001.
1618Tb SDDS storage BE-CO-IN. Proposal Upgrade operational LHC_DATA to 1.1 Tbytes with the same operational level : – New faster technology (SAS disks.
Data Intensive Astronomy Group Talk II ICRAR Con 4 September 2015 Chen Wu.
SIR SONS IN RETIREMENT Computer User Group. HARD DRIVE FORMATTING LOW-LEVEL FORMATTING PARTITIONING HIGH-LEVEL FORMATTING –ERASER:
CASTOR project status CASTOR project status CERNIT-PDP/DM October 1999.
Plate Scanning, Processing, and Compression Status Amy Rosenberg 7 th Annual GSC-II Meeting.
Thanapoom Boondee M.2/2 No.22. Pattawan Tangpattananon M.2/2No.5 Tuchatham Tosakul M.2/2No.13 Thanapoom Boondee M.2/2No.22 Suvit Pathomthanasarn M.2/2No.30.
Managing Files for Personal Computing Part 1 - Data Storage.
A Total Recall of Data Usage for the MWA Long Term Archive
STORAGE DEVICES Towards the end of this unit you will be able to identify the type of storage devices and their storage capacity.
Basic Guide to Computer Backups
Part B Computer Storage
AS ICT Module 2 Objectives: Security of Data
Working with Disks Lesson 4.
Experiences and Outlook Data Preservation and Long Term Analysis
Test C : IBM Enterprise Storage Technical Support V5
Backing up a Hard Disk Windows XP Tutorial 6.
STORAGE DEVICES Towards the end of this unit you will be able to identify the type of storage devices and their storage capacity.
Chapter III, Desktop Imaging Systems and Issues: Lesson II Storing Image Data
Computer Applications
STORAGE DEVICES Towards the end of this unit you will be able to identify the type of storage devices and their storage capacity.
COMPASS Database SPACE TELESCOPE SCIENCE INSTITUTE Gretchen Greene
Have you seen this screen?
By Laurynas Peteraitis
Unit 3 Storage and Retrieval of Information
5 Backing Storage Backing storage is used to store programs and data when they are not being used or when a computer is switched off. When programs and.
IBM Tivoli Storage Manager
Methods to Restore BKF files in Case of Missing Catalog Backup File.
Presentation transcript:

DSS/Db Backups/HSM Overview David Wolfe

DSS-I 102 CD ROM set –POSS-I red XE plates –SERC-J blue S plates –Compressed ~10X –

DQVS Palomar Quick-V –GSC-I construction plates –39 CD ROM set –Compressed ~10X –

XDSS RED ( III-aF) –POSS-II XP images Completed 897 out of 897, 100% –UK Schmidt XS images Completed 592 out of 606, 98% –UK Schmidt ER images Completed 270 out of 288, 94% –Compressed ~10X –Contained on Volumes –Completed by end of 2000 –

XDSS(cont) BLUE (III-aJ) –POSS-II XJ images Completed 897 out of 897, 100% Contained on Volumes INFRARED (IVN) –POSS-II XI images Completed 340 out of 897, 38% Contained on Volumes –UK Schmidt IS images Completed 151 out of 894, 16% Contained on Volumes –Compressed ~10X –Completed by mid 2001, telescope limited –

XDSS(cont) Headers –Headers for all XDSS second generation scans ftp://ftp.stsci.edu/software/casb/xdss/

DB BACKUPS DataBase about 1TB How to handle such a large volume –Old method Stand alone DLT drive, NT Backup 9-10 hours per tape 15+ tapes

DB BACKUPS (cont) New method –BackupExec by Veritas DLT jukebox, 8 cartridges Breakup into North and South High through put Less user interaction

DB BACKUPS (cont) Importance of the Backups –Large system, just in case of errors –Already had to use previous backups Replaced corrupted files –Time Frame Plans are for monthly –Minimal impact to production

HSM Hierarchical Storage Management –DiskXtender by OTG Large storage by using DLT jukeboxes – DLT tape jukeboxes –~60GB/tape –Storing processing data OOP, cutouts, deblend, rank…

HSM (cont) Ease of retrieval –All files visible from explorer –Right click on file to retrieve Limited by physical disk space