Presentation is loading. Please wait.

Presentation is loading. Please wait.

P l a n e t a r y D a t a S y s t e m 1 Data Integrity Compilation Data Integrity Compilation Presented by: Al Schultz Location: PDS Management Council.

Similar presentations


Presentation on theme: "P l a n e t a r y D a t a S y s t e m 1 Data Integrity Compilation Data Integrity Compilation Presented by: Al Schultz Location: PDS Management Council."— Presentation transcript:

1 P l a n e t a r y D a t a S y s t e m 1 Data Integrity Compilation Data Integrity Compilation Presented by: Al Schultz Location: PDS Management Council Meeting UMUC Adelphi, MD Date: November 20-21, 2008

2 P l a n e t a r y D a t a S y s t e m 2 Primary Copy of Data Availability & Data Integrity ATMGEOImgPPISBN, PSI RingsENNAIF Data Volume (TB) 1.0 TB22.8 TB 3.0 TB1.0 TB, 0.13 TB 1.0 TB0.02 TB0.7 TB Online Capacility (TB) 15 TB35 TB47.3 TB18 TB1.4 TB, 0.2 TB 2.0 TB8.0 TB0.2 TB % of Archive which is Online 90%100% 100%, 100% 100% Online Archive Method (e.g., RAID System) RAIDRAID 5RAID, Storage cluster RAIDRAID, RAID 5 RAID 5+0RAIDRAID-DP Schedule to perform Online Archive Data Integrity check (e.g., daily, weekly) Monthly DailyMonthlyNot scheduled, None MonthlyPer buildMonthly Online Archive Data Integrity Checksum Type(s) (e.g., MD5) MD5deepMD5 MD5, MD5 MD5No MD5/CRC32 used (catalog) MD5

3 P l a n e t a r y D a t a S y s t e m 3 2 nd Copy of Data (Backup) Availability & Data Integrity ATMGEOImgPPISBN, PSI RingsENNAIF Online Archive Backup Location SDSC, NMSU, JPL Server Room 2 USGS/JPL (MM), EN, GEO (Mer,Mex), Rings (Voy) SDSCUMCP, on-site Redwood, CA, Big Stone Gap, VA UMD / EN Iron Mountain, Co Online Archive Backup Method (e.g., SDSC) SDSC transfer, DVD/CD, JPL copies CopyMedia or Internet Exchange SDSC transfer Rsync, rsync 1TB Data Bricks Rsync / tape AIT Online Archive Backup Schedule MonthlyWith data release As receivedAs neededNightly & weekly, Nightly & weekly Bi-weeklyWeekly / daily Monthly & yearly % Online Archive been Backed UP 100% 93%90%100%, 100% 100% Schedule to perform Online Archive Backup copy Data Integrity check YearlyMonthlyRedundant with primary copy MonthlyNone, None MonthlyOnly at primary None Online Archive Back up copy Data Integrity Checksum Type(s) MD5deepMD5Redundant with primary copy MD5MD5, MD5 MD5N/A

4 P l a n e t a r y D a t a S y s t e m 4 3 nd Copy of Data (Backup) Availability & Data Integrity ATMGEOImgPPISBN, PSI RingsENNAIF Deep Archive Location NSSDCOffsite, St. Louis NSSDC NSSDC, NSSDC NSSDCN/ANSSDC % of Deep Archive Unk100%1%50%50-90%, Unk 95%N/A100% Deep Archive Method (e.g., NSSDC Tape System) NSSDC transfer, DVD/CD LTD4 tape CD/DVD copies NSSDC on-line Unk, NSSDC NSSDC tape system N/ANSSDC tape system Schedule to perform Deep Archive Data Integrity check Yearly4x per year Per NSSDC agreement As neededNone, N/A Semi-annualN/AOnce per 6 months Deep Archive Checksum Types(s) MD5deepLTD4 built in Per NSSDC agreement MD5MD5 & Unk, N/A MD5N/AMD5 % Deep Archive Data Integrity Checked 0%100%Per NSSDC agreement 0%Unk, 0% 0%N/A0%

5 P l a n e t a r y D a t a S y s t e m 5 PDS Node System ATMGEOImgPPISBN, PSIRingsENNAIF Primary Location NMSUWUSTLJPL/USGSUCLAUMCP, Tucson Mountainvie w, CA, Big Stone Gap, VA JPL-ENJPL Bld 230 Backup Location NMSU, SDSC, JPL WUSTL & offsite JPL/USGSUCLAUMCP, on-siteRedwood City, Ca JPL-ENJPL Bld 230 Backup Method SDSC transfer, DVD/CD tapeTransfer media/internet tapeRsync, rsync1 TB Data Bricks tapeRAID-DP Backup Schedule MonthlyDaily & 4x per year as receivedMonthl y Weekly/nightly, Weekly/bi- nightly Bi-weeklyDailyN/A Mirror Site Location SDSCN/APendingNoneNone, N/A N/AUMDN/A Mirror Test Schedule Transfer in progress N/ATBDNoneNone, N/A N/AEvery 6 months N/A Mirror Backup Method UnkN/ATBDNoneNone, N/A N/ARsyncN/A


Download ppt "P l a n e t a r y D a t a S y s t e m 1 Data Integrity Compilation Data Integrity Compilation Presented by: Al Schultz Location: PDS Management Council."

Similar presentations


Ads by Google