JAXA Archive Activity JAXA Archive Activity JAXA/EORC Kengo Aizawa JAXA/EORCOsamu Ochiai

Background JAXA Start to design a new Archive/Information system for GOSAT and following satellites JAXA Start to design a new Archive/Information system for GOSAT and following satellites There are some of problems in the active archive/Information system like There are some of problems in the active archive/Information system like - slow response - slow response - low cost performance - low cost performance - vender proprietary (upgrade, expansion are depend upon their policy) - vender proprietary (upgrade, expansion are depend upon their policy)

System Requirements Main requirements concerning archives are upgrade system performance ( Quick data access for quick distribution) upgrade system performance ( Quick data access for quick distribution) Easy system expansion Easy system expansion Vender independent Vender independent Reduce maintenance, operation cost Reduce maintenance, operation cost

Respond to requirement … Disk array (SAN)Robotics Tape - data will hold as long as it required - expand capability - vender independent data migration - expand capability - vender independent - Lower required data will migrate to tape

System comparison Raid Disk Robotics tape Raid Disk Robotics tape EOIS 4TB (DAS) 400TB system hold 3days hold forever single vender single vender single vender single vender ALOS 4TB (DAS) 200TB System hold １ day hold forever single vender single vender single vender single vender New 100TB(SAN) 500TB System depend on data hold forever multi vender multi vender multi vender multi vender

To realize We will adopt a concept - Information Lifecycle Management (ILM) Also will adopt a standard - Storage Management Initiative Specification (SMI-S)

What ’ s ILM ILM is a Management that matches data to the change in the importance degree from generation to the ILM is a Management that matches data to the change in the importance degree from generation to the deletion and stores it in appropriate storage. deletion and stores it in appropriate storage. Data is classified according to informational worth. Data is classified according to informational worth. Required availability and performance are efficiently secured for every data by storage arranged hierarchically Required availability and performance are efficiently secured for every data by storage arranged hierarchically

Information Lifecycle Management (ILM) Step 1: Classification Classify the data according to urgency, importance, user needs, etc. Step 2: Backup and delete Copy the data to tapes and delete it from the disk array except critical data. Disk array Tape Users can access the critical data quickly Users can access the other data less quickly Critical data

What ’ s SMI-S (Storage Management Initiative Specification) SMI-S is an interface standard that enables interoperability both hardware and software between storage products from different vendors that an enterprise would use in a SAN environment. SMI-S is an interface standard that enables interoperability both hardware and software between storage products from different vendors that an enterprise would use in a SAN environment. SMI-S is based on the CIM (Common Information Model) and WBEM (Web-based Enterprise Management) specifications. SMI-S is based on the CIM (Common Information Model) and WBEM (Web-based Enterprise Management) specifications. SIM-S creates common models describing storage hardware and storage functions. Vendors then write interfaces that allow their hardware and software to share data using these common models. SIM-S creates common models describing storage hardware and storage functions. Vendors then write interfaces that allow their hardware and software to share data using these common models.

benefits ILM ILM - optimization of disk use, maintaining high-speed access - optimization of disk use, maintaining high-speed access - Automatic processing - Automatic processing SMI-S SMI-S - Provides freedom of choice - Provides freedom of choice - Reduce management costs - Reduce management costs - Control agent proliferation - Control agent proliferation - Reduce overhead and complexity - Reduce overhead and complexity

Vender movement Venders release a HSM tool which will realize ILM. Venders release a HSM tool which will realize ILM. Venders who join SNIA-J (Storage Networking Industry Association Japan) will release products compliant to SMI-S within 2005 Venders who join SNIA-J (Storage Networking Industry Association Japan) will release products compliant to SMI-S within 2005

Plan Basic design for new archive/Information system will be done by end of June Basic design for new archive/Information system will be done by end of June New system will be applied to GOSAT, data for Research use New system will be applied to GOSAT, data for Research use

Draw up management policy Draw up management policy - observation date, area, sensor, clouds percentage, processing level, frequency use ・・