Ani Thakar, JHU 1 SX Status Overview Requirements How has SX met its original requirements? Bugs BRs closed BRs still open Usage statsLoginsQueries Performance Objectivity performance issues Versions 2.1 and 2.2 features Overview Requirements How has SX met its original requirements? Bugs BRs closed BRs still open Usage statsLoginsQueries Performance Objectivity performance issues Versions 2.1 and 2.2 features

Ani Thakar, JHU 2 Overview Two main components: ObjectivityData repository - commercial OO DBMS – Objectivity Persistence and data integrity Binary compatibility across the major hardware platforms Transparent and configurable data organization, Superior data-mining performance for complex data models Distributed database capability Automated replication of the archive (maybe) A client/server interface to the data warehouse layer Tcl/Tk GUI client - the SX Query Tool or sxQT enables users to formulate queries in SXQL submit queries to SX server multi-window environment allows multiple sessions, multiple queries Multi-threaded and distributed server (sxServer) creates and manages user sessions and executes user queries routes query o/p in approp. format to the specified output targets can handle multiple parallel user sessions allows multiple parallel user queries per session queries on distributed federation executed in distributed mode Two main components: ObjectivityData repository - commercial OO DBMS – Objectivity Persistence and data integrity Binary compatibility across the major hardware platforms Transparent and configurable data organization, Superior data-mining performance for complex data models Distributed database capability Automated replication of the archive (maybe) A client/server interface to the data warehouse layer Tcl/Tk GUI client - the SX Query Tool or sxQT enables users to formulate queries in SXQL submit queries to SX server multi-window environment allows multiple sessions, multiple queries Multi-threaded and distributed server (sxServer) creates and manages user sessions and executes user queries routes query o/p in approp. format to the specified output targets can handle multiple parallel user sessions allows multiple parallel user queries per session queries on distributed federation executed in distributed mode

Ani Thakar, JHU 3 Status of SX Requirements Status of SX Requirements Primary Requirements All primary science archive requirements have been met, with the exception of the enhanced goals Inputs to SX All the basic requirements for Inputs have been met - the SX meets these requirements to the extent possible with the current inputs provided by the photoand spectro pipelines. The enhanced goals have not been met Functional Goals All the basic functional goals, with the exception of efficient repeated queries and the ability to make plots in the SX, have been met. One of the two enhanced goals has been met Technical Goals All the technical goals have been met Primary Requirements All primary science archive requirements have been met, with the exception of the enhanced goals Inputs to SX All the basic requirements for Inputs have been met - the SX meets these requirements to the extent possible with the current inputs provided by the photoand spectro pipelines. The enhanced goals have not been met Functional Goals All the basic functional goals, with the exception of efficient repeated queries and the ability to make plots in the SX, have been met. One of the two enhanced goals has been met Technical Goals All the technical goals have been met

Ani Thakar, JHU 4 SX Bugs BRs closed since 3/00 Critical BRs closed Serious BRs closed Non-critical BRs closed Critical BRs still open BRs closed since 3/00 Critical BRs closed Serious BRs closed Non-critical BRs closed Critical BRs still open

Ani Thakar, JHU 5 SX Usage Mar – Jul 2000

Ani Thakar, JHU 6 SX Usage Mar – Jul 2000

Ani Thakar, JHU 7 SX Usage Mar – Jul 2000

Ani Thakar, JHU 8 SX Usage Mar – Jul 2000

Ani Thakar, JHU 9 Server Stability

Ani Thakar, JHU 10 Performance Goal: scalable,primarily I/O-limited archival system Problem: Objectivity performance did not deliver Original versions (3.0 and 4.0) were fast Multi-threaded versions (5.0 onwards) slow opening individual objects takes several thousand cycles should take few hundred cycles Problem reported to Objy in Dec 1999 Objy agreed to put this on their “warmlist” for v6.0 By Spring 2000, still no movement on this In May, Alex pressed this issue at Objy Worldview Conf Finally, in June, Objy engineer Mats Persson looked at it All of June spent in daily exchanges with Objy Over one man-month spent on this effort By end of June, speed increased by factor of ~ 15 (45 Mb/s) With Objy improvements, 100Mb/s on Linux within reach Max raw I/O speed 200 Mb/s on Linux cluster SGI performance disappointing by comparison (< 17 Mb/s) Goal: scalable,primarily I/O-limited archival system Problem: Objectivity performance did not deliver Original versions (3.0 and 4.0) were fast Multi-threaded versions (5.0 onwards) slow opening individual objects takes several thousand cycles should take few hundred cycles Problem reported to Objy in Dec 1999 Objy agreed to put this on their “warmlist” for v6.0 By Spring 2000, still no movement on this In May, Alex pressed this issue at Objy Worldview Conf Finally, in June, Objy engineer Mats Persson looked at it All of June spent in daily exchanges with Objy Over one man-month spent on this effort By end of June, speed increased by factor of ~ 15 (45 Mb/s) With Objy improvements, 100Mb/s on Linux within reach Max raw I/O speed 200 Mb/s on Linux cluster SGI performance disappointing by comparison (< 17 Mb/s)

Ani Thakar, JHU 11

Ani Thakar, JHU 12

Ani Thakar, JHU 13 SX v2.1 and v2.2 Version 2.1 release date now 8/00 Objectivity performance improvements Output corruption problem (SGI) Spectro data model Atlas images Version 2.1 features Distributed Server To-many links Binary output capability Atlas images Spectra (draft model) Version 2.2 features Objectivity performance enhancements Replication utility Parallel extraction Version 2.1 release date now 8/00 Objectivity performance improvements Output corruption problem (SGI) Spectro data model Atlas images Version 2.1 features Distributed Server To-many links Binary output capability Atlas images Spectra (draft model) Version 2.2 features Objectivity performance enhancements Replication utility Parallel extraction

Ani Thakar, JHU 14

Ani Thakar, JHU 15

Ani Thakar, JHU 16 SX Usage Stats (3/00 – 7/00)