2013-2014 CSA Implementation overview since OR-8 Test campaigns Scheduled development plan Arnaud Masson CSA/CAA Operational Review 9 ESTEC, 04-June-2014

Outline About CAA and CSA CSA releases since OR-8 CSA key requirements implementation over the last two years Status of the implementation for other data services Outcome of test campaigns CSA future developments

1. About CAA and CSA: why do we do all this?

1. About CAA and CSA: why do we do all this? The scientific return of the Cluster mission

1. About CSA and CAA

Online archive fully Public 1. About CSA and CAA Publications x2 Online archive fully Public

1. About CSA and CAA CSA is the long term archive of the Cluster and the Double Star missions together with value added products such as ECLAT and MAARBLE CSA-CAA main goals include Continue serving a large scientific community (~ 1700 registered users) Continue to develop the archive (e.g. Double Star datasets) Make sure this data gold mine is preserved in the long term

2. CSA releases since OR-8

2. CSA releases since OR-8 November 2013 Public opening of CSA V1.0

2. CSA releases since OR-8 November 2013 Public opening of CSA V1.0 March 2014 Data streaming V1.1 Pre-gen visualisation plots Inventory plots Improved data delivery speed

2. CSA releases since OR-8 November 2013 Public opening of CSA V1.0 March 2014 Data streaming V1.1 Pre-gen visualisation plots Inventory plots Improved data delivery speed May 2014 New CSA website V1.1.1 Re-design of the GUI V1.1.2 Dynamic async icon with nb of datasets

3. CSA key requirements implementation Cluster Science Archive Key requirements June 2014 1 year ago 2 years ago CSA and CAA data content equivalent Data delivery in CEF and CDF GUI without user profiles (data or graphical) Dataset can be made inactive in the CSA database Caveat files delivered together with data products Command-line capabilties (wget, within Matlab/IDL…) Data visualisation capabilities (on-demand & pregenerated) Inventory plots (on-demand & pregenerated)

3. CSA key requirements implementation Cluster Science Archive Key requirements June 2014 1 year ago 2 years ago CSA and CAA data content equivalent Data delivery in CEF and CDF GUI without user profiles (data or graphical) Dataset can be made inactive in the CSA database Caveat files delivered together with data products Command-line capabilties (wget, within Matlab/IDL…) Data visualisation capabilities (on-demand & pregenerated) On demand Inventory plots (on-demand & pregenerated)

3. CSA key requirements implementation Cluster Science Archive Key requirements June 2014 1 year ago 2 years ago CSA and CAA data content equivalent Data delivery in CEF and CDF GUI without user profiles (data or graphical) Dataset can be made inactive in the CSA database Caveat files delivered together with data products Command-line capabilties (wget, within Matlab/IDL…) Data visualisation capabilities (on-demand & pregenerated) On demand Inventory plots (on-demand & pregenerated) *

3. CSA key requirements implementation Cluster Science Archive Key requirements June 2014 1 year ago 2 years ago CSA and CAA data content equivalent Data delivery in CEF and CDF GUI without user profiles (data or graphical) Dataset can be made inactive in the CSA database Caveat files delivered together with data products Command-line capabilties (wget, within Matlab/IDL…) Data visualisation capabilities (on-demand & pregenerated) On demand Inventory plots (on-demand & pregenerated) * YEARLY and Monthly pregen inventory plots available for the 2001-2012 period; DAILY pregen inventory plots available: 7 instruments available, 5 on-going (RAPID, STAFF, WBD, WHI, AUX) EVERYTHING including plots for 2013 and 2014 shall be available by the end of June 2014

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) ECLAT and MAARBLE products Multiline plots for graphical products

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) ECLAT and MAARBLE products Multiline plots for graphical products

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) ECLAT and MAARBLE products Multiline plots for graphical products

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) ECLAT and MAARBLE products Multiline plots for graphical products

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) ECLAT and MAARBLE products Multiline plots for graphical products CSDS quicklook plots can be browsed from CSDS websites and the CSA website CSDS quicklook plots can be downloaded from CSA Instrument based on PI software QL plots available in October ECLAT and MAARBLE visualisation will be available in October Cross-calibration QL plots visualisation in October CAA based CSDS quicklook plots, still require finetuning,not yet sent to CSA

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) JULY ECLAT and MAARBLE products Multiline plots for graphical products

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) JULY ECLAT and MAARBLE products Multiline plots for graphical products

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions JULY ECLAT and MAARBLE products Multiline plots for graphical products Available today!

4. Implementation status: other data services Cluster Science Archive Data services Now 1 year ago 2 years ago Data streaming capabilities Visualisation of quicklook plots Visualisation of particle distributions (beta version) JULY ECLAT and MAARBLE products Multiline plots for graphical products

4. Implementation status: other data services

4. Implementation status: other data services Multiline plots Available On the CSA Internal server Will be released In June 2014 V1.1.3.

5. Outcome of the testing of CSA wrt CAA Procedure Outcome Data delivery Simultaneous download of every single dataset for different time periods, comparison of size Equivalent 5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA now ok

5. Outcome of the testing of CSA wrt CAA Procedure Outcome Data delivery Simultaneous download of every single dataset for different time periods, comparison of size Equivalent 5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA now ok Graphical pregen plots accessibility/usability (GUI) Data visualisation of pregen graphical plots on both systems (functionalities, time it takes) Equivalent for 24h&6h Minor issue: 1h pregen plot not yet available

5. Outcome of the testing of CSA wrt CAA Procedure Outcome Data delivery Simultaneous download of every single dataset for different time periods, comparison of size Equivalent 5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA now ok Graphical pregen plots accessibility/usability (GUI) Data visualisation of pregen graphical plots on both systems (functionalities, time it takes) Equivalent for 24h&6h Minor issue: 1h pregen plot not yet available Graphical on-demand plots accessibility/usability (GUI) Data visualisation of on-demand graphical plots on both systems (functionalities, time it takes)

5. Outcome of the testing of CSA wrt CAA Procedure Outcome Data delivery Simultaneous download of every single dataset for different time periods, comparison of size Equivalent 5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA now ok Graphical pregen plots accessibility/usability (GUI) Data visualisation of pregen graphical plots on both systems (functionalities, time it takes) Equivalent for 24h&6h Minor issue: 1h pregen plot not yet available Graphical on-demand plots accessibility/usability (GUI) Data visualisation of on-demand graphical plots on both systems (functionalities, time it takes) Inventory on-demand plots accessibility/usability (GUI) Visualisation of on-demand, up to 7 days, inventory information

5. Outcome of the testing of CSA wrt CAA Procedure Outcome Data delivery Simultaneous download of every single dataset for different time periods, comparison of size Equivalent 5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA now ok Graphical pregen plots accessibility/usability (GUI) Data visualisation of pregen graphical plots on both systems (functionalities, time it takes) Equivalent for 24h&6h Minor issue: 1h pregen plot not yet available Graphical on-demand plots accessibility/usability (GUI) Data visualisation of on-demand graphical plots on both systems (functionalities, time it takes) Inventory on-demand plots accessibility/usability (GUI) Visualisation of on-demand, up to 7 days, inventory information Inventory pregen plots Accessibility/usability (GUI) Visualisation of inventory pregenerated plots (functionalitites and time it takes) Equivalent for Yearly&Monthly (2001-2012) Daily ok for 7 experiments (e.g. FGM, CIS, PEACE) 5 on-going

5. Outcome of the testing of CSA wrt CAA

5. Outcome of the testing of CSA wrt CAA

5. Outcome of the testing of CSA wrt CAA

5. Outcome of the testing of CSA wrt CAA

5. Outcome of the testing of CSA wrt CAA

6. Scheduled development plan Mid-June 2014 Multiline plots available at the CSA GUI End of June 2014 Public access closing of CAA End of July 2014 Main goals Distribution functions visualisation (beta version) Improvement of the speed of data streaming Mid-October 2014 Double star data accessible via the GUI and the command line Visualisation of FP7 projects graphical products Visualisation of quicklook plots based on the CSA data End of November 2014 Implementation of the SAMP protocol End of the year 2014 Fix of the remaining minor issues