1. International Data Centre October 2015Page 1 Progressive Commissioning Jerry Carter, Senior Scientist W. Randy Bell, Director Gerhard Graham, Coordinator International Data Centre Division

2. International Data Centre October 2015 Phase 5b (full-scale testing of the IDC hardware and software) is a system verification phase in which the PTS verifies that the IDC functions according to its specifications. The IMS and GCI will also undergo system verification in preparation for Validation and Acceptance in Phase 6. The phase includes “specific experiments” as required, tests of full-time operation (i.e. on a seven days/week schedule), completion of the IDC Validation and Acceptance Test Plan, as well as other requirements. The PTS Performance Monitoring and Testing Framework (INF.1046/Rev.1) guides these activities, whose outputs (test reports and performance monitoring results) provide material for inspection and analysis during validation and acceptance. Page 2

3. International Data Centre October 2015Page 3 CTBT/PC/II/1/Add.2 Appendix III as amended by CTBT/PC-15/1/Annex II Phase 5aPhase 5bPhase 6Phase 7 IMS Certification of station performance and acceptance individual stations into IMS Validation and Acceptance Availability for Full CTBTO Operations IDC Preparation for Full Scale Testing Full Scale Testing Communication Evaluation Further Evaluation on Functioning Elements of IMS, IDC and OSI Present Status Report Evaluation on All Elements of Verification System

4. International Data Centre October 2015Page 4  Progressive commissioning plan is reviewed by WGB and updated.  Event screening criteria and procedures to be tested are finalized.  Location calibration information is incorporated into IDC event locations.  Applications software has near final functionality.  Most IMS stations send data to the IDC via the GCI.  IDC Operational Manual is ‘near final’.  The IDC validation and acceptance test plan is completed.  Specific experiments are carried out as required.  The IDC is operated full time during full scale testing, evaluation and tuning according to EIF schedules.  WGB will review the results from the full scale testing of the IDC. Completed / WGB Responsibility Significant Progress Made Work to be Completed

5. International Data Centre October 2015Page 5  Additional location calibration information is acquired and is incorporated into the IDC event location algorithms. (e.g., RSTT)  The next version of the applications software is prepared and tested. This release provides automatic and interactive processing for all technologies, and upgraded versions of event characterization and screening. At the end of this phase the applications software has near final functionality. (Completed)  The event screening criteria and procedures, to be applied in the validation and acceptance test, are finalized. Procedures are established for continued review and potential modification of the standard event screening criteria. Significant Progress Made

6. International Data Centre October 2015Page 6  The IDC validation and acceptance test plan is completed.  Specific experiments are carried out as required.  The IDC is operated full time (i.e. on a seven days/week schedule) towards the end of this phase during full scale testing, evaluation and tuning. Raw data and products are distributed by the IDC according to the schedules in the Operational Manual. Procedures are refined and revised as necessary in light of its accumulated experience. Work to be Completed

7. International Data Centre October 2015Page 7  Specific experiments are carried out as required.  Testing based on the Validation and Acceptance Test Plan with participation by PTS (including EVAL), NDCs, and Station Operators  Evaluation by stakeholders (process owners, EVAL, NDCs and Station Operators)  Improvement based on lessons learned  Many tests will be repeated periodically Work to be Completed

8. International Data Centre October 2015Page 8  Specific experiments are carried out as required.  Test Areas: Data Handling (full-scale tests) Standard Products (full-scale tests) Data and Product Access Services (2016) Requested Services to States Parties (2017) Supporting Services (2017) IMS Operations (full-scale tests) IMS Maintenance and Repair (full-scale tests) IMS Laboratories (full-scale tests) Work to be Completed

9. International Data Centre October 2015Page 9  The IDC is operated full time (i.e. on a seven days/week schedule) towards the end of this phase during full scale testing, evaluation and tuning. Raw data and products are distributed by the IDC according to the schedules in the Operational Manual. Procedures are refined and revised as necessary in light of its accumulated experience.  Gradual build-up to full-scale capability for interactive analysis and certain services (operations centre, processing engineers). Periodic, limited duration tests and experiments of continuous operation including evaluations by stakeholders and an improvement process Work to be Completed

10. International Data Centre October 2015Page 10 Possible Build-up Tests for Continuous Operation Fall 2016 Experiment/Test 1: Administrative arrangements 2-weeks Experiment/test arrangements required for the preparation, conduct and evaluation of experiments or tests Administrative arrangements for shift work, weekend work, on-call work, holiday work IMS tests of data availability GCI tests of service availability Specific tests of standard product timeliness, content, and documentation Work to be Completed

11. International Data Centre October 2015Page 11 Possible Build-up Tests for Continuous Operation 2017 Experiment/Test 2: Sustained testing under benign conditions One calendar month Sustained full scale operations of a month Administrative arrangements for shift work, weekend work, on-call work, holiday work Adequacy of IDC monthly report to provide evidence for evaluation IMS tests of data availability Specific tests of standard product timeliness, content, and documentation Specific tests of IMS Operations, data handling, standard products and access services Work to be Completed

12. International Data Centre October 2015Page 12 Possible Build-up Tests for Continuous Operation Experiment/Test 3: Sustained testing under benign conditions (2) One calendar month Sustained full scale operations of a month IMS tests of data availability GCI tests of service availability (if GCI transition is complete) Specific tests of standard product timeliness, content, and documentation Specific tests of supporting services including computer infrastructure, communications, security, system monitoring and IMS maintenance and repair. Work to be Completed

13. International Data Centre October 2015Page 13 Possible Build-up Tests for Continuous Operation Experiment/Test 4: Sustained testing with interrupted data flow One calendar month Sustained full scale operations of a month IMS tests of data availability GCI tests of service availability (if GCI transition is complete) Specific tests of standard product timeliness, content, and documentation Specific tests of data handling and access services including catch-up conditions, temporary data arrangements, data that fails authentication, poor quality data. Work to be Completed

14. International Data Centre October 2015Page 14 Possible Build-up Tests for Continuous Operation Experiment/Test 5: Sustained testing during a special event One calendar month Sustained full scale operations of a month IMS tests of data availability GCI tests of service availability Specific tests of standard product timeliness, content, and documentation Specific tests of requested services including special data management; special studies to improve estimated values for standard signal and event parameters, radionuclide spectrum analysis and atmospheric transport modelling; expert technical analysis to assist a state party in identifying the source of specific events; data access assistance; IMS Radionuclide Laboratories. Work to be Completed Includes handling and use of CNF, NTM, “other data” OSI support, etc.

15. International Data Centre October 2015Page 15 Possible Build-up Tests for Continuous Operation Experiment/Test 6-N: Sustained testing under various conditions One calendar month Sustained full scale operations of a month IMS tests of data availability GCI tests of service availability Specific tests of various services and products and under various conditions as necessary Work to be Completed

16. International Data Centre October 2015Page 16 Build-up Tests Coordination Tests must be coordinated to not conflict with other large-scale events and activities such as: GCI Transition CTBTO Science and Technology Conferences OSI Integrated Field Exercises O&M Workshops And to coincide with activities such as: NDC Preparedness Exercises Work to be Completed

17. International Data Centre October 2015Page 17 Thank-you