1. LDF “Highlights,” May-October 2017 (1)
Services Supporting Observatory Operations (aka Level 1 Services)
Installation of DAQ in Level 1 Complete Test Stand and integration of Archiver.
Hosted Systems Engineering Early Pathfinder software integration workshop. Exercise command sequence for single main camera visit.
Preliminary design and review of Header Builder.
Batch Production Services
Completed reprocessing campaign of HSC SSP PDR1. Continued biweekly RC processing campaigns.
Unit-tested DESDM framework on verification cluster using Oracle DB instance for storing metadata, provenance, location.
Containerized Application Management Services
Deployed instance of Kubernetes on the NCSA Nebula as functional integration platform. Deployed JupyterLab container, integrated with LSST IdM system, read-only GPFS.
Deployed test Kubernetes in VM to prototype functionalities and stability, and to advise FY18 Acquisition Strategy of establishing Kubernetes core. Investigated OpenShift container orchestration and management system to understand functionalities on top of bare Kubernetes, how these support facility concerns of resource management, flexible provisioning, security. (tech note forthcoming)
DMLT F2F | Tucson, AZ |

2. LDF “Highlights,” May-October 2017 (2)
ITC
Completed detailed specification and procurements of remaining FY17 capabilities: Base AA & Network Security systems at interim facility (prototypes site coordination and support), single-node Oracle system for first standalone consolidated database (used through ComCam), and 3-PB storage expansion for production file systems.
Completed FY18 Acquisition Strategy plan defining capabilities to be procured.
Continuous operational support of developer and integration systems and services.
Management of Facility
Baselined LSST Data Facility plan, transitions LDF from construction to operations.
Began recording mid-level architecture as defined in the rebaselined WBS in TOGAF standard architecture language (ArchiMate), which follows the layered service architecture we have used as the framework of our plan. Supports overall management of the Data Facility.
Working Groups
SuperTask and Butler working groups participation to represent facility operations needs and assure production use cases are supported by proposed architecture.
Began chairing and leading activities for the Lossy Compression Working Group.
DMLT F2F | Tucson, AZ |

3. FY18 Goals (1) – Support Major Milestones
HSC Reprocessing – Nov 2017
Goal: Production processing using initial version of production workflow system and production file system context.
Spectrograph Test Stand in Tucson -- Feb 2018
Goal: Read out the Spectrograph with the L1 archiver service software and archive data as FITS files to local disk. Provide ability for operator to ingest (transfer and record) selected engineering data into Data Backbone at NCSA. Provide access to files for staff via mounted filesystem (read-only) on lsst-dev and web download.
Spectrograph On Sky – Aug 2018
Goal: Spectrograph Service Bundle deployed in production – Spectrograph Archiving Service, EFD ETL Service, Observatory Operations Data Service, header writer deployed in Observatory system. Offline campaign processing service for spectrograph data use cases.
DMLT F2F | Tucson, AZ |

4. FY18 Goals (2) – Evolution of Facility
Provide offline L1 processing service, develop first-order QA processes. Facility scientist to liaison and set up.
Support single production framework. Integrate Butler and SuperTask components as available and verify use in production.
Deploy instance of LSP for Staff at NCSA. Facility scientist to start integrating components, liaising with groups providing components, using like in production, understanding system from an operational perspective. Extends to the PDAC integration platform while maintaining primary focus on the production instance for staff.
File management for production file systems, including backup and disaster recovery services. Administration of raft-scale consolidated DB.
(Selected) FY18 Acquisition Strategy capabilities support
establishing LDF core Kubernetes commons at NCSA. Supports development, integration and production use cases.
completing the Level 1 Complete Test Stand to fully support all Observatory components and early pathfinder activities.
establishing data transfer service for data transfer between sites. Contexts: ingest from test stands and instruments, export to authorized users, staging for batch production by workload management system.
deploying Summit endpoint for AA and network security.
supporting Spectrograph service bundle in Chile, including Base site file systems.
integrating MyDB capability with PDAC.
(late FY18) prep for initial commissioning cluster – batch, Kubernetes, consolidated database for MyDBs.
flexible provisioning, remote provisioning, development of administrative processes.
provisioning LSST core network fabric in NPCF.
Support flexible provisioning of commons for separate enclaves; ability to exploit idle Kubernetes nodes for batch production.
Establish service-level monitoring for all services we are currently running and plan to have running in FY18.
24/7 incident response for services running in Chile, beginning with deployment of AA & security services.
Processes for managing incidents, requests, changes, problems. Integration with existing workflows and systems (NCSA ICI, LSST ITSC).
Metrics for capacity and availability management. Supports acquisition strategy planning.
Support commissioning planning efforts
DMLT F2F | Tucson, AZ |