1. NCSA Plan for DPP: Construction and Operations of the LSST Data Facility Don Petravick, Paul Domagala, Margaret Johnson Joint Technical Meeting March 8, 2017

2. DPP is a kind of crossroads which couples Sci Ops, Obs Ops, Biz Ops, and EPO

3. Analogy: Transportation

10. Service Management
The way of organizing and managing what the computing and data systems do for you.
It is tied to use cases DPP satisfies
It is used internally within DPP
ITIL is a service-oriented operations framework.
Diverse services in a common model/govenance framework.
Guidance
Concepts + Vocabulary
Processes and roles
Basis for supporting management tooling.

11. Map the Requirements onto a Regular Operational Framework
Some aspects of
technical design
Regular planning and
management schema
This lead to l large plan that is I not custom spaghetti, Facorting laor accoring to skills and career paths, evaluation alternate implementations.

12. LSST/DPP structure
Specific Use Cases
The structure accommodates all use cases, driven by science requirements.
Supports Sci Ops, Obs Ops, Biz Ops, EPO, and General Infrastructure.

13. LSST/DPP structure
All work specific to satisfaction of a Use Case
Support Many
Use Cases
General Capabilities
Three Layer Business Architecture

14. LSST/DPP structure
Components

15. LSST/DPP structure
Cross-cutting elements provide for overall management and evolution of the system.
Cross-
cutting

16. What’s visible to you, outside of DPP?
The main agreement is in Service catalogs/Service agreements
What are we providing?
What use case(s) does it support?
Who are we doing it for?
SLT – How well do we need to do it?

17. Service Level Agreements (SLAs)
Detailed contract with the customers of a specific service that describes:
Hours of operation & support
Metrics that need to be achieved
Where to find information about the service
How we measure performance
Service history
It has an approval process
It is under change control

18. Example: Spectrograph Commissioned
Use Case
Support commissioning of the spectrograph.
DPP-offered Services
Archive the spectrograph data.
Extract, transform and load the EFD databases and large file annex.
Provide L1 complete test stand.
Reusable Services
Deploy instance of archiver. (EFD is its own thing)
Batch processing service.
Data, Compute and IT Security Services
File mirroring between Chile and NCSA; managed database services for file system metadata and for transformed EFD; batch system; authentication and authorization; network-based IT security; disaster recovery for spectrograph data and file annex.
ITC
Data acquisition at Base; Data Backbone at Base, Data Backbone at NCSA; batch platform.
Software
L1 archiving software, EFD ETL software, file management software, workload management system.
MoU
North-south networking; offsite DR.

19. Why IT Service Management
Repeatable process
Continuous improvement
Increased quality of service and reliability
Decreased cost
ITSM is to IT services what EVPM is to projects
Replace unstructured work patterns with intelligent workflows (Process)
IT Service Management
Incident Management
Problem Management
Change Management
Release Management
Asset Management
Service Catalog
Knowledge Management
IT Operations Management
Discovery
Service Mapping
Event Management
Orchestration
Cloud Management
Configuration Management Database
IT Business Management
Project Portfolio Management
Demand Management
Resource Management
Application Portfolio Management
Financial Management
Agile Development
Performance Analytics

20. Summary
Operations has defined an organization called “DPP” (soon to be the “LSST Data Facility and Operations”).
One set of cases is pipeline code from Science Operations.
DPP supports every other operational department in some way.
A detailed WBS is created, using a layered architecture and a standard set of operations concepts.
Services are stood up incrementally
Some services are already being provided.
There is no one grand integration.

21. Extra Slides

22. Constructing Processes
Draw the process, vet with stakeholders, revise. Repeat as necessary
Exercise/stress-test & revise again
Find a good production-quality tool & implement it.

25. A common IT change management process
How W. Edwards Deming suggested we do things
(yes, he was correct)