Click to add title Planning for LSST Verification George Angeli LSST All Hands Meeting Tucson August 15, 2016.

Slides:



Advertisements
Similar presentations
Systems Engineering Breakouts George Angeli. Tuesday 11am Current Commissioning Plans – Chuck Claver Revised commissioning timeline Development plans.
Advertisements

Verification Planning and Compliance Matrices Brian Selvy Wednesday, August 13, :30 – 5:00 p.m. Phoenix West Conference Room.
NGAO Team Meeting Management Peter Wizinowich May 26, 2009.
NGAO System Design Phase System & Functional Requirements Documents NGAO Meeting #6 Peter Wizinowich April 25, 2007.
Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)
LSST Camera Performance and Safety Assurance Plan and Safety Overview Joe Kenny Camera Safety Manager LSST Safety Council Review 18 August 2015.
Framework for Compliance, Verification, and Non-Conformance George Angeli LSST All-Hands Meeting Bremerton August 17, 2015.
LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site.
Common PDR Problems ACES Presentation T. Gregory Guzik March 6, 2003.
Verification and Validation on LSST Brian Selvy LSST All-Hands Meeting Bremerton August 17, 2015.
Software System Engineering: A tutorial
CS 360 Lecture 3.  The software process is a structured set of activities required to develop a software system.  Fundamental Assumption:  Good software.
VST: dome THE LIFE CYCLE OF MODERN TECHNOLOGICAL PROJECTS Ing. Davide Fierro THE LIFE CYCLE OF MODERN TECHNOLOGICAL PROJECTS.
LSST Scheduler requirements
ISM 5316 Week 3 Learning Objectives You should be able to: u Define and list issues and steps in Project Integration u List and describe the components.
LSST Camera CD-3 Review Brookhaven National Laboratory, Brookhaven, NY LSST Safety Council Camera Review Bremerton, WA 2015 LSST Camera Environment,
Project Proposal Document Optimization 15 February 2007 Team members: Chris Catalano Chun-Yu Chang Chris Joson David Matthes.
Request for Proposal (RFP)
LSST Scheduler construction plan Francisco Delgado Sr. Software Engineer Telescope & Site.
Solar Probe Plus A NASA Mission to Touch the Sun March 2015 Instrument Suite Name Presenter's Name.
SRR and PDR Charter & Review Team Linda Pacini (GSFC) Review Chair.
Software Development Process CS 360 Lecture 3. Software Process The software process is a structured set of activities required to develop a software.
SwCDR (Peer) Review 1 UCB MAVEN Particles and Fields Flight Software Critical Design Review Peter R. Harvey.
Prepared by Amira Selim 31 st October 2009 Revised by Dahlia Biazid Requirements Analysis.
6/6/ SOFTWARE LIFE CYCLE OVERVIEW Professor Ron Kenett Tel Aviv University School of Engineering.
Request for Proposal (RFP) In response to the RFP – the first step is to prepare a proposal 1. Review Customer Requirements and come up with candidate.
Installation and Commisioning SE view point Romuald Duperrier ESS SE manager.
1 Board Telescope & Site Tucson, Arizona July 18-20, 2011 LLST Control Software Review Resources Tucson, January
1 OBSERVATORY CONTROL SYSTEM (OCS) FRANCISCO DELGADO OCS CAM.
PRODUCT VERIFICATION Adapted from the NASA Systems Engineering Handbook for CSULB EE 400D by Alia Bonetti.
Commissioning Planning
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
LSST Commissioning Status Update & Overview Charles (Chuck) Claver LSST System Scientist SAC Meeting March 5, 2017.
Camera PDR/CD1 Planning 19 September 2008
Verification Matrix Process
Supportability Design Considerations
Telescope Assembly, Integration and Verification (AIV) WBS 04C. 14 J
Systems Engineering, Verification, and Commissioning for LSST George Z
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
Chapter 6: Database Project Management
LSST Commissioning: FY18 Planning
Verifying – Evaluating Software Estimates
Session 5b Dr. Dan C. Surber, ESEP
Chuck F Claver LSST System Scientist & Commissioning Lead
OCS Scheduler Status Francisco Delgado T&S Software Manager
Enterprise Content Management Owners Representative Contract Approval
Peer Review Agenda (Suggested).
System Verification Plans Brian Selvy Systems Engineering Manager Kathryn Wesson Systems Engineer LSST Commissioning Plan Review January 24-26, 2017.
Request for Proposal (RFP)
Raytheon Parts Management
Quality Management Systems – Requirements
ENGINEERING MANAGEMENT (GE 404)
DOE: Transition from MIE to Early Operations Kevin Reil LSST Camera Commissioning Lead LSST Commissioning Plan Review January 24-26, 2017.
Engineering Processes
NASA Independent Reviews -Lessons Learned-
ENGINEERING MANAGEMENT (GE 404)
Management Breakout: MREFC Budget Summary Victor L
LSST Control Software Integration Francisco Delgado OCS Software Manager LSST Commissioning Plan Review January 24-26, 2017.
Multi Subsystem Software Pathfinders
OCS Scheduler Status Francisco Delgado T&S Software Manager
Lockheed Martin Canada’s SMB Mentoring Program
CIS12-3 IT Project Management
Overview of Science Verification Plan Keith Bechtol and Zeljko Ivezic LSST Commissioning Plan Review January 24-26, 2017.
Instrument PDR Summary of Objectives
Engineering Processes
Introduction and Overview
PSS verification and validation
DOE Review of the LCLS Project October 2006
Atefeh Sadeghzadeh Control engineer – Target safety and control
ESHAC #8 Safety Readiness Review Thomas Hansson, ESH
Presentation transcript:

Click to add title Planning for LSST Verification George Angeli LSST All Hands Meeting Tucson August 15, 2016

Overview Metrics Atmosphere “Long poles” in the budget Current estimates M1M3 fabrication Dome seeing Summary

Requirement Validation System requirements validation Did we specify the right system? Assuming the system meets its requirements, can we do the envisioned science with it? Requirements flow down (subsystem requirements validation) Did we specify the right subsystems? Assuming each subsystem meets its requirements, will the entire system meet the top level requirements? History by now: Demonstrated at FDR

System Verification against Requirements Subsystem design and construction verification Did we design and build the subsystems right? Do the subsystems meet their requirements? System design and construction verification Did we design and integrate the system right? Does the system meet its requirements? Inspection, demonstration, analysis, test during Subsystem Integration and Test System Commissioning Verify as early as possible!

Phase III of Commissioning System Validation Science validation Did we build the right system? Can the observatory deliver the science expected? Demonstrate that LSST is capable of providing the science it is meant to Full validation requires full survey (10 years of operations) Science Commissioning (2nd year of Commissioning) Verify single visit SRD requirements Verify full survey SRD image stacking performance (depth and PSF shape) using limited number of objects Verify full survey SRD area coverage by time-proportional area coverage Demonstrate that LSST is ready for self-directed operations through an autonomous mini-survey (30 days) Phase III of Commissioning

System Verification Process (LSE-160) Detailed Verification Plan (Matrix), including (for each requirement) Verification Owner (Responsible Technical Authority) Verification Method(s) - test, analysis, inspection, demonstration Verification Level - same level, higher level, lower level Verification Requirement - what will be done, where it will be done, what equipment and project hardware/software is needed Success Criteria - explicit pass/fail criteria This Fall Including equipment and software Commissioning Reviews PDR in early 2017 FDR in early 2019

Verification Primary Responsibilities Science Requirements Document (LPM-17) LSST System Requirements (LSE-29) Project Systems Engineering (PSE) Obs. System Specifications (LSE-30) Observatory Control System (LSE-62) Telescope & Site (LSE-60) Camera (LSE-59) Data Management (LSE-61) EPO (LSE-89) Subsystem Systems Engineering with PSE assistance System Interfaces

Verification Development Sequence Develop/finalize tools for verification planning SysML templates and add-ons August 31, 2016 Define the distribution of verification tasks between system and subsystem levels – enable subsystem teams to proceed on their own Verification methods and owners for design and interface requirements Proposal for database use October 10, 2016 Develop bottom-up verification information flows and activity diagrams SysML interdependency and sequencing charts November 4, 2016 Fold verification information into commissioning plan Staffing, cost, and schedule in PMCS November 18, 2016 Subsystem I&T reviews Telescope & DM November 18, 2016 Preliminary Commissioning Review Preliminary Verification Plans January 31, 2017

Detailed Verification Planning Planning for LSST Verification https://docushare.lsstcorp.org/docushare/dsweb/Get/Document-21541/Verification%20Planning%20v5.docx Commissioning Review Preparation Milestone https://docushare.lsstcorp.org/docushare/dsweb/Get/Document-21685/ComReview_planning_schedule_v2.xlsx

Verification Workshop in Tucson Week of October 10 Finalize system level Verification Matrices – gateway to system level detailed commissioning planning Input to grouping into Verification Events Input to sequencing these events Review status of subsystem Verification Matrices – gateway to subsystem detailed planning for I&T reviews Subsystem requirements document Subsystem interfaces Intra-subsystem verification matrices

Subsystem I&T Reviews Weeks of November 7 & 14 Charge Integration & Test Plan, advised by Verification Matrix Verification methods, owner, level, requirements, success criteria Activities, events, and their sequence Integration and test schedule, interfaces and interdependencies Integration and test equipment and software definition and design Organization structure for I&T Schedule and budget for I&T Safety (hazards) analysis Technical and programmatic risks

Pathfinder for Compliance Confluence page (part of System Verification & Compliance) https://confluence.lsstcorp.org/display/SYSENG/Key+Performance+Metrics Compliance evaluation for the Key Performance Metrics Single visit image quality, ellipticity, throughput, limiting depth Critical steps Receive verification data approved for representativness, completeness, and correctness by Subsystem teams or System Commissioning team Archive the data in the verification archive May or may not be the same as the subsystem long term store Process the data to demonstrate compliance status From comparing two numbers To complex integrated and/or end-to-end simulations

Data Flow Diagram

Reference Pointers