OCS Scheduler Status Francisco Delgado T&S Software Manager

Slides:



Advertisements
Similar presentations
GSMT Control Workshop Tucson, September 11-12, 2001 Pointing Control for a giant segmented mirror telescope Patrick Wallace Rutherford Appleton Laboratory.
Advertisements

Systems Engineering Breakouts George Angeli. Tuesday 11am Current Commissioning Plans – Chuck Claver Revised commissioning timeline Development plans.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
R R R CSE870: Advanced Software Engineering (Cheng): Intro to Software Engineering1 Advanced Software Engineering Dr. Cheng Overview of Software Engineering.
The Software Product Life Cycle. Views of the Software Product Life Cycle  Management  Software engineering  Engineering design  Architectural design.
SCEC: An NSF + USGS Research Center ShakeAlert CISN Testing Center (CTC) Development Philip Maechling Information Technology Architect Southern California.
LSST Scheduler Development Workshop Scheduler Design Francisco Delgado Sr. Software Engineer Telescope & Site.
4.x Performance Technology drivers – Exascale systems will consist of complex configurations with a huge number of potentially heterogeneous components.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
RUP Fundamentals - Instructor Notes
Control Software Integration German Schumacher T&S Software Lead.
LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site.
Rational Unified Process Fundamentals Module 4: Disciplines II.
LSST Telescope and Site Observatory Control System Interface Review Scheduler Design Francisco Delgado.
A Scheduling Algorithm with Dynamic Priorities Status Presentation Matias Mora Klein UTFSM Computer Systems Research.
Magnetic Field Measurement System as Part of a Software Family Jerzy M. Nogiec Joe DiMarco Fermilab.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
Ohio State University Department of Computer Science and Engineering 1 Cyberinfrastructure for Coastal Forecasting and Change Analysis Gagan Agrawal Hakan.
LSST Scheduler requirements
Software Engineering Tools Srinivasan Chandrasekharan Senior Software Engineer.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
LSST Scheduler construction plan Francisco Delgado Sr. Software Engineer Telescope & Site.
The Active Optics System S. Thomas and the AO team.
Science Concept for Additional Functionality in the Mosaic Planning Tool Jeff Valenti.
ADASS the Planning and Scheduling Perspective Roadmap: - How planning and scheduling fits in at ADASS - ADASS planning and scheduling posters and presentations.
Proposal: staged delivery of Scheduler and OpSim V1 (2016) meet most of the SRD requirements – Deliver a system that can be extended with an improved scheduler.
1 FINAL DESIGN REVIEW | TUCSON, AZ | OCTOBER 21-25, 2013 Name of Meeting Location Date - Change in Slide Master The LSST Opserations Simulator A. Saha.
1 Board Telescope & Site Tucson, Arizona July 18-20, 2011 LLST Control Software Review Resources Tucson, January
1 OBSERVATORY CONTROL SYSTEM (OCS) FRANCISCO DELGADO OCS CAM.
Commissioning Planning
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
Advanced Software Engineering Dr. Cheng
CIS 375 Bruce R. Maxim UM-Dearborn
Outline Locations SOCS Configuration UI OpSim4 Tools Docker.
Verification Matrix Process
Agenda ComCam planning and scheduling (James & Jacques) CCS & CCS-TCS Interface (Tony) Software to use ComCam Software to get data out of ComCam (Mike)
From LSE-30: Observatory System Spec.
Archiving and Document Transfer Utilities
Observatory Control System
National Institute of Standards and Technology (NIST) Advanced Manufacturing Technology Consortia (AMTech) Program Award Number: 70NANB14H056 Development.
Observing Modes: Nominal and Degraded
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
EO Applications Parallel Session
LSST Commissioning: FY18 Planning
Simulations, Metrics and Merit Functions for Mini-surveys and Deep Drilling 1.
Short term improvements to the Information System: a status report
Systems Architecture WG: Charter and Work Plan
OpSim4 vs OpSim3 Francisco Delgado
Joseph JaJa, Mike Smorul, and Sangchul Song
SOCS/Scheduler Development Plan Michael Reuter, Fransicso Delgado
EIN 6133 Enterprise Engineering
Design and Implementation
Chuck F Claver LSST System Scientist & Commissioning Lead
OCS Scheduler Status Francisco Delgado T&S Software Manager
LSST Project EVMS Performance Overview Kevin E
Management Breakout: MREFC Budget Summary Victor L
LSST Control Software Integration Francisco Delgado OCS Software Manager LSST Commissioning Plan Review January 24-26, 2017.
Software & Hardware for Wavefront Estimation Pipeline Development Te-Wei Tsai Software Engineer Joint Technical Meeting March 6, 2017.
Launch and On-orbit Checkout
Click to add title Planning for LSST Verification George Angeli LSST All Hands Meeting Tucson August 15, 2016.
Observatory Control System
Gustaaf van Moorsel September 9, 2003
Overview of Science Verification Plan Keith Bechtol and Zeljko Ivezic LSST Commissioning Plan Review January 24-26, 2017.
Project Information Management Jiwei Ma
Systems Engineering for Mission-Driven Modeling
GATES: A Grid-Based Middleware for Processing Distributed Data Streams
Software for Neutron Imaging Analysis
Presented By: Darlene Banta
GLAST Large Area Telescope:
Key Issues and Today’s Goals
Presentation transcript:

OCS Scheduler Status Francisco Delgado T&S Software Manager LSST Joint Technical Meeting 2017-03-07 | Glendale, CA

Automatic & Dynamic LSST Scheduler LSST as a robotic observatory Targets are Field/Filter Survey is automatic Multiple science goals Combine area distribution with temporal sampling Dynamic adaptation to weather Flexibility for survey adjustments during operations Flexibility for changes in science programs

Prototype History OpSim1 Proof of concept in IDL Simulation of visits with multiple science cases. OpSim2 Python Detailed model for the observatory and the weather Embedded Scheduler prototype Telescope design validation, site selection OpSim3 Additional science cases and scheduling algorithms Modular Scheduler prototype Parameters exploration, survey definition validation

OCS Requirements Flow Down Science Requirements Document LPM-17 Science Book Science Collaborations LSST System Requirements LSE-29 Metrics Requirements DOC-15319 Observatory System Specifications LSE-30 OpSim Requirements LSE-189 Telescope & Site Requirements LSE-60 Observatory Control System Requirements LSE-62 Scheduler Requirements LTS-347

History of Reviews 2011-08-29 NSF Preliminary Design Review 2012-05-30 NSF Joint Interface & Management Review 2013-02-06 OCS/TCS Software Review 2013-12-03 NSF Final Design Review 2014-02-04 OpSim/Scheduler Review 2014-08-01 Start of Construction 2014-09-10 OCS Interface Review 2016-02-08 NSF Status Review 2016-08-16 NSF/DOE Status Review 2016-10-20 OCS/TCS Software Status Review 2016-11-17 T&S Integration Review 2017-01-24 DOE/NSF Commissioning Review

Observatory Control System Control Context Observatory Control System TCS OCS Application OCS Scheduler CCS OCS Sequencer OCS EFD DMCS

Operations Simulator v4 Simulation Context Operations Simulator v4 OCS Scheduler Simulated OCS (SOCS)

OCS communications Middleware Control Data Flow OCS Operator OCS Remote OCS Monitor OCS Application Control Scheduler History OCS EFD OCS Sequencer Telemetry Image Quality Cmd Visits Targets Sched Telem Visits OCS communications Middleware TCS CCS DM

OCS communications Middleware Simulation Data Flow Control Scheduler History Telemetry Image Quality Targets Sched Telem Visits OCS communications Middleware SOCS

Internal Block Diagram Time Main Driver Sched Config Scheduler Sched Mode Control Targets Targets Downtime Cost functions Sched Telem Degraded Sched Telem Slew Time Observatory Model Telemetry Observatory conditions Sky Model Pre-Calc Data Candidates Weather forecast Proposals Image Quality Environment conditions Value functions History Quality parameters Observation History Past observations Visits Current observation 10

Science Proposal Classes Scripted proposals Designed to produce a pre-determined sequence Basic parameter: scripted cadence of targets Area distribution proposals Designed to obtain uniform distribution Basic parameter: goal visits per filter Look-ahead info: future available time for the targets Time distribution proposals Designed to obtain specified intervals in sequences Basic parameter: time window for visits interval Look-ahead info: visibility for next intervals

Accuracy changes Repeatability 100% repeatability in observations sequence and slew states Alt-Az precision Alt-Az estimated at slewInit and recalculated at slewFinal Difference can be seen between “target” and “slewFinalState” Remaining tracking time Taken into account before sending target (+30 seconds) Avoid reaching tracking limits in altitude, azimuth or rotator

Accuracy changes Sky brightness model New model, per band, includes explicit twilight Configurable moon avoidance New sky model also includes it (built-in) No caching ranks (reuse) Everything is ranked at each visit

Ranking a Target Hard constraints Global Filter change rate, burst and average Observatory kinematic limits Per Proposal Airmass Transparency Seeing Sky region (dynamic for rolling cadence) Per Filter sky brightness

Area distribution algorithms Need ratio

Area Distribution changes Time window hybrid Optional configurable grouped timed visits The first in the group is area ranked The followings in the group are time-window ranked Same night revisits constraint Revisits to the group during the same night can be avoided No overflow

Rank Bonuses Airmass bonus Hour Angle bonus

Ranking a Target Need Function Time Distribution Look-ahead: future sequence feasibility Value Function

Proposals priorities changes Self balancing mechanism

Slew time cost

Filter change cost

Final target rank Value Boost and Cost

Serendipity changes Proposal Id based PropId is included in the observation Winners and Losers counted If serendipity is allowed, both lists are searched Coadding is now optional Coadding values for a target in more than one proposal can be disabled

OCS Scheduler plan Scheduler v0.1 2015-July OCS Middleware framework Scheduler v0.2 2015-December Observatory kinematic model Scripted targets proposal Scheduler v0.3 2016-May Area distribution proposals Sky brightness model Airmass bonus Slew time cost function Dynamic configuration

OCS Scheduler plan Scheduler v1.0 2017-March Filter swaps around new moon Filter change rate constraints Filter change cost function Downtime handling Clouds handling Seeing handling Hour angle bonus Self balancing proposals Grouped visits for Area distribution proposals Time distribution proposals with sequences Parallel subsequences Rolling cadence Deep drilling

OCS Scheduler plan Scheduler v1.1 2017-August Deterministic look-ahead area distribution Scheduler v1.2 2017-December Deterministic look-ahead time distribution Scheduler v1.3 2018-April Speed performance improvements Scheduler v1.4 2018-October Warm start to resume partial survey

OCS Scheduler plan Scheduler v1.5 2019-March Dithering patterns Scheduler v2.0 2019-August Predicted schedule publication Scheduler v2.1 2019-December Weather forecast handling Scheduler v2.2 2020-May Community provided optimizations

(Metrics Analysis Framework) Validation OpSim (Operations Simulator) Observations Database Scheduler SOCS (Simulated OCS) MAF (Metrics Analysis Framework)

Analysis of runs

Quality Assurance Unit Test Integration Test with SOCS Algorithms Validation Validation runs by Systems Engineering Simulations Release Tests (includes installation and fiducial run) Scientific Validation by Science Collaborations Integration Tests with OCS

Software Engineering Tools Model Based Systems Engineering SysML modeling with Enterprise Architect PMCS with Primavera Coordination and progress with JIRA Documentation in Docushare Interface controlled in OCS SAL with XML Version control with Git, Stash Mirrored on GitHub Continuous Integration with Jenkins Coding standards from Telescope group and Simulations group

Summary Scheduling algorithms validated during prototype effort Scheduler designed for control and simulation context Development plan coordinated with SOCS for I&T Integration activities with Observatory Control System In Control context the Scheduler drives the LSST survey In Simulation context the Scheduler evaluates alternate surveys for parameters exploration and optimizations during operations