Sked: Past, Present & Future John M. Gipson NVI, Inc./GSFC 3rd IVS General Meeting Ottawa, Ontario February 9-11, 2003.

Slides:



Advertisements
Similar presentations
Yokogawa Network Solutions Presents:
Advertisements

Short introduction to the use of PEARL General properties First tier assessments Higher tier assessments Before looking at first and higher tier assessments,
CC SQL Utilities.
MASTER QUOTE OVERVIEW.
McGraw-Hill/Irwin ©2008 The McGraw-Hill Companies, All Rights Reserved TECHNOLOGY PLUG-IN T4 PROBLEM SOLVING USING EXCEL Goal Seek, Solver & Pivot Tables.
Decision Analysis Tools in Excel
Ispd-2007 Repeater Insertion for Concurrent Setup and Hold Time Violations with Power-Delay Trade-Off Salim Chowdhury John Lillis Sun Microsystems University.
Templates and Styles Excel Advanced. Templates are pre- designed and formatted spreadsheets –They provide consistency of layout/structure –They.
Thermoflow, Inc. TOPS stands for Thermoflow’s Optimization System and is a general purpose optimizer for use with Thermoflow’s core programs. TOPS runs.
MCTS GUIDE TO MICROSOFT WINDOWS 7 Chapter 10 Performance Tuning.
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 19 Scheduling IV.
HORIZONT 1 ProcMan ® The Handover Process Manager Product Presentation HORIZONT Software for Datacenters Garmischer Str. 8 D München Tel ++49(0)89.
Prediction to Protein Structure Fall 2005 CSC 487/687 Computing for Bioinformatics.
VieVS User Workshop 14 – 21 September, 2011 Vienna Reprocessing the complete history of VLBI observations with VieVS Sigrid Böhm.
VieVS User Workshop 7 – 9 September, 2010 Vienna VIE_SCHED Jing SUN.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 11: Monitoring Server Performance.
INFO 624 Week 3 Retrieval System Evaluation
Academic Advisor: Prof. Ronen Brafman Team Members: Ran Isenberg Mirit Markovich Noa Aharon Alon Furman.
Bioinformatics Challenge  Learning in very high dimensions with very few samples  Acute leukemia dataset: 7129 # of gene vs. 72 samples  Colon cancer.
VieVS User Workshop 14 – 16 September, 2011 Vienna VIE_SCHED Jing SUN.
Concepts of Database Management Sixth Edition
Congratulations! You have successfully logged into the EIM/ESM DMH Release 5 Online Meeting  New Business Processes  R5 Changes  Contract Activation.
Patch Management Module 13. Module You Are Here VMware vSphere 4.1: Install, Configure, Manage – Revision A Operations vSphere Environment Introduction.
The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.
An Introduction to Support Vector Machines Martin Law.
PPOUG, 05-OCT-01 Agenda RMAN Architecture Why Use RMAN? Implementation Decisions RMAN Oracle9i New Features.
Efficient Model Selection for Support Vector Machines
Chapter 8: Systems analysis and design
MCTS Guide to Microsoft Windows 7
© 2010 VMware Inc. All rights reserved Patch Management Module 13.
Concepts of Database Management Seventh Edition
© 2012 MISTRAS GROUP, INC. ALL RIGHTS RESERVED. DISSEMINATION, UNAUTHORIZED USE AND/OR DUPLICATION NOT PERMITTED. TankReporter 2.0 A Step by Step Example.
Cascade Correlation Architecture and Learning Algorithm for Neural Networks.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
Chapter 6 SAS ® OLAP Cube Studio. Section 6.1 SAS OLAP Cube Studio Architecture.
My talk describes how the detailed error diagnosis and the automatic solution procedure of problem solving environment T-algebra can be used for automatic.
Reusability and Effective Test Automation in Telecommunication System Testing Mikael Mattas Supervisor: Professor Sven-Gustav Häggman Instructor: B.Sc.
ALMA Integrated Computing Team Coordination & Planning Meeting #1 Santiago, April 2013 Relational APDM & Relational ASDM models effort done in online.
Systems Software Operating Systems. What is software? Software is the term that we use for all the programs and data that we use with a computer system.
Concepts of Database Management Seventh Edition
An Introduction to Support Vector Machines (M. Law)
1 © 2006 Nokia pullola_ ppt / Extending Base Station Active Radio Link Set for Improved Uplink Scheduling Esa-Pekka Pullola Supervisor:
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
2005MEE Software Engineering Lecture 11 – Optimisation Techniques.
Update on replica management
Training and Evaluation Tool Milan Jovic Dusan Jevtic Dr Dragan Jankovic Public Reporting on Project Results TEMPUS project.
1 CS 552/652 Speech Recognition with Hidden Markov Models Winter 2011 Oregon Health & Science University Center for Spoken Language Understanding John-Paul.
MySQL and GRID status Gabriele Carcassi 9 September 2002.
Monte-Carlo based Expertise A powerful Tool for System Evaluation & Optimization  Introduction  Features  System Performance.
Using Symbolic PathFinder at NASA Corina Pãsãreanu Carnegie Mellon/NASA Ames.
Dionex Corporation Designs, manufactures and sells chemical analysis equipment Based in Sunnyvale, California Employs more than 1,200 people worldwide.
Text Retrieval and Spreadsheets Session 4 LBSC 690 Information Technology.
Chapter. 3: Retrieval Evaluation 1/2/2016Dr. Almetwally Mostafa 1.
1 Object-Oriented Analysis and Design with the Unified Process Figure 13-1 Implementation discipline activities.
An Interval Classifier for Database Mining Applications Rakes Agrawal, Sakti Ghosh, Tomasz Imielinski, Bala Iyer, Arun Swami Proceedings of the 18 th VLDB.
1 Chapter Overview Monitoring Access to Shared Folders Creating and Sharing Local and Remote Folders Monitoring Network Users Using Offline Folders and.
Be “GUI ready” developing in RPG by Robert Arce from PrismaTech. Be “GUI ready” developing in RPG-ILE Presented by: Robert Arce.
Field System Status and Plans Ed Himwich, John Gipson, and Ed Himwich, John Gipson, and Jonathan Quick.
HSC Queue Mode Implementation Plan ~ Stage I, II, III ~ Tae-Soo Pyo Subaru Telescope /01/15.
1 Berger Jean-Baptiste
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
Scenario use cases Szymon Mueller PSNC. Agenda 1.General description of experiment use case. 2.Detailed description of use cases: 1.Preparation for observation.
( ) 1 Chapter # 8 How Data is stored DATABASE.
1 Scheduling Requirements ● overview ● scheme ● requirements ● open questions.
Fundamental of Databases
GML in CDI and CSR ISO using Ends&Bends
B. Jayalakshmi and Alok Singh 2015
TransCAD Vehicle Routing 2018/11/29.
Chapter 6 Network Flow Models.
M. Kezunovic (P.I.) S. S. Luo D. Ristanovic Texas A&M University
Presentation transcript:

Sked: Past, Present & Future John M. Gipson NVI, Inc./GSFC 3rd IVS General Meeting Ottawa, Ontario February 9-11, 2003

Agenda Past—Outline of major changes Present—How it works, what it does Recent changes Future—Plans

Purpose of Sked Create schedules that meet the goals of the session. Take care of much of the detail work involved in scheduling a session. Allow easy creation of geodetic or astrometric schedules.

History 1978 Basic program created (Nancy Vandenberg) –command line input –manual selection of scans –catalogs for sources, stations, equipment 1981 Automatic calculation of antenna motion and tape handling 1988 Automatic selection of observations (Autosked) –Optimization by strict covariance Evaluation of schedules using SOLVE simulations –Creation of pseudo-databases to evaluate formal errors Autosked merged into standard version. –“Strange” schedules 1993 Rule based scheduling of sources Mark IV/VLBA recording mode support added 1997 Numerous changes –Support for VEX files –Y2K fixes, –new Java-based catalog interface –S2 and K4 support

Sked Data Flow Master File (Experiment, date, stations) Sked Catalogs: Sources Stations Equipment … Old sked file Scheduler: Selects sources Selects recording mode. Sets scheduling parameters (SNR targets, procedures, timing) Sets optimization parameters (sky coverage, minimize slewing time, maximize observations, etc.)

Sked Data Flow Master File (Experiment, date, stations) Sked Catalogs: Sources Stations Equipment … Old sked file New Sked file CDDISA StationsCorrelator Schedule put on CDDISA Picked up by stations Picked up by correlator

Sked Data Flow Master File (Experiment, date, stations) Sked Catalogs: Sources Stations Equipment … Old sked file New Sked file CDDISA Vex file StationsCorrelator generates vex file to use in correlation

Sked Output General information about experiment: Sources –Flux models –Positions Station positions Antenna information –Equipment –Horizon mask Equipment –Receivers –Recorders Recording mode setup Scheduling parameters –SNR targets, maximum scan lengths –Procedure timing –Recording mode: stop& stop, continuous, adaptive. Schedule

Sked Modes Manual. –Scheduler chooses stations and scans –Sked has utilities for displaying whats up, etc. Automatic –Sceduler specifieds some time interval, e.g. 17:00:00 to 23:00:00 –Sked chooses scans during this interval Mixed –Automatic and manual interspersed

How AutoSked Works Find All Scans Start within 10 min Rank by Major Option Sky coverage Covariance Rank by Minor Options: # of Observations Rise/Set Tape Wastage … May discard some Keep best X% Keep best scan More Time? Done YesNo Compute score based on minor options

Recent Changes Fill in mode Best N “Astrometric” –Soft constraints to increase observing of weak sources –Won’t talk about this morning Source monitoring Common feature: Try to make sked more automatic, easier to use.

Fill In Mode Typical Scan for 8 station session Original Scan28 Obs=(8*7)/2

Fill In Mode Motivation: Minimize idle time. Typical Scan for 8 station session Strong stations finish first S S S Start End Time

Fill In Mode Motivation: Minimize idle time. Typical Scan for 8 station session Strong stations finish first Weak stations finish last S S S W W Start End Time

Fill In Mode Schedule scan using free stations Scan End Original Scan28 Obs=(8*7)/2 Fill in Scan3 Obs=(3*2)/2

Fill In Mode Repeat until no more idle time. Scan End Fill in Scan 2 Allowable excess Original Scan28 Obs=(8*7)/2 Fill in Scan 13 Obs=(3*2)/2 1 Obs

Best N: Goal Automatically choose best N sources for a session based on: –Network –Schedule start and stop times –Sky coverage –Source strength –Structure

Best N Algorithm 1.Find starting universe of sources: A.Read in all sources in geodetic catalog B.Read in associated fluxes C.Find all sources that are up on two or more baselines for some part of the experiment. D.Exclude sources close to the sun. 2.Rank the sources A.Schedule set of psuedo-scans that span experiment. B.Compute figure of merit for each scan: a.# of obs b.1/ (Scan Time) c.(# of obs)/(Scan time) C.Find total over all scans. 3.Combine with sky coverage to obtain final list

Best N Sky Coverage Universe of possible sources

Best N Sky Coverage A.. Start with good source A.... Highest Ranked Source

Best N Sky Coverage A.. Start with good source Add good source far from A. If several sources are similar in distance, choose highest ranking....B. Far from A.B’

Best N Sky Coverage A.C’. Start with good source Add good source far from A Add good source far from A&B If several sources are similar in distance choose higher ranked..C..B.. Far from A&B

Best N Sky Coverage A.D. Start with good source Add good source far from A Add good source far from A&B Add good source far from A&B&C … Quit when you have N-sources.C..B..

Source Monitoring Regular monitoring of geodetic and astrometric sources Should be (semi-)automatic Catch geodetic sources if they go bad Promote astrometric sources to geodetic if they are good Monitor stability of astrometric sources

Source Monitoring Lists Geodetic sources: –Current NASA catalog of 114 geodetic sources. –Goal is to observe 12/year. Astrometric sources –Defining sources in CRF –Martine’s stable sources –Martine’s sources which are not known to be unstable –About 400 sources in this list. –Observe 2/year

VLBI Summary Database (VSDB) For each experiment & each source: –Date –# of observations scheduled –# of observations correlated –# of observations good List of sources to monitor –Desired # of obs/year Masterfile in MYSQL format Implemented in MYSQL –Open source –Freely available –Can connect to database over net

Source Monitoring Dataflow SKED VSDB 1.Query database for #obs/src. Pick X underobserved sources Number of sources is user option. Typical number ~10. Sources chosen using Best N algorithm These sources are augmented from geodetic catalog using Best N. Total sources ~60.

Source Monitoring Dataflow SKED Schedule on CDDISA VSDB 1. Query database for #obs/src 2. Generate Schedule and put on CDDISA

Source Monitoring Dataflow SKED Schedule on CDDISA VSDB 3. Update VSDB NumSked NumGood=NumSked 1. Query database for #obs/src 2. Generate Schedule and put on CDDISA This is done automatically!

Source Monitoring Dataflow SKED Schedule on CDDISA VSDB 3. Update VSDB NumSked NumGood=NumSked Database from correlator 4. Update VSDB: NumCorr NumGood Also Automatic 1. Query database for #obs/src 2. Schedule Ready

Near Term Plans Better astrometric support Mark5 aware Linux What would you like?

Conclusions Sked is alive well Recent changes made to make it better User input always welcome