A Scheduling Algorithm with Dynamic Priorities Status Presentation 2011-03-18 Matias Mora Klein UTFSM Computer Systems Research.

Slides:



Advertisements
Similar presentations
National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
Advertisements

Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array The March to Early.
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 19 Scheduling IV.
Improving Market-Based Task Allocation with Optimal Seed Schedules IAS-11, Ottawa. September 1, 2010 G. Ayorkor Korsah 1 Balajee Kannan 1, Imran Fanaswala.
CPSC 322, Lecture 15Slide 1 Stochastic Local Search Computer Science cpsc322, Lecture 15 (Textbook Chpt 4.8) February, 6, 2009.
Discrete-Event Simulation: A First Course Steve Park and Larry Leemis College of William and Mary.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array.
Distributed Scheduling. What is Distributed Scheduling? Scheduling: –A resource allocation problem –Often very complex set of constraints –Tied directly.
Data Structures and Programming.  John Edgar2.
Introducing Astronomy Education into High School Physics Curriculum Through the Use of the University of North Dakota Observatory Caitlin Nolby Space Studies.
CISC673 – Optimizing Compilers1/34 Presented by: Sameer Kulkarni Dept of Computer & Information Sciences University of Delaware Phase Ordering.
Operations Research Models
C. ChandlerEVLA Advisory Committee Meeting September 6-7, Scientific Commissioning Plan Claire Chandler.
 Scheduling  Linux Scheduling  Linux Scheduling Policy  Classification Of Processes In Linux  Linux Scheduling Classes  Process States In Linux.
Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.
LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site.
Computer Architecture and Operating Systems CS 3230: Operating System Section Lecture OS-3 CPU Scheduling Department of Computer Science and Software Engineering.
GBT Dynamic Scheduling System (DSS) Dana Balser, Jim Braatz, Mark Clark, Jim Condon, Ray Creager, Mike McCarty, Ron Maddalena, Paul Marganian, Karen O’Neil,
ALMA Operations and the North American ALMA Science Center Al Wootten NRAO.
ICT Coordination and Planning Meeting #1 (17-19 April 2013) ALMA Dashboard 1.0 Giorgio Filippi The Atacama Large Millimeter/submillimeter Array.
LSST Scheduler requirements
Introduction to Job Shop Scheduling Problem Qianjun Xu Oct. 30, 2001.
1 Performance Evaluation of Computer Systems and Networks Introduction, Outlines, Class Policy Instructor: A. Ghasemi Many thanks to Dr. Behzad Akbari.
ALMA Integrated Computing Team Coordination & Planning Meeting #2 Santiago, January 2014 Control Group Planning Rafael Hiriart, Control Group Lead.
ALMA Integrated Computing Team Coordination & Planning Meeting #1 Santiago, April 2013 Relational APDM & Relational ASDM models effort done in online.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array CASA Progress.
Maximum Network Lifetime in Wireless Sensor Networks with Adjustable Sensing Ranges Cardei, M.; Jie Wu; Mingming Lu; Pervaiz, M.O.; Wireless And Mobile.
Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.
Modeling and Simulation Discrete-Event Simulation
Observation Scheduling Review of SSS Software Readiness for SRO, June 5, 2009 Bryan Butler EVLA Computing Division Head.
1 R. D. Gehrz 67th International Symposium on Molecular Spectroscopy, Columbus, OH, June 21, 2012 The Stratospheric Observatory for Infrared Astronomy.
Solar-B SOT/FPP 1 SOT April 2006Ted Tarbell SOT Collaboration & Data Policy Ted Tarbell, for the Science Working Group 18-Apr-2006.
LHCb Software Week November 2003 Gennady Kuznetsov Production Manager Tools (New Architecture)
LSST Scheduler construction plan Francisco Delgado Sr. Software Engineer Telescope & Site.
The North American ALMA Science Center North America’s ALMA Regional Center The North American ALMA Science Center acts as the gateway to ALMA for North.
Solving the Maximum Cardinality Bin Packing Problem with a Weight Annealing-Based Algorithm Kok-Hua Loh University of Maryland Bruce Golden University.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array FPGA Spectrometer.
ICALEPCS’ GenevaACS in ALMA1 Allen Farris National Radio Astronomy Observatory Lead, ALMA Control System.
2007Sep06 EAC Butler - Software Overview 1 Software Overview Bryan Butler.
Observing Modes from a Software viewpoint Robert Lucas and Philippe Salomé (SSR)
The Very Small Array Angela Taylor & Anze Slosar Cavendish Astrophysics University of Cambridge.
ALMA Integrated Computing Team Coordination & Planning Meeting #1 Santiago, April 2013 Telescope Calibration Planning Dominique Broguiere.
Gustaaf van MoorselEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Computing Organization/Development.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Observing with NRAO.
ALMA and the Call for Early Science The Atacama Large (Sub)Millimeter Array (ALMA) is now under construction on the Chajnantor plain of the Chilean Andes.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
ICALEPCS 2005 Geneva, Oct. 12 The ALMA Telescope Control SystemA. Farris The ALMA Telescope Control System Allen Farris Ralph Marson Jeff Kern National.
ADASS the Planning and Scheduling Perspective Roadmap: - How planning and scheduling fits in at ADASS - ADASS planning and scheduling posters and presentations.
Proposal: staged delivery of Scheduler and OpSim V1 (2016) meet most of the SRD requirements – Deliver a system that can be extended with an improved scheduler.
SunSatFriThursWedTuesMon January
ALMA Integrated Computing Team Coordination & Planning Meeting #1 Santiago, April 2013 ICT Group planning: Scheduling Jorge Avarias ICT Scheduling.
The U.S.S.E Team #4 Antonio Alvarez Janice Cruz Jose L. Gamboa Miguel Rivera Status Report #1 January 26 th, 2009 Description: A follower robot that will.
ALMA Common Software Basic Track Project Lifecycle.
HSC Queue Mode Implementation Plan ~ Stage I, II, III ~ Tae-Soo Pyo Subaru Telescope /01/15.
ALMA Common Software Basic Track Component/Container Model and Lifecycle Management.
WVU Astronomy / Engineering and The Green Bank Observatory Richard Prestage Scientist, NRAO.
Towards a Generic Hardware Device Simulation Framework applied to Telescope Control Systems Matias Mora Klein Memoria para optar al título de Ing. Civil.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array ngVLA: Reconfigurability.
Embedded System Scheduling
ALMA Software Scheduling subsystem Planning for cycle5 onwards
PRTS & KPI Nick Whyborn – Vasco Cortez
The Web Application Development Process Models
Approximation Algorithms
OCS Scheduler Status Francisco Delgado T&S Software Manager
Greedy Methods Knapsack Problem Hoffman Codes
Gustaaf van Moorsel September 9, 2003
Observatory Science Operations
Observatory Science Operations
IIS Progress Report 2016/01/18.
Presentation transcript:

A Scheduling Algorithm with Dynamic Priorities Status Presentation Matias Mora Klein UTFSM Computer Systems Research Group Atacama Large Millimeter/submillimeter Array Advisor: Dr. Mauricio Solar (UTFSM)‏ ‏Co-Advisor: Dr. Víctor Parada (USACH)

A Scheduling Algorithm with Dynamic Priorities 2 Problem Description Observation Proposals Observation Proposals Scheduling Plan Scheduling Plan External Factors External Factors Execution Priorities Execution Priorities Re-Scheduling “Maximize the scientific throughput of the telescope” [Sessoms09]

A Scheduling Algorithm with Dynamic Priorities 3 Problem Description

A Scheduling Algorithm with Dynamic Priorities 4 State of the Art The (dynamic) scheduling problem Basic “job shop” problem Dynamic “on-line” approach (CSP) Astronomical observations problem Proposal → Observing time → Observation block(s) Long-term plan:  source visibility, sky brightness Short-term plan:  atmospheric conditions, technical failure

A Scheduling Algorithm with Dynamic Priorities 5 State of the Art: Current Approaches Hubble Space Telescope (HST) Zweben, et al. (1994), Muscettola, et al. (1996) Very Large Telescope (VLT) Johnston (1988), Silva (2002) Subaru Telescope Sasaki, et al. (2000) Gemini Observatory Puxley (1997) Stratospheric Observatory for Infrared Astronomy (SOFIA) Frank (2006) Green Bank Telescope (GBT) Clark, et al. (2009), O'Neil, et al. (2009), Balser, et al. (2009), Sessoms, et al. (2009) Hubble Space Telescope  SPIKE (1987)  CSP  Trial assignment heuristic (min-conflicts times)  Repair heuristic (neural network)  De-conflict (priority selection) Green Bank Telescope  Dynamic Scheduling System (2008)  Scoring algorithm  Sudoku-solver (fixed, windowed sessions)  Knapsack algorithm (remaining time intervals)

A Scheduling Algorithm with Dynamic Priorities 6 ALMA Scheduling Subsystem 66 antennas operating as one or more array(s) Execute interactive / dynamic scheduling blocks Operate “exclusively” in service mode Performance requirements: Handle ~ SBs per period (12 months) Rescheduling process <<1/2 SB length (~30 min.) Currently: Construction phase, Early Science (2011/2012) with very basic DSA

A Scheduling Algorithm with Dynamic Priorities 7 Hypothesis It is possible to model the scheduling problem of observing proposals with dynamic priorities, for a radio telescope array(s), and generate feasible and sufficiently fast solutions.

A Scheduling Algorithm with Dynamic Priorities 8 General Goals Create a mathematical model for a scheduling system with dynamic priorities, and extend it to the ALMA Scheduling problem. Apply an algorithm to one of the identified instances to validate the model.

A Scheduling Algorithm with Dynamic Priorities 9 Specific Objectives Design a model for the dynamic priorities scheduling problem. Use that model to be applied to the ALMA Scheduling problem. Characterize instances of the ALMA Scheduling problem, and identify one suitable for a relatively easy resolution. Develop an algorithm for the identified instance. Evaluate the algorithm's performance, and compare it to the ALMA Scheduling performance requirements.

A Scheduling Algorithm with Dynamic Priorities 10 Expected Results A model for the dynamic priorities scheduling problem, applied to the ALMA Scheduling problem. An implemented algorithm for one of the identified instances. Test results obtained by running the implemented algorithm, which are expected to comply with the performance requirements.

A Scheduling Algorithm with Dynamic Priorities 11 Validation Algorithm implementation to verify the model ALMA Scheduling simulator (?) External reviews: ALMA Software Engineers and Array Operators

A Scheduling Algorithm with Dynamic Priorities 12 Working Plan Phase 1: State of the Art, technical research (Done) June – November 2009 (Done) Phase 2: Problem description and modeling (Done) September 2010 – January 2011 (Done) Phase 3: Algorithm design and implementation (In progress) February – March 2011 (In progress) Phase 4: Implementation validation (Pending) April – May 2011 (Pending)

A Scheduling Algorithm with Dynamic Priorities 13 Working style (CSRG) Overall project discussion and notes: TWiki Document editing: LaTeX Development environment: GNU/Linux Development IDE: Eclipse Docs + code version control: Subversion (SVN) svn co csrg.inf.utfsm.cl/repos/docs/scheduling-thesis/ Advisor coordination: Meetings and

A Scheduling Algorithm with Dynamic Priorities 14 Current Status

A Scheduling Algorithm with Dynamic Priorities 15 Schematic description Projects and Scheduling Blocks

A Scheduling Algorithm with Dynamic Priorities 16 Schematic description Overall scheduling process

A Scheduling Algorithm with Dynamic Priorities 17 Schematic description Short and long-term queues generation

A Scheduling Algorithm with Dynamic Priorities 18 Mathematical model Static parameters

A Scheduling Algorithm with Dynamic Priorities 19 Mathematical model Dynamic variables (1)

A Scheduling Algorithm with Dynamic Priorities 20 Mathematical model Dynamic variables (2)

A Scheduling Algorithm with Dynamic Priorities 21 Mathematical model Objective functions Maximize the scientific value (grade) of completed projects. Minimize the array's idle time (maximize busy time).

A Scheduling Algorithm with Dynamic Priorities 22 Mathematical model Search space discussion Long-term queue Short-term queue

A Scheduling Algorithm with Dynamic Priorities 23 Algorithm implementation

A Scheduling Algorithm with Dynamic Priorities 24 To be continued...