RoboNet-II Robotic operations, System outline and data processing Yiannis Tsapras, 2008, LCOGT, Santa Barbara.

Slides:



Advertisements
Similar presentations
Microlensing Surveys for Finding Planets Kem Cook LLNL/NOAO With thanks to Dave Bennett for most of these slides.
Advertisements

Micro Control Solutions Stability System II rev. 6.4
SupportCenter Plus Product Overview. Overview 1.What is SupportCenter Plus (SCP) 2.Benefits of SCP 3.Licensing & Pricing 4.Questions.
JobTracker™ A Job Tracking System for Architects & Engineers Produced by LA Solutions.
Cornerstone Base Station for Calibration Management Applied System Technologies, Inc N.W. 53rd Street, Suite 101 Fort Lauderdale, Florida
What is a Good SmartSignal Model?
Title: ICON L0 from MOC to SOC automation Author: MOC/SOC Resides: SOC Description: This is a script that copies the ICON L0 files from the MOC to the.
Lesson 17: Configuring Security Policies
Software Delivery. Software Delivery Management  Managing Requirements and Changes  Managing Resources  Managing Configuration  Managing Defects 
29 Oded Moshe, Director of Product Management Beta Release May 3rd, 2010 Official Release May 24, 2010.
Cornerstone Cal Station for Calibration Management Applied System Technologies, Inc N.W. 53rd Street, Suite 101 Fort Lauderdale, Florida
PingER Management1 Error Reporting Model for Ping End-to-End Reporting (PingER Management)
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 11: Monitoring Server Performance.
Autonomous observing The Astronomer’s Last Stand Alasdair Allan School of Physics, University of Exeter, UK Iain Steele Astrophysics Research Institute,
Experiment Support Introduction to HammerCloud for The LHCb Experiment Dan van der Ster CERN IT Experiment Support 3 June 2010.
Maintaining and Updating Windows Server 2008
Check Disk. Disk Defragmenter Using Disk Defragmenter Effectively Run Disk Defragmenter when the computer will receive the least usage. Educate users.
EMBEDDED SOFTWARE Team victorious Team Victorious.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Hands-On Microsoft Windows Server 2008 Chapter 11 Server and Network Monitoring.
Windows Server 2008 Chapter 11 Last Update
Tapit Call Accounting software for the 21st Century Copyright Trisys, Inc Trisys, Inc 215 Ridgedale Avenue Florham Park, NJ (973)
SIMULATOR FOR MICROLENS PLANET SURVEYS Sergei Ipatov 1, Keith Horne 2, Khalid Alsubai 3, Dan Bramich 4, Martin Dominik 2,*, Markus Hundertmark 2, Christine.
STRATEGIES INVOLVED IN REMOTE COMPUTATION
NPOESS Data Quality Monitoring (DQM) Interface Functionality at DoD Centrals Update COPC Action Item Jim Vermeulen 13 November 2008.
Reporting and Build Statistics Using Business Intelligence By Naga Sowjanya Karumuri Build Team, VMware, Cambridge Summer Internship 2008.
Course Presentation EEL5881, Fall, 2003 Project: Network Reliability Tests Project: Network Reliability Tests Team: Gladiator Team: Gladiator Shuxin Li.
1.Overview 2. Hardware 3. Software Interface 4. Triggering 5. Installation 6. Configuring.
Network Management Tool Amy Auburger. 2 Product Overview Made by Ipswitch Affordable alternative to expensive & complicated Network Management Systems.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
LBTI HOSTS Science Operations Plan Draft 0 – Feb
1 STScI Pipeline Thermal-vacuum data handling I. Neill Reid for WFC3 Instrument CALibration team ICAL.
Virtual Interaction Manager
By The First Hotel Booking System. The Group Teodor Talov (Project Manager) Tyler Thomas Michael Evans Yolanda (Xiaofeng, Zhu)
Event Management & ITIL V3
Yokogawa Electric Corporation Copyright © Yokogawa Electric Corporation Release 2.10 Functionality Overview September 2004.
Studying cool planets around distant low-mass stars Planet detection by gravitational microlensing Martin Dominik Royal Society University Research Fellow.
LCOGT: Where Are We? Where Are We Going? Tim Brown Mar 18, 2010 Eventful Universe, Tucson, AZ FTN, Rob Ratkowski.
Copyright © Yokogawa Electric Corporation Release 2.10 Functionality Overview September 2004.
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
Railway Operations: Issues and Objectives Capacity management Infrastructure planning Timetable preparation Management of day-to-day movement of trains.
Fermilab Distributed Monitoring System (NGOP) Progress Report J.Fromm K.Genser T.Levshina M.Mengel V.Podstavkov.
Discussion - Survey Design Survey product equation: #fields = fld/nt x useable x (%xnights/yr) x years = 4 x 0.5 x (0.75 x 13 x 18) x 3 = 4 x 0.5 x 175.
Pre-OTS Testing in Penticton Sonja Vrcic Socorro, December 11, 2007.
16th Microlensing Season of the Optical Gravitational Lensing Experiment A. Udalski Warsaw University Observatory.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
Operating Systems David Goldschmidt, Ph.D. Computer Science The College of Saint Rose CIS 432.
SCIOPS 2013 Reinhard Hanuschik, ESO Garching The VLT Quality Control Loop.
1 SMOV Proposal Process Initial Submission through Flight George Chapman Merle Reinhart Tony Roman February 21, 2001.
DDM Monitoring David Cameron Pedro Salgado Ricardo Rocha.
Welcome to Blackboard Learn Alan Masson, Colette Murphy Tuesday 15 th March, 2011 Technology Facilitated Learning Access and Distributed Learning.
HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.
1 Proposal and Observation Handling Ravi Sankrit (User Support Scientist) SSSC May 11, 2011.
Difference Image Analysis at OAC Groningen, 1st Dec 2004 AW-OAC team.
GLAST Science Support Center November 17, 2006 GUC Face-to-Face Meeting GLAST GI Program (with revised schedule) David Band, GSSC.
WebWatcher A Lightweight Tool for Analyzing Web Server Logs Hervé DEBAR IBM Zurich Research Laboratory Global Security Analysis Laboratory
20 Copyright © 2008, Oracle. All rights reserved. Cache Management.
HSC Queue Mode Implementation Plan ~ Stage I, II, III ~ Tae-Soo Pyo Subaru Telescope /01/15.
QC – User Interface QUALITY CENTER. QC – Testing Process QC testing process includes four phases: Specifying Requirements Specifying Requirements Planning.
Embedded Real-Time Systems Processing interrupts Lecturer Department University.
What is ClassiFire ® ? ClassiFire is a patented Artificial Intelligence system used in the Stratos-HSSD ® range of Aspirating Smoke Detectors. ClassiFire.
Scenario use cases Szymon Mueller PSNC. Agenda 1.General description of experiment use case. 2.Detailed description of use cases: 1.Preparation for observation.
1 Creating Situational Awareness with Data Trending and Monitoring Zhenping Li, J.P. Douglas, and Ken. Mitchell Arctic Slope Technical Services.
Maintaining and Updating Windows Server 2008 Lesson 8.
17 Copyright © 2006, Oracle. All rights reserved. Information Publisher.
Wednesday NI Vision Sessions
1 Scheduling Requirements ● overview ● scheme ● requirements ● open questions.
Stavroula Balopoulou , Angelo Lykiardopoulos, Sissy Iona HCMR-HNODC
TallTimber & TimberPad: Software and Support for Forest Inventory
Observing with Modern Observatories (the data flow)
Presentation transcript:

RoboNet-II Robotic operations, System outline and data processing Yiannis Tsapras, 2008, LCOGT, Santa Barbara

People Y Tsapras (LCOGT) R Street (LCOGT) K Horne (St Andrews) (PI) C Snodgrass (ESO) D Bramich (ING) M Dominik (St Andrews) N Kains (St Andrews) N Rattenbury (Manchester) M Burgdorf (ARI) A Allan (eSTAR/Exeter) E Hawkins (LCOGT) C Mottram (eSTAR/ARI) N Clay (eSTAR/ARI) I Steele (eSTAR/ARI) B Haworth (LCOGT) S Fraser (eSTAR/ARI)

The telescope network FTS+FTN+LT LCOGT expansion plans ( M. Falarski ) All telescopes used by microlensing teams

System Layout

The Robotic Control System

Runs on a computer at each telescope site Issues instructions to the software controlling the telescope and instruments. It performs: Start-up and end of night operations Observations (Science,ToO, RTI, background) Receives updates from local weather station and closes down operations if parameters exceed allowed ranges Receives input from: Observer Support System (normal observations database) Target of Opportunity Control System (bypass normal operations)

Requesting observations The Phase-II database contains all observation program details [targets, configuration, exposures] All observations are part of proposals A proposal contains: Groups of observations [specify:activation,expiration,monitoring,conditions] Individual observation requests [specify: instrument,position,repeats,exptime] 5 types of Groups : Flexible- one off observations, can be performed any time Fixed- one off observations, performed at specific times Monitoring- periodic observations of same target, fixed interval Ephemeris- performed at given phase in a variable objects cycle MinInterval- performed at least the specified interval apart microlensing

Example of phase-II entry

Intelligent Agents create these entries automatically! ( wait for a few more slides )

Scheduling observations When RCS requests next Group of observations… All Groups in database are sorted by the Scheduling algorithm In a rapidly changing environment, the selected group is one that is best matched to current conditions Takes into account: local conditions, phase-II model, Group history. (Fraser S.,2006, AN, 327,779)

Scheduling metrics Group scoring Slew time Lateness in project Time used in proposal relative to allocation Matching of actual condition to requested (seeing/lunar) Assigned priority level Proposal science priority Observing windows missed by monitor/ephemeris group Observation scoring Target location (height) Transit height fraction Distance from the moon

What does this mean? Observing programs in the database are constantly competing for telescope time We generally do not know when an observation will be performed or from which telescope ( though we can have a pretty good guess ) It was designed this way to accommodate a large global telescope network Only very basic user input, the system does the rest

Intelligent agents

eSTAR external agent Receives prioritised list of targets regularly from RoboNet-II ( web-PLOP, every hour ) Submits observation queries and requests to… Telescope Embedded Agent ( TEA & node agent ) Responds to eSTAR agent about telescope suitability for specific observing request Handles the requests from external agents and updates Phase-II database

Intelligent agents (addendum) We can override normal observations manually via a webpage interface or from our iPod Touch while having coffee at Starbucks We can override normal observations manually via a webpage interface or from our iPod Touch while having coffee at Starbucks

Prioritising the events

Planet Lens Optimisation ( “web-PLOP” Snodgrass 2008 ) Provides optimal target list for automated observing ( updated every 15 min ) Keeps up to date record of all data from OGLE,MOA,PLANET,RoboNet-II observations New fits performed when new data points arrive ( PLENS, SIGNALMEN, web page updates ) List read by the eSTAR intelligent agent Receives input from anomaly detector ( which tags anomalous events as high priority ) Prioritisation algorithm ( Horne 2008, MNRAS, submitted )

Anomaly detection

Exploits the systems’ possibility of automated fast response and flexible scheduling ( M. Dominik ) How? Receives new data by rsync from RoboNet-II cluster ( as soon as these are processed by our pipeline ) Data from other surveys also included Identifies new points that are deviating Action requests: check, anomaly, ordinary No manual intervention needed Currently this mode of override only works for real-time RoboNet-II data

Quicklook Archiving

Archives

The reduction pipeline

Intercepts incoming microlensing data Performs an assessment of data quality Updates the log file of observations Moves data to the appropriate event directories If appropriate, identifies the target position on reference ( based on WCS fits to the finder charts ) – R. Street Initiates Difference Image Analysis pipeline

The reduction pipeline Creates a template reference frame Geometric and Photometric alignment of all images to the reference frame Matches the seeing between each image and the reference Subtracts each scaled image from the reference Variable stars leave a positive or negative residual Fits PSF to target Update photometry ( also on web-PLOP, ARTEMiS and the PLANET webpages ) OB08199

The reduction pipeline (dfd)

Results displayed “live”

2008 exchanges (anomaly and high magnif.) KB08075 KB binary KB scatter at peak? KB08171 KB08198 KB binary KB08267 KB08280 KB08308 KB binary source KB planet? KB08336 KB08380 KB binary OB08013 OB08208 OB08272 OB peak anomaly OB planet? OB08272 OB08320 OB08330 OB08342 OB08346 OB08349 OB08355 OB08378 OB08432 OB08493 OB peak anomaly OB planet? OB s alerting suspected anomalous behaviour OB08151 OB08209 OB08215 OB finite source OB08426 OB08509 KB08022 KB08096 KB08105 KB08225 KB08311 KB08383 KB08402 KB08415 KB anomalous KB s alerting possible high magnification

KB08384

OB08210

OB08510

KB08310 microFUN Probably a Saturn- like planet?, pretty close to the Einstein ring ( preliminary model by Subo Dong ) Strong Parallax signal

OB08270 Preliminary modelling based on microFUN + SAAO data around the peak seem indicate the presence of Jovian planetary companion

OB08513 q~0.018?

OB08513

2008 season summary Time used : hours Events observed: 502, 266(>5 data points) Data FTN FTS LT Used : Rejected: ( ? ) Total : [ used:8390/rejected:3856 ] Events observed: 331, 214(>5 data points) Data FTN FTS LT Used : Rejected: Total : [ used:7592/rejected:6421 ] 2007 >5 dp : hrs (65%) <5 dp : hrs (3%) Rejected : hrs (32%) What fraction of the time?

Issues Software: deploy, debug, maintain… Introduce extra internal monitoring, auto-recovery mechanisms where possible School programs ( 1 to 4 hours on most nights ) Not much we can do. Wait for 0.4m deployment FTS performance ( main microlensing telescope ) Still room for improvement, engineering trip planned Data display problems Target misidentification by the pipeline, incorrect lightcurves ( you may have noticed the huge error bars on some RoboNet-II data on ARTEMiS plots )

“wouldn’t it be nice…” Agree on a common data format so that teams can exchange data efficiently Associate data points on graphs with statistics on images Information readily accessible Fit binary events automatically with preliminary models displayed “live”

Websites (RoboNet-II homepage) (LCOGT website) (microlensing discussion forum)

Fin

Other event examples KB08284

FTS image quality 2007 problems: bipolar images, bad tracking…

FTS image quality 2008 (on a good night)