ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop 2008 - 1 N. Kornweibel & P. Baksai Operations at Paranal.

Slides:



Advertisements
Similar presentations
July 2006Instrument Scientist Retreat, Santiago Quality Control: closing the loop Reinhard Hanuschik, DFO/QC 1. Principles 2. Processes 3. Critical components.
Advertisements

Chapter 10 Systems Operation, Support, and Security
Hands-On Microsoft Windows Server 2003 Administration Chapter 10 Monitoring and Troubleshooting Windows Server 2003.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 12: Managing and Implementing Backups and Disaster Recovery.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 2: Managing Hardware Devices.
1 Operating Systems Ch An Overview. Architecture of Computer Hardware and Systems Software Irv Englander, John Wiley, Bare Bones Computer.
ATS8500 Remote Service Solution
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 10: Server Administration.
CCNA 2 v3.1 Module 2.
1 Semester 2 Module 2 Introduction to Routers Yuda college of business James Chen
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 12: Managing and Implementing Backups and Disaster Recovery.
70-293: MCSE Guide to Planning a Microsoft Windows Server 2003 Network, Enhanced Chapter 14: Problem Recovery.
Chapter 12 Implementation
Module 3: Resolving Boot Process Issues. Overview Understanding the Boot Process Using Advanced Boot Options Using the Boot.ini file to Change Startup.
®® Microsoft Windows 7 for Power Users Tutorial 8 Troubleshooting Windows 7.
Pre-Project Activities Text Chapters 5 and 6. Pre-Project Activities 1.Contract Review 2.Development Plan 3.Quality Plan.
Training on ManageEngine Desktop Central
A+ Guide to Managing and Maintaining Your PC Fifth Edition Chapter 15 Installing and Using Windows XP Professional.
Remote Service Solutions ATS 8550
IT Essentials 1 v4.0 Chapters 4 & 5 JEOPARDY RouterModesWANEncapsulationWANServicesRouterBasicsRouterCommands RouterModesWANEncapsulationWANServicesRouterBasicsRouterCommands.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 2: Managing Hardware Devices.
1 © 2003, Cisco Systems, Inc. All rights reserved. CCNA 3 v3.0 Module 6 Switch Configuration.
Chapter Fourteen Windows XP Professional Fault Tolerance.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 12: Managing and Implementing Backups and Disaster Recovery.
Automatic Software Testing Tool for Computer Networks ADD Presentation Dudi Patimer Adi Shachar Yaniv Cohen
User Manager Pro Suite Taking Control of Your Systems Joe Vachon Sales Engineer November 8, 2007.
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
Windows Vista Inside Out Chapter 22 - Monitoring System Activities with Event Viewer Last modified am.
CS 390 Unix Programming Summer Unix Programming - CS 3902 Course Details Online Information Please check.
IT 456 Seminar 5 Dr Jeffrey A Robinson. Overview of Course Week 1 – Introduction Week 2 – Installation of SQL and management Tools Week 3 - Creating and.
18 Copyright © Oracle Corporation, All rights reserved. Workshop.
Computer Emergency Notification System (CENS)
Guide to Linux Installation and Administration1 Chapter 4 Running a Linux System.
Module 15 Managing Windows Server® 2008 Backup and Restore.
1 Session Number Presentation_ID © 2001, Cisco Systems, Inc. All rights reserved. Using the Cisco TAC Web Site for LAN Switching Issues Cisco TAC Web Seminar.
Slide 12.1 Chapter 12 Implementation. Slide 12.2 Learning outcomes Produce a plan to minimize the risks involved with the launch phase of an e-business.
SCIOPS 2013 Reinhard Hanuschik, ESO Garching The VLT Quality Control Loop.
14 Copyright © 2005, Oracle. All rights reserved. Backup and Recovery Concepts.
18 Copyright © 2004, Oracle. All rights reserved. Backup and Recovery Concepts.
Page 1 PACS GRITS 17 June 2011 Herschel Data Analysis Guerilla Style: Keeping flexibility in a system with long development cycles Bernhard Schulz NASA.
Mountaintop Software for the Dark Energy Camera Jon Thaler 1, T. Abbott 2, I. Karliner 1, T. Qian 1, K. Honscheid 3, W. Merritt 4, L. Buckley-Geer 4 1.
Module 6: Configuring User Environments Using Group Policies.
18 Copyright © 2004, Oracle. All rights reserved. Recovery Concepts.
Observations with AMBER  General overview  P2VM  OB preparation with P2PP P2PP / OB / templates Available templates for observation procedure Typical.
14 Copyright © 2005, Oracle. All rights reserved. Backup and Recovery Concepts.
Instrument Control Systems Seminar 2014, 20 th -24 th October 2014 Instrument Control Systems 2014 J.Knudstrup, ESO/DoE/CSE/CINS 3GTCCD – Detector Control.
ESO – A.Longinotti ESO Instrumentation Software Workshop Antonio Longinotti Testing Instrumentation Software Applications.
HSC Queue Mode Implementation Plan ~ Stage I, II, III ~ Tae-Soo Pyo Subaru Telescope /01/15.
André Augustinus 18 March 2002 ALICE Detector Controls Requirements.
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
InsSw WorkShop 2008Observation SW by Eszter Pozna1 Observation Software based on BOSS General Overview Details/Demo Dr Eszter Pozna Instrument SW workshop.
1 © 2004 Cisco Systems, Inc. All rights reserved. Session Number Presentation_ID Cisco Technical Support Seminar Using the Cisco Technical Support Website.
Troubleshooting Windows Vista Lesson 11. Skills Matrix Technology SkillObjective DomainObjective # Troubleshooting Installation and Startup Issues Troubleshoot.
Lecture 11. Switch Hardware Nowadays switches are very high performance computers with high hardware specifications Switches usually consist of a chassis.
Feature Overview Oracle Explorer – browse and alter schema Wizards and Designers Automatic code generation PL/SQL Editor with IntelliSense Oracle Data.
Slide title :40-47pt Slide subtitle :26-30pt Color::white Corporate Font : FrutigerNext LT Medium Font to be used by customers and partners : Arial HUAWEI.
REDCap General Overview
© 2002, Cisco Systems, Inc. All rights reserved.
CCS Engineering Tools The tools are used help development and debugging of VLT SW control applications This presentation will provide a general view of.
CV PVSS project architecture
Chapter 18 Maintaining Information Systems
Maximum Availability Architecture Enterprise Technology Centre.
Automated Update System
Introduction to System Administration
Introduction to System Administration
Michael Mast Senior Architect
Solutions: Backup & Restore
Introduction of Week 3 Assignment Discussion
CONFIGURING HARDWARE DEVICE & START UP PROCESS
Workshop.
Presentation transcript:

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop N. Kornweibel & P. Baksai Operations at Paranal

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Introduction Instrument Control LAN Console Layout Data Flow System Autrep Logging

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Instrument Control LAN

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Control LAN Data 1.Control Information: involves all LANs. Maximum 200 ms delay for a reply on a command is met “typically” by keeping the network load low (< 30%). 2.Data from technical CCDs (e.g. slit viewing, guiding). Per camera up to ~5 Mbit/s for short periods (i.e. data is not sent continuously to WS). 3.Astronomical data from CCDs or IR detectors. Instrument LAN, and via the Backbone LAN also to the User Station and General Services LANs (for Archiving). Support sustained data rates of 1000 mbps. 4.Other data: Field stabilization, Rapid Guiding and X.

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop X Terminals CDE window manager Console Layout

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop DHS Data Flow System P2PP (visitor) OT (service) Instrument WS BOB vcsolac volac FITS DCSICSTCS OS Logs vcsolac DHS WS (archive) OB OHS WS (archive)

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Autrep System Extracts operations logs from log files Archives operations logs in SYBASE Generates automatic daily reports and plots Web interface for long term trending

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Autrep Automatic Plot

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Autrep Architecture IWS Ops logs Web Report Interface

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Instrument Software Life and Adventures Life Cycle Daily Operations User Feedback

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Life Cycle of an Instrument at Paranal After PAE…shipping… AIV Commissioning PAC Paranalization SciOps Maintenance Refurbishment Decommissioning Recycling

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Life Cycle of its Software Software activity mainly during: Commissioning Paranalization Maintenance

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Commissioning activities Mainly support, we do not touch the software Maintain the SW Punch List in Remedy Standby for start of sky observations to tackle problems interacting with other systems (TCS, OHS, ASM, DFS, etc.) Contribute to the analysis of problems and propose solutions based on operations experience

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Paranalization activities Update PECS for new targets (operations, development) Update integration module xxins for operations target, to achieve smooth rebuild sequence Create integration module for development target Create xxmtoo module Create xxocal module Update template signature files and create Instrument Package for the first period of operation Update Technical Instrument Package Register instrument WBS in Remedy PPRS Register keywords for AUTREP, create Autrep plots

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Software Maintenance Instrument is assigned a 1 st and 2 nd software responsible, but software could be modified and installed by any software engineer Instrument must be able to be rebuilt from “scratch” using pkginBuild access to Garching cmm archive. Integration module is central configuration control for instrument. (e.g. xxins)

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Software Maintenance Remedy (PPRS) Central Database for Incidents, Problems, Maintenance Change requests.

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Software Maintenance regular activities Configuration update and backup Change request commissioning with Instrument Scientist Daily startup Weekly reboot Rebuild twice per semester Period changeover VLTSW Release upgrade and Patch installation

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Daily Operations Shutdown and Startup Modes: Night, Day, Calibration CalobBuild

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Daily Operations Cycle Calibrating Night Operations (Observing or ready) Day Operation (Daily checks Maintenance) 1. Shutdown 2. Startup 3. Night Mode 1. Calib Mode 2. Execute Daily Calibrations 1. Check Calibrations 2. Day mode

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Operations Menu

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Shutdown and Startup xxinsStop and xxinsStart shutdown and startup INS WS software according to the configuration in xxmcfgSTART.cfg determines panel displays and system access. xxinsStartup GUI is used to edit the config.

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Shutdown and Startup

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Instrument Modes NIGHT: Online, TCS enabled. CALIB: Online as required for calibrations. DAY: Standby, dark state, TCS disabled. Executed with script xxinsMode with possible SETUP from reference files.

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Build calibration OB from observation data and standard calibration set Executed daily at end of night operations Should complete in under 2 hours in CALIB mode and no TCS. Configured in xxocalCALOB.cfg CalobBuild

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop CalobBuild # Initial OBDs to be included CALIB.TPL.OBD1 "HAWKI_calob_begin.obd"; CALIB.TPL.OBD2 "HAWKI_calob_bias.obd"; # Final OBD to be included CALIB.TPL.ENDOBD "HAWKI_calob_end.obd" # FITS keywords used to select the calibrations CALIB.TPL.FITS "INS.MODE"; # Calibrations for Mode=IMG; exclude TECHNICAL CALIB.TPL1.INDEX "IMG"; CALIB.TPL1.VALUE1 "HAWKI_img_cal_Darks.obdx"; CALIB.TPL1.COND1 "(({$IMAGE:DPR.CATG} == {SCIENCE} || {$IMAGE:DPR.CATG} == {CALIB} || {$IMAGE:DPR.CATG} == {ACQUISITION}) && {$IMAGE:DPR.TYPE} != {DARK})"; CALIB.TPL1.DAYS "1";

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop User Feedback Principal users of Instrument Software are: Night time — Staff Astronomers / Instrument Scientist — TIOs Day time — Instrument Scientist — Instrumentation Engineers

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Importance of User Feedback INS SW is in use almost 24h per day Time of use in operation adds up to more than was invested in the development and commissioning phases INS SW authors are usually not available for troubleshooting Ask any user about SW features: they know exactly What is slow The boring and bothersome tasks The useful and fast commands How things could be improved How some problems can be reproduced

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Our Common Goal at Paranal Minimize downtime, specially thecnical, and SW above all

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Three things that play against our goal Slow procedures in instrument function drivers Difficulties for the operator/engineers to identify and cure the problem cause (Root Cause Analysis) Administrative obstacles for safe and efficient troubleshooting

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Considerations that will help us During design, consider the impact of: Parting from standards (procedures, devices, models) Poor error handling and unclear diagnostics Tollerance to failure Speed of recovery (recover or switch focus?)

ESO-PSW – N. Kornweibel & P. Baksai ESO Instrumentation Software Workshop Conclusion Operations at Paranal are oriented towards minimum downtime and maximum data quality A positive impact is quickly noticed after close interaction between Users and Engineers A better knowledge of systems integration and INS SW cycles at Paranal might empower developer’s contribution to smoother and shorter Commissioning, Paranalization times (INS offered sooner to community)