Download presentation
Presentation is loading. Please wait.
Published byDomenic Hamilton Modified over 9 years ago
1
We have developed a GUI-based user interface for Chandra data processing automation, data quality evaluation, and control of the system. This system, known as The Telemetry Tracker 9000 (TT9), allows dynamic interaction and monitoring of all operational tasks, including automated data quality evaluation, quicklook generation, submission to archival processing, realtime data flow, and reporting metrics in a single multi-tab GUI. A MySQL database serves as a backend for this system enabling identification of anomalies, unusual acquisition situations, as well as tracking statistics. New Interactive User Interface for Spacecraft Data Processing C. S. Anderson, D. L. Morgan, P. J. Mendygral, J. S. Nichols Harvard-Smithsonian Center for Astrophysics Epoch 1 2001.1 -> 2002.3 Epoch 4 2004.6 -> 2005.7 Epoch 2 2002.3 -> 2003.5 Epoch 3 2003.5 -> 2004.6 Manual DQ of Raw Telemetry Manual Submission of Raw Telemetry to Archival Processing Data operations personnel: 7 Automated DQ of Raw Telemetry (TT9) Manual Submission of Raw Telemetry to Archival Processing Data operations personnel: 6 Automated DQ of Raw Telemetry Automatic Submission of Raw Telemetry to Archival Processing Data operations personnel: 4 Prior to archival processing raw telemetry must pass a series of data quality (DQ) checks including partial pipeline processing for quicklook data. Initially executed by operators (Epoch 1), TT9 has automated DQ checks and quicklook processing reducing staff requirements and increasing efficiency (Epochs 2&3). Raw telemetry meeting DQ requirements are flagged by TT9 for automatic submission to archival processing which has reduced latency to a few hours (Epoch 4). TT9 stores information into a database which is viewable in an object oriented GUI written in Perl. The GUI is divided into selectable tabs with each tab customized to organize information on a specific data processing aspect. The modular design allows new data processing tasks to be automated and interfaced with additional GUI Tabs. The development of new tabs is simplified by a generalized Perl super class. Observation Tab Table row for each observation. Tabulated information includes: Estimated time of processing stages i.e. data received, processing completed Number of events Quicklook processing status 51 total viewable columns Statistics Tab Statistics on raw telemetry files and observations Instant metrics for management reports Tracking completion times of data processing stages identifies bottlenecks in the system. 29 total viewable columns Raw Telemetry Tab Table row for each raw telemetry file Tabulated information includes: Observations contained Data quality measures Archival processing status 55 total viewable columns Features of TT9 Database backend allows fast, flexible storage, search, and display of data processing information. Run time configuration controls including servers available for remote processing. Text notifications for data processing events to alert personnel. Single organized source of data processing related information. Majority of TT9 written in Perl with some C Shell. Code consists of 35,162 lines in 21 scripts and 54 libraries (version 4.3). Features of TT9 GUI Completely customizable tables allows users to add, remove, or sort on any column. Selectable time frame to display. User “profiles” allow storage of each user’s default settings. Table rows can be color coded based on column values. Raw telemetry files that fail DQ checks are highlighted in red for example. Row highlighting and right-click menus for customized user controls.
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.