NCAR Aviation Facility Processing Software. Current System Architecture Raw Data Processor On The Ground In Flight netCDF file WINDS Display Display &

Slides:



Advertisements
Similar presentations
Etter/Ingber Engineering Problem Solving with C Fundamental Concepts Chapter 1 Engineering Problem Solving.
Advertisements

CSE 105 Structured Programming Language (C)
Dropsonde RICO Atmospheric Technology Division/ NCAR Terry Hock
Mehdi Naghavi Spring 1386 Operating Systems Mehdi Naghavi Spring 1386.
I/O and Networking Fred Kuhns
Sponsored by the National Science Foundation GENI I&M Workshop NetCDF and Local Data Manager (LDM) Mike Zink November 4, 2010
INTRODUCTION TO SIMULATION WITH OMNET++ José Daniel García Sánchez ARCOS Group – University Carlos III of Madrid.
Threads, SMP, and Microkernels
Social Web Design 1 Darby Chang Social Web Design.
Molecular Biomedical Informatics Web Programming 1.
Chapter 11: The X Window System Guide To UNIX Using Linux Third Edition.
1 A Problem of Time and Telescopes By: Tyler Yoshiyama Home Institution: UH Hilo Mentor: Ross Matoi.
Operating Systems An Introduction. 2 What Does An Operating System Do? Manages the hardware and software resources of the system. In a desktop computer,
TURKEY AWOS TRAINING 1.0 / ALANYA 2005 TRAINING COURSE ON AUTOMATED WEATHER OBSERVING SYSTEMS ( AWOS ) MODULE D: DATA PROCESSING SYSTEM SONER KARATAŞ ELECTRONIC.
What is an operating system? Is it software?
EEG Probe Project Grant G. Connell. EEG Probe Project Design Objectives –Investigate BCI for severely handicapped individuals –Use time, frequency, and.
Unidata Seminar Series - 30 January 2004 OPeNDAP and THREDDS: Access and Discovery of Distributed Scientific Data Yuan Ho Ethan Davis UCAR Unidata.
Automation with SA , CERN Markus Steiner, PM Software.
WOCE Global Data V3 WOCE-DPC Report Nathan Bindoff and David M. Legler Co-Chairs, WOCE DPC WOCE Conference November 2002 All of it.
Reading HDF family of formats via NetCDF-Java / CDM
/2829 November 2007 WDF-Presentation V Common Wind Tunnel Data Format.
The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,
Int 2 Multimedia Revision. Digitised Sound Analogue sound recorded from person, or real instruments.
Chapter 5 Operating Systems. 5 The Operating System When working with multimedia, the operating system is perhaps the most important, the most complex,
Engineering Problem Solving With C++ An Object Based Approach Fundamental Concepts Chapter 1 Engineering Problem Solving.
Week 2 IBS 685. Static Page Architecture The user requests the page by typing a URL in a browser The Browser requests the page from the Web Server The.
GLAST LAT ProjectGLAST Flight Software IDT, October 16, 2001 JJRussell1 October 16, 2001 What’s Covered Activity –Monitoring FSW defines this as activity.
Unix Presentation. What is an Operating System An operating system (OS) is a program that allows you to interact with the computer -- all of the software.
Computers: Software Patrice Koehl Computer Science UC Davis.
Rensselaer Polytechnic Institute CSCI-4210 – Operating Systems David Goldschmidt, Ph.D.
Trigger design engineering tools. Data flow analysis Data flow analysis through the entire Trigger Processor allow us to refine the optimal architecture.
CS 390- Unix Programming Environment CS 390 Unix Programming Environment Topics to be covered: Distributed Computing Fundamentals.
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
Midterm Hardware vs. Software Everyone got this right!
The netCDF-4 data model and format Russ Rew, UCAR Unidata NetCDF Workshop 25 October 2012.
INVITATION TO COMPUTER SCIENCE, JAVA VERSION, THIRD EDITION Chapter 6: An Introduction to System Software and Virtual Machines.
COLLECTING Software. Why use Software with Hardware? Software used for collecting includes the software that interfaces with hardware collection device.
Application Block Diagram III. SOFTWARE PLATFORM Figure above shows a network protocol stack for a computer that connects to an Ethernet network and.
NCAR Aviation Facility ADS II Overview Chris Webster, National Center for Atmospheric Research.
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
Control & Data Handling, Operator Control, Aircraft Interface to C&DH Steve Musko Space Physics Research Laboratory University of Michigan Ann Arbor, MI.
HDF EOS Workshop David Han Code
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
Controls & Monitoring Overview J. Leaver 03/06/2009.
Postgraduate Computing Lectures PAW 1 PAW: Physicist Analysis Workstation What is PAW? –A tool to display and manipulate data. Learning PAW –See ref. in.
OPERATING SYSTEM BY KINSHUK RASTOGI. WHAT IS AN OPERATING SYSTEM? What is an operating system in the first place? An operating system is a software that.
Examples of Matlab Controls Software on ALICE Andy Wolski 24 September 2014 Multiknobs: simultaneous control of a set of magnets Undulator Gap Scan ALICE.
NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO
TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.
Unidata Infrastructure for Data Services Russ Rew GO-ESSP Workshop, LLNL
EOL Aircraft Platform Software Tools Chris Webster NCAR – EOL - CDS.
The Development of Flight Operations: Improvement of ERAU Cube-Sat’s Ground System Interface and Research of the Satellite’s Orbital Decay Presented by.
Other Projects Relevant (and Not So Relevant) to the SODA Ideal: NetCDF, HDF, OLE/COM/DCOM, OpenDoc, Zope Sheila Denn INLS April 16, 2001.
Lesson 4 Software: Systems and Applicatio n Software CREATED BY MOBIN 2016.
Chapter 5 Operating Systems.
Andrew White, Brian Freitag, Udaysankar Nair, and Arastoo Pour Biazar
SRNWP Interoperability Workshop
Operating System.
TIGGE Archives and Access
Embedded Systems Design
Process Management Presented By Aditya Gupta Assistant Professor
Event Driven Programming Dick Steflik
Introduction to Operating System (OS)
TYPES OFF OPERATING SYSTEM
Computer Software CS 107 Lecture 2 September 1, :53 PM.
Functions of an operating system
HDF-EOS Workshop XXI / The 2018 ESIP Summer Meeting
Outline Operating System Organization Operating System Examples
NCL variable based on a netCDF variable model
Chapter 13: I/O Systems “The two main jobs of a computer are I/O and [CPU] processing. In many cases, the main job is I/O, and the [CPU] processing is.
Presentation transcript:

NCAR Aviation Facility Processing Software

Current System Architecture Raw Data Processor On The Ground In Flight netCDF file WINDS Display Display & Analysis WINDS Display WINDS Display Processor De-spike De-spike Time Shift Time Shift FIR filtering (HRT) FIR filtering (HRT) Derived parameters Derived parameters Serial ASCII Feed To onboard users Iridium to ground Image Data Control & Recording (discWin) Real-time Real-time Web-based Web-based Post-flight Post-flight QC

System Specifications OS: Redhat Linux 9.0. OS: Redhat Linux 9.0. Language: C. All of our code is C and/or C++. Language: C. All of our code is C and/or C++. GUI: Motif, tied to Unix. New developments in Qt (KDE), which is portable to MS-Win, Mac, Unix. GUI: Motif, tied to Unix. New developments in Qt (KDE), which is portable to MS-Win, Mac, Unix. Typical flight is 8-9 hours with variables Typical flight is 8-9 hours with variables Analog channels Analog channels raw block data (PMS, GPS, IRS, etc) raw block data (PMS, GPS, IRS, etc) derived variables derived variables. LRT (1hz) takes about 2 minutes to process. LRT (1hz) takes about 2 minutes to process. HRT (25hz) takes about 15 minutes to process. HRT (25hz) takes about 15 minutes to process.

Processor Features Low Rate (1hz), High Rate (25hz), Sample Rate, Real- Time. Low Rate (1hz), High Rate (25hz), Sample Rate, Real- Time. De-spike; remove spikes up to 1 second in duration. De-spike; remove spikes up to 1 second in duration. Time shift up to plus or minus 1 second. Time shift up to plus or minus 1 second. FIR rate-change filter (HRT processing). FIR rate-change filter (HRT processing). Mask out of bad data. Mask out of bad data. Quality/Error checking (in development) Quality/Error checking (in development) Spike detection Spike detection Flat line detection Flat line detection Out of bounds/range detection Out of bounds/range detection

Variable Editing

Read Data Check For Time Gap Decode Raw Data Apply Analog Cals De-spike Time Shift Average to 1hz FIR filter (rate change) Compute Derived Output High Rate (25hz)Low Rate, 1hz ADSdata (raw) SampleRateData AveragedData HighRateData netCDF & SQL Raw Data Real time Processing Flow (1 of 3 main loops) Buffer/Data Flow

Calculation Template

Output file – netCDF Hardware architecture independent. Hardware architecture independent. Self describing (meta-data). Self describing (meta-data). Supports multi-rate data (e.g. 25hz, 5hz, 10hz, etc). Supports multi-rate data (e.g. 25hz, 5hz, 10hz, etc). Fortran, C, C++, and Java language API’s. Fortran, C, C++, and Java language API’s. Interfaces: Matlab, IDL, Python, Perl & Tcl/Tk. Interfaces: Matlab, IDL, Python, Perl & Tcl/Tk. OpenDAP allows network reads via http. OpenDAP allows network reads via http NCAR “Conventions” for aircraft data registered with Unidata. NCAR “Conventions” for aircraft data registered with Unidata. Used by NCAR, University of Wyoming and NOAA. Used by NCAR, University of Wyoming and NOAA.

Self-describing (netCDF)

NCAR netCDF multi-rate record layout 1hz 5hz 1hz1hz, vector 161hz 25hz 10hz vector 16 Dimension 1 is the record dimension, 1 record per second Dimension 2 Sub samples 1hz Dimension 3 Vector Data (PMS1D)

….. In use for 11 years on 45 projects. In use for 11 years on 45 projects. PMS-2D processing recently added. PMS-2D processing recently added. Future Future Finish error checking Finish error checking Second-pass processing. Second-pass processing.