Aquarius Algorithm Workshop Santa Rosa, CA 9 March 2010 College of Engineering Department of Atmospheric, Oceanic & Space Sciences Chris Ruf University.

Slides:



Advertisements
Similar presentations
1 Manufacturing Process A sequence of activities that is intended to achieve a result (Juran). Quality of Manufacturing Process depends on Entry Criteria.
Advertisements

Chapter 7: User-Defined Functions II
Aquarius Status Salinity Retrieval and Applications D. M. Le Vine NASA/GSFC, Greenbelt, MD E. P. Dinnat, G. Lagerloef, P. de Matthaeis, H. Kao, F.
ALMA Pipeline Heuristics F2F Meeting 2006 in Paris 1 SD Pipeline Heuristics Status Report ALMA Project, NAOJ George KOSUGI.
Proxy ABI datasets relevant for fire detection that are derived from MODIS data Scott S. Lindstrom, 1 Christopher C. Schmidt 2, Elaine M. Prins 2, Jay.
Unit 13 Analysis of Clocked Sequential Circuits Ku-Yaw Chang Assistant Professor, Department of Computer Science and Information.
1 Testing the Efficiency of Sensory Coding with Optimal Stimulus Ensembles C. K. Machens, T. Gollisch, O. Kolesnikova, and A.V.M. Herz Presented by Tomoki.
AOSC 634 Air Sampling and Analysis Lecture 1 Measurement Theory Performance Characteristics of instruments Nomenclature and static response Copyright Brock.
Based on Slides by D. Gunopulos (UCR)
Aquarius/SAC-D Science Meeting Seattle, WA July 2010 College of Engineering Department of Atmospheric, Oceanic & Space Sciences Chris Ruf Space Physics.
 a fixed measure for a given population  ie: Mean, variance, or standard deviation.
Classification of Instruments :
CT Quality Control for CT Scanners. Quality Control in CT A good idea? Yes Required for accreditation? Sometimes Improves image quality? Sometimes Depends.
October 8, 2013Computer Vision Lecture 11: The Hough Transform 1 Fitting Curve Models to Edges Most contours can be well described by combining several.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
FEATURE EXTRACTION FOR JAVA CHARACTER RECOGNITION Rudy Adipranata, Liliana, Meiliana Indrawijaya, Gregorius Satia Budhi Informatics Department, Petra Christian.
Aquarius Algorithm Meeting To Do Lists. From Frank Wentz:  Implement Ruf RFI flagging  Implement other QC flags  Further test review, and finalize.
Autonomous Tracking Robot Andy Duong Chris Gurley Nate Klein Wink Barnes Georgia Institute of Technology School of Electrical and Computer Engineering.
1 Techniques to control noise and fading l Noise and fading are the primary sources of distortion in communication channels l Techniques to reduce noise.
Statistics 1 The Basics Sherril M. Stone, Ph.D. Department of Family Medicine OSU-College of Osteopathic Medicine.
Basic Geographic Concepts GEOG 370 Instructor: Christine Erlien.
Indiana GIS Conference, March 7-8, URBAN GROWTH MODELING USING MULTI-TEMPORAL IMAGES AND CELLULAR AUTOMATA – A CASE STUDY OF INDIANAPOLIS SHARAF.
Performance characteristics for measurement and instrumentation system
Part 1: Basic Principle of Measurements
LECTURER PROF.Dr. DEMIR BAYKA AUTOMOTIVE ENGINEERING LABORATORY I.
Aquarius Algorithm Workshop March 2007 College of Engineering Department of Atmospheric, Oceanic & Space Sciences Chris Ruf Space Physics Research.
EXPERIMENTAL STUDY OF RADIO FREQUENCY INTERFERENCE DETECTION ALGORITHMS IN MICROWAVE RADIOMETRY José Miguel Tarongí Bauzá Giuseppe Forte Adriano Camps.
Calibration and Validation Studies for Aquarius Salinity Retrieval PI: Shannon Brown Co-Is: Shailen Desai and Anthony Scodary Jet Propulsion Laboratory,
Status of the compression/transmission electronics for the SDD. Cern, march Torino group, Bologna group.
SCIENCE PROCESSING OVERVIEW David Le Vine Aquarius Deputy PI 07 July 2009.
Mehdi Mohammadi March Western Michigan University Department of Computer Science CS Advanced Data Structure.
25 June 2009 Dawn Conway, AMSR-E TLSCF Lead Software Engineer AMSR-E Team Leader Science Computing Facility.
Workshop on Algorithm Implementation within the Aquarius Data Processing System March 2007 College of Engineering Department of Atmospheric, Oceanic.
1 An Observatory for Ocean, Climate and Environment SAC-D/Aquarius HSC - Radiometric Calibration H Raimondo M Marenchino 7th SAC-D Aquarius Science Meeting.
Level 2 Algorithm. Definition of Product Levels LevelDescription Level 1 1A Reconstructed unprocessed instrument data 1B Geolocated, calibrated sensor.
Aquarius Level-3 Binning and Mapping Fred Patt. Definitions Projection - any process which transforms a spatially organized data set from one coordinate.
Lecture I Sensors.
First Tropical Cyclone Overflights by the Hurricane Imaging Radiometer (HIRAD) Chris Ruf 1, Sayak Biswas 2, Mark James 3, Linwood Jones 2, Tim Miller 3.
Workshop Agenda: Day One 9:30 IntroductionLagerloef / Le Vine 9:45 Workshop objectivesG. Feldman 10:00 Overview of the Aquarius Data Processing System:G.
Design Features of a Boresighted GPM Core Radiometer Christopher S. Ruf Dept. of Atmospheric, Oceanic & Space Sciences University of Michigan, Ann Arbor,
AM RECEPTION Introduction
1 CLUSTER VALIDITY  Clustering tendency Facts  Most clustering algorithms impose a clustering structure to the data set X at hand.  However, X may not.
Chapter 1 : Part 3 Noise. Noise, interference and distortion  Noise  unwanted signals that coincide with the desired signals.  Two type of noise: internal.
Mission Operations Review February 8-10, 2010 Cordoba, ARGENTINA SECTION 16.x Aquarius Science Commissioning and Acceptance Draft 2 Prepared by: Gary Lagerloef,
2006 IHC – Mobile, Alabama 20 – 24 March 2006 JHT Project: Operational SFMR- NAWIPS Airborne Processing and Data Distribution Products OUTLINE JHT Project.
NPP ATMS Instrument Performance SDR Product Review, 23 Oct Kent Anderson Chief Engineer, Civil Space Programs NG Electronic Systems Azusa, CA.
Level 2 Scatterometer Processing Alex Fore Julian Chaubell Adam Freedman Simon Yueh.
Aquarius Simulation Studies Gary Lagerloef Aquarius Principal Investigator Algorithm Workshop 9-11 March 2010.
ADPS Science Software Development Bryan Franz NASA Ocean Biology Processing Group Aquarius Data Processing Workshop, NASA/GSFC, March 2007.
Principles of the Global Positioning System Lecture 08 Prof. Thomas Herring Room ;
CHEE825 Fall 2005J. McLellan1 Nonlinear Empirical Models.
Aquarius Level 0-to-1A Processing Rule #1: save everything from the Level 0 data. Rule #2: never forget Rule #1! The objective is to ensure that the Level.
Radiometer Calibration: Implementation of Counts to TA Processor Frank Wentz and Thomas Meissner Aquarius Algorithm Workshop, Santa Rosa, CA, March 9-11,
Instructor: Mircea Nicolescu Lecture 5 CS 485 / 685 Computer Vision.
SOUND PRESSURE, POWER AND LOUDNESS
Kalman Filter and Data Streaming Presented By :- Ankur Jain Department of Computer Science 7/21/03.
MECH 373 Instrumentation and Measurement
Techniques to control noise and fading
CoSMIR Performance during OLYMPEX
Efficient Estimation of Residual Trajectory Deviations from SAR data
Fitting Curve Models to Edges
Environmental Modeling Basic Testing Methods - Statistics
Instrument Considerations
CHAPTER 8 TIME AND TIME-RELATED PARAMETERS
Lesson 10: Sensor and Transducer Electrical Characteristics
CHAPTER 8 TIME AND TIME-RELATED PARAMETERS
CHAPTER 8 TIME AND TIME-RELATED PARAMETERS
Program Phase Directed Dynamic Cache Way Reconfiguration
Mosaic artifacts reduction in SIPS Backscatter
Biostatistics Lecture (2).
Presentation transcript:

Aquarius Algorithm Workshop Santa Rosa, CA 9 March 2010 College of Engineering Department of Atmospheric, Oceanic & Space Sciences Chris Ruf University of Michigan RFI Detection and Mitigation

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 2 of 9 RFI ATBD (1) The RFI detection algorithm can be broken into five steps: 1) Identify the set of TA samples surrounding the sample under test which will be used to estimate the local mean value of TA. The interval of time that those samples must lie within is constant in order to keep constant the ground track distance covered by the antenna footprint. However, because the spacing between samples of TA is not uniform, the actual number of samples that fall in the time interval will vary. The time between samples follows the pattern listed in Table 1.

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 3 of 9 RFI ATBD (2) Table 1. Sequencing of radiometer antenna temperatures, TA 1 Sample #Subcycle #Step #Time (s) 2 NOTES 111 & 20.00Start time; two 10 ms samples averaged on board 213 & 40.02two 10 ms samples averaged on board Skip steps 8-12 of subcycle 1; not antenna samples 621 & 20.12two 10 ms samples averaged on board 723 & 40.14two 10 ms samples averaged on board Skip steps 8-12 of subcycle 2; not antenna samples 1131 & 20.24two 10 ms samples averaged on board Repeat this pattern for subcycles Last sample from subcycle 12; Skip steps 8-12 of subcycle 12; not antenna samples & Start all over again with the pattern as in Sample #1 1. Based on “Aquarius Instrument High-Rate-Data Structure Definition,” Project Doc. AQ , v. 15 May 06 and J. Piepmeier, personal communication, 8 Jun Relative (elapsed) sample time with respect to sample #1.

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 4 of 9 RFI ATBD (3) (The RFI detection algorithm can be broken into five steps) 2) The TA samples surrounding the sample under test are examined for the presence of RFI. They are considered to be contaminated by RFI if they deviate from the local mean by more than a specified threshold. 3) Samples that pass the test are averaged together to estimate the local mean value of the sample under test. The average should equally weight samples made before and after the sample under test, in order to best represent the gradient of TA along the ground track of the radiometer.

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 5 of 9 RFI ATBD (4) (The RFI detection algorithm can be broken into five steps) 4) The TANT sample under test is compared to the local mean. It is considered to be contaminated by RFI if it deviates from the local mean by more than a specified threshold. 5) If TANT is determined to be contaminated by RFI, a specified range of samples surrounding it is also flagged as contaminated. This range is determined based on the characteristic time scale with which signals can enter and leave the radiometer antenna beam vs. the time interval between raw samples.

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 6 of 9 RFI Implementation (1) Input Radiometer data: Samples of the raw (shortest integration time; either 0.01 s or 0.02 s) radiometer antenna temperatures, TA. The TA samples should be calibrated using only internal noise diode counts to avoid RFI contamination and not external (CND) noise diode counts. The internal noise diode counts are measured during steps 9-12 of each subcycle. (The external (CND) noise diode counts are measured during step 8 of each subcycle.) For each sample to be tested for RFI, the preceding and subsequent 30 TA samples from the same radiometer at the same polarization are also needed.

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 7 of 9 RFI Implementation (2) Input Dynamic auxiliary data: Time tag for each TA sample: For each sample, TAi, a time tag, ti, is needed from which the relative time between each of the 61 samples can be determined. The time can be referenced to any common point in the integration interval (e.g. any of the start time, the center time or the end time of the integrator is okay). Location (latitude, longitude) of the center of the radiometer antenna footprint for the TA sample under test.

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 8 of 9 RFI Implementation (3) Input Static auxiliary data: Local mean running average window, WM. Values for this parameter are assigned independently in 1 degree increments of latitude and longitude and for each of the three radiometers. (units 0.01 s samples; baseline WM = 20) Local mean running average glitch threshold, TM. Values for this parameter are assigned independently in 1 degree increments of latitude and longitude and for each of the three radiometers. (units STDTA; baseline TM = 1) RFI detection glitch threshold, TD. Values for this parameter are assigned independently in 1 degree increments of latitude and longitude and for each of the three radiometers. (units STDTA; baseline TD = 4) RFI detection neighborhood window, WD. Values for this parameter are assigned independently in 1 degree increments of latitude and longitude and for each of the three radiometers. (units 0.01 s samples; baseline WD = 5) Nominal standard deviation of radiometer antenna temperature, STDTA. Values for this parameter are assigned independently for each of the three radiometers. (units Kelvins; baseline STDTA= K)

9 Mar 2010Ruf, RFI, Aquarius Algo Workshoppg 9 of 9 RFI Implementation (4) Output data For each sample of the radiometer antenna temperature that is tested for RFI: Number of TA samples in the neighborhood of the sample under test (neighborhood as defined by WM) that were flagged with RFI. The number of standard deviations that the sample under test deviated from the local mean by. TA RFI detection word: =3 if RFI detected in sample under test and in neighbors; =2 if RFI detected in sample under test only; =1 if RFI detected in neighbors only; =0 if RFI not detected in sample under test or in neighbors. CND RFI detection bit: =1 if RFI detected in neighbor; =0 if RFI not detected in neighbors.