Updates to the SZ-2 Algorithm Sebastián Torres CIMMS/NSSL Technical Interchange Meeting Fall 2007.

Slides:



Advertisements
Similar presentations
Radial-by-Radial Noise Power Estimation Igor Ivić and Christopher Curtis CIMMS/University of Oklahoma and NSSL/National Oceanic and Atmospheric Administration.
Advertisements

Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Week 8 Update Joe Hoatam Josh Merritt Aaron Nielsen.
CLEAN-AP Update Cl utter E nvironment An alysis using A daptive P rocessing Sebastián Torres and David Warde CIMMS/The University of Oklahoma and National.
Upgrades to the MODIS near-IR Water Vapor Algorithm and Cirrus Reflectance Algorithm For Collection 6 Bo-Cai Gao & Rong-Rong Li Remote Sensing Division,
1 Sebastian Torres NEXRAD Range-Velocity Ambiguity Mitigation Staggered PRT and Phase Coding Algorithms on the KOUN Research Radar.
The leading pioneer in GPS technology Copyright © 2007 NavCom Technology, Inc.Confidential A New Anti-Jamming Method for GNSS Receivers Jerry Knight, Charles.
A Refresher on Super-Resolution Radar Data Audra Hennecke, Dave Beusterien.
NEXRAD TAC Norman, OK March 21-22, 2006 Clutter Mitigation Decision (CMD) system Status and Demonstration Studies Mike Dixon, Cathy Kessinger, and John.
Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Semester 2 Update Joe Hoatam Josh Merritt Aaron Nielsen.
Contributors to Measurement Errors (Chap. 7) *1) Widespread spatial distribution of scatterers (range ambiguities) *2) Large velocity distribution (velocity.
Evolution of the SZ-2 Algorithm Sebastian Torres CIMMS/NSSL Technical Interchange Meeting Fall 2006.
Staggered PRT Update Part I Sebastián Torres and David Warde CIMMS/The University of Oklahoma and National Severe Storms Laboratory/NOAA NEXRAD TAC Norman,
VCPs for Staggered PRT Sebastián Torres and David Warde CIMMS/NSSL Data Quality MOU – Technical Interchange Meeting Fall 2008.
1 Oguz Kazanci and Jeffrey Krolik Duke University Department of Electrical and Computer Engineering Durham, NC Supported by the CNTPO R&D Program.
Error detection and concealment for Multimedia Communications Senior Design Fall 06 and Spring 07.
Carlos A. Rodríguez Rivera Mentor: Dr. Robert Palmer Carlos A. Rodríguez Rivera Mentor: Dr. Robert Palmer Is Spectral Processing Important for Future WSR-88D.
Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Dual Polarization Radar Signal Processing Dr. Chandra Joe Hoatam Josh Merritt.
Single-Channel Speech Enhancement in Both White and Colored Noise Xin Lei Xiao Li Han Yan June 5, 2002.
Active Appearance Models Computer examples A. Torralba T. F. Cootes, C.J. Taylor, G. J. Edwards M. B. Stegmann.
Problem: Ground Clutter Clutter: There is always clutter in signals and it distorts the purposeful component of the signal. Getting rid of clutter, or.
A. McDonald (1), J. Devlin (2). (1) Department of Physics, La Trobe University, Victoria, Australia (2) Department of Electronic Engineering, La Trobe.
Use of FOS for Airborne Radar Target Detection of other Aircraft Example PDS Presentation for EEE 455 / 457 Preliminary Design Specification Presentation.
Surveillance Weather Radar 2000 AD. Weather Radar Technology- Merits in Chronological Order WSR-57 WSR-88D WSR-07PD.
Considerations in the Observation of Weather Sebastian Torres CIMMS/NSSL.
Data Windowing in ORDA Technical Briefing Sebastián Torres 1,2, Chris Curtis 1,2, Rodger Brown 2, and Michael Jain 2 1 Cooperative Institute for Mesoscale.
11/18/02Technical Interchange Meeting Progress in FY-02 Research RDA –Capability to collect time series data –Control of phase shifter Phase coding –Sigmet’s.
Review Doppler Radar (Fig. 3.1) A simplified block diagram 10/29-11/11/2013METR
Sebastián Torres Weather Radar Research Innovative Techniques to Improve Weather Observations.
VISAR & Vibrometer results Goran Skoro (University of Sheffield) UK Neutrino Factory Meeting Lancaster, April 2009.
Sebastian Torres NEXRAD Range-Velocity Ambiguity Mitigation Spring 2004 – Technical Interchange Meeting.
Antenna 1 Transmitter EISCAT-3D as a diagnostic for ionospheric heating experiments Michael Rietveld EISCAT Scientific Association TromsøNorway.
Doc.: IEEE /016r0 Submission March 2003 Andy Gowans - UK RA Andy Gowans Private Business Systems Unit Radiocommunications Agency
Integration Readiness Review NEXRAD Turbulence Detection Algorithm (NTDA) Gary Blackburn, Steven G. Carson, John K. Williams NCAR Research Applications.
Correlation Coefficient (CC)
Technical Interchange Meeting Spring 2008: Status and Accomplishments.
Noise is estimated [NEXRAD technical manual] at elevation >20  and scaled. Data with low Signal/Noise are determined and censored (black or white on PPI).
Parameter studies of the e - cloud build up (update) C.Octavio Domínguez, Frank Zimmermann 28 th April e - cloud meeting.
Real-time Doppler Wind Quality Control and Analysis Qin Xu National Severe Storms Laboratory/NOAA Pengfei Zhang, Shun Liu, and Liping Liu CIMMS/University.
A statistical test for point source searches - Aart Heijboer - AWG - Cern june 2002 A statistical test for point source searches Aart Heijboer contents:
1 RADAR OPERATIONS CENTER (ROC) EVALUATION OF THE WSR-88D OPEN RADAR DATA ACQUISITION (ORDA) SYSTEM SIGNAL PROCESSING WSR-88D Radar Operations Center Engineering.
Initial Implementation of Super-Resolution Data on the NEXRAD Network Dr. Sebastian Torres CIMMS/NSSL A presentation to the Data Quality Team June 15,
Updates to the SZ-2 Algorithm Sebastian Torres CIMMS/NSSL Technical Interchange Meeting Spring 2007.
A Two-Dimensional Velocity Dealiasing Algorithm for the WSR-88D W. Dave Zittel, Zhongqi Jing Radar Operations Center, Norman, OK Nicholas Langlieb WFO,
LIGO-G D Status of Stochastic Search with LIGO Vuk Mandic on behalf of LIGO Scientific Collaboration Caltech GWDAW-10, 12/15/05.
WEATHER SIGNALS Chapter 4 (Focus is on weather signals or echoes from radar resolution volumes filled with countless discrete scatterers---rain, insects,
1 Spectral identification & suppression of ground clutter contributions for phased array radar Spectral identification of ground clutter Spectral identification.
University of Saskatchewan PHYSICS AND ENGINEERING PHYSICS Spectral widths of F-region PolarDARN echoes, a statistical assessment A.V. Koustov, S. Toderian.
Sebastian Torres NEXRAD Range-Velocity Ambiguity Mitigation Fall 2004 – Technical Interchange Meeting.
Review Doppler Radar (Fig. 3.1) A simplified block diagram 10/29-11/11/2013METR
Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.
NCAR Activity Update John Hubbert, Cathy Kessinger, Mike Dixon, Scott Ellis, Greg Meymaris and Frank Pratte To the NEXRAD TAC October 2005 San Diego,
COMPARING NOISE REMOVAL IN THE WAVELET AND FOURIER DOMAINS Dr. Robert Barsanti SSST March 2011, Auburn University.
1 Mean Analysis. 2 Introduction l If we use sample mean (the mean of the sample) to approximate the population mean (the mean of the population), errors.
By Zinour Charifoulline, Scott Rowan Automation of Hardware Commissioning - Offline Analysis of 60A circuits.
DOPPLER SPECTRA OF WEATHER SIGNALS (Chapter 5; examples from chapter 9)
Lecture 04 Edge Detection Lecture 04 Edge Detection Mata kuliah: T Computer Vision Tahun: 2010.
1 Svetlana Bachmann November 20, 2007, Norman OK Technical Interchange Meeting “Data Quality / R-v ambiguities mitigation” Staggered PRT ground clutter.
ASAT Project Two main research thrusts –Feature extraction –Evidence combiner Feature extraction –The classical distinctive features are well explored,
1 D *+ production Alexandr Kozlinskiy Thomas Bauer Vanya Belyaev
Estimation of Doppler Spectrum Parameters Comparison between FFT-based processing and Adaptive Filtering Processing J. Figueras i Ventura 1, M. Pinsky.
LFM Pulse Compression Sidelobe Reduction Techniques
High Resolution Weather Radar Through Pulse Compression
DUAL POLARIZATION AND ZDR CALIBRATION IMPROVEMENTS 5.2(6)
NEXRAD Data Quality Optimization AP Clutter Mitigation Scheme
An overview by: Thomas Jones December 2, 2002
the University of Oklahoma
Examples of spectral fields
Final Project: Phase Coding to Mitigate Range/Velocity Ambiguities
Mark Sayles, Ian M. Winter  Neuron 
Date Submitted: November 11, 2005]
Presentation transcript:

Updates to the SZ-2 Algorithm Sebastián Torres CIMMS/NSSL Technical Interchange Meeting Fall 2007

Over 25 years ago…

Today… KTLX radar in Oklahoma City 30 Mar 2007, 0.5 deg elevation (VCP 12/VCP 221) Courtesy of Jami Boettcher (WDTB)

SZ-2 is Operational! KCRI 20 June 2007 VCP 121 SZ-2 tilt Courtesy of Dave Zittel (ROC)

Outline SZ-2 Upgrades –4 th -trip overlaid echoes –Recovery region censoring Recommendations

20 June 2007 Case Observed “noisy velocities”

Sanity Check KCRI Level II Data KCRI Level I Data processed with MATLAB Note: Velocity color scales are different

Where is it Coming From? Long PRT: r a = 471 kmShort PRT: r a = 119 km Storm cell between 400 and 450 km: 4 th trip overlaid echoes

A Little Detective Work 4 th 3 rd 2 nd 1 st None 4 th 3 rd 2 nd 1 st None Noisy velocities correspond to strong 4 th trip and weak 1 st trip

The SZ-2 Processing Notch Filter S 1 = 10 dB v 1 = 15 m/s w 1 = 2 m/s S 2 = 0 dB v 2 = -15 m/s w 2 = 2 m/s Weak signal is in 2 nd trip 3 rd trip 4 th trip PNF width 0.75 M 0.50 M 0.75 M Overlaid signals Sidebands Sidebands don’t bias, but contribute to higher errors of velocity estimates Two replicas of the modulated weak signal are needed for proper spectral reconstruction

Back to Our Case… Strong signal is in the 4 th trip Weak signal is in the 1 st trip Recovered 1 st trip signal spectrum does not seem to have the expected mainlobe with decaying sidelobes! AZ = 266 deg r = 64 km Strong trip

SZ(8/64) Modulation Codes 1 st to 2 nd trip mod. code 1 st to 3 rd trip mod. code 1 st to 4 th trip mod. code Cohere to strong  Apply von Hann window  Apply PNF  Cohere to weak

Weak Trip Velocity Recovery 2 nd trip 3 rd trip 4 th trip Standard deviation of weak-trip velocity estimates If strong and weak signals are 3 trips apart (e.g., 1 st and 4 th trips), recovery of weak- trip velocities is not possible with the current algorithm

Why are the errors so large? PNF’s NW = 0.75M PNF’s NW = 0.50M  vn = 0.53  vn = Change

A New PNF Notch Width 2 nd trip 3 rd trip 4 th trip Standard deviation of weak-trip velocity estimates If strong and weak signals are 3 trips apart (e.g., 1 st and 4 th trips), recovery of weak velocities is possible with a small change to the current algorithm

Changes to SZ-2 ≠1

Back to Our Case with the Fix Current SZ-2 Algorithm Proposed SZ-2 Algorithm

19 June 2007 Case Current SZ-2 Algorithm Proposed SZ-2 Algorithm

Still Noisy Velocities! Weak Trip Number 4 th 3 rd 2 nd 1 st None

Recovery Region Censoring Weak-trip velocity estimates exhibit large errors for wider strong-trip spectrum widths and large power ratios –In this case, weak-trip velocities “cannot be recovered” –Weak-trip velocities are censored if we are outside the “recovery region” CTCT CICI CSCS Accept Censor Extracted from NSSL Report 2

Current SZ-2 Thresholds Narrow weak- trip widths Wide weak- trip widths Weak trip:  v = 4.2 m/s Nominal parameters f = 2800 MHz DELTA PRI C Nominal parameters f = 2800 MHz DELTA PRI C Strong trip:  v = 4.8 m/s  v = 3.7 m/s  v,s (m/s) P s /P w (dB) dB/(m/s) dB/(m/s) 10.9  v,s (m/s) P s /P w (dB) Narrow weak-trip widthsWide weak-trip widths

2 nd Trip Overlay Requirement: SD(v w ) < 2 m/s 4.5 m/s 3.5 m/s dB s/m 45 dB 4.25 m/s dB s/m 45 dB 4.5 m/s dB s/m 45 dB 4.5 m/s dB s/m 45 dB 4.5 m/s w w <3.5m/s3.5m/s<w w <4.5 m/s CTCT 45 dB CSCS dB s/m CICI 4.5 m/s4.25 m/s Conditions?

3 rd Trip Overlay Requirement: SD(v w ) < 2 m/s 6.5 m/s w w <6.5m/s CTCT 45 dB CSCS dB s/m CICI 2.75 m/s dB s/m 45 dB 2.75 m/s dB s/m 45 dB 2.75 m/s dB s/m 45 dB 2.75 m/s dB s/m 45 dB 2.75 m/s dB s/m 45 dB 2.75 m/s dB s/m 45 dB 2.75 m/s

4 th Trip Overlay Requirement: SD(v w ) < 2 m/s 4.5 m/s 3.5 m/s dB s/m 45 dB 2 m/s dB s/m 45 dB 2.25 m/s dB s/m 45 dB 2.25 m/s dB s/m 45 dB 2.25 m/s w w <3.5m/s3.5m/s<w w <4.5 m/s CTCT 45 dB CSCS dB s/m CICI 2.25 m/s2 m/s

Proposed thresholds Depend on type of overlay Current thresholds Same for every type of overlay w wn < w 0 w 0 < w wn < w 1 w w > w 1 CTCT 45 dB -∞ CSCS -772 N/A CICI N/A CTCT 45 dB-∞ CSCS N/A-772N/A CICI N/A CTCT 45 dB -∞ CSCS -772 N/A CICI N/A Summary of Recovery Regions One-trip difference w 0 = w 1 = Two-trip difference w 0 = 0 w 1 = Three-trip difference w 0 = w 1 =

Changes to the SZ-2 Algorithm Define thresholds for each overlay type Make recovery region censoring a function of the strong-to-weak trip number difference Define recovery region using three zones depending on the weak-trip spectrum width –Immediate censoring for large weak-trip widths

Back to our cases (I) 20 Jun 2007 Current Censoring (mild) Proposed Censoring (normal) Proposed Censoring (aggressive)

Back to our cases (II) 19 Jun 2007 Current Censoring (mild) Proposed Censoring (normal) Proposed Censoring (aggressive)

Summary Analysis of operational SZ-2 fields revealed noisy velocities Three-trip-difference overlay situations are not handled well in SZ-2 –This affects weak-trip velocities for those cases in which 1 st trip is weak, 4 th trip is strong, and there are no significant signals in the 2 nd and 3 rd trips –Effective recovery of weak-trip velocities in this situation requires a narrower PNF notch

Summary (cont’d) Censoring based on power-ratio recovery region is not aggressive enough –This affects weak-trip velocities only Higher errors of estimates –Different overlay situations require different recovery regions Current algorithm based on one-trip difference overlay case One-, two-, and three-trip difference overlay cases need to be considered –Recovery for wide weak-trip widths is very difficult

Recommendations Fix PNF notch width –Verified issue with clear-cut fix –Very simple, transparent change –Recommend implementation for ORDA Build 11 Upgrade “Recovery Region” Censoring –Change is relatively simple Will result in more purple haze –Should look at more cases before proposing new thresholds Involve DQ Team? –Recommend implementation ASAP