Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data Windowing in ORDA Technical Briefing Sebastián Torres 1,2, Chris Curtis 1,2, Rodger Brown 2, and Michael Jain 2 1 Cooperative Institute for Mesoscale.

Published byRoland Russell Modified over 9 years ago

Similar presentations

Presentation on theme: "Data Windowing in ORDA Technical Briefing Sebastián Torres 1,2, Chris Curtis 1,2, Rodger Brown 2, and Michael Jain 2 1 Cooperative Institute for Mesoscale."— Presentation transcript:

1 Data Windowing in ORDA Technical Briefing Sebastián Torres 1,2, Chris Curtis 1,2, Rodger Brown 2, and Michael Jain 2 1 Cooperative Institute for Mesoscale Meteorological Studies 2 National Severe Storms Laboratory NEXRAD Technical Advisory Committee Meeting March 27, 2007

2 What is Data Windowing? Unlike legacy RDA, ORDA uses data windows Time-series samples used to compute base data moments are weighted using a “window” Data windows available in ORDA are: rectangular (no window)  Equivalent to legacy RDA Hamming von Hann Blackman More aggressive RectangularHamming von HannBlackman

3 Why Data Windowing? Tapered data windows are usually applied before processing in the frequency domain (spectral processing) Aggressive windows have lower frequency sidelobes that help reduce the frequency “leakage” effect In ORDA : GMAP, SZ-2 Tapered data windows reduce the effective antenna beamwidth due to scanning A narrower effective beamwidth results in smaller resolution volumes In ORDA : Super Resolution

4 The Effects of Data Windowing Tapered windows reduce the equivalent number of independent samples available to estimate spectral moments End samples “contribute less” to the estimation process The more aggressive the data window, the larger the errors of estimates for all base data moments Rectangular Window Hamming Window

5 Standard Error of Moment Estimates for Different Windows vs. Spectrum Width (VCP 11) Parameters correspond to 1 st split cut of VCP 11 M = 17, T s = 3.1 ms, SNR = 10 dB M = 52, T s = 1 ms, SNR = 10 dB

6 Standard Error of Moment Estimates for Different Windows vs. SNR (VCP 11) Parameters correspond to 1 st split cut of VCP 11 M = 17, T s = 3.1 ms,  v = 4 m/s M = 52, T s = 1 ms,  v = 4 m/s

7 Standard Error of Moment Estimates for Different Windows vs. SNR (VCP 12) Parameters correspond to 1 st split cut of VCP 12 M = 15, T s = 3.1 ms,  v = 4 m/s M = 40, T s = 1 ms,  v = 4 m/s

8 Relative Error Increase for Different Data Windows Compared to using a rectangular data window (no window), use of tapered data windows results in higher standard deviation of all base data moments For  v = 4 m/s and high SNR The Hamming window increases the errors by about 30% The von Hann window increases the errors by about 35% The Blackman window increases the errors by about 50%

9 A Timeline of Data Windowing in the RDA Past (before ORDA) Rectangular: all legacy RDA algorithms Present (ORDA Builds 8 and 9) Hamming: default window Blackman: GMAP ground clutter filter von Hann: SZ-2 with overlaid echoes Near Future (ORDA Builds 10 through 12) Rectangular: proposed default window Blackman: GMAP ground clutter filter von Hann: SZ-2 with overlaid echoes and Super-Resolution Future (ORDA Build 13 and beyond) Same as Build 12 plus… von Hann: spectral processing? Windowing would not be necessary in case of unimodal spectra How does the present system deviates from the past ? Compare performance of Rectangular vs. Hamming

10 VCP 11 Comparison SurveillanceDoppler Rectangular windowHamming window Elv (deg) WFPRIM MSD(Z) (dB)*SD(v) (m/s)SD(w) (m/s)SD(Z) (dB)*SD(v) (m/s)SD(w) (m/s) 0.5CS1170.59--0.80-- 0.5CD552-0.890.73-1.200.89 1.45CS1160.61--0.83-- 1.45CD552-0.890.73-1.200.89 2.4B165410.940.631.010.861.310.841.341.04 3.35B265411.040.631.010.861.420.841.341.04 4.3B265411.040.631.010.861.420.841.341.04 5.25B3105410.970.631.010.861.290.841.341.04 6.2B3105410.970.631.010.861.290.841.341.04 7.5CD6430.631.010.920.841.341.11 8.7CD7460.631.010.980.851.341.18 10CD7460.631.010.980.851.341.18 12CD7460.631.010.980.851.341.18 14CD7460.631.010.980.851.341.18 16.7CD7460.631.010.980.851.341.18 19.5CD7460.631.010.980.851.341.18 f = 2800 MHz, PRI Delta C * Reflectivity errors in the Batch mode are indicated for overlaid / non-overlaid situations. SurveillanceDoppler Rectangular window Elv (deg) WFPRIM MSD(Z) (dB)*SD(v) (m/s)SD(w) (m/s) 0.5CS1170.59-- 0.5CD552-0.890.73 1.45CS1160.61-- 1.45CD552-0.890.73 2.4B165410.940.631.010.86 3.35B265411.040.631.010.86 4.3B265411.040.631.010.86 5.25B3105410.970.631.010.86 6.2B3105410.970.631.010.86 7.5CD6430.631.010.92 8.7CD7460.631.010.98 10CD7460.631.010.98 12CD7460.631.010.98 14CD7460.631.010.98 16.7CD7460.631.010.98 19.5CD7460.631.010.98 SurveillanceDoppler Rectangular window Elv (deg) WFPRIM MSD(Z) (dB)*SD(v) (m/s)SD(w) (m/s) 0.5CS1170.59-- 0.5CD552-0.890.73 1.45CS1160.61-- 1.45CD552-0.890.73 2.4B165410.940.631.010.86 3.35B265411.040.631.010.86 4.3B265411.040.631.010.86 5.25B3105410.970.631.010.86 6.2B3105410.970.631.010.86 7.5CD6430.631.010.92 8.7CD7460.631.010.98 10CD7460.631.010.98 12CD7460.631.010.98 14CD7460.631.010.98 16.7CD7460.631.010.98 19.5CD7460.631.010.98

11 NEXRAD Requirements and Historical Data Quality Meeting NEXRAD data quality requirements Requirements formulated to ensure DQ is maintained within the system Committee established to assess NTR related to base data quality Matching legacy RDA performance Algorithms and users were accustomed to data with a certain quality Frequently, legacy RDA exceeded requirements Data quality of ORDA compared to legacy RDA determines the “ DQ Delta ” that users and algorithms are experiencing Currently evaluating the operational impact of using a tapered data window all the time (“apples-to-apples” comparison) Impact may be worse for  FAA’s fully-automated algorithms  Data assimilation into numerical forecast models  Polarimetric variables

12 Base Data Comparison Reflectivity (KCRI – 03/19/2006)

13 Rectangular window

14 Base Data Comparison Reflectivity (KCRI – 03/19/2006) Hamming window

15 Rectangular window Algorithm Performance Comparison One-hour Precipitation Accumulation Courtesy Bob Lee (ROC)

16 Hamming window Algorithm Performance Comparison One-hour Precipitation Accumulation Courtesy Bob Lee (ROC)

17 Algorithm Performance Comparison Mesocyclone Detection Algorithm  Rectangular window  Hamming window time Accumulated number of detections

18 Range Gates with … ClutterOverlaid echoes Clean echoes Split Cuts Surveillance data Baseline processing Super Resolution Doppler data Baseline processing Super Resolution SZ-2 Batch Cuts Baseline processing for Long-PRT data Baseline processing for Short-PRT data Doppler Cuts Baseline processing Range Gates with … ClutterOverlaid echoes Clean echoes Split Cuts Surveillance data Baseline processingBlackman-Default Super ResolutionBlackman-Von Hann Doppler data Baseline processingBlackmanDefault Super ResolutionBlackmanVon Hann SZ-2BlackmanVon HannDefault Batch Cuts Baseline processing for Long-PRT data Rectangular- Baseline processing for Short-PRT data BlackmanDefault Doppler Cuts Baseline processingBlackman-Default Range Gates with … ClutterOverlaid echoes Clean echoes Split Cuts Surveillance data Baseline processingBlackman-Hamming Super ResolutionBlackman-Von Hann Doppler data Baseline processingBlackmanHamming Super ResolutionBlackmanVon Hann SZ-2BlackmanVon HannHamming Batch Cuts Baseline processing for Long-PRT data Rectangular- Baseline processing for Short-PRT data BlackmanHamming Doppler Cuts Baseline processingBlackman-Hamming Range Gates with … ClutterOverlaid echoes Clean echoes Split Cuts Surveillance data Baseline processingBlackman-Rectangular Super ResolutionBlackman-Von Hann Doppler data Baseline processingBlackmanRectangular Super ResolutionBlackmanVon Hann SZ-2BlackmanVon HannRectangular Batch Cuts Baseline processing for Long-PRT data Rectangular- Baseline processing for Short-PRT data BlackmanRectangular Doppler Cuts Baseline processingBlackman-Rectangular Near-Future Impact of Changing the Default Data Window in ORDA

19 Conclusions Hamming window increases errors of all base data moments Compared to legacy RDA current data has ~ 30% larger errors VCPs that met NEXRAD DQ technical requirements with legacy RDA no longer meet them with ORDA Is this lower data quality operationally acceptable? Working on “apples-to-apples” quantitative analyses Preliminary results indicate there can be performance differences in certain products Users always demand better data quality and faster updates Back in 2003, one of the TAC’s recommendations was to… “Produce the best quality data possible from the WSR-88D throughout the remainder of its service life.”  e.g., recommendation for super resolution followed this criterion (recombination)

20 Recommendations ORDA should operate with a rectangular window whenever possible Making this change is straightforward, low-cost, and would not change the computational complexity of ORDA algorithms Historically, requirements have been relaxed only if significant operational benefits were realized Clutter filtering → Uncontaminated data VCP 12 → Faster updates SZ-2 → Recovery of overlaid echoes (reduced obscuration) Super Resolution → Improved detection of weather features Operating with the Hamming window does not bring any significant operational benefits However, before using the rectangular window as the default window, we recommend the ORDA spectrum width estimator be fixed Stay tuned!

21 Back-Up Slides

22 Relative Standard Error of Moment Estimates for Different Windows vs. Spectrum Width Parameters correspond to 1 st split cut of VCP 11 M = 17, T s = 3.1 ms, SNR = 10 dB M = 52, T s = 1 ms, SNR = 10 dB

23 Relative Standard Error of Moment Estimates for Different Windows vs. SNR Parameters correspond to 1 st split cut of VCP 11 M = 17, T s = 3.1 ms,  v = 4 m/s M = 52, T s = 1 ms,  v = 4 m/s

24 Errors with Different Data Windows for VCPs 11, 12, and 21 VCP 11 SD( Z ) (dB) SD( v ) (m/s) SD(  v ) (m/s) Rectangular0.580.890.73 Hamming0.801.190.90 Von Hann0.781.210.91 Blackman0.891.351.05 VCP 12 SD( Z ) (dB) SD( v ) (m/s) SD(  v ) (m/s) Rectangular0.621.020.88 Hamming0.841.361.06 Von Hann0.821.371.08 Blackman0.941.541.25 VCP 21 SD( Z ) (dB) SD( v ) (m/s) SD(  v ) (m/s) Rectangular0.460.680.52 Hamming0.620.910.66 Von Hann0.620.930.68 Blackman0.701.030.76 Errors correspond to the 1 st elevation angle For Z and  v :  v = 4 m/s and SNR = 10 dB For v :  v = 4 m/s and SNR = 8 dB

25 Relative Errors with Different Data Windows for VCPs 11, 12, and 21 VCP 11 SD( Z )  SD( Z rect ) SD( Z rect ) SD( v )  SD( v rect ) SD( v rect ) SD(  v )  SD(  v rect ) SD(  v rect ) Hamming38%34%23% Von Hann34%36%25% Blackman53%52%44% Errors correspond to the 1 st elevation angle For Z and  v :  v = 4 m/s and SNR = 10 dB For v :  v = 4 m/s and SNR = 8 dB VCP 12 SD( Z )  SD( Z rect ) SD( Z rect ) SD( v )  SD( v rect ) SD( v rect ) SD(  v )  SD(  v rect ) SD(  v rect ) Hamming35%33%20% Von Hann32%34%23% Blackman52%51%42% VCP 21 SD( Z )  SD( Z rect ) SD( Z rect ) SD( v )  SD( v rect ) SD( v rect ) SD(  v )  SD(  v rect ) SD(  v rect ) Hamming35%34%27% Von Hann35%37%31% Blackman52%51%46%

Download ppt "Data Windowing in ORDA Technical Briefing Sebastián Torres 1,2, Chris Curtis 1,2, Rodger Brown 2, and Michael Jain 2 1 Cooperative Institute for Mesoscale."

Similar presentations

Change-Point Detection Techniques for Piecewise Locally Stationary Time Series Michael Last National Institute of Statistical Sciences Talk for Midyear.

Change-Point Detection Techniques for Piecewise Locally Stationary Time Series Michael Last National Institute of Statistical Sciences Talk for Midyear.
Radial-by-Radial Noise Power Estimation Igor Ivić and Christopher Curtis CIMMS/University of Oklahoma and NSSL/National Oceanic and Atmospheric Administration.

Radial-by-Radial Noise Power Estimation Igor Ivić and Christopher Curtis CIMMS/University of Oklahoma and NSSL/National Oceanic and Atmospheric Administration.
Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Week 8 Update Joe Hoatam Josh Merritt Aaron Nielsen.

Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Week 8 Update Joe Hoatam Josh Merritt Aaron Nielsen.
CLEAN-AP Update Cl utter E nvironment An alysis using A daptive P rocessing Sebastián Torres and David Warde CIMMS/The University of Oklahoma and National.

CLEAN-AP Update Cl utter E nvironment An alysis using A daptive P rocessing Sebastián Torres and David Warde CIMMS/The University of Oklahoma and National.
1 Sebastian Torres NEXRAD Range-Velocity Ambiguity Mitigation Staggered PRT and Phase Coding Algorithms on the KOUN Research Radar.

1 Sebastian Torres NEXRAD Range-Velocity Ambiguity Mitigation Staggered PRT and Phase Coding Algorithms on the KOUN Research Radar.
A Refresher on Super-Resolution Radar Data Audra Hennecke, Dave Beusterien.

A Refresher on Super-Resolution Radar Data Audra Hennecke, Dave Beusterien.
CLUTTER MITIGATION DECISION (CMD) THEORY AND PROBLEM DIAGNOSIS

CLUTTER MITIGATION DECISION (CMD) THEORY AND PROBLEM DIAGNOSIS
NEXRAD TAC Norman, OK March 21-22, 2006 Clutter Mitigation Decision (CMD) system Status and Demonstration Studies Mike Dixon, Cathy Kessinger, and John.

NEXRAD TAC Norman, OK March 21-22, 2006 Clutter Mitigation Decision (CMD) system Status and Demonstration Studies Mike Dixon, Cathy Kessinger, and John.
Statistical Issues in Research Planning and Evaluation

Statistical Issues in Research Planning and Evaluation
Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Semester 2 Update Joe Hoatam Josh Merritt Aaron Nielsen.

Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Semester 2 Update Joe Hoatam Josh Merritt Aaron Nielsen.
Contributors to Measurement Errors (Chap. 7) *1) Widespread spatial distribution of scatterers (range ambiguities) *2) Large velocity distribution (velocity.

Contributors to Measurement Errors (Chap. 7) *1) Widespread spatial distribution of scatterers (range ambiguities) *2) Large velocity distribution (velocity.
Evolution of the SZ-2 Algorithm Sebastian Torres CIMMS/NSSL Technical Interchange Meeting Fall 2006.

Evolution of the SZ-2 Algorithm Sebastian Torres CIMMS/NSSL Technical Interchange Meeting Fall 2006.
Updates to the SZ-2 Algorithm Sebastián Torres CIMMS/NSSL Technical Interchange Meeting Fall 2007.

Updates to the SZ-2 Algorithm Sebastián Torres CIMMS/NSSL Technical Interchange Meeting Fall 2007.
 Definition of Spectrum Width (σ v ) › Spectrum width is a measure of the velocity dispersion within a sample volume or a measure of the variability.

 Definition of Spectrum Width (σ v ) › Spectrum width is a measure of the velocity dispersion within a sample volume or a measure of the variability.
Staggered PRT Update Part I Sebastián Torres and David Warde CIMMS/The University of Oklahoma and National Severe Storms Laboratory/NOAA NEXRAD TAC Norman,

Staggered PRT Update Part I Sebastián Torres and David Warde CIMMS/The University of Oklahoma and National Severe Storms Laboratory/NOAA NEXRAD TAC Norman,
VCPs for Staggered PRT Sebastián Torres and David Warde CIMMS/NSSL Data Quality MOU – Technical Interchange Meeting Fall 2008.

VCPs for Staggered PRT Sebastián Torres and David Warde CIMMS/NSSL Data Quality MOU – Technical Interchange Meeting Fall 2008.
© Crown copyright Met Office RAINGAIN Kick-Off Meeting Benefits of High Spatial and Temporal Resolution for Urban Catchments from existing Radars.

© Crown copyright Met Office RAINGAIN Kick-Off Meeting Benefits of High Spatial and Temporal Resolution for Urban Catchments from existing Radars.
Carlos A. Rodríguez Rivera Mentor: Dr. Robert Palmer Carlos A. Rodríguez Rivera Mentor: Dr. Robert Palmer Is Spectral Processing Important for Future WSR-88D.

Carlos A. Rodríguez Rivera Mentor: Dr. Robert Palmer Carlos A. Rodríguez Rivera Mentor: Dr. Robert Palmer Is Spectral Processing Important for Future WSR-88D.
Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Dual Polarization Radar Signal Processing Dr. Chandra Joe Hoatam Josh Merritt.

Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Dual Polarization Radar Signal Processing Dr. Chandra Joe Hoatam Josh Merritt.
COPS-GOP-WS3 Hohenheim 2006_04_10 Micro- Rain- Radar Local Area Weather Radar Cloud Radar Meteorological Institute University Hamburg Gerhard Peters.

COPS-GOP-WS3 Hohenheim 2006_04_10 Micro- Rain- Radar Local Area Weather Radar Cloud Radar Meteorological Institute University Hamburg Gerhard Peters.

Similar presentations

Ads by Google