RTFDDA Engineering System Architecture Input Data Cycle Timing.

Slides:



Advertisements
Similar presentations
New Resources in the Research Data Archive Doug Schuster.
Advertisements

LAPS Analysis & Software by Steve Albers. 2 Basic Solution LAPS coupled with MM5 NWP model Use diabatic initialization (“hot start”) Utilize parallel.
“Where America’s Climate, Weather and Ocean Services Begin” NCEP CONDUIT UPDATE Brent A Gordon NCEP Central Operations January 31, 2006.
Rapid Refresh and RTMA. RUC: AKA-Rapid Refresh A major issue is how to assimilate and use the rapidly increasing array of off-time or continuous observations.
NOAA Joint OSSE System’s Applications for WISDOM project Y. Zhang, Y. Xie, N. Prive, and B. Mock Jan 18, 2012 GSD/FAB.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Update on the Regional Modeling System Cliff Mass, David Ovens, Richard Steed, Mark Albright, Phil Regulski, Jeff Baars, Eric Grimit.
The Puget Sound Regional Environmental Prediction System: An Update.
Atmospheric Modeling at RENCI Brian J. Etherton. Atmospheric Modeling at RENCI Focus of RENCI for C- STAR project is to provide modeling support/development.
Global Forecast System (GFS) Model Previous called the Aviation (AVN) and Medium Range Forecast (MRF) models. Global model and 64 levels Relatively primitive.
Consortium Meeting Feb 3, Hit Rates Finally, a clear reduction in Canadian traffic and other mega-users not part of the consortium Some may have.
RTFDDA/CFDDA/E-RTFDDA Resources. Repositories –CVS –Data Sources Documentation & Useful Information –Internal –External –Mailing lists/aliases –Misc Web.
Storm Tracker – a Web-Based Tool for Working with the Automated Tracking of Thunderstorm Clusters Bob Rabin NOAA / NSSL / CIMSS Tom Whittaker Space Science.
Lecture 10 (11/11) Numerical Models. Numerical Weather Prediction Numerical Weather Prediction (NWP) uses the power of computers and equations to make.
Incorporation of TAMDAR into Real-time Local Modeling Tom Hultquist Science & Operations Officer NOAA/National Weather Service Marquette, MI.
Forecasting and Numerical Weather Prediction (NWP) NOWcasting Description of atmospheric models Specific Models Types of variables and how to determine.
Applied Meteorology Unit 1 An Operational Configuration of the ARPS Data Analysis System to Initialize WRF in the NWS Environmental Modeling System 31.
Met Alert Tool (MAT). Introduction What is MAT? –Met Alert Tool (MAT) monitors and alerts the user to weather conditions exceeding thresholds (for example,
The Sensitivity of a Real-Time Four- Dimensional Data Assimilation Procedure to Weather Research and Forecast Model Simulations: A Case Study Hsiao-ming.
ITIS 1210 Introduction to Web-Based Information Systems Chapter 4. Understanding the Internet’s Software Structure.
November 1, 2013 Bart Brashers, ENVIRON Jared Heath Bowden, UNC 3SAQS WRF Modeling Recommendations.
RDFS Rapid Deployment Forecast System Visit at: Registration required.
Obs-nudging-FDDA An overview.
The NCAR/ATEC Real-Time Four-Dimensional Data Assimilation and Forecast System (RTFDDA) Yubao Liu, Laurie Carson, Francois Vandenberghe Chris Davis, Mei.
MDSS Lab Prototype: Program Update and Highlights Bill Mahoney National Center For Atmospheric Research (NCAR) MDSS Stakeholder Meeting Boulder, CO 20.
TIM-GSD 13 June GSD Weather Modeling Efforts in Support of RSA Christopher J. Anderson ESRL/GSD/FAB 10-km grid valid 09 UTC 12 Jun1.1-km grid valid.
RAMS Input Data. Types of input data Meteorological data  First guess gridded data – NCEP, ECMWF, etc.  Surface observations (single level measurements.
GLFE Status Meeting April 11-12, Presentation topics Deployment status Data quality control Data distribution NCEP meeting AirDat display work Icing.
Combining mesoscale, nowcast, and CFD model output in near real-time for protecting urban areas and buildings from releases of hazardous airborne materials.
OUTLINE Current state of Ensemble MOS
AMB Verification and Quality Control monitoring Efforts involving RAOB, Profiler, Mesonets, Aircraft Bill Moninger, Xue Wei, Susan Sahm, Brian Jamison.
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
START-08/pre-HIPPO FIELD CATALOG AND DATA MANAGEMENT Steve Williams NCAR Earth Observing Laboratory (EOL) Boulder, Colorado START-08/pre-HIPPO Planning.
Sea Ice Mapping Systems Archive Browser Interface Distribution IngestProduction Ice Analyst Application Database Henrik Steen AndersonDMI Paul SeymourNIC.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
WRF Four-Dimensional Data Assimilation (FDDA) Jimy Dudhia.
Scatterometers at KNMI; Towards Increased Resolution Hans Bonekamp Marcos Portabella Isabel.
Easy Deployment of the WRF Model on Heterogeneous PC Systems Braden Ward and Shing Yoh Union, New Jersey.
LEAD – WRF How to package for the Community? Tom Baltzer.
Title_Sli de Quality Controlling Wind Power Data for Data Mining Applications Gerry Wiener Research Applications Laboratory Software Engineering Assembly,
MADIS Airlines for America Briefing Meteorological Assimilated Data Ingest System (MADIS) FPAW Briefing Steve Pritchett NWS Aircraft Based Observations.
Renewable Energy Requirements Rapid Update Analysis/Nowcasting Workshop - June 4, 2015 Sue Ellen Haupt Director, Weather Systems & Assessment Program Research.
Progress Update of Numerical Simulation for OSSE Project Yongzuo Li 11/18/2008.
Status and Plans for the RSA LAPS/MM5 Implementation – July 2005 John McGinley, Steve Albers*, Ed Szoke*, Dan Birkenheuer NOAA Forecast Systems Laboratory.
Status and Plans for the RSA LAPS/MM5 Implementation – July 2004 Brent Shaw*, John McGinley, Steve Albers* NOAA Forecast Systems Laboratory *In collaboration.
4dwx Range Web Pages 2006 Forecasters Conference.
TIGGE Archive Access at NCAR Steven Worley Doug Schuster Dave Stepaniak Hannah Wilcox.
Using the LEAD Portal to submit a Regional WRF run to the Teragrid July 13, 2006.
2008 Briefings National Security Applications Program 6 November 2008 Yubao Liu Next Generation Operational Mesoscale NWP Technology Next Generation Operational.
Derek Weitzel Grid Computing. Background B.S. Computer Engineering from University of Nebraska – Lincoln (UNL) 3 years administering supercomputers at.
OFCM CEISC December 12, 2005 Non-Traditional and Non-WMO Observational Networks: Transitioning of the Meteorological Assimilation Data Ingest System (MADIS)
ATEC-4DWX Project 6 October 2008 Jason Knievel, lead scientist Keith Searight, lead engineer Scott Swerdlin, project manager.
15 June 2005RSA TIM – Boulder, CO Hot-Start with RSA Applications by Steve Albers.
NCAR/RAL - National Security Applications Program 1 MetVault Training Keith Searight Tom Margolis ATEC-4DWX Forecaster Training 25 Feb 2009.
C. Bruce Entwistle Science and Operations Officer Aviation Weather Center Kansas City, MO C. Bruce Entwistle Science and Operations.
Model recovery steps Or what to do when everyone at NCAR went skiing.
Breakout Session 3: Analysis Strategies Charge(s): –Identify and evaluate the current capabilities to develop AORs –Recommendations on overcoming current.
WRF Four-Dimensional Data Assimilation (FDDA)
Rapid Update Cycle-RUC
TIGGE Archives and Access
Better Forecasting Bureau
TIGGE Data Archive and Access System at NCAR
gWRF Workflow and Input Data Requirements
Winter storm forecast at 1-12 h range
Local Analysis and Prediction System (LAPS)
Western Africa NWP: The model and initial results
New Developments in Aviation Forecast Guidance from the RUC
Start Hot-Start Section
New Technologies for Storage and Display of Meteorological Data
Status of the Regional OSSE for Space-Based LIDAR Winds – Feb01
Presentation transcript:

RTFDDA Engineering System Architecture Input Data Cycle Timing

4DWX System Architecture NOAAPort Internet Range Data Model Applications Cluster Data Applications System Auto- Nowcast System Web Displays JVIZ CQT MAT, WWT CIDD/MRRD

4DWX System Architecture DAS Data Applications Cluster NOAAPort Internet Range Data Web Displays JVIZ CQT MAT, WWTCIDD/MRRD Ingest: Data ingest Web Server System Monitor Web-based tools Server: Mysql RAID storage Display: Web Browser JVIZ Desktop Tools nport radar Spare No high-speed interconnect between nodes

4DWX System Architecture MAC Data Applications Cluster NOAAPort Internet Range Data Web Displays JVIZ CQT MAT, WWTCIDD/MRRD Admin node: Holds O/S & tools Interactive nodes (2): data ingest Pre processing Post processing Compute nodes (14): High speed interconnect (Myrinet or other) between nodes At least one kept as a spare “Good” nodes collected each RTFDDA cycle No external network connectivity

DAS Architecture NOAAPort Internet Range Data IngestServerDisplay RAID Storage Web ToolsDesktop Tools

RTFDDA Data Initial and Boundary Conditions –NAM –GFS –Sometimes other models – ECMWF, NNRP –From NCEP FTP servers –NOAAPort broadcasts a reduced set of these data which are not sufficient (vertical resolution and missing fields) for model initialization –00Z NAM/GFS is used as input to RTFDDA 05Z –12Z NAM/GFS is used as input to RTFDDA 17Z

RTFDDA Data Observations datasets –More observations are always being added –The data sources adapt as new data is added –Range data is always used and very important for local scale phenomena –Some obs are gathered at NCAR and distributed to the ranges –Some obs are gathered independently at each range –Only observations that measure direct model variables are currently used in the RTFDDA obs- nudging scheme (temp, wind, rh, etc)

Regional-scale model, based on PSU/NCAR MM5 (WRF) RTFDDA Cold start t Forecast FDDA New 48 h forecast every 3 hrs at 1 km res, using all new obs QuickSCAT TAMDAR LIDAR RADAR MESOWEST ACARS GOES

RTFDDA dataflow “in general” Ingest host ETA GFS WMO Satwinds NPN BLP ACARs RAWs MADIS Other NCEP Other Ranges NOAA NOAAPort FSL Model Cluster RTFDDA cycles Output Products Web server Web accessible Output Products UGUI gifs NAPS MEDOC FDDA sites Data host MDV server/files JVIZ Gridded Climatology Files

RTFDDA dataflow *ATEC range* Ingest Mysql  Files: SAMS Range Soundings Range PWIDS Files: Range Profilers Range Obs Web server Web accessible Output Products UGUI gifs NAPS MEDOC FDDA sites Data host MDV server/files JVIZ Gridded Climatology Files MAC RTFDDA cycles Output Products NCEPFSL-MADIS RAL WMO NOAAPort WMO

RTFDDA Cycles Current ATEC RTFDDA configurations run cycles every 3 hours, at 02Z, 05Z, 08Z, etc. This timing is based on data availability. 1, 2 or 6 hour cycle intervals are sometimes used –For rapid real-time updates (1 or 2 hour cycles) –For longer forecast output options (6 hour cycles) Precise cycle timing depends on –cluster compute-power –forecast length goals –data availability Output products generally use “the latest available” for the requested valid time –This assumes that the latest available is the most accurate

Anatomy of a Cycle Pre- process Obs FDDA Final Analysis MM5 running Process Add’l Obs Prelim + Forecast … MM5 running… 05:0007:0006:0008:00 Cycle Starts Longer or shorter for different cycle intervals

Cycle Output Valid Time Cycle Final Analysis Preliminary Analysis Forecast 05Z08Z11Z14Z17Z20Z