2013 NOAA MADIS Plans MADIS – The Meteorological Assimilation Data Ingest System Greg Pratt, Leon Benjamin, Thomas Kent, Gopa Padmanabhan, and Leigh Cheatwood NOAA/Oceanic and Atmospheric Research/Earth System Research Laboratory/Global Systems Division Tim Mcclung, Steven Pritchett, Curtis Marshall, Ben Kyger, Daniel Starosta, Rebecca Cosgrove, and Wen Meng NOAA/National Weather Service/Office of Science and Technology & National Centers for Environmental Prediction John Bates, Drew Saunders, and Philip Jones NOAA/National Environmental Satellite, Data and Information Service/National Climate Data Center MADIS Goal A more usable, complete, accurate, timely, and higher density observational infrastructure for use in local weather warnings and products, numerical weather prediction, and use by the greater meteorological community. MADIS Provides Access to real-time and archived data sets Uniform data formats, observation units, and time stamps Observational Quality Control (QC) Network-enabled distribution with server-site sub-setting Authentication for proprietary data User documentation and help desk support NOAA Mission NOAA’s mission increasingly demands advanced data management processes, including data integration, to achieve interoperable, accessible, and readily usable observational data. MADIS Data Scope 66,127 stations from over 160 surface networks producing nearly 13 million observations per day 154 Profiler sites (>200,000 observations per day) >450,000 aircraft observations per day Plus global radiosonde and satellite observations MADIS Data Sets Available Observations Surface Aircraft Radiosonde Profiler GOES Satellite POES Satellite Radiometer oXPR +oXPR MADIS observations covering North America The MADIS Team NWS/OST&NCEP Transition/Operations Tim Mcclung, Steven Pritchett, Curtis Marshall, Ben Kyger, Daniel Starosta, Rebecca Cosgrove, and Wen Meng MADIS Future Plans  Additional data sets – (FAA 1 minute ASOS, Clarus, …)  Advanced data query and web services  Improved data/metadata standards  Improved QC and station monitoring  Open source development environment  Extend QC algorithms to meet operational and research needs Reach Full Operating Capability (FOC) for real-time processing within the NWS Work with NESDIS to transition the MADIS archive capabilities into operations at NCDC Work with Federal Highway Administration Clarus team to fully transition Clarus capabilities into MADIS FAA NextGen/NWS AWIPS data discovery/dissemination capable Conduit for efficient transfer of research and development to operations Decoders Integration and Quality Control NCEP WOC Ingest Distribution Providers Users MADIS Final Operating Capability ESRL/GSD MADIS software is being ported to a distributed environment hosted at NOAA’s WOC, NCEP, and NCDC with GSD supporting a research-to-operations test bed hosted at GSD. NESDIS/NCDC Archive John Bates, Drew Saunders, and Philip Jones OAR/ESRL/GSD Transition/R&D/Conduit to Operations Greg Pratt, Leon Benjamin, Thomas Kent, Gopa Padmanabhan, and Leigh Cheatwood Providers Observations and Metadata National Mesonet (NM) Mobile Platform Environmental Data (MoPED) Clarus NCDC Archive Internet MADIS Users Include… International meteorological centers >200 universities Public NWS Forecast Offices and National Centers OAR, NESDIS, NOS NCAR, NASA, DOE, FAA, DOT Hundreds of private companies MADIS Google Displays Surface Temperatures Metadata SensorML

A 2011 Update to the NOAA MADIS System MADIS – The Meteorological Assimilation Data Ingest System Greg Pratt, Leon A. Benjamin, Randall S. Collander, Thomas B. Kent, and Gopa Padmanabhan NOAA/Oceanic and Atmospheric Research/Earth System Research Laboratory/Global Systems Division Patricia A. Miller and Michael F. Barth NOAA/Oceanic and Atmospheric Research/Earth System Research Laboratory/Global Systems Division (Retired) Steven Pritchett, Curtis Marshall, David Helms, Rebecca Cosgrove, Daniel Starosta, Michelle Mainelli, Mahnaz Dean, and Robert Bunge NOAA/National Weather Service MADIS Goal To integrate other-agency observations with NOAA obser- vations and make them easily accessible and useable to the meteorological community. MADIS Provides Access to real-time and saved data sets Uniform data formats, observation units, and time stamps Observational Quality Control (QC) Network-enabled distribution with server-site subsetting Authentication for proprietary data User documentation and help desk support NOAA Mission NOAA’s mission increasingly demands advanced data management processes, including data integration, to achieve interoperable, accessible, and readily usable observational data. MADIS Data Scope 69,917 stations from over 160 surface networks producing nearly 13 million observations per day 154 Profiler sites (>200,000 observations per day) >450,000 aircraft observations per day Plus global radiosonde and satellite observations MADIS Data Sets Available Observations Surface Aircraft Radiosonde Profiler GOES Satellite POES Satellite Radiometer oXPR +oXPR MADIS observations covering North America MADIS Overall Benefits A more usable, complete, accurate, timely, and higher density observational infrastructure for use in local weather warnings and products, model predictions, and hazardous situations. MADIS Central U.S. Observations Standard Surface Observations Additional MADIS Surface Observations All MADIS Observations MADIS Provides QC and Station Monitoring Support Estimated observation errors for a station in Galveston, Texas. The time series shows a bias detected by MADIS and corrected by the data provider. Data Provider NotifiedData Restored MADIS Users Include… International meteorological centers >200 universities NWS Forecast Offices and National Centers OAR, NESDIS, NOS NCAR, NASA, DOE, FAA Hundreds of private companies MADIS Future Plans  Additional data sets  Advanced data query and web services  Expanded metadata fields  Improved QC and station monitoring Reach Full Operating Capability (FOC) for real-time processing within the NWS Work with NESDIS to transition the MADIS archive capabilities into operations at NCDC Continue research and development enhancements Decoders Integration and Quality Control NCEP TOC Ingest Distribution Internet MADIS NWS Compute Environment MADIS Real-Time Processing is Now Operational Within the NWS ESRL/GSD MADIS software has been ported to an integrated NWS TOC and NCEP distributed environment with a supporting backup and research-to-operations test environment at GSD. MADIS – New Datasets Observations from a mobile platform reporting via the Mobile Platform Environmental Data (MoPED) System on December 24, The plot shows low temperature errors at high platform speed, but higher errors at lower speeds. New MADIS datasets are now in development at GSD: National Mesonet observations with extended metadata; Mobile Vehicle observations.