A Focus on International Activities NOAA’s Climate Database Modernization Program (CDMP)

Slides:



Advertisements
Similar presentations
DATA RESCUE IN AFRICA: SYNERGY WITH NATIONAL AND REGIONAL PROJECTS Climate&Environment Department ACMAD International Workshop on the Rescue and Digitization.
Advertisements

José Meitín NOAA Office of Global Programs Steve Williams UCAR Joint Office for Science Support José Meitín NOAA Office of.
B E T HE W EATHER G UY A guide to accessing and using public domain weather information via the world wide web by Dick Westergard Certified Consulting.
1 NOAA’S NATIONAL CLIMATIC DATA CENTER – ASHEVILLE, NORTH CAROLINA NCDC Report to US Port Meteorological Officers August 2014 Eric Freeman 1,2, Scott.
Technical Information Center
NOAA’s CENTER for OPERATIONAL OCEANOGRAPHIC PRODUCTS and SERVICES Improvements to the CO-OPS Storm QuickLook Product for Real-Time Storm Surge Monitoring.
National Climatic Data Center Status of Continental Indicators for NADM Richard R. Heim Jr. NOAA/NESDIS/National Climatic Data Center Asheville, North.
Part 5. Human Activities Chapter 13 Weather Forecasting and Analysis.
U.S. Department of the Interior U.S. Geological Survey National Geospatial Technical Operations Center Towards a More Consistent Framework for Disseminated.
Report from the GCOS Archive/Analysis Center Matthew Menne NOAA/National Centers for Environmental Information Center for Weather and Climate (NCEI-Asheville)
On the road toward an Archaeological Knowledge Management System David Gabai – CIO Israel Antiquities Authority.
SRI LANKA High mountains occupy the south- central part of the country with altitude up to 2,524m 1.
NOAA’s National Climatic Data Center 1 NOAA’s National Climatic Data Center – Resources Regarding Climate and Weather Extremes J. Neal Lott, Richard R.
Comprehensive Large Array-data Stewardship System (CLASS) Web Site Tutorial Visit CLASS Site at
NWS Calibration Workshop, LMRFC March, Historical Data Access Basic Calibration Workshop March 10-13, 2009 LMRFC.
1 ST MEETING OF THE STEERING COMMITTEE OF THE INDIAN OCEAN DATA RESCUE INITIATIVE – INDARE-SC GENEVA, SWITZERLAND 29 SEPTEMBER- 01 OCTOBER, 2014 Tanzania.
Dr Mark Cresswell Model Assimilation 69EG6517 – Impacts & Models of Climate Change.
Non-profit organizations can assist environmental data rescue and digitzation Dr. Richard Crouthamel, D.Sc. Executive Director – IEDRO International Environmental.
MADIS to LITTLE_R Converter MADIS observation types MADIS to LITTE_R converter Future work.
MEDARE Workshop, Tarragona, Spain Rescue and Digitization of Climate Records of Cyprus 28 – 30 November 2007 Stelios Pashiardis Meteorological Service.
11 NOAA’s Climate Database Modernization Program- Data Rescue Activities Program Manager- Tom Ross.
SERVIR-AFRICA: an overview André Kooiman International workshop on higher resolution Land cover mapping for the African continent UNEP, 27 June 2013.
MADIS – The Meteorological Assimilation Data Ingest System Current Operational Status and Future Plans Greg Pratt, Leon Benjamin, Thomas Kent, Gopa Padmanabhan,
Workshop on Evaluation of Reanalysis Baltimore, MD, November 1-3, Atmospheric Data Recovery and Biases in Observations Russell S. Vose Product Development.
Snow Measurements NOAA/NWS Current Standard Observing Practices ASOS, Snow Paid and Snow Spotters NOAA/NWS Current Standard Observing Practices ASOS, Snow.
Descriptive Analysis Database Archive monitoring network locations, climate, emissions, wildfires, census, political, physical, and image databases Databases.
California Data Exchange Center Hydrologic Database System
ORNL DAAC Spatial Data Access Tool (SDAT): Internet tools to access and visualize land-based data National Aeronautics and Space Administration
JCOMM in situ Observing Platform Support Centre JCOMMOPS
1 Winter 2009 ESIP Federation Meeting NOAA Data Users Workshop Data Stewardship at the NOAA Data Centers Data Stewardship at the NOAA Data Centers.
Carolinas Coast: A One-Stop Shop for Marine Observations in the Carolinas Funded by the National Oceanic And Atmospheric Administration Southeast Atlantic.
Automated Weather Observations from Ships and Buoys: A Future Resource for Climatologists Shawn R. Smith Center for Ocean-Atmospheric Prediction Studies.
` DIVISION OF NEARSHORE RESEARCH TEXAS A&M UNIVERSITY-CORPUS CHRISTI Key Features:  Located on oil production platforms 3 and 15 nautical miles from Port.
The IEM-KCCI-NWS Partnership: Working Together to Save Lives and Increase Weather Data Distribution.
WMO Cliquez pour ajouter un texte GLOBAL CRYOSPHERE WATCH CryoNet Asia Workshop in Beijing, China - Report - CryoNet Team Meeting, Reykjavik, Iceland
Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)
National Weather Service Goes Digital With Internet Mapping Ken Waters National Weather Service, Honolulu HI Jack Settelmaier National Weather Service,
NIST Data Science SymposiumMarch 4, 2014 NIST Data Science SymposiumMarch 4, Climate Archives in NOAA: Challenges and Opportunities March 4, 2014.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
2013 NOAA MADIS Plans MADIS – The Meteorological Assimilation Data Ingest System Greg Pratt, Leon Benjamin, Thomas Kent, Gopa Padmanabhan, and Leigh Cheatwood.
Rescue and Digitization of Climate Records in Egypt By Amr Mohamed. Amr.
ACRE Workshop Zurich, Switzerland, June 23-25, GCOS/WCRP Working Group on Observational Data Sets For Reanalysis Russell Vose Chief, Climate Analysis.
Future of Global Earth Observations: Innovation Yielding Societal Benefits Vice Admiral Conrad C. Lautenbacher, Jr., U.S. Navy (Ret.) Under Secretary of.
NORTH AMERICAN MONSOON EXPERIMENT (NAME) An internationally coordinated, joint US-Mexico process study aimed at improving warm season precipitation prediction.
NOAA Report WGISS 19 Climate and Meteorology Status Glenn K. Rutledge NOAA Cordoba, Argentina March 7,2005.
WGISS and GEO Activities Kathy Fontaine NASA March 13, 2007 eGY Boulder, CO.
MADIS Airlines for America Briefing Meteorological Assimilated Data Ingest System (MADIS) FPAW Briefing Steve Pritchett NWS Aircraft Based Observations.
J. Eric Madsen International Relations Specialist National Oceanic and Atmospheric Administration (NOAA) July, 2006 Global Earth Observation System of.
Northeast Regional Climate Center Keith Eggleston Regional Climatologist.
NOAA’s National Climatic Data Center Climate Service Partnership Activities At NOAA’s National Climatic Data Center Tim Owen Climate Prediction Applications.
Outcomes of CLIMAR-IV DAVID I. BERRY ETMC-V, 22 – 25 JUNE 2015.
Space Observations Ocean Observations Land Surface Observations Atmospheric Observations Environmental Data at NOAA.
Robert Grumbine National Weather Service RA-IV WIGOS Implementation Workshop (English), December, Willemstad Curaçao United.
Asia Flood Network— A USAID Program for Flood Mitigation and Preparedness in Asia Asia Flood Network Program Objective –Identify and fill gaps in end-to-end.
National Geophysical Data Center (NGDC) U.S. Department of Commerce National Oceanic & Atmospheric Administration National Geophysical Data Center (NGDC)
Climate Database Modernization Program (CDMP) Marine Tasks Joe Elms Program Manager.
The National Weather Service Goes Geospatial – Serving Weather Data on the Web Ken Waters Regional Scientist National Weather Service Pacific Region HQ.
The Bear River Watershed Information System Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University David.
CODATA Mission: Preserving Scientific Data for the Future Tide Gauge Data Rescue Mr. Patrick Caldwell Data-at-Risk Task Group (DARTG) (NOAA/Univ. of Hawaii)
88 th Annual American Meteorological Society Meeting New Orleans, LA January 20-25, The Integrated Surface Database: Partnerships and Progress Neal.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 STAR Enterprise Synthesis.
Unit 4 Lesson 5 Weather Maps and Weather Prediction
Data Browsing/Mining/Metadata
AmeriGEOSS Regional Initiative A framework that seeks to promote collaboration and coordination among the GEO Members of the American Continent Angelica.
Be The Weather Guy Presented to UCALL on October 14, 2009
GOES Data Collection System
Michael P. Finn, Barbara S. Poore, and Mark R. Feller
- Digitization of historical data at DWD -
Research Data Archives at NCAR
International Environmental Data Rescue Organization
Presentation transcript:

A Focus on International Activities NOAA’s Climate Database Modernization Program (CDMP)

NOAA’s Climate Database Modernization Program MANDATE: The Modernization of NOAA’s Climate Data. GOAL: To make major climate databases available via the internet thus increasing the access and utilization of this national resource Managed by  National Environmental Satellite, Data, and Information Service National Climatic Data Center, Asheville, NC  Tom Ross, Program Manager Seventh year of program

Forecast Warning Analysis NWS Coop Observers Global Synoptic Reports NCEP Charts Ship, Buoy Reports Rocketsonde Radiosonde Storm Data Doppler Radar (GOES, POES, NPOESS, many other) Satellites Aircraft Profiler ASOS USCRN Data Received From Many Sources

35mm & 16mm Film 125,129 Rolls Microfiche 860K fiche containing 51 million pages Manuscript / Autograph* 100 Million Pages stored in 125K boxes * Located at Asheville; additional paper records located at the Federal Records Center in Georgia that will be inventoried and prioritized for digitization Percent digitized (Keyed or imaged) 50% (50 million) 1.7% (2,105 reels) 1.0% (8,600 fiche) Non-Digital Data Archive

NOAA & the Uruguayan Meteorological Service enter cooperative project on data rescue. The U.S. National Oceanic and Atmospheric Administration (NOAA) donated digital equipment used for the project. Images received from the Uruguayan Meteorological Service and the Uruguayan Navy Include: 42,000 + images This includes 6 synoptic stations with observations early as the 1908 and as recent as early NCDC developed multiple keying format and keying began in 2006 and ended in mid 2007 Total imaging/keying for this multi-year project involves data from over 30+ stations totaling nearly 1,000,000 records

Camera and Imaging Setup In Uruguay High tech (35 mm) cameras and camera stands are set up in a well lit environment Technicians are trained to image the records using the camera equipment Technicians check for quality, exposure and completeness during the imaging process of each station Digital jpeg images are stored in the camera’s hard drive then transferred to the computer Images on the computer are then written to CD-ROM or DVD and sent to NCDC for storage and keying These same procedures are generally followed at the other international locations. A technical leader responsible at each international location is critical

Uruguay and Chile –Civilian and Military Projects Data keyed for six stations with variable periods of records- Earliest data was 1908 with 148 station years keyed. In Chile, data taken at a monastery (Punta Arenas) for the period 12/ was keyed

Colonia, Uruguay ( ) Orange boxes Synoptic/Hour ly Data for that day in NOAA database Green Boxes Synoptic/Ho urly Data overlap between keyed and existing data Missing period Blue Boxes Synoptic/ Hourly Data For that period keyed under the CDMP (7/ /1943) Missing period

Mexican Surface Project 401,280 synoptic and daily records imaged by camera by Meteorological Staff in Mexico Period of record covers Data is keyed from the imaged records and added to NOAA’s database. Data useful in water supply and drought monitoring activities in the America’s

North American Drought Monitor The North America Drought Monitor (NA- DM) is a cooperative effort between drought experts in Canada, Mexico and the United States to monitor drought across the continent on an ongoing basis Costs and effects of drought often extend beyond international borders. Concerns over international water rights and agricultural productivity affect all three countries CDMP is keying historical Mexican climate data that currently exists as paper records to help extend and fill in gaps of the climate record back into the 1800’s. This will also be useful in historical drought analysis and future predictions.

European Data Rescue Activities European Ship logs and documentation were imaged by camera at the British Museum. Roughly 250,000 observations from the were imaged and loaded to the NCDC WSSRD system (53 GB). These images are accessible to researchers without charge with a user name and password. These data have been keyed- 31 million records digitized and are in process to be added to the ICOADS database. EIC Logbooks are next

African Upper Air Project Total of 194,333 images of pibal records received to date from Kenya, Malawi and Senegal Pibal data contain upper air wind observations for various stations from these countries from the 1960’s to These data are being keyed and after passing quality control checks will be entered in NOAA’s global upper air database Digital files of these data will be provided to the partner countries that imaged the data Project will expand to Mozambique and Zambia later in 2006/2007 Kenya Senegal Malawi

African Data- linking images, keyed data and tables together on CD-ROM. CDMP01XX,XX0001,0354.jpg,99 991,07,11,1970,1,04,1,1,1, 130, 05,3272,212,3379,224,3397,249, 3427,261,3374,255,3277,242,329 3,235,3271,232,3254,231,3248,2 31,3239,240,,,,,,,,

Data Links -Table Station:99991 Day/Mo/Year Time:07/11/ Z Keyed Image ID: CDMP01XX\XX0001\0354.jpg Source Image ID:.\XX0001\1\P jpg COMPUTED OBSERVED TIME HGHT Azimuth Elev DIR SPD DIR SPD MINS FEET DEG DEG DEG KTS DEG KTS > Note: > Marks the Beginning of each Record in the Launch

Access Interface SITE_1 Station NumberDateTimeTableDir/SpdRaw DataImage /07/ TableDir/SpdRaw DataImage /21/ TableDir/SpdRaw DataImage /22/ TableDir/SpdRaw DataImage /24/ TableDir/SpdRaw DataImage /27/ TableDir/SpdRaw DataImage /29/ TableDir/SpdRaw DataImage /30/ TableDir/SpdRaw DataImage /31/ TableDir/SpdRaw DataImage /01/ TableDir/SpdRaw DataImage /01/ TableDir/SpdRaw DataImage /02/ TableDir/SpdRawTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw

Additional International Projects Imaging and keying international lightship logbook data from Finland and Sweden covering the period from the 1860’s to the 1930’s will be added to NOAA’s global marine database Processing historical and current incoming Canadian marine data via NCDC’s incoming records system. These marine data from the period are added NOAA’s marine database

GIS Data Portal NCDC's GIS Portal allows users to view, access, and utilize in situ station data through NCDC's Geographic Information System (GIS) portal. Interactive maps, associated metadata, and advanced Open Geospatial Consortium (OGC) services, such as Web Map Services (WMS) and Web Feature Services (WFS) are available.

Gis Portal Page GIS service Files allow visual links to stations, inventories and access to the data

Portal Inventory

Additional International Projects Foreign Climate Data Imaging by NOAA’s Central Library- Project goal of the project is to preserve and disseminate unique climatological data from historical sources. Period of record covers 1830s through the 1970s with most data from the period prior to Each series typically includes observations for a number of meteorological and other geophysical parameters. Involves documents from over 14 countries in Africa, 8 in Asia, 6 in Europe, 10 in North America, 1 Pacific Island and 8 in South America. NCDC Foreign Data Library Inventory Project Hard copies sources of early African Data climate/research/ghcn/africa. html#INTRO