A Focus on International Activities NOAA’s Climate Database Modernization Program (CDMP)
NOAA’s Climate Database Modernization Program MANDATE: The Modernization of NOAA’s Climate Data. GOAL: To make major climate databases available via the internet thus increasing the access and utilization of this national resource Managed by National Environmental Satellite, Data, and Information Service National Climatic Data Center, Asheville, NC Tom Ross, Program Manager Seventh year of program
Forecast Warning Analysis NWS Coop Observers Global Synoptic Reports NCEP Charts Ship, Buoy Reports Rocketsonde Radiosonde Storm Data Doppler Radar (GOES, POES, NPOESS, many other) Satellites Aircraft Profiler ASOS USCRN Data Received From Many Sources
35mm & 16mm Film 125,129 Rolls Microfiche 860K fiche containing 51 million pages Manuscript / Autograph* 100 Million Pages stored in 125K boxes * Located at Asheville; additional paper records located at the Federal Records Center in Georgia that will be inventoried and prioritized for digitization Percent digitized (Keyed or imaged) 50% (50 million) 1.7% (2,105 reels) 1.0% (8,600 fiche) Non-Digital Data Archive
NOAA & the Uruguayan Meteorological Service enter cooperative project on data rescue. The U.S. National Oceanic and Atmospheric Administration (NOAA) donated digital equipment used for the project. Images received from the Uruguayan Meteorological Service and the Uruguayan Navy Include: 42,000 + images This includes 6 synoptic stations with observations early as the 1908 and as recent as early NCDC developed multiple keying format and keying began in 2006 and ended in mid 2007 Total imaging/keying for this multi-year project involves data from over 30+ stations totaling nearly 1,000,000 records
Camera and Imaging Setup In Uruguay High tech (35 mm) cameras and camera stands are set up in a well lit environment Technicians are trained to image the records using the camera equipment Technicians check for quality, exposure and completeness during the imaging process of each station Digital jpeg images are stored in the camera’s hard drive then transferred to the computer Images on the computer are then written to CD-ROM or DVD and sent to NCDC for storage and keying These same procedures are generally followed at the other international locations. A technical leader responsible at each international location is critical
Uruguay and Chile –Civilian and Military Projects Data keyed for six stations with variable periods of records- Earliest data was 1908 with 148 station years keyed. In Chile, data taken at a monastery (Punta Arenas) for the period 12/ was keyed
Colonia, Uruguay ( ) Orange boxes Synoptic/Hour ly Data for that day in NOAA database Green Boxes Synoptic/Ho urly Data overlap between keyed and existing data Missing period Blue Boxes Synoptic/ Hourly Data For that period keyed under the CDMP (7/ /1943) Missing period
Mexican Surface Project 401,280 synoptic and daily records imaged by camera by Meteorological Staff in Mexico Period of record covers Data is keyed from the imaged records and added to NOAA’s database. Data useful in water supply and drought monitoring activities in the America’s
North American Drought Monitor The North America Drought Monitor (NA- DM) is a cooperative effort between drought experts in Canada, Mexico and the United States to monitor drought across the continent on an ongoing basis Costs and effects of drought often extend beyond international borders. Concerns over international water rights and agricultural productivity affect all three countries CDMP is keying historical Mexican climate data that currently exists as paper records to help extend and fill in gaps of the climate record back into the 1800’s. This will also be useful in historical drought analysis and future predictions.
European Data Rescue Activities European Ship logs and documentation were imaged by camera at the British Museum. Roughly 250,000 observations from the were imaged and loaded to the NCDC WSSRD system (53 GB). These images are accessible to researchers without charge with a user name and password. These data have been keyed- 31 million records digitized and are in process to be added to the ICOADS database. EIC Logbooks are next
African Upper Air Project Total of 194,333 images of pibal records received to date from Kenya, Malawi and Senegal Pibal data contain upper air wind observations for various stations from these countries from the 1960’s to These data are being keyed and after passing quality control checks will be entered in NOAA’s global upper air database Digital files of these data will be provided to the partner countries that imaged the data Project will expand to Mozambique and Zambia later in 2006/2007 Kenya Senegal Malawi
African Data- linking images, keyed data and tables together on CD-ROM. CDMP01XX,XX0001,0354.jpg,99 991,07,11,1970,1,04,1,1,1, 130, 05,3272,212,3379,224,3397,249, 3427,261,3374,255,3277,242,329 3,235,3271,232,3254,231,3248,2 31,3239,240,,,,,,,,
Data Links -Table Station:99991 Day/Mo/Year Time:07/11/ Z Keyed Image ID: CDMP01XX\XX0001\0354.jpg Source Image ID:.\XX0001\1\P jpg COMPUTED OBSERVED TIME HGHT Azimuth Elev DIR SPD DIR SPD MINS FEET DEG DEG DEG KTS DEG KTS > Note: > Marks the Beginning of each Record in the Launch
Access Interface SITE_1 Station NumberDateTimeTableDir/SpdRaw DataImage /07/ TableDir/SpdRaw DataImage /21/ TableDir/SpdRaw DataImage /22/ TableDir/SpdRaw DataImage /24/ TableDir/SpdRaw DataImage /27/ TableDir/SpdRaw DataImage /29/ TableDir/SpdRaw DataImage /30/ TableDir/SpdRaw DataImage /31/ TableDir/SpdRaw DataImage /01/ TableDir/SpdRaw DataImage /01/ TableDir/SpdRaw DataImage /02/ TableDir/SpdRawTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw DataImageTableDir/SpdRaw
Additional International Projects Imaging and keying international lightship logbook data from Finland and Sweden covering the period from the 1860’s to the 1930’s will be added to NOAA’s global marine database Processing historical and current incoming Canadian marine data via NCDC’s incoming records system. These marine data from the period are added NOAA’s marine database
GIS Data Portal NCDC's GIS Portal allows users to view, access, and utilize in situ station data through NCDC's Geographic Information System (GIS) portal. Interactive maps, associated metadata, and advanced Open Geospatial Consortium (OGC) services, such as Web Map Services (WMS) and Web Feature Services (WFS) are available.
Gis Portal Page GIS service Files allow visual links to stations, inventories and access to the data
Portal Inventory
Additional International Projects Foreign Climate Data Imaging by NOAA’s Central Library- Project goal of the project is to preserve and disseminate unique climatological data from historical sources. Period of record covers 1830s through the 1970s with most data from the period prior to Each series typically includes observations for a number of meteorological and other geophysical parameters. Involves documents from over 14 countries in Africa, 8 in Asia, 6 in Europe, 10 in North America, 1 Pacific Island and 8 in South America. NCDC Foreign Data Library Inventory Project Hard copies sources of early African Data climate/research/ghcn/africa. html#INTRO