CLPx Data Management Mark Parsons 9th Cold Land Processes Workshop 28 May 2003

Cold Land Processes Workshop 28 May 2003 Field data collection process 1.Interview surveyor and note any idiosyncrasies 2.Photocopy field notebook 3.Enter data into spreadsheets according to detailed style sheet 4.Download photos and save according to surveyor 5.Note questions for surveyor and follow up at briefing 6.Print and review data entry accuracy 7.Check counts, means, and standard deviations (depths) 8.Convert to ASCII and run auto QC and formatting (pits) 9.Make backups and deliver beta version of data 10.Produce GIS images and review

Cold Land Processes Workshop 28 May 2003 Unique aspects of field data collection Data entry techs (data monkeys) learned data protocol first hand;  Aware of changes in protocol (briefings); some say in protocol changes  Collected data as well as entered Data entry while collection fresh in surveyor's mind catches errors and clearly identifies idiosyncrasies (Saved as much as 10-20% of data collection that would otherwise have to have been thrown out due to unanswerable questions.) “Touching the data”—Data monkeys had some understanding of data applications, processing, and science and caught things a computer wouldn’t “Belt and suspenders” back ups

Cold Land Processes Workshop 28 May 2003 Additional QC and formatting Rename photos and edit according to surveyor comments (Four photo types: roughness, general terrain, pit wall detail, other) Create/Revise automated QC and formatting scripts Produce final QCed ASCII tables of the data (over 30 warnings, and QC flags) Derived values include snow water equivalent and various means, maximums, and minimums. Thorough documentation and references

Cold Land Processes Workshop 28 May 2003 Satellite data from NSIDC MODIS, SSM/I, AMSR Common grids and formats:  UTM and Geographic grids of the LRSA  GeoTIFF and flat binary files with ASCII headers  Individual files per channel

Cold Land Processes Workshop 28 May 2003 Other data We’ve collected basic metadata for all data sets. Thanks to our data wrangler, Nick. Please contact me or Nick Rutter to make data delivery arrangements: ext. 230 Please deliver final data Data will be embargoed to CLP investigators for one year from receipt All data will be open to the public 1 October 2004

Cold Land Processes Workshop 28 May 2003 Current Data Access Data currently embargoed to CLP investigators. 1st public data release 1 Oct. 03 You must register with NSIDC and be approved by the Chair of the CLP working group Register at Access data at ftp://sidads.colorado.edu/clp five subdirectoriesftp://sidads.colorado.edu/clp  aircraft  ground_data  ground_remote_sensing  incoming  satellite Summary table of data available at

Cold Land Processes Workshop 28 May 2003

Data sets currently available Data SetPeriod Available Snow depth transectsIOP1 and 2 ISA Snow PitsAll IOPs (IOP1 preliminary) LSOS Snow PitsIOP1 and 2 PhotosIOP1 and 2 Sub-canopy Energetics at LSOSIOP1 and 2 FMCW quicklooksIOP1 and 2 GBMR-74 days Dec. 02, IOP3, part of IOP4. PSRIOP1 MODISSeveral days in spring 02 Ungeoreferenced Hyperion reflectances 15 Feb and 19 Mar GPS at LangleyIOP1

Cold Land Processes Workshop 28 May 2003 Future data access All products listed in NSIDC data catalog with simple search and subject and title indexes Summary table of all CLP products, temporal and spatial coverage, and parameters Sophisticated search by space, time, parameter, and source? Integrated (e.g., GIS) data set of key parameters

Cold Land Processes Workshop 28 May 2003 Integrated data set parameters Key gridded remote sensing radiances and reflectances (Pathfinder channels?) Remote sensing derived products:  Snow water equivalent  Snow-covered area  Snow depth  Grain size  Soil moisture  Freeze/thaw Key in-situ measurements  SWE  Snow depth  Snow wetness  Grain size  Surface roughness  Soil, snow, air temperature  Soil moisture  Other Met data? Separate consideration of LSOS?