START08 DATA MANAGEMENT AND ARCHIVING UPDATE Janine Goldstein, Steve Williams NCAR Earth Observing Laboratory Boulder, Colorado START08/PreHIPPO Data Workshop Boulder, CO 4-5 Mar 2009

“One-stop access to everything START08!”

ACCESS TO RESEARCH DATASETS All measurements and data products should be submitted to the Archive in netCDF, GTE, or NASA Ames format Files should be named project_flight_product_version.filetype, i.e. start08_rf01_merge_v01.nc Data Submission instructions are available on the project management web page ( Investigators are responsible for acquiring, processing, certifying and reducing the data from their instruments and providing required data products on schedule EOL Archive keeps track of data versions, so updates are easy to track. START08/PreHIPPO Data Policy -> Data Policy

USE OF DATA Neither measurements nor data products may be published or used in any presentation without the permission of the PI responsible for the measurements. Any Science Team member preparing a paper for publication which uses measurements and/or data products submitted to the Archive by another group is required to offer co-authorship on the paper to the PI responsible for the parameter(s). Early contact with possible collaborators in development of publication is encouraged to maximize scientific interaction and ensure proper use of PI data. In all circumstances, the PIs responsible for acquisition of data should be acknowledged appropriately. START08/PreHIPPO Data Policy

USE OF DATA ●Suggested acknowledgement: The xxxx data was gathered as part of the Stratosphere-Troposphere Analyses of Regional Transport (START08) project. The primary sponsor of START08 was the US National Science Foundation. The acquisition of the xxxx data was carried out by Dr. Yyyyy using the zzzz instrument and was funded by ???? ●Acknowledge that data was obtained from the START08 Data Archive at NCAR/EOL, i.e. “Data provided by NCAR/EOL under sponsorship of the National Science Foundation. START08/PreHIPPO Data Policy

Suggested DATASET METADATA -> Dataset Documentation Guidelines TITLE: This should match the data set name AUTHOR(S): Name(s) of PI and all co-PIs Complete mailing address, telephone/facsimile Nos., address of PIs, and WWW address (if applicable) Similar contact information for data questions (if different than above) 1.0 DATA SET OVERVIEW: Introduction or abstract Time period covered by the data Physical location (including lat/lon/elev) of the measurement or platform Data source if applicable (e.g. for operational data include agency) Any World Wide Web address references (i.e. additional documentation such as Project WWW site) 2.0 INSTRUMENT DESCRIPTION: Brief text (i.e. 1-2 paragraphs) describing the instrument with references Figures (or links), if applicable Table of specifications (i.e. accuracy, precision, frequency, resolution, etc.) 3.0 DATA COLLECTION AND PROCESSING: Description of data collection Description of derived parameters and processing techniques used Description of quality control procedures Data intercomparisons, if applicable 4.0 DATA FORMAT: Data file structure and file naming conventions (e.g. column delimited ASCII, NetCDF, GIF, JPEG, etc.) Data format and layout (i.e. description of header/data records, sample records) List of parameters with units, sampling intervals, frequency, range Data version number and date Description of flags, codes used in the data, and definitions (i.e. good, questionable, missing, estimated, etc.) 5.0 DATA REMARKS: PI's assessment of the data (i.e. disclaimers, instrument problems, quality issues, etc.) Missing data periods Software compatibility (i.e. list of existing software to view/manipulate the data) 6.0 REFERENCES: List of documents cited in this data set description

submission deadlines and schedule ‘Quick Look' data due 24 – 48 hrs after each flight 1 Hz ‘Quick Look’ Merge hours after PI data Phase I: Preliminary data due 16 June 2008 Phase II: Preliminary data due 28 July 2008 Merges of ‘Quick Look' Archive available Updated as needed Final data due 31 December 2008 Final Archive data available 31 December 2008 Merged data files available 15 January 2009 Model products available when submitted Data Workshop (I) Winter, 2009 (TBD) International Workshop on Chemistry and Dynamics of the Extratropical UTLS Summer, 2009 (TBD) Final Archive released to public 1 July 2009 Data Workshop (II) If required Manuscript and conference presentations To be determined

EOL DATA MANAGEMENT TOOLS EOL Field Catalog In-field tool to ingest and display operational and preliminary research imagery and project documentation for making real-time decisions and evaluating project progress Features: Daily Mission Reports Operations Summary Facility Status Reports Data Analysis Products Authoring Tools Web-based access EOL Data System (EMDAC) Primary means for all project scientists and researchers to browse and retrieve data from any EOL-supported projects Features: Long-term field project data archival and distribution Interactive data browsing, subsetting, and format translation Web-based access Value-added datasets Data documentation

NO FINAL DATA HERE!!!

Field Catalog Issues The Field Catalog contains only imagery. Final data are in the archive “Master List”. Flight Info has been included in the Field Catalog under the Missions tab. Research products will be backfilled into the Field Catalog following transition of the archive to EOL.

START08 Flight Information Book ➜

-> Master List

Model: trajectory (lagrangian?) High resolution WRF NCEP GFS Global Analysis Radar: NEXRAD WSR-88D Data (level II, III) Satellite: GOES-11,12 4KM Imager Data Chemical Satellite Data AIRS, MLS, OMI-MLS, IASI, ACE Soundings: COSMIC imagery/data like done for HIPPO? NOAA/NWS 6-sec vertical resolution Rawinsonde Data Ozonesonde Data Supporting Datasets

PROJECT PUBLICATION LIST AND ARCHIVE

Thank you!