Data and Metadata Archiving: Atlantic Coast Environmental INdicators Consortium (ACE INC) Lexia M. Valdes June 11, 2003 R828677
Outline Data management experience Current data and metadata archiving protocols ACE INC: Questions Concerns Needs Suggestions
Data Management Experience Phytoplankton and estuarine ecology Experience working with large water quality datasets Short-term monitoring data Long-term monitoring data from Delaware Department of Natural Resources and Environmental Control (DNREC) Large datasets from time-series experiments Long-term monitoring data from the Neuse River and Pamlico Sound Microsoft Excel Organization, data storage, analysis (graphics)
ACE INC Research Sites Plum Island Ecosystems (PIE-LTER), MA Chesapeake Bay, MD-VA Neuse River-Pamlico Sound, NC North Inlet, SC
ACE INC Data Types Water Quality Parameters (biological, chemical, & physical) nutrients, salinity, temperature, chlorophyll a discrete depths, vertical profiles, spatial profiles Phytoplankton and higher plant pigments River flow rates Residence times Zooplankton (species, abundance, distribution) Fish (biomass, recruitment) Biomass size spectra (phytoplankton, zooplankton, fish) Climate Remote sensing Geomorphology
ACE INC Research Sites Plum Island Ecosystems (PIE-LTER), MA Chesapeake Bay, MD-VA Neuse River-Pamlico Sound, NC North Inlet, SC
Neuse River Neuse River Monitoring Program Neuse River Modeling & Monitoring Program (ModMon) Ferry Monitoring Program (FerryMon) Pamlico Sound Pamlico Sound Monitoring Program Ferry Monitoring Program (FerryMon) North River North River Monitoring Program
Depth of sample Temperature Salinity Conductivity Dissolved oxygen Nitrate Nitrite Ammonium DIN TDN DON DOC DIC POC PON C:N Secchi depth Primary productivity Kd Chlorophyll a Phytoplankon pigments Silicic acid pH Neuse River-Pamlico Sound: Data Types
Neuse River-Pamlico Sound: Data Management Structure Data Pamlico Sound North River Metadata Neuse River Excel File Pamlico Sound Excel File North River Excel File Neuse River
Neuse River-Pamlico Sound: Data File Format Neuse Data Updated
Metadata: Parameter Descriptions Neuse River-Pamlico Sound: Data File Format
Metadata: Station History Neuse River-Pamlico Sound: Data File Format
Metadata: Definitions of Qualifier Codes Neuse River-Pamlico Sound: Data File Format
Neuse River-Pamlico Sound
Neuse River- Pamlico Sound
ACE INC Research Sites Plum Island Ecosystems (PIE-LTER), MA Chesapeake Bay, MD-VA Neuse River-Pamlico Sound, NC North Inlet, SC
Word Document.txt or.html file Metadata Data Excel spreadsheet or.txt (tab-delimited) file Investigator Network Information System PIE LTER Site: XML Ecological Metadata Language (EML) DataMetadata
DATA FILE: YEAR: PI: OTHERS: BRIEF DESCRIPTION OF DATA FILE: KEYWORDS: SITE TYPE: RESEARCH LOCATION: EXPERIMENTAL DESIGN AND METHODS: NOTES AND COMMENTS: VARIABLE DESCRIPTION: CALCULATIONS: FOR MORE INFORMATION, CONTACT: OTHER DATA FILES TO REFERENCE: REFERENCE CITATIONS: DATA AVAILABILITY STATUS: ARCHIVE INFORMATION: PIE LTER: Metadata Template
Type 1: Published data and meta-data are available upon request without review. Type 2: Collective data of PIE-LTER (routine measurements) are available for specific scientific purposes within one year after generation. Type 3: Original measurements by individual researchers (experimental data) are available for scientific purposes two years after generation. Type 4: Unusual long-term data collected by individual researchers are available with permission of the researcher. PIE-LTER: Policy for Data Availability
DATA FILE: YEAR: PI: OTHERS: BRIEF DESCRIPTION OF DATA FILE: KEYWORDS: SITE TYPE: RESEARCH LOCATION: EXPERIMENTAL DESIGN AND METHODS: NOTES AND COMMENTS: VARIABLE DESCRIPTION: CALCULATIONS: FOR MORE INFORMATION, CONTACT: OTHER DATA FILES TO REFERENCE: REFERENCE CITATIONS: DATA AVAILABILITY STATUS: ARCHIVE INFORMATION: PIE LTER: Metadata Template
Plum Island Ecosystems LTER Database (PIE-LTER)
ACE INC: Data & Metadata Archiving Concerns Who will have access to data? What data? Raw, intermediate, or final values? Archiving of data collected only during funding? Historical data? Data collected by collaborators? Legal issues and copyrights?
ACE INC: Data Archiving System Requirements Secure: Password protected Easy to find and access data Across spatial, temporal, and trophic levels Good quality data Ability to support different data types Different levels of user access ACE INC & EaGLe scientists, external institutions, education/outreach, local organizations, K-12, policy makers Backed up frequently
Questions?