Judd Patterson Brian Witcher

Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds  Excel graphing (VB) 4) Problems  size of dataset  graphing improvements

Where We Work 40 reef temperature 1 weather station 4 reef temperature 2 weather stations 4 reef temperature 10 reef temperature

Water Temperature  HOBO water temperature loggers on coral reefs  located at 47 reef sites in BISC, BUIS, DRTO, and VIIS  several sites have paired sensors  data point every 2 hours  Yawzi Reef 1988-present one of the longest water temperature datasets in the Caribbean

Why we do this… Historically HOT seawater temps Source: adapted from Miller et al. 2009

Why we do this… 2005 resulted in massive coral bleaching and disease… …and ultimately 60% decline in coral cover in the U.S. Virgin Islands

Weather Stations land-based weather data collection in the USVI and Florida full weather station storing 9 sensor values logging every 10 minutes independent rain gauge storing 2 sensor values logging every 10 minutes

Weather Stations 1. Download data with a HOBO shuttle

Weather Stations 2. Open hobo/dtf and convert to csv

Data Validation Workflow Final Cleanup All remaining observations are set to ‘validated’ Manual Checks Spikes and flat lines on graphs are flagged as ‘erroneous’ Automated Checks Out of range and no-values are flagged as ‘erroneous’ Data Import Everything starts as a.k.a. “not validated” 3. Access database – Import

Weather Stations 3. Access database – Import

Weather Stations 4. Access database – Manual Validation Spike Check suspicious readings with local airport weather Flatline

Export/Graphing Pick a station, pick a date range, select the export location... VB creates appropriate query VB creates Excel document from template and loads with query data

Workarounds

Data ForEVER

Remaining Issues 1) Size of dataset  With each new import a performance hit is noticeable  …inevitable switch to SQL Server on the horizon 2) Graphing  Excel is also at its limit when dealing with large datasets; particularly graphing

Thanks! Questions?