1. Judd Patterson Brian Witcher

2. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds  Excel graphing (VB) 4) Problems  size of dataset  graphing improvements

3. Where We Work 40 reef temperature 1 weather station 4 reef temperature 2 weather stations 4 reef temperature 10 reef temperature

4. Water Temperature  HOBO water temperature loggers on coral reefs  located at 47 reef sites in BISC, BUIS, DRTO, and VIIS  several sites have paired sensors  data point every 2 hours  Yawzi Reef 1988-present one of the longest water temperature datasets in the Caribbean

5. Why we do this… Historically HOT seawater temps Source: adapted from Miller et al. 2009

6. Why we do this… 2005 resulted in massive coral bleaching and disease… …and ultimately 60% decline in coral cover in the U.S. Virgin Islands

7. Weather Stations land-based weather data collection in the USVI and Florida full weather station storing 9 sensor values logging every 10 minutes independent rain gauge storing 2 sensor values logging every 10 minutes

8. Weather Stations 1. Download data with a HOBO shuttle

9. Weather Stations 2. Open hobo/dtf and convert to csv

10. Data Validation Workflow Final Cleanup All remaining observations are set to ‘validated’ Manual Checks Spikes and flat lines on graphs are flagged as ‘erroneous’ Automated Checks Out of range and no-values are flagged as ‘erroneous’ Data Import Everything starts as a.k.a. “not validated” 3. Access database – Import

11. Weather Stations 3. Access database – Import

12. Weather Stations 4. Access database – Manual Validation Spike Check suspicious readings with local airport weather http://www.wunderground.com/history/airport/TISX/2010/4/14/DailyHistory.html Flatline

13. Export/Graphing Pick a station, pick a date range, select the export location... VB creates appropriate query VB creates Excel document from template and loads with query data

14. Workarounds

17. Data ForEVER

18. Remaining Issues 1) Size of dataset  With each new import a performance hit is noticeable  …inevitable switch to SQL Server on the horizon 2) Graphing  Excel is also at its limit when dealing with large datasets; particularly graphing

19. Thanks! Questions?