Presentation is loading. Please wait.

Presentation is loading. Please wait.

3SAQS Technical Workshop February 25 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse.

Similar presentations


Presentation on theme: "3SAQS Technical Workshop February 25 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse."— Presentation transcript:

1 3SAQS Technical Workshop February 25 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse

2 Data Warehouse System Overview

3 Ongoing Goals and Activities Model Input Data: Acquire and organize model input data for new and updated platforms Make model input data readily accessible Track and characterize download and request activity for input data Model Results: Enable uploading of model results Make model results readily accessible for download and interactive analysis Track and characterize download and request activity for model results

4 Ongoing Goals and Activities General System Operation and Maintenance: Backup, archive, and ensure the availability of cooperator data and resources Maintain and refine the data warehouse website Document the system and its tools Service approved cooperator requests for features and data Facilitate synergy and collaboration with other relevant projects Maintain the hardware and software infrastructure of the data warehouse

5 Data Warehouse Hardware - Current Modeling Data 36-bay Linux server with twenty four 64-bit, six-core CPUs and 24GB RAM 3 RAID 6 partitions: o Partition #1: Twelve 2TB disks (~17TB) o Partition #2: Twelve 6TB disks (~55TB) o Partition #3: Currently empty (12 6TB disks would give ~55TB) o Potential total: 165TB (if 2TB disks are replaced with 6TB disks) Monitoring Data Windows server with two 64-bit, sixteen-core CPUs and 128GB RAM 1TB solid state drive (OS), 3 6TB drives (data) “Shared” with the FED project, which funded the purchase

6 Data Warehouse Hardware – Estimates for the Future Estimate the size of “representative” platforms to be maintained Estimate the number of representative platforms to maintain online Estimate the growth rate of new datasets Estimate volumes and rates for data delivery needs Estimate the archival rate for historical platforms Estimate the storage required for backup, redundancy, and recovery Estimate the aging and replacement rate for hardware components

7 Data Warehouse System Overview – “Phase I”

8 Data Warehouse System Overview – “Phase II”

9 Monitoring Data Tools – Example

10 Emissions Review Tool – Example Chart Oil & Gas Emissions by State for CO, UT, WY, and surrounding states

11 Emissions Review Tool – Example Chart Oil & Gas Emissions by County for Colorado

12 Emissions Review Tool – Example Report Oil & Gas Emissions by SCC for Weld County, Colorado

13 Model-To-Obs Comparison Tool

14 Source Apportionment Tool

15 Gridded Data Visualization Tool

16 Future Goals and Activities Enable the uploading and cataloging of model results Refine and expand the capabilities of visualization and analysis tools Leverage GIS capabilities for data visualization Expand the selection of gridded-data visualization tools Enable “data drill-down” on relevant tools Link relevant tools to enable fluid data exploration Solicit and incorporate feedback from collaborators and users Give Us Feedback: http://views.cira.colostate.edu/tsdw/User/Feedback.aspx


Download ppt "3SAQS Technical Workshop February 25 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse."

Similar presentations


Ads by Google