NCICB Systems Architecture Bill Britton Terrapin Systems LPG/NCICB Dedicated Support
NCICB Architecture Components Facilities Architecture Overview Storage Processing Application Servers Systems Management
Facilities Two locations Primary and Mirror Sites Primary Location at Helgerman Court in Gaithersburg Mirror site at 6116 Executive Blvd in Rockville
Facilities Management Power –APC Silicon for conditioning and Battery backup –Monitoring and management through web interface Air Conditioning –Self contained computer room A/C with redundant house system at HC –Dedicated computer room A/C in 6116 on house water
Production Environment Overview
Dev/Test Environment Overview
Current Storage Hardware: –Sun Enterprise 420R server –4 400 Mhz processors –4 Gb RAM –2 Compaq HBA fibre channel host bus adapters –2 Compaq 8-port fibre channel switches –Compaq EMA12000 storage array –Compaq EMA16000 storage array Software: Compaq Secure Path Veritas Volume Manager Rsync Approx. 6 Tb Raw storage As of February 19, 2003, fs104's usage is as follows: Total usable storage capacity: 2879 GB Total allocated to filesystems: 2404 GB (84% of total usable capacity) Total space in use: 1764 GB (61% of total usable capacity) Free space: 404 GB (14% of total usable capacity)
Current Storage (cont’d.) Shortcomings of current storage Failover to mirror server is time consuming Single point of failure 420R platform cannot scale Ports on fibre channel switch are utilized Volume of storage has outgrown existing replication and backup solutions
Storage Upgrade Solution Upgrade Goals Increase server Fault Tolerance Increase server performance Provide scalability for server and SAN Server Solution Sun Fire V-480 Platforms MHz processors 4 GB RAM scalable to MHz processors and 32 GB Ram SAN Upgrade Upgrade fibre channel switch to 32 port Cluster Solution Veritas Cluster Server Replication Solution Veritas Volume Replicator Backup Solution Veritas Flash Snap Veritas Flash Backup
Future Storage Hardware: Primary Cluster 2 Sun Fire V-480 Server 2 Compaq HBA fibre channel host bus adapters in each server 2 Compaq 32 port fibre channel switches Compaq EMA12000 storage array Compaq EMA16000 storage array Mirror Cluster 2 Sun Fire 420R Server 2 Compaq HBA fibre channel host bus adapters in each server 2 Compaq 32 port fibre channel switches Compaq EMA12000 storage array Compaq EMA16000 storage array Software: Compaq Secure Path Veritas Volume Manager Veritas Volume Replicator Veritas Flash Snap and Flash Backup
Future Storage Diagram
Dedicated Processing Platform Sun Fire 6800 Platform Mhz Processors, scalable to 24 Processors with current boards 12 Gb Ram, Scalable to 192 Gb 2 GigE interfaces 2 AC power grids Front Open View (Click on underlined text to view components) Zoom In Zoom In
NCICB Application Servers Web application server Sun Enterprise MHz processors 2 GB RAM RMI Server Sun Enterprise MHz processors 2 GB RAM Oracle 9i Application Server Sun 280R MHz processors 2 GB RAM GEDP application server Sun Fire MHz processors 2 GB RAM Media Server Sun Enterprise MHz processors 2 GB RAM FTP Servers Sun netra T MHz processors 1 GB RAM EVS Comapq DL 380
NCICB Application Servers (cont’d.) Shortcomings of current app servers Single production apache, zope tomcat server Single point of failure E250 platform cannot scale
App Servers Upgrade Solution Upgrade Goals Increase server Fault Tolerance Increase server performance Provide scalability Server Solution Sun Fire V-480 Platforms MHz processors 4 GB RAM scalable to MHz processors and 32 GB Ram Load Balancer Appliances F5 Networks Big IP 5000 Redundant configuration Application Oriented Architecture Redundant ncicb apache, zope, tomcat servers GEDP Cancer Models Database Processing platform Media server Oracle 9iAS Server
Systems Management Management Portal SiteScope monitors SAR/gnuplot system management portals wusage web stats RMI monitoring LDAP Tools