1. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Ocean Observatories Initiative OOI CI Release 2 Life Cycle Objectives Review CyberPoPs & Network (Build2) OOI CI Operations Team R1 PRR and R2 LCO Review La Jolla, CA Aug-30 to Sep-1 2011 1

2. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Agenda CyberPoP Points R1 Development & Test Infrastructure Integrated Observatory Network CyberPoP Operational Deployment Use Case Overview Accomplishments 2

3. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 OOI Deployment Topology Observatory Requirements: Provide observatory assets to support measurements of scientific processes. Provide computational and network assets to enable real-time, secure access and processing for the observatory users Engineering Drivers: P roximity to observatory assets, geographic redundancy. High- bandwidth, low latency access to national and international network peering points. Access to commercial and academic compute clouds

4. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 CyberPoP ‘Points’ Types of Points –Acquisition Point: Collects data (e.g., from marine environments) –Distribution Point: Distributes data around the network, provides access to data –Management Point: Enables operator management of OOI system CyberPoP can be configured for any of these purposes, including several at once 4

5. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Observatory Acquisition Point Functions –Data acquisition from marine observatories –Real-time data processing and product generation –Data forwarding to Data Distribution Point –Data preservation Requirements –Protected data facility with built-in redundancy –Sufficient storage capacity, network resources, and computational resources –Connection to marine networks 5

6. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Observatory Distribution Point Hardware environment for the Capability Containers for data and content distribution Web services for supporting end users End users communicate through the Distribution Points, never directly to the Acquisition Points Provides layer 2 peering with external network providers Links to cloud execution and storage providers such as Amazon EC2 and TeraGrid 6

7. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Observatory Management Point Supports network and resource operations from a central location Interfaces to marine management systems Provides state of the health monitoring activities – shows availability of resources Monitors all network traffic, protocols and availability Generates automated alerts when system capacities are approaching warning levels or when it detects that resources are no longer available 7

8. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Buildout Sequence 8 Buildout 1 Buildout 2 Commercial Clouds Academic Clouds & HPC National Repositories Buildout 3 Buildout 4 Buildout 5

9. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Peering Environment with National Research & Academic Networks 9

10. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Peering Environment with International Research & Academic Networks 10

11. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 CyberPoP Functions & Locations FunctionLocationSpeedInitial Capacity Aggregate Cores Acquisition PointPortland10 Gbps34 TB144 Acquisition PointWoods Hole1.54 Mgbs15 TB48 Engineering Environment San Diego10 Gbps34 TB176 Distribution PointSeattle10 Gbps34 TB96 Distribution PointChicago10 Gbps34 TB80 Management Point San Diego10 Gbps18 TB80 11

12. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Server Environment 12 4 Dell R810 Servers –Used in Development and Test environments for R1 –Duplicate hardware that will be used in Staging and Production for R2

13. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Engineering Center Service Deployment Infrastructure 13 ION Development Environment ION Testing Environment ION Staging Environment ION Production Environment Virtualization Capacities Physical Computing Infrastructure OOI Program Application Environment Management Environment San Diego CyberPoP Virtualization Capacities Physical Computing Infrastructure First Article Build of Operation Grade CyberPoP Design First Article Build of Production Grade CyberPoP Design

14. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Software Development/Service Maturity Cycle 14 DevelopmentEnvironmentDevelopmentEnvironmentTestingEnvironmentTestingEnvironmentStagingEnvironmentStagingEnvironmentProductionEnvironmentProductionEnvironment San Diego Engineering CenterPortland CyberPoP Development TeamIntegration & Test TeamOperations Team

15. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 R1 Application and Middleware Support Virtual Machine Support –Hardened Centos LINUX: Base VM Image –Cassandra: Multi-site, Multi Process Data Store –RabbitMQ: Message Broker –Grails: Web Application Platform –THREDDS: Provides Access to Scientific Data –Nimbus: Elastic Computing Management Framework –ION Capability Containers: OOI Service Container Virtualization Infrastructure –Citrix (KVM) –VMWare and VCenter 15

16. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 R1 Software Configurations 16 EPU ION ServicesEPU ION Services Test and Development Environments Cassandra (multiple instances) RabbitMQ (multiple instances) Grails (multiple instances) THREDDS (multiple instances) Nimbus Service Nodes Nimbus 2.7Nimbus 2.8 KVM/VMM Test Environments ion-beta buildbot ion-test Images cc-worker (4 GB) cc-cfchecker (10 GB)

17. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Integrated Observatory Network 17

18. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 OOI Network Deployment

19. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 R2 Network Connectivity Requirements Provide high speed backbone (10 Gbps) wide area network to connect the CyberPoPs located at San Diego, Portland, Seattle, and Chicago Provide T-1 connectivity to Woods Hole off of a spur from Chicago 19

20. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Initial Components Required for Build2 Wide Area Network (National Network Infrastructure) Network Messaging Infrastructure –Based on Layer 2 National Network Infrastructure –Provides direct application-level message connectivity between Capability Containers in ION and at users’ sites Acquisition Points –Portland –Woods Hole Distribution Points –Seattle –Chicago 20

21. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Network Functional Capabilities 10-40 Gbps connectivity to storage and computing devices High availability/fault tolerance – Local and Wide Area strategies WAN 10 Gbps eBGP peering 10 Gbps message processing 1 Gbps network firewall and intrusion detection 1 Gbps load balancing Dynamic VLAN support 21

22. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 CyberPoP Operational Deployment 22

23. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 CyberPoP Constructions Build first instances of all CyberPoPs in San Diego –Engineering Center as first instance –Follow with SD Management CyberPoP Full functional capabilities co-located –Configure Portland CyberPoP for supporting PRR activities –Later differentiate and distribute capabilities geographically All CyberPoPs will be run as a lights-out operations 23

24. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Remote CyberPoP Equipment Locations Use secure co-location facilities to house racks and equipment –Pittock Building (Portland Oregon), contracted through the University of Washington –University of Washington (RSN facility) –Woods Hole Oceanographic Institution –StarLight Facility (Northwestern University) 24

25. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Server, Storage and Network Deployment 25

26. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 San Diego Management Point Assembly 26

27. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 San Diego CyberPoP Detailed Rack Design 27

28. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 San Diego CyberPoP Detailed Network Design 28

29. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Use Case Overview 29

30. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 R2 Operational Support 30  UC.R2.55 Manage Help TicketProcess problems and request for services  UC.R2.56 Monitor ION NetworkRespond to network issues affecting the system

31. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Accomplishments 31

32. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Accomplishments to Date Deploy and operate OOI Program Operations Build the Engineering Center Environment –Development and Test Environments –Representative of CyberPoP hardware/software configuration –Management Point – acquire network, servers and software Continual support for the ION Development team –Deploy, (re)configure needed systems and applications –Provide monitoring and analysis tools –Assist with network performance issues Gained experience in supporting the operational requirements for ION 32

33. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Operations & Maintenance Support Create High Availability Environments Help Desk Support (approx. 1000 tickets) –Immediate responses to tickets Problems/Issues, request for new services Creation of Metrics –Availability of resources (99.969%) Servers Storage Network components Software applications Databases Coordinated Hardware and Software Upgrades –Minimize outages 33

34. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 R1 Development Services Create OS configurations and CentOS imaging Installation of the hardware Network connectivity (DNS/DHCP/VPN access) Initial installation of monitoring tools Installation of service components with final configurations in conjunction with developers Development of deployable scripts/templates Load Balancer for Cassandra cluster, also NAT services Authentication support 34

35. OOI CI R2 Life Cycle Objectives Review Aug 30 - Sep 1 2011 Thanks! 35