MCNC Grid Computing and Networking Services (GCNS) North Carolina Statewide Grid Western Carolina University John Killebrew Director - NCREN

GCNS UNIVERSE UNC-OP e-NC RENCI ITS Universities General Assembly Industry RTI RDI MCNC GCNS SURA Internet2NLR Services and Relationships DukeNet ERCWC WinstonNet SERNet

NCREN Video Services MCNC GCNS Broadcast quality interactive video conferencing 20 sites continuous presence audio and video Full bridging interoperability among Broadcast Quality video sites H.320 private line sites H.320 dial (ISDN) sites H.323 Video-over-IP sites MPEG2 Video-over-IP sites Live monitoring of all scheduled Conferences Satellite Links Downlinks for any/all campuses Uplinks via Microspace from any/all campuses

MCNC Network Access and Services Direct Access to – NCREN – Internet2 (Abilene) – Research networks (NLR, NCNI) – National Labs – NC Grid, MCNC Enterprise Grid Grid and Data Center Offerings – Co-location hosting services – Managed hosting services – Managed WAN hosting – Use of Grid Compute & Data resources – NEW! Grid Technology Evaluation Cntr benchmarking, interoperability, integration, and training

“Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations” Ian Foster & Carl Kesselman, 2002 What is a Grid ? I don’t know, but… “Context, Not Products, Defines Grid Computing” Gartner, 2004

This is a Grid ! An IT Utility A Grid Middleware (the glue) And Networked Distributed Resources

The North Carolina Economy Challenge Employment by North American Industry Classification System (NAICS) Source: The Employment Security Commission of NC, Labor Market Information

Access: transparent, remote, secure, wireless Sharing: enable collaboration over the network Failover: migrate/restart applications automatically On Demand: get resources, when you need them Productivity: more work done in shorter time Virtualization: access compute services, not servers Heterogeneity: platforms, OSs, devices, software Resource Utilization: increase from 20% to 80+% Virtual Organizations: build & dismantle on the fly Grid Benefits Department, Enterprise, and Global Grids

Grid Computing: Competitive Advantage for N.C. Rapidly process and solve problems beyond an individual organization's capacity Leverage very powerful but inexpensive networked resources Connect and share computing resources seamlessly - regardless of system type or physical location Reduce IT costs Access disparate data across multiple domains Enhance Education, R&D and Business processes Create innovative products and services Reduce design time and time to market Increase quality (reduce defects) Accelerate product development (e.g. drugs) Education, Research, Government, Industry Technology

However, There is Still a Long Way to Go !  Grids are over-hyped: currently, they promise much more than they can really offer.  Grid technology is far from mature and complete.  Grid standards are (mostly) still missing.  Grids are very complex IT infrastructures.  Grids bring new challenges: sharing resources, loosing direct control, security, intellectual property, legal, social, political issues... Therefore, MCNC - GCNS !

Cisco EPA Our Foundation for Grid: NCREN 4-7 MCNC-owned Clusters distributed throughout the state Locations still under evaluation Internet Internet 2 NLR Internet Internet 2 NLR Interne t Existing: Blend of owned and leased fiber and circuits moving toward resilient rings powered by Cisco routers Planned: Strong focus on owned and leased fiber, Lambda, and few circuits, in resilient rings powered by Cisco routers and Wave Division Multiplexers

The Grid The next IT Infrastructure of North Carolina NC BioGrid Proving ground for Grid Successful prototype apps Catalyst for collaboration International recognition

NC BioGrid MCNC Enterprise Grid Cluster and SMP resources Research platform for GTEC Core component in NCGrid Revenue generation The Grid The next IT Infrastructure of North Carolina

NC BioGrid MCNC Enterprise Grid NC Grid Initiative State-wide partnership Leverage lessons learned Grid education & training resource Enable first mover applications The Grid The next IT Infrastructure of North Carolina

NC BioGrid MCNC Enterprise Grid NC Statewide Grid Initiative MCNC & The Grid Infrastructure for North Carolina NCREN North Carolina Research & Education Network MCNC Microelectronics Center of North Carolina - Founded in Independent, private, non-profit organization - Operates NCREN since Past: Supercomputer Center for universities - Now: Grid Service Provider, offering Video, Network, Grid, and Datacenter Services employees

MCNC-GCNS Roadmap Awareness Creation Easy Access Grid Service Provider

Our Vision : The Three Waves of Grid Computing The Research Wave The Industry Wave The Consumer Wave Technology, Prototypes Grid-Enabled Products Commodity Virtual Organizations Enterprise Solutions IT Utility Standards Interoperability Integration GGF, IETF, OASIS GGF, EGA, IETF, OASIS Legal, Ethical, Political Orgs GCNS: “Awareness Creation” GCNS: “Easy Access” GCNS: “Grid Service Provider”

GCNS Mission Advance education, innovation and economic development throughout North Carolina by delivering next generation information technology that enables the academic, research, government and business communities to discover, create, share and apply knowledge.

Higher Education Grid Constituencies Chancellors/Presidents: University Outreach CIO’s: Providing and running IT infrastructure CRO’s, Deans, Key faculty: Education and Research Students

Chancellors/Presidents Play key important role in NC further education and economic development Improve global competitive position of NC universities Offer the best infrastructure for research and education Become early part and active participant in the next-gen Advanced Internet

CIO’s Offer service-oriented IT architecture (hide complexity) Enable much more efficient resource management Balance resource utilization within and across Campuses

CRO’s, Deans, Key Faculty Offer and use larger and richer set of resources Develop, provide, and use more powerful tools for joint research collaborations Enable researchers to concentrate on research (and not on the resources)

Core Strategy Components Briefing key constituencies about Grid Computing Train key IT and research staff Develop joint Graduate/PhD program Build and use NC Grid as foundation (think globally, start locally) Grid-enable existing resources and join the NC Grid Offer training to users to grid-enable applications Work with users to port applications to the NC Grid Start QuadA project with partners

Grid Technology Evaluation Center The Epicenter for Accelerating Grid Adoption Influential Network of Key-Players Independent Lab: Eval & Testing Joint BizDev, PR & Marketing Grid Training & Education Customer Briefing Center From Innovation to Deployment Socio-Economical Mission

So, are there really any working Grids out there? Yes!…. In North Carolina even… + Wachovia + NC BioGrid + SCOOP + EPA

NC BioGrid One of the nation’s first grid test beds for computing, data storage and networking resources for life sciences research Installed in Summer 2002, heterogeneous hardware and OS platforms More than 80 organizations Dedicated systems for testing grid middleware and developing grid applications for bioinformatics Spans multiple administrative domains with systems located at MCNC, NC State, UNC-CH & Duke Established a Certificate Authority Established to research and implement new grid computing technologies that will enable researchers and educators throughout North Carolina to take full advantage of the genomic revolution.

SURA SCOOP South-eastern Coastal Ocean Observing Program The Challenge: - More than half of the nation's tidal shores home to 80 million people - coastal zone is undergoing environmental and ecological changes - threaten the sustainability of the region's economies and marine resources The Solution: - develop a Grid of sensors and linked computers - fully integrating several observing systems in the southern region - provide data, in real-time and at high speed, for more reliable, accurate and timely information To help guide effective coastal stewardship, plan for extreme events, facilitate safe maritime operations, and support coastal military security.

And, how about other states? Grid Development efforts announced in Colorado West Virginia Louisiana Texas Virginia Plus….the following are also working….

Access Grid for Education and Training Builds on our proven and advanced video infrastructure Utilizes Multicast Backbone Real time, continuous presence audio, video, data Purpose-built sites encourage natural, seamless interaction – Desktop implementation available Multi-Platform: including Win X, Linux/Unix – Mac OS X support coming soon H.323 Voice & Video Over IP (V2oIP), Ubiquitous 352 x 128 kbps - 2 Mbps, Multipoint capable H.320 Multipoint via third-party MPEG x 5.5 Mbps NCREN Video Network supports multipoint

Earth System Grid Goal: address technical obstacles to the sharing & analysis of high-volume data from advanced earth system models

Field Equipment Laboratory Equipment Remote Users Remote Users: ( K-12 Faculty and Students) Instrumented Structures and Sites Leading Edge Computation Curated Data Repository Laboratory Equipment Global Connections ( Faculty, Students, Practitioners) Simulation Tools Repository Network for Earthquake Eng. Simulation

Butterfly.net: Enterprise Optimization A scalable, resilient infrastructure for creating & running massive multiplayer games Developers avoid upfront costs Improved end-user experience Demonstrated 8x increase in profitability over centralized model Dynamic provisioning & on demand capacity Uses Globus Toolkit & runs on IBM Global Services hosting environment

Metropolitan Grid across the Universities Stable, well-managed HPC resources Supporting multi-disiplinary research And local industries (e.g. Rolls Royce) Slides: Courtesy James Coomer

Grid Collaboration MCNC - Universities = = 3 Common CommonInterests Grid Computing Higher Education Economic Development Thought Leadership UniversitiesMCNC Top Research Deployment Top Research Deployment Education Infrastructure Education Infrastructure Vertical Applications Horizontal Middleware Complementary Focus

The Innovation Engine Time Machines Thank You !

32-CPU SGI Altix Linux SMP Server 128-CPU IBM Linux Cluster (64 nodes) 8-TB Storage LSF Master Job Scheduler Grid Gatekeeper / Interactive Nodes Global Grid Resource DB (GIIS) Users Campus Grids GCNS Enterprise Grid Avaki Data Grid Data Grid Access Servers (8 total, i.e. 1 per 8 nodes)

Network, Grid and Data Center Services NCREN State-wide Grid Services Enterprise Grid Services Value-add Information Systems Services Self-serve Data Center Services DATA CENTER Hosting & InfrastructureGrid Computing GTEC, NLR, ANR and other Innovation Initiatives Information Security Services Data Archival Services Information Assurance DEPLOYMENT

Co-location Services GCNS supplies server cabinets – 19” EIA, 42-RU, 4-post APC-brand enclosures – Perforated, lockable doors – 84” high x 24” wide x 40” deep – Additional APC cabinet accessories available – $1,200 per cabinet one-time setup fee Base monthly rate of $500* per cabinet – Includes two 20-Amp, 110-VAC power circuits – One 100-Mbps network uplink – Four public IP addresses – 30-day average network utilization of up to 0.5-Mbps Additional network utilization options are available – *20% discount available for educational customers

Data Mirroring and Archival Network Appliance R200 Nearstore Filer 8-TB initially (scales up to 96-TB) Virtual Filers Data Grid Interface NetApp SnapVault NetApp SnapMirror NetApp SnapMirror Customer 1 Grid Users Customer 2 Linux Servers Customer 3 NetApp Servers Customer 4 NetApp Servers NCREN

Qwest Internet (Oc12 PoS) Abilene (Internet2 OC48 PoS) Level3 (GbE) RaleighRTP OC48 SRP Ring counter-rotating ring <=50ms reroute Fully active redundancy Greensboro Winston-Salem Charlotte Level3 (GbE) Duke (GbE)NCSU (GbE) UNC-CH (GbE) UNC-G NCAT ASU WFU WSSU NCSA UNC-C 7609 Wilmington Fayetteville Greenville ECU ECSU CMST FSU UNCP UNCW Asheville UNCA WCU ERC Greenville OC12 SRP Ring counter-rotating ring <=50ms reroute Fully active redundancy OC12 SRP Ring counter-rotating ring <=50ms reroute Fully active redundancy NCCU Qwest (OC12 PoS) Hickory

GTEC Projects Driving Grid Adoption MCNC Grid SP Grid ColLab Kids Grids Gaming Grid School Grids Grid-Info Grid Download-The-Grid AAAA Project Grid Training Courses Startup Grid Grid Appliance Grid Portal GGF & EGA NC Statewide Grid MCNC Enterprise Grid NC BioGrid MCNC Supercomputing

CY03 CY04 CY05CY06 MCNC: 3-Year GCNS Grid Roadmap Easy Access: Training, Web Courses Access Grid Node Grid Appliance QuadA Grid Service Provider: Network, Computing, Data, Video Partner with SC Sites Build GTEC Service Portfolio Start Grid Consulting Annual GSP Workshop Awareness Creation: Conferences, Workshops, PR MCNC Enterprise Grid NC BioGrid NC Statewide Grid