Cluster Infrastructure BoF Bruce J. Walker. Cluster BoF Cluster Summits What is a cluster Information about Clusters Types of clusters Characteristics.

Slides:

Advertisements

Similar presentations

Clustering Technology For Scaleability Jim Gray Microsoft Research

Advertisements

2  Industry trends and challenges  Windows Server 2012: Beyond virtualization  Complete virtualization platform  Improved scalability and performance.

Virtual Machine Technology Dr. Gregor von Laszewski Dr. Lizhe Wang.

The Datacenter Needs an Operating System Matei Zaharia, Benjamin Hindman, Andy Konwinski, Ali Ghodsi, Anthony Joseph, Randy Katz, Scott Shenker, Ion Stoica.

Database Architectures and the Web

System Center 2012 R2 Overview

Introduction to DBA.

Dinker Batra CLUSTERING Categories of Clusters. Dinker Batra Introduction A computer cluster is a group of linked computers, working together closely.

Chapter 3 Database Architectures and the Web Pearson Education © 2009.

“It’s going to take a month to get a proof of concept going.” “I know VMM, but don’t know how it works with SPF and the Portal” “I know Azure, but.

Dr. Zahid Anwar. Simplified Architecture of Linux Cluster Simplified Architecture of a Single Computer Simplified architecture of an enterprise cluster.

Single System Image Clustering. Source ex.pl?node_id=38692&lastnode_id=131

Server Platforms Week 11- Lecture 1. Server Market $ 46,100,000,000 ($ 46.1 Billion) Gartner.

Cluster Computing Slides by: Kale Law. Cluster Computing Definition Uses Advantages Design Types of Clusters Connection Types Physical Cluster Interconnects.

Copyright © 2002 Wensong Zhang. Page 1 Free Software Symposium 2002 Linux Virtual Server: Linux Server Clusters for Scalable Network Services Wensong Zhang.

Microsoft Load Balancing and Clustering. Outline Introduction Load balancing Clustering.

Is Windows Right for High-Availability Enterprise Applications? Dan Kusnetzky, Vice President System Software Research IDC.

Chapter 3 Database Architectures and the Web Pearson Education © 2009.

Design and Implementation of a Single System Image Operating System for High Performance Computing on Clusters Christine MORIN PARIS project-team, IRISA/INRIA.

Infiniband enables scalable Real Application Clusters – Update Spring 2008 Sumanta Chatterjee, Oracle Richard Frank, Oracle.

CLUSTER COMPUTING Prepared by: Kalpesh Sindha (ITSNS)

Database Architectures and the Web

SSI-OSCAR A Single System Image for OSCAR Clusters Geoffroy Vallée INRIA – PARIS project team COSET-1 June 26th, 2004.

IBM WebSphere Architectural Overview. Content Management ● Controlled by Java – Servlet – Enterprise Java Beans (EJB) – Java Server Pages (JSP) ● Base.

Database Architectures and the Web Session 5

+ CS 325: CS Hardware and Software Organization and Architecture Cloud Architectures.

Software Architecture

Submitted by: Shailendra Kumar Sharma 06EYTCS049.

Indiana University’s Name for its Sakai Implementation Oncourse CL (Collaborative Learning) Active Users = 112,341 Sites.

Presented by Reliability, Availability, and Serviceability (RAS) for High-Performance Computing Stephen L. Scott and Christian Engelmann Computer Science.

Loosely Coupled Parallelism: Clusters. Context We have studied older archictures for loosely coupled parallelism, such as mesh’s, hypercubes etc, which.

1 Introduction to Middleware. 2 Outline What is middleware? Purpose and origin Why use it? What Middleware does? Technical details Middleware services.

Multiple Processor Systems Chapter Multiprocessors 8.2 Multicomputers 8.3 Distributed systems.

Crystal Ball Panel ORNL Heterogeneous Distributed Computing Research Al Geist ORNL March 6, 2003 SOS 7.

FailSafe SGI’s High Availability Solution Mayank Vasa MTS, Linux FailSafe Gatekeeper

High-Availability Linux Project (Last updated 24 Septemver, 2003) 30 th December, 2003 Seo Dong Mahn.

Headline in Arial Bold 30pt HPC User Forum, April 2008 John Hesterberg HPC OS Directions and Requirements.

Hakim Weatherspoon Robbert van Renesse SUPERCLOUD: GOING BEYOND FEDERATED CLOUDS 1.

Distributed Computing Systems CSCI 4780/6780. Geographical Scalability Challenges Synchronous communication –Waiting for a reply does not scale well!!

CLUSTER COMPUTING TECHNOLOGY BY-1.SACHIN YADAV 2.MADHAV SHINDE SECTION-3.

OS and System Software for Ultrascale Architectures – Panel Jeffrey Vetter Oak Ridge National Laboratory Presented to SOS8 13 April 2004 ack.

Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.

Cluster Software Overview

Unit 9: Distributing Computing & Networking Kaplan University 1.

Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:

CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,

Data Communications and Networks Chapter 9 – Distributed Systems ICT-BVF8.1- Data Communications and Network Trainer: Dr. Abbes Sebihi.

COMP381 by M. Hamdi 1 Clusters: Networks of WS/PC.

Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012.

VM vs Container Xen, KVM, VMware, etc. Hardware emulation / paravirtualization Can run different OSs on the same box Dozens of instances OS sprawl problem.

3/12/2013Computer Engg, IIT(BHU)1 CONCEPTS-3. Clusters Classification Application Target ● High Performance (HP) Clusters ➢ Grand Challenging Applications.

Copyright ©2003 Dell Inc. All rights reserved. Scaling-Out with Oracle® Grid Computing on Dell™ Hardware J. Craig Lowery, Ph.D. Software Architect and.

Enabling the Cloud OS Today  New high-density Web Sites with elastic cloud scaling and complete dev-ops experiences  New rich IaaS experience for self-service.

Cluster computing. 1.What is cluster computing? 2.Need of cluster computing. 3.Architecture 4.Applications of cluster computing 5.Advantages of cluster.

Background Computer System Architectures Computer System Software.

REMINDER Check in on the COLLABORATE mobile app Best Practices for Oracle on VMware - Deep Dive Darryl Smith Chief Database Architect Distinguished Engineer.

Lecture 17 Page 1 CS 111 Online Single System Image Approaches Built a distributed system out of many more- or-less traditional computers – Each with typical.

SYSTEM MODELS FOR ADVANCED COMPUTING Jhashuva. U 1 Asst. Prof CSE

Containers vs Others Xen, VMware, etc. ● Emulation/paravirtualization ● Can run different OSs on the same box ● Lower density/scalability ● OS sprawl problem.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING

OpenMosix, Open SSI, and LinuxPMI

“Nodes of Distributed Systems”

Grid Computing.

Database Architectures and the Web

Distributed System Structures 16: Distributed Structures

HP’s OpenSSI Linux Cluster Project

CLUSTER COMPUTING.

Distributed computing deals with hardware

Presentation Title Linux cluster issues

Client/Server Computing and Web Technologies

Presentation transcript:

Cluster Infrastructure BoF Bruce J. Walker

Cluster BoF Cluster Summits What is a cluster Information about Clusters Types of clusters Characteristics of clusters Cluster components Clusters and Xen Cluster Issues

Cluster Summits Waldorf, Germany Summit – June, RH –Daniel Phillips will discuss in next BoF OLS Summit – Monday/Tuesday this week –Set up via OSDL cluster sig (clusters_sig mailing list

OLS Summit Attendees: –HP (OpenSSI), IBM (HA-Linux), ORNL (Oscar, etc.), MontaVista (Virtual Synchrony), Novell (CIM/DMTF), Suse, Cassat, RH (CLVM), Steeleye, … Notes will be sent out on clusters_sig mailing list Talks: Ha-Linux; Virtual Synchrony, DMTF/CIM Discussion: CLVM, cman GFS, DLM OCFS2 integration; component interop and substitution; memory pressure

What is a Cluster? –Multiple machines working together; –Standard computers with an OS kernel per node; –Peers, working together –NOT client-server –NOT SMP or NUMA (but have SMP or NUMA nodes) –Clusters and Grids? Grids are loose and can cross administrative lines; Use a grid only if you can’t set up a cluster; The best grid would be a collection of SSI clusters;

Information about clusters Clusters_sig mailing list (OSDL) Linux_clusters mailing list (RedHat) Sourceforge cluster web site Projects –Linux-ha.org, openssi.org, openmosix.org, kerrighed.org, bproc.org, OCFS2, GFS, Luster Products –Scyld, Steeleye, RH, Suse, HP (ServiceGuard), IBM, linux-ha ….

Many types of Clusters High Performance Clusters Beowulf; 1000 nodes; parallel programs; MPI Load-leveling Clusters –Move processes around to borrow cycles (eg. Mosix) Web-Service Clusters –LVS; load-level tcp connections; Web pages and applications Storage Clusters –cluster filesystems; same view of data from each node; GFS, OCFS2 Database Clusters –Oracle RAC; High Availability Clusters –ServiceGuard, Lifekeeper, Failsafe, ha-linux, failover clusters

SMP Availability Manageability Usability Scalability HUGE Perfect Cluster in all dimensions Really BIG SMP Ideal Linux Cluster log scale Ideal Linux Cluster Typical HA Cluster

Cluster Components Membership Communication Group Membership and Communicaiton –Virtual Synchrony DLM CLVM Cluster Filesystems Networking (Linux Virtual Server) Cluster Process Management Scheduling/ Workload Mgmt Remote Fileblock Remote IPC Distributed Shared Memory (DSM) DMTF / CIM

Clusters and Xen HA across DomU –On same host / on different hosts HA across Dom0 –Restart VMs Load balancing

Clustering Issues Different Cluster managers –Apis and resource mgmt Interoperability of cluster components CIM model for clusters / what apps want Clusters of Clusters Overlaping membeship