TeraGrid n US based, funded by the NSF n High speed network, combines clusters into one Super-Cluster! n Doesn’t just combine computation… combines storage,

Slides:



Advertisements
Similar presentations
Computer Science Internet and Web Technology High Performance Distributed Computing Parallel and Distributed Computer Systems Dr.-Ing. Thilo Kielmann.
Advertisements

FUTURE TECHNOLOGIES Lecture 13.  In this lecture we will discuss some of the important technologies of the future  Autonomic Computing  Cloud Computing.
Dinker Batra CLUSTERING Categories of Clusters. Dinker Batra Introduction A computer cluster is a group of linked computers, working together closely.
Single System Image Clustering. Source ex.pl?node_id=38692&lastnode_id=131
The CrossGrid project Juha Alatalo Timo Koivusalo.
Parallelization and Grid Computing Thilo Kielmann Bioinformatics Data Analysis and Tools June 8th, 2006.
Cluster Computing Slides by: Kale Law. Cluster Computing Definition Uses Advantages Design Types of Clusters Connection Types Physical Cluster Interconnects.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
Introduction to Grid Computing Ann Chervenak Carl Kesselman And the members of the Globus Team.
Chapter 2 Computer Clusters Lecture 2.1 Overview.
Information and Computer Science Department Research Profile Information and Computer Science Department Research Profile Dr. Sadiq M. Sait Information.
Cloud Computing for the Enterprise November 18th, This work is licensed under a Creative Commons.
Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Principles of Scalable HPC System Design March 6, 2012 Sue Kelly Sandia National Laboratories Abstract: Sandia National.
DISTRIBUTED COMPUTING
March 3rd, 2006 Chen Peng, Lilly System Biology1 Cluster and SGE.
Distributed EU-wide Supercomputing Facility as a New Research Infrastructure for Europe Gabrielle Allen Albert-Einstein-Institut, Germany Jarek Nabrzyski.
Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Loosely Coupled Parallelism: Clusters. Context We have studied older archictures for loosely coupled parallelism, such as mesh’s, hypercubes etc, which.
Tools for collaboration How to share your duck tales…
CLUSTER COMPUTING TECHNOLOGY BY-1.SACHIN YADAV 2.MADHAV SHINDE SECTION-3.
Turning Software Projects into Production Solutions Dan Fraser, PhD Production Coordinator Open Science Grid OU Supercomputing Symposium October 2009.
Authors: Ronnie Julio Cole David
Introduction to Research 2011 Introduction to Research 2011 Ashok Srinivasan Florida State University Images from ORNL, IBM, NVIDIA.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
Microsoft Creating Supercomputer Software. Microsoft’s New Product  Microsoft is developing software for high- performance computers computers that are.
Master’s Degree in Computer Science. Why? Acquire Credentials Learn Skills –Existing software: Unix, languages,... –General software development techniques.
Computational Science & Engineering meeting national needs Steven F. Ashby SIAG-CSE Chair March 24, 2003.
1 CS145 Lecture 24 What’s next?. 2  What questions does Computer Science study?  Where is programming and Computer Science headed? –With special emphasis.
1 CS145 Lecture 26 What’s next?. 2 What software questions do we study? Where is software headed?
+ Clusters Alternative to SMP as an approach to providing high performance and high availability Particularly attractive for server applications Defined.
Operating System. Chapter 1: Introduction What is an Operating System? Mainframe Systems Desktop Systems Multiprocessor Systems Distributed Systems Clustered.
Smart Grid Big Data: Automating Analysis of Distribution Systems Steve Pascoe Manager Business Development E&O - NISC.
Northwest Indiana Computational Grid Preston Smith Rosen Center for Advanced Computing Purdue University - West Lafayette West Lafayette Calumet.
SYSTEM MODELS FOR ADVANCED COMPUTING Jhashuva. U 1 Asst. Prof CSE
EGEE is a project funded by the European Union under contract IST Generic Applications Requirements Roberto Barbera NA4 Generic Applications.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
Chapter 1: Introduction What is an Operating System? Mainframe Systems Desktop Systems Multiprocessor Systems Distributed Systems Clustered System Real.
Grids and SMEs: Experience and Perspectives Emanouil Atanassov, Todor Gurov, and Aneta Karaivanova Institute for Parallel Processing, Bulgarian Academy.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
Sub-fields of computer science. Sub-fields of computer science.
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Chapter 1: Introduction
Clouds , Grids and Clusters
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Chapter 1: Introduction
Chapter 1: Introduction
CLUSTER COMPUTING Presented By, Navaneeth.C.Mouly 1AY05IS037
Distributed System 電機四 陳伯翰 b
Chapter 1: Introduction
Grid Computing Colton Lewis.
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
Distributed computing deals with hardware
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
LO2 – Understand Computer Software
Chapter 1: Introduction
Vrije Universiteit Amsterdam
Chapter 1: Introduction
What is a Grid? Grid - describes many different models
Chapter 1: Introduction
Presentation transcript:

TeraGrid n US based, funded by the NSF n High speed network, combines clusters into one Super-Cluster! n Doesn’t just combine computation… combines storage, sensors, visualisation, all computing resources! n Enables better science

TeraGrid as a Distributed System n Computing resources at different sites n TeraGrid to be used as a single system n Systems built from individual nodes

Not the only Grid… n Many grids worldwide n Examples: EUGrid, I-Grid n Individual clusters & supercomputers in various places, commercial and academic

What can we use Grids for? n Hard & heavy research n Applications: –Geography, weather forecasting –Economics, financial predictions in markets –Physics, simulations, theory verification –Chemistry & Biology, AIDS/Cancer –Raytracing, Encoding Audio/Video, more!

Image/Video Rendering

Toy Story made on a distributed system, a cluster! n 117 Sun SparcStations n Render farm, a load of machines rendering different frames of video n 114,000 frames, 77 minute movie n One computer would have taken 43 years of nonstop computing

Parallel Video Encoding n MPEG

Immersive Environments n Video Walls! Visualisation stuff

Analysis of Video n Shot & Scene detection in Fischlar n Slow computation process, goes through every frame of video to analyse n Our beowulf does it 5 times faster than a large enterprise Sun server, worth 10G!

Search engines n Google, pigeon rank n Searching wide database, ideal for deployment on a cluster n *was* driven by 4500 node Linux Cluster

Breaking Security - Computing n RC5, DES, & distributed.net n 2^64 (18,446,744,073,709,551,616) keys n Teams, donated CPU cycles

Other “proper” research n Molecular modelling, drug design n Study of viruses, virus propagation n AIDS/Cancer research n Weather forecasting, climate prediction n High Energy Physics n Simulation, earth, economics, financial n Artificial Intelligence

Other stuff in Distributed Systems n Distributed Software Objects, CORBA n Distribued Information = WWW n Peer to Peer – Napster and mates

What issues are there? n Organisation n Resource Management, Scheduling n Optimisation n Security n Balancing load n Handling errors

Linux Cluster

How do they do it? n Split up problems, requires specific analysis for different problems though :-/ n Architecture of a cluster, software n Parallelising Compilers, why not do it automatically?

Distributed Systems n Loose definition - collaborative computing n Enables all applications in all areas, however mostly for large stuff n Pushes back the frontiers of what we think we’re able to solve n Better use of our scarce resources!