CCPR Workshop Introduction to the Cluster March 2, 2005.

Slides:



Advertisements
Similar presentations
NGS computation services: API's,
Advertisements

OPERATING SYSTEM An operating system is a group of computer programs that coordinates all the activities among computer hardware devices. It is the first.
Operating System.
SUPERCOMPUTER TO THE RESCUE Justin Curry EKU, Dept. of Technology, CEN/CET)
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
CCPR Workshop Lexis Cluster Introduction October 19, 2007 David Ash.
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS PRIMERGY Servers and Windows Server® 2008 R2 Benefit from an efficient, high performance and flexible platform.
Lecture 1: History of Operating System
6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal.
Academic and Research Technology (A&RT)
High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.
CPS216: Advanced Database Systems (Data-intensive Computing Systems) How MapReduce Works (in Hadoop) Shivnath Babu.
Sample School Website Sydney Region ITSU School Support
Introduction to R. Statistical Software Statistical software – Wide variety of software tools that researchers use to analyze data – Common examples are.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
Ch 4. The Evolution of Analytic Scalability
Abstract Load balancing in the cloud computing environment has an important impact on the performance. Good load balancing makes cloud computing more.
Operating Systems Who’s in charge in there?. Types of Software Application Software : Does things we want to do System Software : Does things we need.
© 2008 The MathWorks, Inc. ® ® Parallel Computing with MATLAB ® Silvina Grad-Freilich Manager, Parallel Computing Marketing
1 COMPSCI 110 Operating Systems Who - Introductions How - Policies and Administrative Details Why - Objectives and Expectations What - Our Topic: Operating.
Operating System. Architecture of Computer System Hardware Operating System (OS) Programming Language (e.g. PASCAL) Application Programs (e.g. WORD, EXCEL)
 Introduction to Operating System Introduction to Operating System  Types Of An Operating System Types Of An Operating System  Single User Single User.
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 1 Introduction Read:
Introduction to HPC resources for BCB 660 Nirav Merchant
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
CMPF124:Basics Skills for Knowledge Workers Introduction to Windows OS.
C++ Programming Language Lecture 1 Introduction By Ghada Al-Mashaqbeh The Hashemite University Computer Engineering Department.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
17-April-2007 High Performance Computing Basics April 17, 2007 Dr. David J. Haglin.
Parallel Computing with Matlab CBI Lab Parallel Computing Toolbox TM An Introduction Oct. 27, 2011 By: CBI Development Team.
المحاضرة الاولى Operating Systems. The general objectives of this decision explain the concepts and the importance of operating systems and development.
CCPR Workshop Introduction to the Cluster July 13, 2006.
INVITATION TO COMPUTER SCIENCE, JAVA VERSION, THIRD EDITION Chapter 6: An Introduction to System Software and Virtual Machines.
Batch Scheduling at LeSC with Sun Grid Engine David McBride Systems Programmer London e-Science Centre Department of Computing, Imperial College.
Windows 7 Your Life, Simplified System Requirements  1GB of RAM (2GB for 64Bit Version)  2Ghz processor speed  At least 20GB for Hard Disk Space 
Frontiers in Massive Data Analysis Chapter 3.  Difficult to include data from multiple sources  Each organization develops a unique way of representing.
Parallel Programming on the SGI Origin2000 With thanks to Igor Zacharov / Benoit Marchand, SGI Taub Computer Center Technion Moshe Goldberg,
School of Computer Science & Information Technology G6DICP Introduction to Computer Programming Milena Radenkovic.
CCS Overview Rene Salmon Center for Computational Science.
Capabilities of Software. Object Linking & Embedding (OLE) OLE allows information to be shared between different programs For example, a spreadsheet created.
Sample School Website. What is wrong with the existing School Webspace Site? Can only host static pages – no dynamic content possible. Can not be edited.
C o n f i d e n t i a l 1 Course: BCA Semester: III Subject Code : BC 0042 Subject Name: Operating Systems Unit number : 1 Unit Title: Overview of Operating.
Nanco: a large HPC cluster for RBNI (Russell Berrie Nanotechnology Institute) Anne Weill – Zrahia Technion,Computer Center October 2008.
UNICOS. When it comes to solving real-world problems, leading-edge hardware is only part of the solution. A complete solution also requires a powerful.
Intel SECSIMPro Script Editor Introductory Presentation E N S C R Y P T The E N S C R Y P T Team Brian Crampton, Eric Miles, & Yoshani Thiruvilangam.
CPSC 171 Introduction to Computer Science System Software and Virtual Machines.
CIS250 OPERATING SYSTEMS Chapter One Introduction.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Department of Computer Science Operating Systems OPS621S Semester 2.
CIP HPC CIP - HPC HPC = High Performance Computer It’s not a regular computer, it’s bigger, faster, more powerful, and more.
NGS computation services: APIs and.
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
Lecture 1: Network Operating Systems (NOS)
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
CFI 2004 UW A quick overview with lots of time for Q&A and exploration.
An Brief Introduction Charlie Taylor Associate Director, Research Computing UF Research Computing.
Advanced Computing Facility Introduction
Compute and Storage For the Farm at Jlab
Brief introduction about “Grid at LNS”
Introduction.
Operating System.
Architecture & System Overview
NGS computation services: APIs and Parallel Jobs
Quick Introduction to OS
OPERATING SYSTEM OVERVIEW
Ch 4. The Evolution of Analytic Scalability
The Main Features of Operating Systems
Quick Tutorial on MPICH for NIC-Cluster
Chapter-1 Computer is an advanced electronic device that takes raw data as an input from the user and processes it under the control of a set of instructions.
What is an operating system An operating system is the most important software that runs on a computer. It manages the computer's memory and processes,
Presentation transcript:

CCPR Workshop Introduction to the Cluster March 2, 2005

Outline Overview –What is a “cluster”? –What tools are available on CCPR’s cluster? –How will the cluster benefit your research? Cluster Tutorial –Connecting from Windows –Submitting jobs –Managing jobs –Job output –Website

What is a cluster? The first “cluster” was motivated by the need for cheap, high-performance computing Off-the-shelf computers/processors were successfully connected to create a “super- computer” Great success; idea spread rapidly Cost-effective and scalable

What is a cluster? Think of a cluster as having two parts: –Hardware: a collection of computers –Cluster management system: software for coordinating hardware with a collection of computational tasks (batch jobs)

CCPR’s Cluster: Hardware Front-end Job submission Cluster management Administrative tools lexis.ccpr.ucla.edu or “lexis” for short Back-end All processing and “heavy-lifting” 4 “worker” nodes Specs 2 x AMD Opteron Model 248, 64bit 8 gigs RAM on node 1 2 gigs RAM on nodes “slots”

CCPR’s Cluster: Management System Jobs are submitted to the cluster via the cluster management system –An advanced batch system –Efficiently allocates resources to jobs –Remembers job requirements –Remembers node specs and availability –Schedules jobs according to requested resources and priority –Users can easily view jobs

Software and Data on the Cluster Stata SAS Matlab Stat/Transfer R Editors: emacs, pico, vi, and more Various compilers (C, Fortran) Scripting languages Suggestions? Ready-data archive –HRS –CPS (Unicon version) –AddHealth –IFLS –Susenas Lots more to come… Suggestions?

Other features Personal disk space provided Access to additional disk space available Interactive use of software available Quick comparison to Whitney, nicco, ts1, ts2, Hoffman cluster Cost-effective and scalable

How does this help your research? Easy access to software and data Faster processors More RAM Easy to share data, programs, etc. with colleagues via the cluster More advanced users: parallel processing, compilers, etc. Continued…

How does this help your research? (continued) Your pc is available for other work when you submit a job to the cluster Submit a job and forget about it As an early user, you will have all our ears for requests and questions. It’s EASY.

Questions/Comments

Tutorial Connecting from Windows Submitting jobs Managing jobs Job output Website