Parallel Computing With High Performance Computing Clusters (HPCs) By Jeremy Cathey.

Slides:



Advertisements
Similar presentations
A DISTRIBUTED CSMA ALGORITHM FOR THROUGHPUT AND UTILITY MAXIMIZATION IN WIRELESS NETWORKS.
Advertisements

MINJAE HWANG THAWAN KOOBURAT CS758 CLASS PROJECT FALL 2009 Extending Task-based Programming Model beyond Shared-memory Systems.
Parallel Processing with OpenMP
SkewReduce YongChul Kwon Magdalena Balazinska, Bill Howe, Jerome Rolia* University of Washington, *HP Labs Skew-Resistant Parallel Processing of Feature-Extracting.
CA 714CA Midterm Review. C5 Cache Optimization Reduce miss penalty –Hardware and software Reduce miss rate –Hardware and software Reduce hit time –Hardware.
Beowulf Supercomputer System Lee, Jung won CS843.
SUPERCOMPUTER TO THE RESCUE Justin Curry EKU, Dept. of Technology, CEN/CET)
1. Topics Is Cloud Computing the way to go? ARC ABM Review Configuration Basics Setting up the ARC Cloud-Based ABM Hardware Configuration Software Configuration.
Distributed Systems 1 Topics  What is a Distributed System?  Why Distributed Systems?  Examples of Distributed Systems  Distributed System Requirements.
Information Technology Center Introduction to High Performance Computing at KFUPM.
MCITP Guide to Microsoft Windows Server 2008 Server Administration (Exam #70-646) Chapter 11 Windows Server 2008 Virtualization.
1 Distributed Computing Algorithms CSCI Distributed Computing: everything not centralized many processors.
11/14/05ELEC Fall Multi-processor SoCs Yijing Chen.
Lesson 4-Installing Network Operating Systems. Overview Installing and configuring Novell NetWare 6.0. Installing and configuring Windows 2000 Server.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 8: Implementing and Managing Printers.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 8: Implementing and Managing Printers.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 8: Implementing and Managing Printers.
Software Development CS 1 Rick Graziani Spring 2007.
How to Install Windows 7.
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
Christopher Bednarz Justin Jones Prof. Xiang ECE 4986 Fall Department of Electrical and Computer Engineering University.
Hands-On Microsoft Windows Server 2008
1 RH033 Welcome to RedHat Linux. 2 Hardware Requirements ♦ Pentium Pro or better with 256 MB RAM ♦ Or ♦ 64-bit Intel/AMD with 512 MB RAM ♦ 2-6 GB disk.
Module 14: Configuring Print Resources and Printing Pools.
Virtualization Dr. John P. Abraham Professor. Grid computing Multiple independent computing clusters which act like a “grid” because they are composed.
Predictive Runtime Code Scheduling for Heterogeneous Architectures 1.
 Introduction to Operating System Introduction to Operating System  Types Of An Operating System Types Of An Operating System  Single User Single User.
So, Jung-ki Distributed Computing System LAB School of Computer Science and Engineering Seoul National University Implementation of Package Management.
Database Edition for Sybase Sales Presentation. Market Drivers DBAs are facing immense time pressure in an environment with ever-increasing data Continuous.
View-Oriented Parallel Programming for multi-core systems Dr Zhiyi Huang World 45 Univ of Otago.
Introduction A computer is a group of interdependent items that interact regularly to perform a task. A computer system refers to the hardware.
COMPTUER CLUSTERING WITH LINUX-ON-CD Robert Ibershoff Computer Electronic Networking.
Optimal Client-Server Assignment for Internet Distributed Systems.
Beowulf Cluster Jon Green Jay Hutchinson Scott Hussey Mentor: Hongchi Shi.
Parallelization of the Classic Gram-Schmidt QR-Factorization
“Come out of the desert of ignorance to the OASUS of knowledge” Grid Computing with SAS ® Foundation Statistics Canada SAS Technology Centre.
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
Instrumentation ModelKit is released in the following editions: 1) 2) 3) 4)
CHAPTER 2. Overview 1. Pre-Installation Tasks 2. Installing and Configuring Linux 3. X Server 4. Post Installation Configuration and Tasks.
The Cosmic Cube Charles L. Seitz Presented By: Jason D. Robey 2 APR 03.
IT320 OPERATING SYSTEM CONCEPTS Unit 3: Welcome to Linux June 2011 Kaplan University 1.
Bio-Linux 3.0 An integrated bioinformatics solution for the EG community ClustalX showing DNA polymerase alignment GeneSpring showing yeast transcriptome.
Full and Para Virtualization
LINUX CLUSTERING USING OPENMOSIX Jose Matthews Computer Electronic Networking, EKU College of Business and Technology.
BMTS 242: Computer and Systems Lecture 2: Memory, and Software Yousef Alharbi Website
CEG 2400 FALL 2012 Windows Servers Network Operating Systems.
Load Rebalancing for Distributed File Systems in Clouds.
CEG 2400 FALL 2012 Linux/UNIX Network Operating Systems.
Linux and Coldfusion MX Mid-Michigan Coldfusion User’s Group, Nov
G.PULLAIAH COLLEGE OF ENGINEERING & TECHNOLOGY. BLUE BRAIN Prepared by, Prepared by, D. Sruthi Reddy, D. Sruthi Reddy, 08AT1A0521, 08AT1A0521, 2 nd CSE.
PERFORMANCE OF THE OPENMP AND MPI IMPLEMENTATIONS ON ULTRASPARC SYSTEM Abstract Programmers and developers interested in utilizing parallel programming.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
LOGO Chapter 4 System Software. Contents Lead in New words and phrases Intensive study Exercises Operating System.
Group Members Hamza Zahid (131391) Fahad Nadeem khan Abdual Hannan AIR UNIVERSITY MULTAN CAMPUS.
Chapter 4: Threads Modified by Dr. Neerja Mhaskar for CS 3SH3.
Introduction to Parallel Computing: MPI, OpenMP and Hybrid Programming
Clinton A Jones Eastern Kentucky University Department of Technology
Popular Operating Systems
Hadoop Clusters Tess Fulkerson.
Multi-Processing in High Performance Computer Architecture:
DEBROS: A UNIX-like OS for 8-bit microcontrollers
MASS CUDA Performance Analysis and Improvement
Chapter 4: Threads.
Distributed Computing:
Chapter 4: Threads & Concurrency
Technology 6 Operating Systems.
Simulation of the Late Permian with Community Climate System Model 3
Lecture Topics: 11/1 Hand back midterms
Presentation transcript:

Parallel Computing With High Performance Computing Clusters (HPCs) By Jeremy Cathey

Super Computing Began as early as late 1950’s Compute large mathematical calculations Large scale task management

Advantages of Super Computing Power Configuration Administration Cost Scalability Diversity Disadvantages of Super Computing

Alternatives Distributed Computing - Uses queuing system to manage multiple tasks on several computers serially Parallel Computing - Uses several computers to work on one task in parallel

Implementations of Alternatives Shared Processors (Multiple Processors) Shared Memory Pools Messaging Systems

Advantages of Parallel Computing Cost Scalability Diversity Power Configuration Administration Disadvantages of Parallel Computing

Parallelization Techniques Manual - Parallelization implemented by the programmer at creation of the program Automatic - Parallelization implemented on the fly by the operating system

Advantages of Manual Parallelization Specific Customization More Effective Parallelization Disadvantages of Manual Parallelization Difficult to Implement Not Very Portable

Advantages of Automatic Parallelization Easier to Implement Portable Applications Disadvantages of Automatic Parallelization Less Effective Parallelization

Reduce Disadvantages of Parallel Computing Learn more about Operating System development and parallel optimization Provide a solution for optimized parallel computing for Dr. Salazar’s research Project Goals

Goal Techniques Reduce power issue of parallel computing machines by custom building an operating system kernel for optimization Research and Improve Open-Mosix Parallelization Technique Create a cluster that is easy to assemble and disassemble Create and/or implement an interface that simplifies cluster administration

Operating System Choice Windows Vs. Linux Live vs. Install Community Support Creation vs. Customization HARDWARE SUPPORT!!!!!!!! Bill!!!!

Implementation Dr. Salazar: Professor of Chemistry Use cluster to reduce time for sophisticated mathematical computation

Simulation Details 2.6 GHz Computer - 2GB RAM 1.2 GHz Computer - 256MB RAM 5 Parallel 1.2GHz Computers – 1.28GB RAM

Parallel

Hurdles HARDWARE DETECTION!!!!!! Did I Mention: HARDWARE DETECTION!!!!!!

Improvements Redesign Operating System Kernel For More Advanced HARDWARE DETECTION Try Simulations on More Advanced Computers Create Custom Installer for Distribution

Special Thanks Dr. Kirk: For providing computers for experiment and for finding a place for me to store my project My Wife: For not killing me while I had to store my project at our home Dr. Wilms: for providing older versions of Red Hat, and for Operating Systems Class Dr. Salazar: For time and effort spent helping me understand a SMALL part of his research

Questions? Comments? Derogatory Remarks?