CS 351/ IT 351 Modeling and Simulation Technologies HPC Architectures Dr. Jim Holten.

Slides:



Advertisements
Similar presentations
Network II.5 simulator ..
Advertisements

Mehdi Naghavi Spring 1386 Operating Systems Mehdi Naghavi Spring 1386.
DSPs Vs General Purpose Microprocessors
Computer Organization and Architecture
Practical techniques & Examples
Distributed Systems CS
Vector Processing. Vector Processors Combine vector operands (inputs) element by element to produce an output vector. Typical array-oriented operations.
Traditional Approach to Design
Chapter 10 The Traditional Approach to Design
Development of Parallel Simulator for Wireless WCDMA Network Hong Zhang Communication lab of HUT.
Computer Architecture & Organization
Introduction to Operating Systems CS-2301 B-term Introduction to Operating Systems CS-2301, System Programming for Non-majors (Slides include materials.
CMPT 300: Final Review Chapters 8 – Memory Management: Ch. 8, 9 Address spaces Logical (virtual): generated by the CPU Physical: seen by the memory.
A Grid Parallel Application Framework Jeremy Villalobos PhD student Department of Computer Science University of North Carolina Charlotte.
CS 584. A Parallel Programming Model We need abstractions to make it simple. The programming model needs to fit our parallel machine model. Abstractions.
1 CS1001 Lecture Overview Java Programming Java Programming Midterm Review Midterm Review.
Emerging Trends in Computer Science Dr. Gurvinder Singh Reader, Deptt of Computer Science & Engineering, GNDU, Amritsar.
Chapter 1 Introduction 1.1A Brief Overview - Parallel Databases and Grid Databases 1.2Parallel Query Processing: Motivations 1.3Parallel Query Processing:
CMPT 300: Final Review Chapters 8 – Memory Management: Ch. 8, 9 Address spaces Logical (virtual): generated by the CPU Physical: seen by the memory.
Architecture and Real Time Systems Lab University of Massachusetts, Amherst An Application Driven Reliability Measures and Evaluation Tool for Fault Tolerant.
Chapter 1 and 2 Computer System and Operating System Overview
1 Input/Output Chapter 3 TOPICS Principles of I/O hardware Principles of I/O software I/O software layers Disks Clocks Reference: Operating Systems Design.
Introduction to Parallel Processing Ch. 12, Pg
Operating Systems Concepts 1. A Computer Model An operating system has to deal with the fact that a computer is made up of a CPU, random access memory.
CS 0008 Day 2 1. Today Hardware and Software How computers store data How a program works Operators, types, input Print function Running the debugger.
10-1 Chapter 10 - Trends in Computer Architecture Principles of Computer Architecture by M. Murdocca and V. Heuring © 1999 M. Murdocca and V. Heuring Principles.
1 Instant replay  The semester was split into roughly four parts. —The 1st quarter covered instruction set architectures—the connection between software.
RaPTEX: Rapid Prototyping of Embedded Communication Systems Dr. Alex Dean & Dr. Mihai Sichitiu (ECE) Dr. Tom Wolcott (MEAS) Motivation  Existing work.
Secure Embedded Processing through Hardware-assisted Run-time Monitoring Zubin Kumar.
Chapter 3.1:Operating Systems Concepts 1. A Computer Model An operating system has to deal with the fact that a computer is made up of a CPU, random access.
Lecture 29 Fall 2006 Lecture 29: Parallel Programming Overview.
 What Is a Computer? What Is a Computer?  Computer System Components Computer System Components  Hardware Hardware  Types of Memory Types of Memory.
Ajmer Singh PGT(IP) Software Concepts. Ajmer Singh PGT(IP) Operating System It is a program which acts as an interface between a user and hardware.
Computer System Overview Chapter 1. Operating System Exploits the hardware resources of one or more processors Provides a set of services to system users.
Impulse Embedded Processing Video Lab Generate FPGA hardware Generate hardware interfaces HDL files HDL files FPGA bitmap FPGA bitmap C language software.
2007 Sept 06SYSC 2001* - Fall SYSC2001-Ch1.ppt1 Computer Architecture & Organization  Instruction set, number of bits used for data representation,
CS 1308 Computer Literacy and the Internet. Introduction  Von Neumann computer  “Naked machine”  Hardware without any helpful user-oriented features.
1 Dryad Distributed Data-Parallel Programs from Sequential Building Blocks Michael Isard, Mihai Budiu, Yuan Yu, Andrew Birrell, Dennis Fetterly of Microsoft.
(More) Interfacing concepts. Introduction Overview of I/O operations Programmed I/O – Standard I/O – Memory Mapped I/O Device synchronization Readings:
Chapter 2 Parallel Architecture. Moore’s Law The number of transistors on a chip doubles every years. – Has been valid for over 40 years – Can’t.
Parallel Computers Organizations and Architecture Department of Computer Science Southern Illinois University Edwardsville Summer, 2015 Dr. Hiroshi Fujinoki.
Frontiers in Massive Data Analysis Chapter 3.  Difficult to include data from multiple sources  Each organization develops a unique way of representing.
Parallel Processing Steve Terpe CS 147. Overview What is Parallel Processing What is Parallel Processing Parallel Processing in Nature Parallel Processing.
Pipelined and Parallel Computing Data Dependency Analysis for 1 Hongtao Du AICIP Research Mar 9, 2006.
PARALLEL APPLICATIONS EE 524/CS 561 Kishore Dhaveji 01/09/2000.
Computing Ontology Part II. So far, We have seen the history of the ACM computing classification system – What have you observed? – What topics from CS2013.
Operating System Provides a set of services to system users Manages memory (primary and secondary) and I/O devices Exploits the hardware resources of one.
Chapter 1 Computers, Compilers, & Unix. Overview u Computer hardware u Unix u Computer Languages u Compilers.
Vector and symbolic processors
CS 351/ IT 351 Modeling and Simulation Technologies Review ( ) Dr. Jim Holten.
10-1 Chapter 10 - Trends in Computer Architecture Department of Information Technology, Radford University ITEC 352 Computer Organization Principles of.
3/12/2013Computer Engg, IIT(BHU)1 INTRODUCTION-1.
Silberschatz and Galvin  Operating System Concepts Module 1: Introduction What is an operating system? Simple Batch Systems Multiprogramming.
UNIX Operating System. A Brief Review of Computer System 1. The Hardware CPU, RAM, ROM, DISK, CD-ROM, Monitor, Graphics Card, Keyboard, Mouse, Printer,
1 Chapter 1 Basic Structures Of Computers. Computer : Introduction A computer is an electronic machine,devised for performing calculations and controlling.
Introduction to Performance Tuning Chia-heng Tu PAS Lab Summer Workshop 2009 June 30,
Identify internal hardware devices (e. g
CS 351/ IT 351 Modeling and Simulation Technologies
Operating Systems (CS 340 D)
Linux Operating System Architecture
Vision for Robotic Applications
CS 286 Computer Organization and Architecture
湖南大学-信息科学与工程学院-计算机与科学系
Advanced Computer Architecture 5MD00 Project on Network-on-Chip
CS 501: Software Engineering Fall 1999
Introduction to Operating Systems
Introduction to Operating Systems
CS 286 Computer Organization and Architecture
Overview of Computer system
Presentation transcript:

CS 351/ IT 351 Modeling and Simulation Technologies HPC Architectures Dr. Jim Holten

CS 351/ IT 351 Overview Parallel Program Concerns Algorithm “Architectures” Data “Architectures” Hardware Architectures

CS 351/ IT 351 Parallel Program Concerns What are parallel processes? Why go parallel? What goes “parallel” in a program?

CS 351/ IT 351 Parallel Processes? The processor – size, speed, capability The communications – topology, types, shared links File I/O – access links topology, file system sizes, shared accesses Overall architecture models?

CS 351/ IT 351 Why parallel? Too large for one processor’s memory! Takes too long to execute! Amdahl’s law? T = S + P  T = S + P/m (  T = S + max(P i )) Lim(T) = S, as m  ∞

CS 351/ IT 351 What goes “parallel”? Data parallel Partition the data. Same algorithm, different data Task parallel Partition the code. Different algorithms, different data Task Parallel Pipeline Partition the code Different algorithms, same data (possibly augmented)

CS 351/ IT 351 Data Parallel Partition the primary data set. Project the partitioning to secondary data sets Identify data sharing –“Sharing” communications maps (where?) –Data set members’ needing shared (who?) –Actual attributes to be shared (what?)

CS 351/ IT 351 Data Parallel: Applications Mesh Models Top cells – primary data set Other cells – secondary (dependant) data sets Network Models Nodes – primary data set Links, agent models – secondary data sets Others?

CS 351/ IT 351 Task Parallel Code and data interdependencies Relatively independent code blocks Identify each code block’s needs Initial data into process (from another) Run time data sharing Result data from process (to another)

CS 351/ IT 351 Task Parallel: Applications Independent operations System management (Comm, I/O, load monitoring) User interface control – different user categories Many pattern finders, one data set Data mining Computer vision One stage in pipeline

CS 351/ IT 351 Task Parallel Pipeline Successive stages of separate algorithms Data stream input to first stage Each stage’s output is next stage’s input Data stream output from last stage

CS 351/ IT 351 Task Parallel Pipeline: Applications Computer vision Surveillance Robotics Real-time sensor monitoring Large data set scanning Data mining Security scans

CS 351/ IT 351 Combining Parallel Approaches Keep up with stream data rates Pipeline stages must execute within sample acquisition windows (frame rate) Video, radar scan, sensor suite acquisition frame rate Other sensor data blocks – audio blocks for frequency calculations Number of stages gives fixed delay for results, but at frame rate.

CS 351/ IT 351 Combining Parallel Approaches Pipeline stage to slow? Due to too much data? – make it data parallel Due to too many patterns to check? – make it task parallel Due to too long an algorithm execution? – pipeline that step (increasing overall delay!)