Introduction to Parallel Processing Guy Tel-Zur Lecture 8.

Slides:



Advertisements
Similar presentations
CSE 160 – Lecture 9 Speed-up, Amdahl’s Law, Gustafson’s Law, efficiency, basic performance metrics.
Advertisements

Lecturer: Simon Winberg Lecture 18 Amdahl’s Law & YODA Blog & Design Review.
Computational Physics Lecture 10 Dr. Guy Tel-Zur.
Computer Architecture Wed: 14:00-14:00, 14/34 Instructor: Jihad El-Sana Office:111, Building:37 Tel:
Reference: Message Passing Fundamentals.
Computational Physics Lecture 3 - Admin Dr. Guy Tel-Zur Coral. Picture by Anna Cervova, publicdomainpictures.net.
Computational Physics Dr. Guy Tel-Zur Version :40.
Computational Physics Dr. Guy Tel-Zur Home Assignment Number 2.
Kapi’olani Community College Art 128 Interface Programming 1 In-class Presentation Week 13B.
Parallel & Distributed Computing Fall 2004 Comments About Final.
Computational Physics Home Assignment #3 Dr. Guy Tel-Zur.
CS 584 Lecture 11 l Assignment? l Paper Schedule –10 Students –5 Days –Look at the schedule and me your preference. Quickly.
Computational Physics Lecture 2 - administration Dr. Guy Tel-Zur Old rustic barn. Picture by: by Peter Griffin,
Introduction to Scientific Computing on Linux Clusters Doug Sondak Linux Clusters and Tiled Display Walls July 30 – August 1, 2002.
Computational Physics Dr. Guy Tel-Zur Lecture 7 mohan pmohan p, Forest,
Lecture 37: Chapter 7: Multiprocessors Today’s topic –Introduction to multiprocessors –Parallelism in software –Memory organization –Cache coherence 1.
Dr. Guy Tel-Zur (*)=and clones + various tools
CS 470/570:Introduction to Parallel and Distributed Computing.
Jawwad A Shamsi Nouman Durrani Nadeem Kafi Systems Research Laboratories, FAST National University of Computer and Emerging Sciences, Karachi Novelties.
Scientific Computing Lecture 6 Dr. Guy Tel-Zur Butterfly in Africa by Anna Cervova,
Data Structures and Programming.  Today:  Administrivia  Introduction to 225, Stacks  Course website: 
Integrating Parallel and Distributed Computing Topics into an Undergraduate CS Curriculum Andrew Danner & Tia Newhall Swarthmore College Third NSF/TCPP.
Scientific Computing Topics for Final Projects Dr. Guy Tel-Zur Version 2,
Scientific Computing Lecture 5 Dr. Guy Tel-Zur Autumn Colors, by Bobby Mikul, Mikul Autumn Colors, by Bobby Mikul,
04/30/13 Last class: summary, goggles, ices Discrete Structures (CS 173) Derek Hoiem, University of Illinois 1 Image: wordpress.com/2011/11/22/lig.
Parallel System Lecture #2 דר ' גיא תל - צור. הודעות אין שיעור בתאריך 15/11 בתאריך 22/11 תתקיים מעבדה מספר 1, בחדר 217. נוכחות חובה !
Edgar Gabriel Short Course: Advanced programming with MPI Edgar Gabriel Spring 2007.
General Purpose Computing on Graphics Processing Units: Optimization Strategy Henry Au Space and Naval Warfare Center Pacific 09/12/12.
ITCS 6/8010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Jan 3, 2011outline.1 ITCS 6010/8010 Topics in Computer Science: GPU Programming for High Performance.
Course Wrap-Up Miodrag Bolic CEG4136. What was covered Interconnection network topologies and performance Shared-memory architectures Message passing.
Message Passing Computing 1 iCSC2015,Helvi Hartmann, FIAS Message Passing Computing Lecture 1 High Performance Computing Helvi Hartmann FIAS Inverted CERN.
Definitions Speed-up Efficiency Cost Diameter Dilation Deadlock Embedding Scalability Big Oh notation Latency Hiding Termination problem Bernstein’s conditions.
Lecturer: Simon Winberg Lecture 18 Amdahl’s Law (+- 25 min)
Rethinking Computer Architecture Wen-mei Hwu University of Illinois, Urbana-Champaign Celebrating September 19, 2014.
CompSci 4 Introduction to Programming Animation and Virtual Worlds Prof. Susan Rodger.
Parallel Systems Lecture 9 Guy Tel-Zur. Today’s agenda Final Presentations status OpenMP continue with SC99 tutorial (from slide 58). SC12 Sorting Algorithms.
CSC 7600 Lecture 28 : Final Exam Review Spring 2010 HIGH PERFORMANCE COMPUTING: MODELS, METHODS, & MEANS FINAL EXAM REVIEW Daniel Kogler, Chirag Dekate.
Early Adopter: Integration of Parallel Topics into the Undergraduate CS Curriculum at Calvin College Joel C. Adams Chair, Department of Computer Science.
Introduction to Parallel Processing Dr. Guy Tel-Zur Lecture 6.
Strategies for Developing Visualizations of Parallel Algorithms for Dense Matrix Operations on Interconnected SIMD Computers by : Justin C. Miller 1/12.
1Thu D. NguyenCS 545: Distributed Systems CS 545: Distributed Systems Spring 2002 Communication Medium Thu D. Nguyen
| nectar.org.au NECTAR TRAINING Module 4 From PC To Cloud or HPC.
Advanced Computer Networks Lecture 1 - Parallelization 1.
Parallel Systems Lecture 10 Dr. Guy Tel-Zur. Administration Home assignments status Final presentation status – Open Excel file ps2013a.xlsx Allinea DDT.
מבוא לעיבוד מקבילי – שיעור מס ' 2 דר ' גיא תל - צור.
Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments.
Computational Physics Lecture 3 - Admin Dr. Guy Tel-Zur Coral. Picture by Anna Cervova, publicdomainpictures.net.
CSci6702 Parallel Computing Andrew Rau-Chaplin
Data Structures and Algorithms in Java AlaaEddin 2012.
Scaling Conway’s Game of Life. Why do parallelism? Speedup – solve a problem faster. Accuracy – solve a problem better. Scaling – solve a bigger problem.
In The Name of God. Parallel processing Course Evaluation  Final Exam is closed book( 14 Scores)  Research and Presentation, Quizzes (5 Scores)  No.
Scientific Computing Lecture 2 - administration Dr. Guy Tel-Zur Old rustic barn. Picture by: by Peter Griffin,
Recursion Chapter 16 S. Dandamudi To be used with S. Dandamudi, “Introduction to Assembly Language Programming,” Second Edition, Springer, 2005.
Parallel Systems Guy Tel-Zur Lecture 8. Agenda Parallel Programming in Shared Memory - 1. Introduction 2. OpenMP SC12 presentation Students’ Presentations.
Processor Level Parallelism 2. How We Got Here Developments in PC CPUs.
Scientific Computing Dr. Guy Tel-Zur Lecture 7 mohan pmohan p, Forest,
First INFN International School on Architectures, tools and methodologies for developing efficient large scale scientific computing applications Ce.U.B.
IST256 : Applications Programming for Information Systems
Introduction to Parallel Computing: MPI, OpenMP and Hybrid Programming
Topic: Introduction to Computing Science and Programming + Algorithm
Constructing a system with multiple computers or processors
Introduction to Parallelism.
GSP 315 Education for Service/tutorialrank.com
Three major projects: There will be a midterm covering the material presented during the first half of the semester a final covering the material presented.
Visual Studio Cloud-based Load Testing Performance Testing Made Easy
Constructing a system with multiple computers or processors
Constructing a system with multiple computers or processors
No. Date Agenda 1 09/14/2012  Course Organization; [slides]  Lecture 1 - What is Cloud Computing [slides] 2 09/21/2012  Lecture 2 - The Art of Concurrency.
Grid and Cloud Computing Lecture 8
HCI/ComS 575X: Computational Perception
Presentation transcript:

Introduction to Parallel Processing Guy Tel-Zur Lecture 8

The Course Roadmap Introduction Message Passing HTC HPC Shared Memory Condor Cloud Computing MPIOpenMP Today Next week

Agenda Parallel Programming in Shared Memory - 1. Introduction 2. OpenMP GPU Computing Cloud Computing Home Assignment #3

Condor Demos On my PC: C:\Users\telzur\Documents\BGU\Teaching\ParallelProcessi ng\PP2012B\Lectures\06\condor_demo_2010 On the Linux vdwarf – Condor + Octave /users/agnon/misc/tel-zur/condor/octave On the Linux vdwarf – Condor + Matlab /users/agnon/misc/tel-zur/condor/matlab/example_legendre

0utput of the Matlab+Condor demo

Latency Factors in Data Center Reference: Intel's 10 Gigabit Ethernet boost pushes out InfinibandIntel's 10 Gigabit Ethernet boost pushes out Infiniband

Comments about the final presentations Pay attention to: 1.Parallel Computing aspects. For example: speedup, efficiency, scalability, computation to communication ratio, how close your program to Amdahl’s law prediction?, run time vs. problem size. 2.See more instructions in Lecture #1 slides 3.Please hurry! The time is running fast now….

More on the final presentations More topics – Sorting algorithms – Matlab over Condor – OpenMP projects, e.g. quicksort in OpenMP – Parallel Matlab

OpenMP OpenMP from Wikipedia מומלץ להסתכל בסימוכין הנוספים באתר הויקיפדיה !

Turn to SC99 tutorial Pages: 1-64, 109, , , 143

תרגיל בית מאתגר של אביתר Lecture 8: gtest.c

Q&A שלום גיא. לא ברור לי למה אבל המחשב נתקע לי בכל פעם שאני מריץ איתחול על מטריצה, ממימד 100*100 ומעלה. האם זה סביר ? יש פתרון לכך ? Open DevC++ demos: m_size.c and m_size2.c

Game of Life A clip by Gadi Lahav

More references OpenMP in Visual C++ Quick Reference Card: Download it and keep it under your pillow