Introduction to Parallel Processing Dr. Guy Tel-Zur Lecture 6.

Slides:



Advertisements
Similar presentations
Grid Wizard Enterprise Basic Tutorial Using Web Control Panel.
Advertisements

Cluster Computing at IQSS Alex Storer, Research Technology Consultant.
Introduction to Parallel Processing Guy Tel-Zur Lecture 8.
1 Concepts of Condor and Condor-G Guy Warner. 2 Harvesting CPU time Teaching labs. + Researchers Often-idle processors!! Analyses constrained by CPU time!
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
1 Using Stork Barcelona, 2006 Condor Project Computer Sciences Department University of Wisconsin-Madison
Condor Project Computer Sciences Department University of Wisconsin-Madison Stork An Introduction Condor Week 2006 Milan.
Computational Physics Lecture 10 Dr. Guy Tel-Zur.
Computational Physics Lecture 4 Dr. Guy Tel-Zur.
Computational Physics Lecture 3 - Admin Dr. Guy Tel-Zur Coral. Picture by Anna Cervova, publicdomainpictures.net.
Computational Physics Dr. Guy Tel-Zur Version :40.
Computational Physics Dr. Guy Tel-Zur Home Assignment Number 2.
Sun Grid Engine Grid Computing Assignment – Fall 2005 James Ruff Senior Department of Mathematics and Computer Science Western Carolina University.
Computational Physics Home Assignment #3 Dr. Guy Tel-Zur.
Computational Physics Dr. Guy Tel-Zur Bench In Valley Gardens by Petr Kratochvil. Version :50.
Computational Physics Dr. Guy Tel-Zur. Agenda Administration MPI – Parallel Mandelbrot set Differential equations – MHJ Chapter 13 + S. Koonin Chapter.
Computational Physics Lecture 2 - administration Dr. Guy Tel-Zur Old rustic barn. Picture by: by Peter Griffin,
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 8 Introduction to Printers in a Windows Server 2008 Network.
1 Chapter Overview Introduction to Windows XP Professional Printing Setting Up Network Printers Connecting to Network Printers Configuring Network Printers.
Recitation 1 Programming for Engineers in Python.
Agenda What is Computer Programming? The Programming Process
Zach Miller Computer Sciences Department University of Wisconsin-Madison What’s New in Condor.
ITIS 2110 Class # No home network devices devices devices devices devices devices devices 9.
Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.
Prof. Heon Y. Yeom Distributed Computing Systems Lab. Seoul National University FT-MPICH : Providing fault tolerance for MPI parallel applications.
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
The Glidein Service Gideon Juve What are glideins? A technique for creating temporary, user- controlled Condor pools using resources from.
Sun Grid Engine. Grids Grids are collections of resources made available to customers. Compute grids make cycles available to customers from an access.
Computer Programming for Biologists Oct 30 th – Dec 11 th, 2014 Karsten Hokamp  Fill out.
Scientific Computing Lecture 5 Dr. Guy Tel-Zur Autumn Colors, by Bobby Mikul, Mikul Autumn Colors, by Bobby Mikul,
Introduction to Parallel Programming with C and MPI at MCSR Part 2 Broadcast/Reduce.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Grid and Cloud Computing Final Projects Dr. Guy Tel-Zur.
Parallel System Lecture #2 דר ' גיא תל - צור. הודעות אין שיעור בתאריך 15/11 בתאריך 22/11 תתקיים מעבדה מספר 1, בחדר 217. נוכחות חובה !
Grid Computing I CONDOR.
17-April-2007 High Performance Computing Basics April 17, 2007 Dr. David J. Haglin.
Grid and Cloud Computing Dr. Guy Tel-Zur. Today’s agenda UNICORE (see a separate presentation) AWS + Python (Boto) – ideas for projects… Hadoop (see a.
Part 6: (Local) Condor A: What is Condor? B: Using (Local) Condor C: Laboratory: Condor.
1 The Roadmap to New Releases Todd Tannenbaum Department of Computer Sciences University of Wisconsin-Madison
Condor Project Computer Sciences Department University of Wisconsin-Madison A Scientist’s Introduction.
Agenda Link of the week Use of Virtual Machine Review week one lab assignment This week’s expected outcomes Review next lab assignments Break Out Problems.
Building a Real Workflow Thursday morning, 9:00 am Greg Thain University of Wisconsin - Madison.
The Roadmap to New Releases Derek Wright Computer Sciences Department University of Wisconsin-Madison
The BioBox Initiative: Bio-ClusterGrid Maddie Wong Technical Marketing Engineer Sun APSTC – Asia Pacific Science & Technology Center.
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
Grid and Cloud Computing Dr. Guy Tel-Zur. /larry-ellison-cloud-computing/ /larry-ellison-cloud-computing/
Cloud Foundry Part II - Tutorial Dr. Guy Tel-Zur.
Week Two Agenda Announcements Link of the week Use of Virtual Machine Review week one lab assignment This week’s expected outcomes Next lab assignments.
מבוא לעיבוד מקבילי – שיעור מס ' 2 דר ' גיא תל - צור.
1 Practical information for the GEMLCA / P-GRADE hands-on Tamas Kiss University of Westminster.
Introduction to Operating Systems Prepared by: Dhason Operating Systems.
Computational Physics Lecture 3 - Admin Dr. Guy Tel-Zur Coral. Picture by Anna Cervova, publicdomainpictures.net.
Open Science Grid Build a Grid Session Siddhartha E.S University of Florida.
Condor Project Computer Sciences Department University of Wisconsin-Madison Condor Job Router.
Condor Project Computer Sciences Department University of Wisconsin-Madison Running Interpreted Jobs.
Scientific Computing Lecture 2 - administration Dr. Guy Tel-Zur Old rustic barn. Picture by: by Peter Griffin,
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
RI EGI-TF 2010, Tutorial Managing an EGEE/EGI Virtual Organisation (VO) with EDGES bridged Desktop Resources Tutorial Robert Lovas, MTA SZTAKI.
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
How to connect your DG to EDGeS? Zoltán Farkas, MTA SZTAKI
Primer for Site Debugging
IST256 : Applications Programming for Information Systems
Parallel computation with R & Python on TACC HPC server
Genre1: Condor Grid: CSECCR
Parallel computation with R & Python on TACC HPC server
Michael P. McCumber Task Force Meeting April 3, 2006
Condor-G Making Condor Grid Enabled
System Administration (LTAT )
PU. Setting up parallel universe in your pool and when (not
Presentation transcript:

Introduction to Parallel Processing Dr. Guy Tel-Zur Lecture 6

Exe #3 The Course Roadmap Introduction Message Passing HTC HPC Shared Memory Condor The Grid (EGEE) Cloud Computing MPIOpenMP Next week Today

Agenda A remark about Collective commands in MPI More MPI Demonstrations Introduction to Condor (next week - lab) – Users perspective – Admin. Perspective – Demo: How to install a Personal Condor A test program Discussion about the Final presentations Home assignment #2

MPI More MPI examples – Dead lock example with collective commands.

פקודות קולקטיביות חייבות להינתן באותו הסדר לכל התהליכים בקומוניקטור // Process A: MPI_Bcast(buf1, count, type, 0, comm); MPI_Bcast(buf2, count, type, 1, comm); break; // Process B (reverse broadcast): MPI_Bcast(buf2, count, type, 1, comm); MPI_Bcast(buf1, count, type, 0, comm); From: “Grid Computing for Developers” book, by VLADIMIR SILVA

Makefile tutorial

Condor Online manual: Next presentation: – 2010 Condor Week – Nick LeRoy presentation: Condor User Tutorial – URL: condor_presentations.html condor_presentations.html

Installing Condor (7.4.2 – current) “Personal” Condor on Windows (Vista) Version Released on April 6, 2010

Cont ’

Click on Install

Cont ’ Give Administrator rights to the installer

Cont ’ restart

The Condor service should be started If needed restart the service here

At least the five Condor daemons should be running

Condor config

Condor config_local You will find both configuration files under the install dir c:\condor

condor_status Good! So now we have a Personal Condor running on my laptop

Demo: cpu_burn.c #include int main() { int iMAX = 60000; int i,j; float fNORM, fMAX; float x,y; fMAX = iMAX; // convert to float fNORM = fMAX * fMAX; for (j=0;j<iMAX;j++) for (i=0;i<iMAX;i++) { y = i; // convert to float x = y*y/fNORM; } return 0; }

Submit file: universe = vanilla executable = cpu_burn.exe Error = err.$(Cluster).$(Process) Output = out.$(Cluster).$(Process) Log = log.$(Cluster).$(Process) Queue 5

Watch the Task Manager

Check the logfile 000 ( ) 04/26 10:23:10 Job submitted from host: ( ) 04/26 10:23:19 Job executing on host: ( ) 04/26 10:24:20 Job terminated. (1) Normal termination (return value 0) Usr 0 00:00:27, Sys 0 00:00:00 - Run Remote Usage Usr 0 00:00:00, Sys 0 00:00:00 - Run Local Usage Usr 0 00:00:27, Sys 0 00:00:00 - Total Remote Usage Usr 0 00:00:00, Sys 0 00:00:00 - Total Local Usage 0 - Run Bytes Sent By Job Run Bytes Received By Job 0 - Total Bytes Sent By Job Total Bytes Received By Job...

Condor daemons while executing cpu_burn

Same job at the vdwarf Show demo under: /users/agnon/misc/tel-zur/condor/cpuburn

Condor and Matlab/Octave demo

The submit file

The wrapper file

Final Presentations עבור למצגת הרצאות גמר כל קבוצת תלמידים מתבקשת לבחור נושא להרצאת גמר ואז לפעול כדלקמן : –לשלוח אלי ל - את הדברים הבאים נושא ההרצאה ( כותרת ) מספר הקבוצה (PP-xx) שמות חברי הקבוצה –אני אשיב לקבוצה באם הנושא אושר או לא ! בטרם תקבלו אישור ממני, אין להתחיל לעבוד על ההצעה שהגשתם !

זהו להפעם שבוע הבא, 21.8, תירגול CONDOR במעבדה 310 בבניין 34 18:00-21:00 נוכחות חובה