EDAGRID TUTORIAL Dr. Tuan-Anh Nguyen Ho Chi Minh City University of Technology Prof. Pierre Kuonen University of Applied Sciences of Fribourg, Switzerland.

Slides:



Advertisements
Similar presentations
PRAGMA 14 – Taichung March High Performance and Grid Computing Group Faculty of Computer Science and Engineering Ho Chi Minh City University.
Advertisements

Barcelona Supercomputing Center. The BSC-CNS objectives: R&D in Computer Sciences, Life Sciences and Earth Sciences. Supercomputing support to external.
MAP REDUCE PROGRAMMING Dr G Sudha Sadasivam. Map - reduce sort/merge based distributed processing Best for batch- oriented processing Sort/merge is primitive.
Pegasus on the Virtual Grid: A Case Study of Workflow Planning over Captive Resources Yang-Suk Kee, Eun-Kyu Byun, Ewa Deelman, Kran Vahi, Jin-Soo Kim Oracle.
Ns-2 Tutorial Exercise (1) Multimedia Networking Group, The Department of Computer Science, UVA Jianping Wang Adopted from Nicolas’s slides Jianping Wang,
1 Multi-Grid and Multi-VO Job Submission based on a Unified Computational Model Krakow Grid Workshop, November 22nd 2005 Trinity College Dublin Mr. Oliver.
 Prof. Dr. M. H. Assal Introduction to Computer AS 15/10/2014.
Portal for EDAGrid Nguyễn Quang Hùng. Objectives Project goals Review some Portals Review some Grid Portals.
A Grid Resource Broker Supporting Advance Reservations and Benchmark- Based Resource Selection Erik Elmroth and Johan Tordsson Reporter ： S.Y.Chen.
Clusters Part 2 - Hardware Lars Lundberg The slides in this presentation cover Part 2 (Chapters 5-7) in Pfister’s book.
1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of.
Company LOGO Development of Resource/Commander Agents For AgentTeamwork Grid Computing Middleware Funded By Prepared By Enoch Mak Spring 2005.
Copyright © 2009 Pearson Education, Inc. Publishing as Prentice Hall 1 Managing Information Technology 6 th Edition CHAPTER 2 COMPUTER HARDWARE.
Unit 1- Recognizing Computers.  Understand the importance of computers  Define computers & computer systems  Classify different types of computers.
Common Services in a network Server : provide services Type of Services (= type of servers) –file servers –print servers –application servers –domain servers.
DIRAC API DIRAC Project. Overview  DIRAC API  Why APIs are important?  Why advanced users prefer APIs?  How it is done?  What is local mode what.
1 Int System Introduction to Systems and Networking Department Faculty of Computer Science and Engineering Ho Chi Minh City University of Technology.
CprE 288 – Quick intro for compiling C in Linux
Chapter 4.  NT came with a new way to organize hard drives and files, called the NT File System (NTFS). Before NTFS, all versions of Windows used an.
Research Computing with Newton Gerald Ragghianti Newton HPC workshop Sept. 3, 2010.
Grid ASP Portals and the Grid PSE Builder Satoshi Itoh GTRC, AIST 3rd Oct UK & Japan N+N Meeting Takeshi Nishikawa Naotaka Yamamoto Hiroshi Takemiya.
Research Achievements Kenji Kaneda. Agenda Research background and goal Research background and goal Overview of my research achievements Overview of.
A brief overview about Distributed Systems Group A4 Chris Sun Bryan Maden Min Fang.
Information Technology Ms. Rocío Acevedo August 2006.
Grid Data Management A network of computers forming prototype grids currently operate across Britain and the rest of the world, working on the data challenges.
HTCondor and BOINC. › Berkeley Open Infrastructure for Network Computing › Grew out of began in 2002 › Middleware system for volunteer computing.
A Distributed Computing System Based on BOINC September - CHEP 2004 Pedro Andrade António Amorim Jaime Villate.
1. Introduction  The JavaScript Grid Portal is trying to find a way to access Grid through Web browser, while using Web 2.0 technologies  The portal.
University of Southampton Clusters: Changing the Face of Campus Computing Kenji Takeda School of Engineering Sciences Ian Hardy Oz Parchment Southampton.
Principles of Scalable HPC System Design March 6, 2012 Sue Kelly Sandia National Laboratories Abstract: Sandia National.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
A-Level Computing#BristolMet Session Objectives# Must identify some common types of computer system Should describe the meaning of a computer system Could.
Execute Workflow. Home page To execute a workflow navigate to My Workflows Page.
Evaluation of Agent Teamwork High Performance Distributed Computing Middleware. Solomon Lane Agent Teamwork Research Assistant October 2006 – March 2007.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
1 5th AstroGrid-D Meeting, MPE Garching Frank Breiting, AIP November 14, 2006 Status of the Dynamo Use Case as prepared by Michael Braun Frank Breitling.
- Rohan Dhamnaskar. Overview  What is a Supercomputer  Some Concepts  Couple of examples.
ServiceSs, a new programming model for the Cloud Daniele Lezzi, Rosa M. Badia, Jorge Ejarque, Raul Sirvent, Enric Tejedor Grid Computing and Clusters Group.
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
Towards Exascale File I/O Yutaka Ishikawa University of Tokyo, Japan 2009/05/21.
July 11-15, 2005Lecture3: Grid Job Management1 Grid Compute Resources and Job Management.
1 Media Grid Initiative By A/Prof. Bu-Sung Lee, Francis Nanyang Technological University.
Nguyen Tuan Anh. VN-Grid: Goals  Grid middleware (focus of this presentation)  Tuan Anh  Grid applications  Hoai.
Tevfik Kosar Computer Sciences Department University of Wisconsin-Madison Managing and Scheduling Data.
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.
Computing Environment The computing environment rapidly evolving ‑ you need to know not only the methods, but also How and when to apply them, Which computers.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI CloudBroker Platform Tutorial Wibke Sudholt CloudBroker GmbH Technoparkstrasse.
11/15/04PittGrid1 PittGrid: Campus-Wide Computing Environment Hassan Karimi School of Information Sciences Ralph Roskies Pittsburgh Supercomputing Center.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Timeshared Parallel Machines Need resource management Need resource management Shrink and expand individual jobs to available sets of processors Shrink.
Nguyen Tuan Anh Page 1 Grid Computing – Master Course 2007 Grid Computing Dr. Nguyen Tuan Anh Contacts: Tel: (84-8)
COMP381 by M. Hamdi 1 Clusters: Networks of WS/PC.
Matthew Farrellee Computer Sciences Department University of Wisconsin-Madison Condor and Web Services.
1 P-GRADE Portal hands-on Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
Background Computer System Architectures Computer System Software.
Holding slide prior to starting show. Scheduling Parametric Jobs on the Grid Jonathan Giddy
The ‘stuff you can touch’. Evolution of Computer Hardware Abacus counting machines Babbage’s difference engine Hollerith’s tabulating machine ABC computer.
CFI 2004 UW A quick overview with lots of time for Q&A and exploration.
Flynn’s Taxonomy Many attempts have been made to come up with a way to categorize computer architectures. Flynn’s Taxonomy has been the most enduring of.
First proposal for a modification of the GIS schema
Pegasus WMS Extends DAGMan to the grid world
Usecase Dynamo Moderate Requirements:
Grid Computing.
MIK 2.1 DBNS - introduction to WS-PGRADE, 2013
Unit 2 Computer Systems HND in Computing and Systems Development
CLUSTER COMPUTING.
Part 2: Parallel Models (I)
User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.
Frieda meets Pegasus-WMS
Presentation transcript:

EDAGRID TUTORIAL Dr. Tuan-Anh Nguyen Ho Chi Minh City University of Technology Prof. Pierre Kuonen University of Applied Sciences of Fribourg, Switzerland

Overview  First part: EDAGrid middleware How to use EDAGrid middleware to submit jobs How to describe a job flow  Part two: EDAGrid programming Writing a simple Grid program with POP- C++ Executing the program on EDAGrid

Supercomputer PC Supercomputer My laptop Workstation SMP Cluster The Grid environment ?

EDAGrid infrastructure: Objectives  Middleware for computing Grid Execute parallel applications transparently with a QoS of resources  Use case User EDAGrid middleware “Execute my app on 4 processors with at least 500MFlops and 1GB/s network”

Login  User name: acomp2007  Password: guess  Create a subdirectory mkdir cd  Server information: Grid FTP server  gsiftp://serverkstn.cse.hcmut.edu.vn:2811 Your home: /home/acomp2007

Describe jobs  XML based job descriptions Resource characteristics Application characteristics Staging description... A single job description Number of CPUs How many CPU each node Linpack benchmark Network bandwidth... Where are executables Agruments Compatible platforms How to stage in/out data...

Describe a simple job 1 /bin/sleep 10  Edit job.xml:  Submit the job eda_job_submit -w job.xml

Resource requirement  Add resource requirement to the job description 100MFlops but at least 60MFlops is also acceptable Physical memory of at lease 256MB /bin/sleep 10  NetworkBandwidth (MBit/s)  IndividualCPUFree5 (0...1)  IndividualCPUFree10 (0...1)  IndividualCPUFree15 (0...1)  IndividualCPUCount

Stage data in/out  gsiftp://serverkstn.cse.hcmut.edu.vn:2811  Sort data gsiftp://serverkstn.cse.hcmut.edu.vn:2811/PATH_TO_YOUR_FILE file:///${GLOBUS_USER_HOME}/data file:///$ /bin/sort ${GLOBUS_USER_HOME}/data --output=${GLOBUS_USER_HOME}/result file:///${GLOBUS_USER_HOME}/result file:///$ gsiftp://serverkstn.cse.hcmut.edu.vn:2811/PATH_TO_YOUR_OUTPUT...

Describe a multijob workflow... Job 1 Job 2 Job 3

Parallel sort.... split data sort 2 sort 1 mer ge result... Note: - To sort (all platforms): /bin/sort -output= - To merge (all platforms): /bin/sort -merge -output= - To split (only available on YOUR machine): /home/edagrid/demo/splittext

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2024 SlidePlayer.com. Inc. All rights reserved.