Presentation is loading. Please wait.

Presentation is loading. Please wait.

E-science grid facility for Europe and Latin America OurGrid E2GRIS1 Rafael Silva Universidade Federal de Campina.

Published byCrystal Wiggins Modified over 8 years ago

Similar presentations

Presentation on theme: "E-science grid facility for Europe and Latin America OurGrid E2GRIS1 Rafael Silva Universidade Federal de Campina."— Presentation transcript:

1 www.eu-eela.eu E-science grid facility for Europe and Latin America OurGrid http://www.ourgrid.org E2GRIS1 Rafael Silva Universidade Federal de Campina Grande (Brazil) Itacuruça (Brazil), 2-15 November 2008

2 www.eu-eela.eu Overview Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 2 OurGrid Architecture Infrastructure Jobs Installing an OurGrid Site –XMPP Server –Peer –Worker –Broker Running Jobs References

3 www.eu-eela.eu OurGrid OurGrid is an open, free-to-join, cooperative grid in which labs donate their idle computational resources in exchange for accessing other labs’ idle resources when nedeed Applications Bag-of-Tasks (BoT) –However, a single OurGrid task may itself be a parallel tightly- coupled application (written in MPI, for example) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 3

4 www.eu-eela.eu Architecture Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 4

5 www.eu-eela.eu Infrastructure Broker –Client interface for job submission Worker –Executes the jobs submitted Peer –Controls the donating and consuming of the machines Discovery Service –Discover resources on the Grid Network of Favors (NoF) –Resource share incentive –Prevent free riding  Peers that only consumes resources Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 5

6 www.eu-eela.eu Communication Infrastructure Commune –Built on top of XMPP (Extensible Messaging and Presence Protocol). Thus, every communication between OurGrid components are intermediated by a XMPP server. –OpenFire Server (WildFire)  http://www.igniterealtime.org/downloads/index.jsp http://www.igniterealtime.org/downloads/index.jsp Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 6

7 www.eu-eela.eu Jobs Job Description File (JDF) Each job is a set of tasks, where each task can have three parameters: –Init  File list to be transferred to the worker –Remote  Command to be executed in the worker –Final  Retrieve the result of the task Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 7

8 www.eu-eela.eu Jobs (2) Requirements –Actually, the OurGrid only has two types of requirements specification available:  Operating System  Memory Size Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 8 requirements: (os == windows) requirements: (mem == 1024) requirements: (os == windows) requirements: (mem == 1024)

9 www.eu-eela.eu Jobs (3) Types of Storage –$PLAYPEN (temporary storage) –$STORAGE (permanent storage) Other Variables –$PROC  Contain the grid machine chosen to run the task –$JOB  Job unique number –$TASK  Task unique number (within a job) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 9 put store

10 www.eu-eela.eu An example of a JDF file Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 10 job : label : SimpleJob task: init : put Fat.class Fat.class remote : java -cp. Fat 3 261147332 6819792792357414911 output-$JOB.$TASK final : get output-$JOB.$TASK output-$JOB.$TASK task : remote : hostname -f job : label : SimpleJob task: init : put Fat.class Fat.class remote : java -cp. Fat 3 261147332 6819792792357414911 output-$JOB.$TASK final : get output-$JOB.$TASK output-$JOB.$TASK task : remote : hostname -f

11 www.eu-eela.eu Installing an OurGrid Site To install an OurGrid Site, it is only necessary to install the following services: –XMPP Server –Peer –Workers –Broker In addition to these services, the only requirement is Java 1.5 or higher Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 11 Two ways to configure: - text mode - gui mode

12 www.eu-eela.eu Installing the XMPP Server Download the openfire package from: –http://www.igniterealtime.org/downloads/index.jsphttp://www.igniterealtime.org/downloads/index.jsp Extract the tarball and start it – /bin/openfire start Open your browser and type: –http:// :9090 And follow the instructions of the following link: –http://www.ourgrid.org/index.php?option=com_content&view=article&id=52&Ite mid=2&lang=en#Anc_2http://www.ourgrid.org/index.php?option=com_content&view=article&id=52&Ite mid=2&lang=en#Anc_2 Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 12

13 www.eu-eela.eu XMPP Server Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 13

14 www.eu-eela.eu Peer Installation Download the peer package from the OurGrid’s website, uncompress it and start the graphical interface Configuring the peer Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 14 $ unzip peer-.zip $ cd peer- $ sh peer gui $ unzip peer-.zip $ cd peer- $ sh peer gui

15 www.eu-eela.eu Peer Installation (2) Adding Workers Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 15

16 www.eu-eela.eu Peer Installation (3) Site Description File (SDF) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 16 workerdefaults : copyTo : scp $localfile $machine:$remotefile remExec : ssh -x $machine $command copyFrom : scp $machine:$remotefile $localfile worker : OS : linux servername : xmpp.ourgrid.org username : worker-001 worker : OS : windows servername : xmpp.ourgrid.org username : worker-002 workerdefaults : copyTo : scp $localfile $machine:$remotefile remExec : ssh -x $machine $command copyFrom : scp $machine:$remotefile $localfile worker : OS : linux servername : xmpp.ourgrid.org username : worker-001 worker : OS : windows servername : xmpp.ourgrid.org username : worker-002

17 www.eu-eela.eu Peer Installation (4) Adding Brokers Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 17

18 www.eu-eela.eu Worker Installation Download the worker package from the OurGrid’s website, uncompress it and start the graphical interface Then, configure the same variables again: –XMPP User Name –XMPP User Password –XMPP Server Name IMPORTANT! –Put the public key of the peer in the “Worker Configuration” tab. Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 18 $ unzip worker-.zip $ cd worker- $ sh worker gui $ unzip worker-.zip $ cd worker- $ sh worker gui

19 www.eu-eela.eu Broker Installation Download the broker package from the OurGrid’s website, uncompress it and start the graphical interface Then, configure the same variables again: –XMPP User Name –XMPP User Password –XMPP Server Name Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 19 $ unzip broker-.zip $ cd broker- $ sh broker gui $ unzip broker-.zip $ cd broker- $ sh broker gui

20 www.eu-eela.eu Broker Installation (2) Now, it is necessary specify the peers the broker will be able to submit jobs Grid Description File (GDF) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 20 peer: label: 127.0.0.1 username : peer-rafael servername : rs peer: label: 127.0.0.1 username : peer-rafael servername : rs

21 www.eu-eela.eu Running Jobs Demonstration Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 21

22 www.eu-eela.eu References OurGrid web site –http://www.ourgrid.orghttp://www.ourgrid.org XMPP Community –http://www.xmpp.orghttp://www.xmpp.org Openfire –http://www.igniterealtime.org/projects/openfire/index.jsphttp://www.igniterealtime.org/projects/openfire/index.jsp Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 22

23 www.eu-eela.eu Questions… Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 23

Download ppt "E-science grid facility for Europe and Latin America OurGrid E2GRIS1 Rafael Silva Universidade Federal de Campina."

Similar presentations

Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal.

1 Bogotá, EELA-2 1 st Conference, On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal.
MyGrid: A User-Centric Approach for Grid Computing Walfredo Cirne Universidade Federal da Paraíba.

MyGrid: A User-Centric Approach for Grid Computing Walfredo Cirne Universidade Federal da Paraíba.
1 Configuring Internet- related services (April 22, 2015) © Abdou Illia, Spring 2015.

1 Configuring Internet- related services (April 22, 2015) © Abdou Illia, Spring 2015.
FILE TRANSFER PROTOCOL Short for File Transfer Protocol, the protocol for exchanging files over the Internet. FTP works in the same way as HTTP for transferring.

FILE TRANSFER PROTOCOL Short for File Transfer Protocol, the protocol for exchanging files over the Internet. FTP works in the same way as HTTP for transferring.
The OurGrid Project Walfredo Cirne Universidade Federal de Campina Grande.

The OurGrid Project Walfredo Cirne Universidade Federal de Campina Grande.
The OurGrid Project Walfredo Cirne Universidade Federal de Campina Grande.

The OurGrid Project Walfredo Cirne Universidade Federal de Campina Grande.
1 Configuring Web services (Week 15, Monday 4/17/2006) © Abdou Illia, Spring 2006.

1 Configuring Web services (Week 15, Monday 4/17/2006) © Abdou Illia, Spring 2006.
Running Thor over MyGrid Walfredo Cirne Universidade Federal de Campina Grande.

Running Thor over MyGrid Walfredo Cirne Universidade Federal de Campina Grande.
K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.

K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.
Labs of The World, Unite!!! Walfredo Cirne Universidade Federal de Campina Grande.

Labs of The World, Unite!!! Walfredo Cirne Universidade Federal de Campina Grande.
Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.

Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.
2440: 141 Web Site Administration Remote Web Server Access Tools Instructor: Enoch E. Damson.

2440: 141 Web Site Administration Remote Web Server Access Tools Instructor: Enoch E. Damson.
INTRODUCTION TO WEB DATABASE PROGRAMMING

INTRODUCTION TO WEB DATABASE PROGRAMMING
Research Computing with Newton Gerald Ragghianti Newton HPC workshop Sept. 3, 2010.

Research Computing with Newton Gerald Ragghianti Newton HPC workshop Sept. 3, 2010.
Overview of Linux CS3530 Spring 2014 Dr. José M. Garrido Department of Computer Science.

Overview of Linux CS3530 Spring 2014 Dr. José M. Garrido Department of Computer Science.
1 Web Server Administration Chapter 9 Extending the Web Environment.

1 Web Server Administration Chapter 9 Extending the Web Environment.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.

Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
Remote OMNeT++ v2.0 Introduction What is Remote OMNeT++? Remote environment for OMNeT++ Remote simulation execution Remote data storage.

Remote OMNeT++ v2.0 Introduction What is Remote OMNeT++? Remote environment for OMNeT++ Remote simulation execution Remote data storage.
Client Installation StratusLab Tutorial (Orsay, France) 28 November 2012.

Client Installation StratusLab Tutorial (Orsay, France) 28 November 2012.
Connecting OurGrid & GridSAM A Short Overview. Content Goals OurGrid: architecture overview OurGrid: short overview GridSAM: short overview GridSAM: example.

Connecting OurGrid & GridSAM A Short Overview. Content Goals OurGrid: architecture overview OurGrid: short overview GridSAM: short overview GridSAM: example.

Similar presentations

Ads by Google