Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR www.eu-eela.euwww.eu-eela.eu.

Slides:



Advertisements
Similar presentations
EGEE is a project funded by the European Union under contract IST EGEE Tutorial Turin, January Hands on Job Services.
Advertisements

INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
Job Submission The European DataGrid Project Team
EDGI European Desktop Grid Initiative gLite job submission to EDGI EDGI is supported by the FP7 Capacities Programme under contract nr RI
SEE-GRID-SCI User Interface (UI) Installation and Configuration Branimir Ackovic Institute of Physics Serbia The SEE-GRID-SCI.
Steve LloydGridPP13 Durham July 2005 Slide 1 Using the Grid Steve Lloyd Queen Mary, University of London.
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
Special Jobs Claudio Cherubino INFN - Catania. 2 MPI jobs on gLite DAG Job Collection Parametric jobs Outline.
Querétaro (Mexico), E2GRIS – Job Description Language JDL 1.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio COMETA
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Special Jobs Matias Zabaljauregui UNLP.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Luciano Díaz ICN-UNAM Based on Domenico.
Enabling Grids for E-sciencE EGEE-II INFSO-RI BG induction to GRID Computing and EGEE project – Sofia, 2006 Practical: Porting applications.
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals GILDA Tutors INFN Catania ICTP/INFM-Democritos Workshop on Porting Scientific.
Computational grids and grids projects DSS,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
1 HeMoLab - Porting HeMoLab's SolverGP to EELA glite Grid Environment FINAL REPORT Ramon Gomes Costa - Paulo Ziemer.
1 SECG/CAS/eScience-2007 Regional Weather Modeling and Grid Computing at C-DAC Computational Atmospheric Sciences Team, Centre for Development of Advanced.
Enabling Grids for E-sciencE Workload Management System on gLite middleware Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi (Vietnam)
Nadia LAJILI User Interface User Interface 4 Février 2002.
E-science grid facility for Europe and Latin America Marcelo Risk y Juan Francisco García Eijó Laboratorio de Sistemas Complejos Departamento.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) GISELA Additional Services Diego Scardaci
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite job submission Fokke Dijkstra Donald.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Practical: Porting applications to the GILDA grid Slides from Vladimir Dimitrov, IPP-BAS.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives Plovdiv, 2006.
E-science grid facility for Europe and Latin America E2GRIS1 Gustavo Miranda Teixeira Ricardo Silva Campos Laboratório de Fisiologia Computacional.
E-science grid facility for Europe and Latin America Using Secure Storage Service inside the EELA-2 Infrastructure Diego Scardaci INFN (Italy)
E-science grid facility for Europe and Latin America gLite MPI Tutorial for Grid School Daniel Alberto Burbano Sefair, Universidad de Los.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
Satellital Image Clasification with neural networks Step implemented – Final Report Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
INFSO-RI Enabling Grids for E-sciencE Workflow Management in Giuseppe La Rocca INFN – Catania ICTP/INFM-Democritos Workshop on Porting.
E-science grid facility for Europe and Latin America MAVs-Study Biologically Inspired, Super Maneuverable, Flapping Wing Micro-Air-Vehicles.
Chapter 1 Computers, Compilers, & Unix. Overview u Computer hardware u Unix u Computer Languages u Compilers.
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.
High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.
EGEE-0 / LCG-2 middleware Practical.
Tier 3 Status at Panjab V. Bhatnagar, S. Gautam India-CMS Meeting, July 20-21, 2007 BARC, Mumbai Centre of Advanced Study in Physics, Panjab University,
INFSO-RI Enabling Grids for E-sciencE Job Submission Tutorial (material from INFN Catania)
Workload Management System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Tony Calanducci.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Moisés Hernández Duarte UNAM FES Cuautitlán.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals Giuseppe La Rocca INFN – Catania gLite Tutorial at the EGEE User Forum CERN.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMS tricks & tips – further scripting Giuseppe.
User Interface UI TP: UI User Interface installation & configuration.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Presentation of the results khiat abdelhamid
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Advanced Job Riccardo Rotondo
Introduction to Computing Element HsiKai Wang Academia Sinica Grid Computing Center, Taiwan.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio Cometa
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
Advanced Topics: MPI jobs
gLite MPI Job Amina KHEDIMI CERIST
Special jobs with the gLite WMS
Alexandre Duarte CERN Fifth EELA Tutorial Santiago, 06/09-07/09,2006
5. Job Submission Grid Computing.
Special Jobs: MPI Alessandro Costa INAF Catania
login: clermont-ferrandxx password: GridCLExx
Presentation transcript:

Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR Itacuruça – Brazil, november 2 -15, 2008

We discard one of the solutions which referred the application to switch from Windows to Linux through the mono's program; and decided to a second solution which referred to translate the application.net to C language with MPI. Itacuruça – Brazil, november 2 -15, 2008

#include using namespace std; #include "mpi.h" /****************************************************************************** M A I N ******************************************************************************/ int numprocesses, procnum; int main(int nargs, char* argv[]) { NET Net; BOOL Stop; REAL MinTestError; int result=MPI_Init(&nargs, &argv); MPI_ Comm_size(MPI_COMM_WORLD, &numprocesses); // get total number of processes MPI_ Comm_rank(MPI_COMM_WORLD, &procnum); // get process number for this process Itacuruça – Brazil, november 2 -15, 2008 file bf.c

Itacuruça – Brazil, november 2 -15, 2008 –Then we compiler MPI en UI, $ mpiCC –Compiler our application calls bf, $ mpiCC -o bf bf.c –Then create a.jdl Type = “Job”; JobType = “MPICH”; Executable = “bf”; CPUNumber = 10 ; StdOutput = “output”; StdError = “error”; InputSandbox = {“bf”}; OutputSandbox = {“BPN.txt”}; RetryCount = 3;

Itacuruça – Brazil, november 2 -15, 2008 –We compiler bf.c ONLY in the 64 bits machine, do not compiler the machine in 32 bits because do not have installed MPI. BF]$ glite-wms-job-submit -a -o jid bf.jdl Connecting to the service e2gris1.eela.ufrj.br:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success The job has been successfully submitted to the WMProxy Your job identifier is: The job identifier has been saved in the following file: /home/app01/BF/jid

Itacuruça – Brazil, november 2 -15, 2008 BF]$ glite-wms-job-status -i jid *************************************************** ********** BOOKKEEPING INFORMATION: Status info for the Job : e2gris1.eela.ufrj.br:9000/5MXWaTLMghW39DN2_sydXw Current Status: Running Status Reason: Job successfully submitted to Globus Destination: m06-e2gris1.eela.ufrj.br:2119/jobmanager- lcgpbs-e2gris1 Submitted: Fri Nov 7 22:03: BRST *************************************************** **********

Itacuruça – Brazil, november 2 -15, 2008 The job is done, ******************************************************** ***** BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Done (Success) Logged Reason(s): - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: m06-e2gris1.eela.ufrj.br:2119/jobmanager-lcgpbs- e2gris1 Submitted: Wed Nov 5 19:49: BRST ******************************************************** *****

Itacuruça – Brazil, november 2 -15, 2008 The job is done, and we get the outputfiles =============================================== ============ JOB GET OUTPUT OUTCOME Output sandbox files for the job: NP2gRkgamA have been successfully retrieved and stored in the directory: /tmp/jobOutput/app01_776TAA4JvsR-NP2gRkgamA =============================================== =============

Itacuruça – Brazil, november 2 -15, 2008 BF]$ cd /tmp/jobOutput/app01_776TAA4JvsR-NP2gRkgamA/ app01_776TAA4JvsR- NP2gRkgamA]$ ls BPN.txt NMSE is on Training Set and on Test Set NMSE is on Training Set and on Test Set NMSE is on Training Set and on Test Set NMSE is on Training Set and on Test Set.

As the same time, We worked in another application like Mrbayes (bionformatics), We install mrbayes at the UI, and We try to run mrbayes with condor, but it was not possible because there was not condor in the CE, finally We saw how to mrbyes runs with mpi and find out how to put some directives to run in the WN. Itacuruça – Brazil, november 2 -15, 2008

The.jdl Type = "Job"; JobType = "MPICH"; Executable = "mb"; CPUNumber = 10; StdOutput = "output"; StdError = "error"; InputSandbox = {"primates_mbbatch.dat","mrbayes/mb"}; OutputSandbox = {"output","error"}; RetryCount = 3; Arguments = "primates_mbbatch.dat"; Itacuruça – Brazil, november 2 -15, 2008

MRB]$ glite-wms-job-submit -i -o jid mrb.jdl MRB]$ glite-wms-job-status -i jid ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : e2gris1.eela.ufrj.br:9000/uAMFWkt7QjbE2dJmOK1uXw Current Status: Running Status Reason: Job successfully submitted to Globus Destination: m06-e2gris1.eela.ufrj.br:2119/jobmanager-lcgpbs-e2gris1 Submitted: Sat Nov 8 12:21: BRST ************************************************************* Itacuruça – Brazil, november 2 -15, 2008

Itacuruça – Brazil, november 2 -15, 2008 Next Steps Use the Storage Element Development a user interface that can interactive with the final user, more flexible, ex. GENIUS

Thanks! Itacuruça – Brazil, november 2 -15, 2008