Grid Wizard Enterprise Advanced Tutorial. General Considerations This tutorial assumes that you already completed the Basic Features tutorial: You already.

Slides:



Advertisements
Similar presentations
EPrints Web Configuratio n Management. SQL database Web server Scripts to configure repository activities Configuration files EPrints - the Administrator's.
Advertisements

Grid Wizard Enterprise GSlicer3 Tutorial. Introduction This tutorial assumes you already completed the basic and advanced tutorial. GSlicer3 is a Slicer3.
Grid Wizard Enterprise Basic Tutorial. Steps Overview.
Grid Wizard Enterprise Basic Tutorial Using Web Control Panel.
17 Copyright © 2005, Oracle. All rights reserved. Deploying Applications by Using Java Web Start.
WEB AND WIRELESS AUTOMATION connecting people and processes InduSoft Web Solution Welcome.
Topic - DATA PROVIDERS TRAINING COURSE DEPLOYMENT PROCESS MINCyT, Buenos Aires, Argentina, 7 – 11 October 2013.
Chapter 20 Oracle Secure Backup.
1 Automated SFTP Windows and SUN Linux and SUN. 2 Vocabulary  Client = local=the machine generating the SFTP request  Server = remote = the machine.
Hyrax Installation and Customization ESIP ‘08 Summer Meeting Best Practices in Services and Data Interoperability Dan Holloway James Gallagher.
Presentation Heading – font Arial
4 Copyright © 2006, Oracle. All rights reserved. Deploying the Oracle Management Agent.
Web Application Server Apache Tomcat Downloading and Deployment Guide.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 10: Server Administration.
Guide To UNIX Using Linux Third Edition
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 8 Introduction to Printers in a Windows Server 2008 Network.
Linux+ Guide to Linux Certification, Second Edition
NETOP ONDEMAND What’s new in version 2.1? DECEMBER 09 NETOP ONDEMAND1.
©2012 Microsoft Corporation. All rights reserved..
Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.
Amazon EC2 Quick Start adapted from EC2_GetStarted.html.
Guide to MCSE , Enhanced 1 Activity 10-1: Restarting Windows Server 2003 Objective: to restart Windows Server 2003 Start  Shut Down  Restart Configure.
Using Opal to deploy a real scientific application as a Web service Sriram Krishnan
DB2 (Express C Edition) Installation and Using a Database
Eucalyptus Virtual Machines Running Maven, Tomcat, and Mysql.
Advanced Shell Programming. 2 Objectives Use techniques to ensure a script is employing the correct shell Set the default shell Configure Bash login and.
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik University of Manchester materials by Dr Katy Wolstencroft and Dr Aleksandra.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
LATTICE TECHNOLOGY, INC. For Version 10.0 and later XVL Web Master Advanced Tutorial For Version 10.0 and later.
Client Installation StratusLab Tutorial (Orsay, France) 28 November 2012.
Java Server Pages A JSP page is a text-based document that contains two types of text: static template data, which can be expressed in any text-based format,
|Tecnologie Web L-A Anno Accademico Laboratorio di Tecnologie Web Introduzione ad Eclipse e Tomcat
June 6 th – 8 th 2005 Deployment Tool Set Synergy 2005.
The In’s and Out’s of the IIS 6.0 Migration Tool The In’s and Out’s of the IIS 6.0 Migration Tool Chris Adams Web Platform Supportability Lead Microsoft.
LLRP GUI Client User Guide
CHAPTER 3 - INPUT DEFINITION
Tomcat Setup BCIS 3680 Enterprise Programming. Getting Web Apps to Work  Verify that Tomcat works.  Understand how context works.  Create folders/files.
Using OUI to install Oracle9i Release 2 on an OpenVMS System.
Image Management and Rain on FutureGrid: A practical Example Presented by Javier Diaz, Fugang Wang, Gregor von Laszewski.
Oracle 10g Database Administrator: Implementation and Administration Chapter 2 Tools and Architecture.
Bookkeeping Tutorial. Bookkeeping & Monitoring Tutorial2 Bookkeeping content  Contains records of all “jobs” and all “files” that are created by production.
Technical Workshops | Esri International User Conference San Diego, California Creating Geoprocessing Services Kevin Hibma, Scott Murray July 25, 2012.
Application portlets within the PROGRESS HPC Portal Michał Kosiedowski
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik materials by: Katy Wolstencroft University of Manchester.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
APST Internals Sathish Vadhiyar. apstd daemon should be started on the local resource Opens a port to listen for apst client requests Runs on the host.
CSE 548 Advanced Computer Network Security Trust in MobiCloud using Hadoop Framework Updates Sayan Cole Jaya Chakladar Group No: 1.
] COREY PEARSON [ ASUG INSTALLATION MEMBER MEMBER SINCE: 2008 CHAVONE JACOBS [ ASUG INSTALLATION MEMBER MEMBER SINCE: 2003 ALLAN FISHER [ ASUG INSTALLATION.
What is MySQL? MySQL is a relational database management system (RDBMS) based on SQL (Structured Query Language). First released in January, Many.
CSE 548 Advanced Computer Network Security Trust in MobiCloud using Hadoop Framework Updates Sayan Kole Jaya Chakladar Group No: 1.
WMarket For Adminstrators Install with Docker or the Automatic Script.
Sem 2v2 Chapter 5 Router Startup and Setup. A router initializes by loading the bootstrap, the operating system, and a configuration file. If the router.
Application Web Service Toolkit Allow users to quickly add new applications GGF5 Edinburgh Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University.
Tomcat Setup BCIS 3680 Enterprise Programming. One-Click Tomcat Setup 2  This semester we’ll try to set up Tomcat with a PowerShell script.  Preparation.
Splunk Enterprise Instructor: Summer Partain 3 Day Course.
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
Remote Api Tutorial How to call WS-PGRADE workflows from remote clients through the http protocol?
0 Copyright 2012 FUJITSU Interstage BOP SQL Query Tutorial Todd Palmer October 2012.
Libvirt management Andrea Chierici Virtualization tutorial Catania 1-3 dicember 2010.
CACI Proprietary Information | Date 1 PD² SR13 Client Upgrade Name: Semarria Rosemond Title: Systems Analyst, Lead Date: December 8, 2011.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS
GWE Core Grid Wizard Enterprise (
StratusLab Tutorial (Bordeaux, France)
Router Startup and Setup
Remote Api Tutorial How to call WS-PGRADE workflows from remote clients through the http protocol?
CONTENT MANAGEMENT SYSTEM CSIR-NISCAIR, New Delhi
CCA Skill Certification
Download dumps - Microsoft Real Exam Questions Dumps4download
Crawling with Heritrix
Router Startup and Setup
Presentation transcript:

Grid Wizard Enterprise Advanced Tutorial

General Considerations This tutorial assumes that you already completed the Basic Features tutorial: You already installed GWE in your machine. GWE Daemon has been already auto-deployed and it is running in the local machine (local cluster). You are familiar with GWE Terminal usage. If you have the GWE Terminal client application running, you must exit it before proceeding (input command exit). The detailed configuration guide can be found at:

Configuration: Grid Descriptor This configuration file provides GWE with the description of each of the GWE daemons GWE can access (and install if required). For each GWE daemon to access, a cluster entry must be found. Additionally, each cluster entry accepts a list of default P2EL variables. Each of these variables which will be brought into the scope of any P2EL statement queued into the particular daemon. Edit your $GWE_HOME/conf/gwe-grid.xml to look like this: Replace the SLICER_LOCATION placeholder for the real path where Slicer is installed on your local system.

Configuration: Key Store This configuration file provides GWE with the authentication information that will allow it to access SECURED networked resources, such as remote host where to install GWE daemons and secured file systems to download/upload files. Edit your $GWE_HOME/conf/gwe-auth.xml to look like this: Replace the placeholders (values between brackets) with your particular authentication information when accessing the BIRN cluster.

Study Case Slicers BSpline Deformable Registration of Online Brain Scans (OASIS Database)

Study Case: Creating Orders P2EL Statement Our target is to read a set of brain scans from the online OASIS database, extract their contents, process each one of them with Slicers Bspline Deformable Registration using different parameters (parameter exploration) and upload the generated output files to a specific directory in the remote host. The P2EL statement to express this will look like this: ${URI}= brains.org/app/action/DownloadImages/template/ClosePage.vm?download_type=zip&searc h_element=xnat%3AmrSessionData&search_field=xnat%3AmrSessionData.ID&scanmpr1=true& scanmpr2=true&scanmpr3=true&scanmpr4=true&search_value= ${FIX_NAME}=OAS1_0101_MR1 ${FIX}=$in(${URI}${FIX_NAME},${FIX_NAME}.zip,Y) ${MOV_NAME}=OAS1_00${MOV_NUM}_MR1 ${MOV_NUM}=$range(1,51,10) ${MOV}=$in(${URI}${MOV_NAME},${MOV_NAME}.zip,Y) ${SCAN}=$range(1,4) ${OUT}=sftp://birn-cluster0.nbirn.net/${SYSTEM.USER_HOME}/oasis/out-${SYSTEM.JOB_NUM}. ${OUT_HDR}=$out(${OUT}hdr) ${OUT_IMG}=$out(${OUT}img) ${ITER}=$const(10,20) ${HIST}=$range(20,100,060) ${SAM}=$range(500,5000,3000) ${SLICER_HOME}/Slicer3 –launch ${SLICER_HOME}/lib/Slicer3/Plugins/BSplineDeformableRegistration --iterations ${ITER} --gridSize 5 --histogrambins ${HIST} --spatialsamples ${SAM} -- maximumDeformation 1 --default 0 --resampledmovingfilename ${OUT_HDR} ${FIX}-contents/${FIX_NAME}/RAW/${FIX_NAME}_mpr-${SCAN}_anon.hdr ${MOV}-contents/${MOV_NAME}/RAW/${MOV_NAME}_mpr-${SCAN}_anon.hdr Iteration Variables Process Invocation Template

Study Case: Local Cluster Execution Launch GWE terminal application (gwe-terminal.sh). By default it will connect to the first daemon described in the gwe-grid.xml configuration file; which is the local one according to the configuration we are using. Queue the P2EL statement just created using the queue-order command. Gather the images (resulting of GWE processing these jobs in your local machine) by SSH-ing into the remote host birn-cluster0.nbirn.net and inspecting the path: ${SYSTEM.USER_HOME}/oasis/out-${SYSTEM.JOB_NUM}.

Study Case: BIRN Cluster Execution Launch GWE terminal application by invoking the gwe-terminal.sh as follows: The additional argument instructs the GWE terminal application to connects to your GWE daemon running at the BIRN cluster (previously installing if necessary). Queue the P2EL statement just created using the queue-order command. Gather the images (resulting of GWE processing these jobs in your local machine) by SSH-ing into the remote host birn-cluster0.nbirn.net and inspecting the path: IMPORTANT: You need to shutdown any local GWE daemon running if you intend to connect to any remote one. This is a alpha restriction only! gwe-terminal.sh –conf=BIRN ${SYSTEM.USER_HOME}/oasis/out-${SYSTEM.JOB_NUM}.

Study Case: P2EL Statement Analysis This is the same P2EL statement used in the Study Case 2 of the Basic Tutorial with 2 minor differences: The ${SLICER_HOME} variable is no longer explicitly defined (although still referenced in the process invocation template). This variable will be automatically injected by the GWE daemon into the statement with the value previously configured in the gwe-grid.xml file The out variable has been redefined to a remote file system location, specifically the birn-cluster0.nbirn.net file system, to truly test the uploading capabilites (in the Basic Tutorial we just saved the file in a different location on the same local file system: … ${OUT}=sftp://birn-cluster0.nbirn.net/${SYSTEM.USER_HOME}/oasis/out-${SYSTEM.JOB_NUM}. …