Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

Slides:



Advertisements
Similar presentations
Piotr Bała ICM University of Warsaw Grid technology in Europe Zurich 2008.
Advertisements

March 6 th, 2009 OGF 25 Unicore 6 and IPv6 readiness and IPv6 readiness
SOAP.
Security Daniel Mallmann MWSG meeting Amsterdam December 2005.
K. Salah 1 Chapter 31 Security in the Internet. K. Salah 2 Figure 31.5 Position of TLS Transport Layer Security (TLS) was designed to provide security.
A CHAT CLIENT-SERVER MODULE IN JAVA BY MAHTAB M HUSSAIN MAYANK MOHAN ISE 582 FALL 2003 PROJECT.
CS533 - Concepts of Operating Systems 1 Remote Procedure Calls - Alan West.
A Model for Grid User Management Rich Baker Dantong Yu Tomasz Wlodek Brookhaven National Lab.
Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.
Member of the ExperTeam Group Ralf Ratering Pallas GmbH Hermülheimer Straße Brühl, Germany
14 Chapter 14 Databases and The Internet Database Systems: Design, Implementation, and Management 4th Edition Peter Rob & Carlos Coronel.
Client-server interactions in Mobile Applications.
Client/Server Architecture
Client-Server Processing and Distributed Databases
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Course 201 – Administration, Content Inspection and SSL VPN
.NET, and Service Gateways Group members: Andre Tran, Priyanka Gangishetty, Irena Mao, Wileen Chiu.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
Seamless Medical Image Processing on the Grid on the Example of Segmentation and Partition of the Airspaces Andrzej Rutkowski 1, Michał Chlebiej 1, Marcelina.
Databases and the Internet. Lecture Objectives Databases and the Internet Characteristics and Benefits of Internet Server-Side vs. Client-Side Special.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Grid Engine Riccardo Rotondo
Presented by Xiaoyu Qin Virtualized Access Control & Firewall Virtualization.
1 HKU CSIS DB Seminar: HKU CSIS DB Seminar: Web Services Oriented Data Processing and Integration Speaker: Eric Lo.
CSCI 6962: Server-side Design and Programming Web Services.
1 22 August 2001 The Security Architecture of the M&M Mobile Agent Framework P. Marques, N. Santos, L. Silva, J. Silva CISUC, University of Coimbra, Portugal.
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
TRASC Globus Application Launcher VPAC Development Team Sudarshan Ramachandran.
Csi315csi315 Client/Server Models. Client/Server Environment LAN or WAN Server Data Berson, Fig 1.4, p.8 clients network.
The Network Performance Advisor J. W. Ferguson NLANR/DAST & NCSA.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
DORII Joint Research Activities DORII Joint Research Activities Status and Progress 6 th All-Hands-Meeting (AHM) Alexey Cheptsov on.
Open Service Gateway Initiative (OSGi) Reporter : 林學灝 侯承育 1.
Network Security. 2 SECURITY REQUIREMENTS Privacy (Confidentiality) Data only be accessible by authorized parties Authenticity A host or service be able.
Using Encryption with Microsoft SQL Server 2000 Kevin McDonnell Technical Lead SQL Server Support Microsoft Corporation.
Communicating Security Assertions over the GridFTP Control Channel Rajkumar Kettimuthu 1,2, Liu Wantao 3,4, Frank Siebenlist 1,2 and Ian Foster 1,2,3 1.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 14 Database Connectivity and Web Technologies.
Copyright © cs-tutorial.com. Overview Introduction Architecture Implementation Evaluation.
Piotr Bała ICM Warsaw University, Warsaw N. Copernicus University, Toruń CHEMOMENTUM Grid Services Based Environment to Enable Innovative.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße.
PoC Induction 19-April VBrowser (VL-e Toolkit) The single point of access to the grid  Medical use case: functional MRI (fMRI)  VBrowser design  VBrowser.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
S imple O bject A ccess P rotocol Karthikeyan Chandrasekaran & Nandakumar Padmanabhan.
CSIT 220 (Blum)1 Remote Procedure Calls Based on Chapter 38 in Computer Networks and Internets, Comer.
Lightweight construction of rich scientific applications Daniel Harężlak(1), Marek Kasztelnik(1), Maciej Pawlik(1), Bartosz Wilk(1) and Marian Bubak(1,
SOCKS By BITSnBYTES (Bhargavi, Maya, Priya, Rajini and Shruti)
Services Security A. Casajus R. Graciani. 12/12/ Overview DIRAC Security Infrastructure HSGE Transport Authentication Authorization DIRAC Authorization.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
Paul Graham Software Architect, EPCC PCP – The P robes C oordination P rotocol A secure, robust framework.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
WEB SERVER SOFTWARE FEATURE SETS
Web Services An Introduction Copyright © Curt Hill.
REST By: Vishwanath Vineet.
EUFORIA FP7-INFRASTRUCTURES , Grant Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
EGI Technical Forum Amsterdam, 16 September 2010 Sylvain Reynaud.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poland EGEE’08 Conference, Istanbul, 24 Sep.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Google Code Libraries Dima Ionut Daniel. Contents What is Google Code? LDAPBeans Object-ldap-mapping Ldap-ODM Bug4j jOOR Rapa jongo Conclusion Bibliography.
Nguyen Thi Thanh Nha HMCL by Roelof Kemp, Nicholas Palmer, Thilo Kielmann, and Henri Bal MOBICASE 2010, LNICST 2012 Cuckoo: A Computation Offloading Framework.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
Securing Grid Services – OGF19 > Thijs Metsch > securing_grid_services_ogf19.ppt > Slide 1 Application Level Gateway Securing services using.
UNICORE and Argus integration Krzysztof Benedyczak ICM / UNICORE Security PT.
Prepared By : Pina Chhatrala
MCA – 405 Elective –I (A) Java Programming & Technology
Study course: “Computing clusters, grids and clouds” Andrey Y. Shevel
Creating a Distributed System with Remote Procedure Calls and Web Services Ch.5 B.Ramamurthy 2/17/2019 B.Ramamurthy.
NICOS – IBEX Interactions
Presentation transcript:

Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM, Warsaw University, Poland (2)Faculty of Mathematics and Computer Science, N. Copernicus University, Torun, Poland

Unicore middleware  Well known  Very stable  Message based protocol  No streaming at all  Very good security model  Intensive SSL usage  Good firewall passing

Firewall Unicore architecture Client Gateway NJS TSI Single entry point NJS TSI USpace UUDB USpace UUDB SSL

VisIt – a visualization toolkit  Well known protocol for remote visualization and steering  Easy to use  Reversed connection direction – simulation connects to visualization  Service registry and specific protocol – SEAP  Very well developed binary data conversion procedures  No java binding  May use multiple connections for single session

VisIt - architecture Example session:  Simulation starts  Simulation queries SEAP poeriodically  Visualization starts and registers on SEAP server  Simulation gets visualization address from the SEAP  Simulation connects to the Visualization  Data is exchanged Simulation (Visit client) Visualization (Visit server) SEAP server Data (may useMultiple connections)

IVis  Streaming extension for Unicore developed in ICM  Uses Unicore gateway extension feature  Developed as system for access to groving files  Easily extendable  Very good performance  Authorization done separately

IVis architecture Firewall Client Gateway NJS TSI Still single entry point IVis server USpace UUDB IVis Extension

UVisit  Support for running VisIt over Unicore infrastructure  Does not require changes in simulation and visualization  Implements most important parts of the protocol  Require SEAP usage by both simulation & visualization  Implementation using IVis server and Unicore client extension plugins.

UVisit - schema Visit Server (Visualization) Unicore Client UVisit plugin Firewall Gateway NJS TSI IVis server IVis Extension Visit client (simulation) UVisit module SEAP Run job SEAP Data

UVisit – seap split  Seap server has to be split: Client part included into UVisit plugin Server part in the UVisitServer, module of IVis server  Seap data has to be modified (destination address)  Endpoint created on the request  Data on the server valid only as long as the client is connected

UVisit implementacja - tunnel  Single secure (SSL) connection to the gateway used to transfer SEAP and data  Very simple message-based protocol used to separate streams on the endpoints (client&server)  Small overhead  Multiple visualization streams can be run through the single tunnel

UVisit – plugin  Runs at UVisit ‘server’ (visualization) endpoint  Implemented as the Unicore extension plugin  Can connect to multiple sites at once  User can see registered SEAP entries  Only.visitrc setup required

UVisit - setup  Working IVis installation required (gateway and server)  On the user endpoint valid.visitrc pointing to the client host is required  On the server config file must be edited to define server location  On the job server valid.visitrc pointing to the server required  That’s all…

UVisit limitations:  Requires forcing of single connection for control and data  Requires SEAP usage  Problems with multiple users on the same server – Visit security is limited

UVisit demo application  UVisit lacks nice graphic demo  Application created for UVisit, but works with plain visit as well  Simulation of diffusion and advection in the complex velocity field defined by randomly moving vortices  Simple steering included

UVisit demo application  Visualization in java stand-alone application  Minimal proxy in C required (no java binding for Visit!)  Available in UVisit package

Conclusions  UVisit is a successful implementation of streaming in unicore  Does not require changes in the legacy code (or minor changes only)  Good performance  No changes required in unicore

Future development  Currently we are working on mechanism similar to the IVis/UVisit for unigrids environment - UGSF  We develop Web-Service integrated streaming in the new infrastructure

Thank you!