- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

Slides:



Advertisements
Similar presentations
Piotr Bała ICM University of Warsaw Grid technology in Europe Zurich 2008.
Advertisements

GPE4UNICORE Grid Programming Environment for UNICORE
March 6 th, 2009 OGF 25 Unicore 6 and IPv6 readiness and IPv6 readiness
Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
CSF4, SGE and Gfarm Integration Zhaohui Ding Jilin University.
Security Daniel Mallmann MWSG meeting Amsterdam December 2005.
Grid Computing at Intel c urrent Status and Outlook Ralf Ratering Senior Software Engineer Intel Parallel and Distributed Solutions Division (PDSD)
Member of the ExperTeam Group Ralf Ratering Pallas GmbH Hermülheimer Straße Brühl, Germany
This product includes material developed by the Globus Project ( Introduction to Grid Services and GT3.
Seminar Grid Computing ‘05 Hui Li Sep 19, Overview Brief Introduction Presentations Projects Remarks.
Distributed Heterogeneous Data Warehouse For Grid Analysis
Universität Dortmund Robotics Research Institute Information Technology Section Grid Metaschedulers An Overview and Up-to-date Solutions Christian.
Grid Programming Environment (GPE) Grid Summer School, July 28, 2004 Ralf Ratering Intel - Parallel and Distributed Solutions Division (PDSD)
Ch 12 Distributed Systems Architectures
Member of the ExperTeam Group Ralf Ratering Pallas GmbH Hermülheimer Straße Brühl, Germany
GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/ /09/2006.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4
1 AHE Server Deployment and Hosting Applications Stefan Zasada University College London.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Job Submission Condor, Globus, Java CoG Kit Young Suk Moon.
23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29
TRASC Globus Application Launcher VPAC Development Team Sudarshan Ramachandran.
COMP3019 Coursework: Introduction to GridSAM Steve Crouch School of Electronics and Computer Science.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
London e-Science Centre GridSAM Job Submission and Monitoring Web Service William Lee, Stephen McGough.
10/25/20151 Single Sign-On Web Service Supervisors: Viktor Kulikov Alexander Sherman Liana Lipstov Pavel Bilenko.
Shannon Hastings Multiscale Computing Laboratory Department of Biomedical Informatics.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
The Globus Toolkit 4 (GT4) A brief introduction. Web Services, WSRF, OGSA and GT4.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
EGEE-Forum – May 11, 2007 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks A gateway platform for Grid Nicolas.
Migrating Desktop Marcin Płóciennik Marcin Płóciennik Kick-off Meeting, Santander, Graphical.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
Piotr Bała ICM Warsaw University, Warsaw N. Copernicus University, Toruń CHEMOMENTUM Grid Services Based Environment to Enable Innovative.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
1October 9, 2001 Sun in Scientific & Engineering Computing Grid Computing with Sun Wolfgang Gentzsch Director Grid Computing Cracow Grid Workshop, November.
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
WALSAIP Portal Automated Composition of Signal Processing Operators Mariana Mendoza Botero.
VO. VOMS 1. Authentication2. Credentials 3. Authentication Client Resource.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
1 Service Creation, Advertisement and Discovery Including caCORE SDK and ISO21090 William Stephens Operations Manager caGrid Knowledge Center February.
Ad Hoc VO Akylbek Zhumabayev Images. Node Discovery vs. Registration VO Node Resource User discover register Resource.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.
Grid portals Gergely Sipos
Modern Programming Language. Web Container & Web Applications Web applications are server side applications The most essential requirement.
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
Tool Integration with Data and Computation Grid “Grid Wizard 2”
National Energy Research Scientific Computing Center (NERSC) Visportal : interface to grid enabled NERC resources Cristina Siegerist NERSC Center Division,
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
EGI Technical Forum Amsterdam, 16 September 2010 Sylvain Reynaud.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite – UNICORE interoperability Daniel Mallmann.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
OGSA-DAI.
GGF10 DRMAA Working Group Hrabri Rajic Intel GGF10 Berlin, Germany March, 2004 GLOBALGRIDFORUM.ORG.
Data Bridge Solving diverse data access in scientific applications
WEB SERVICES.
Unit – 5 JAVA Web Services
Some Basics of Globus Web Services
Grid Portal Services IeSE (the Integrated e-Science Environment)
Standard Portlet Architecture Supports Reusable Components
Development of Information Grid
Presentation transcript:

- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 2 - OGSA enabled Server Components Web Services WS Resource Framework WSRF Open Grid Service Architecture OGSA Applications Grid Programming Language Bringing applications to the Grid... Visual Grid SDK GridBeans Client Framework The next step: Grid Programming Environment (GPE) GPE High Level Grid API Java reference implementation Language independent definition

- 3 - Use Case: Expert User Application Grid Service User Keystore Grid Client Run multiple applications in complex workflows Get all information from the Grid Application GS Broker GS Information GS Application GS Database GS WSRF Fully-fledged Java Application

- 4 - Use Case: Application User Application Grid Service User Certificate Application Client WSRF Only one application Get only application specific information Run lightweight client on mobile devices Lightweight Java Application

- 5 - Use Case: Unaware User What is a "Grid"? Service provider offers a service on the web Server Server Certificate Service Provider User Web Browser User DB Authenticate using server certificate Request/ Response JSP Application Grid Service WSRF Presentation oriented user interface Register

- 6 - Web Client Application Client Grid Client The Grid Developer Grid SDK GridBean = Grid Service + Client Plug-in Wrap existing applications Write new Grid applications Plug-in for Eclipse Application GS Broker GS Database GS Information GS Application GS Deploy WSRF G-API Application Plug-in Deploy

- 7 - Grid Service Backends GPE will provide Grid services to wrap different server types Application GS UNICORE GS Globus GS DRMAA GS Globus Job Manager UNICORE Network Job Supervisor Condor WSRF Sun Grid Engine Native Protocols

- 8 - GPE: The big picture… Application Client GridBean User Certificate Mobile Device Web Client Web Browser JSP User Workstation Expert Client Plugins GridBeans Keystore Service Provider Application Portal Service Certificate GridBean Application GS Broker GS Information GS Application GS Database GS WSRF Developer Workstation Grid SDK Deploy Plug-Ins Deploy GS DRMAA UNICORE Globus G-API

- 9 - GPE Step 1: Writing a UNICORE handler for Globus CoG AJO Builder Components and SecurityContext added Functionality: Task Execution and File Transfers UNICORE GT2 SSH GT3 Globus CoG

GPE Step 2: Integrating UNICORE with Karajan Karajan-XML job description Workflow managed in Karajan Engine –Treat UNICORE jobs as Karajan tasks! UNICORE Karajan Engine Karajan XML Job Description GT2/3/4 SSH Globus CoG

GPE Current Status: Proof of concept implementation UNICORE Application Client GT2/3/4 SSH Expert Client GridBean mySQL Database Globus CoG Job Management Web Service Karajan Engine Spool Directory Karajan XML Job Description Database keeps track of jobs and files Files are spooled at web service Service and two clients implemented

Some Problems…  Karajan is too simple –no resource descriptions, etc. Extend Karajan to match our requirements –Close cooperation with Globus CoG team –Cooperate with GGF SAGA-WG (JSDL-WG?)  UNICORE security model too strict Use Globus style proxy certificates