14, Chicago, IL, 2005 Science Gateways to DEISA Motivation, user requirements, and prototype example Thomas Soddemann, RZG, Germany.

Slides:



Advertisements
Similar presentations
W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.
Advertisements

ETSI Grid Starter Group BT Perspective on Grid and Standardisation Mike Fisher BT Group 24 May 2006.
Forschungszentrum Jülich in der Helmholtz-Gesellschaft December 2006 A European Grid Middleware Achim Streit
1 From Grids to Service-Oriented Knowledge Utilities research challenges Thierry Priol.
Overview of local security issues in Campus Grid environments Bruce Beckles University of Cambridge Computing Service.
1 Ideas About the Future of HPC in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views of.
Towards a Virtual European Supercomputing Infrastructure Vision & issues Sanzio Bassini
E-Infrastructures A key component for the European Industry and Services Christian SAGUEZ e-Infrastructures-Roma-Dec 9th-03.
Computational Steering on the GRID Using a 3D model to Interact with a Large Scale Distributed Simulation in Real-Time Michael.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Lisbon, August A. Streit DEISA Forschungszentrum Jülich in der Helmholtz-Gesellschaft Achim Streit
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
W w w. h p c - e u r o p a. o r g Single Point of Access to Resources of HPC-Europa Krzysztof Kurowski, Jarek Nabrzyski, Ariel Oleksiak, Dawid Szejnfeld.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Experiences with using UNICORE in Production Grid Infrastructures DEISA and D-Grid Michael Rambadt
EuroCAMP, Malaga, October 19, 2006 DEISA requirements for federations and AA Jules Wolfrat SARA
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Grid Engine Riccardo Rotondo
GGF16 Athens, February DEISA Perspectives Towards cooperative extreme computing in Europe Victor Alessandrini IDRIS - CNRS
Connecting OurGrid & GridSAM A Short Overview. Content Goals OurGrid: architecture overview OurGrid: short overview GridSAM: short overview GridSAM: example.
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
Enterprise Java Beans Part I Kyungmin Cho 2001/04/10.
Presented by Xiaoyu Qin Virtualized Access Control & Firewall Virtualization.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
Global Land Cover Facility The Global Land Cover Facility (GLCF) is a member of the Earth Science Information Partnership (ESIP) Federation providing data,
Grid Computing, B. Wilkinson, b.1 National Science Foundation Middleware Initiative (NMI) Started in 2001 initially over 3 years “to create and deploy.
CS480 Computer Science Seminar Introduction to Microsoft Solutions Framework (MSF)
Forschungszentrum Jülich in der Helmholtz-Gesellschaft Experiences with using UNICORE in Production Grid Infrastructures DEISA and D-Grid Michael Rambadt.
SBIR Final Meeting Collaboration Sensor Grid and Grids of Grids Information Management Anabas July 8, 2008.
Cracow Grid Workshop October 2009 Dipl.-Ing. (M.Sc.) Marcus Hilbrich Center for Information Services and High Performance.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
9 Systems Analysis and Design in a Changing World, Fourth Edition.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,
RI The DEISA Sustainability Model Wolfgang Gentzsch DEISA-2 and OGF rzg.mpg.de.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Research Infrastructures Information Day Brussels, March 25, 2003 Victor Alessandrini IDRIS - CNRS.
CEOS Working Group on Information Systems and Services - 1 Data Services Task Team Discussions on GRID and GRIDftp Stuart Doescher, USGS WGISS-15 May 2003.
A PanDA Backend for the Ganga Analysis Interface J. Elmsheuser 1, D. Liko 2, T. Maeno 3, P. Nilsson 4, D.C. Vanderster 5, T. Wenaus 3, R. Walker 1 1: Ludwig-Maximilians-Universität.
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
Panel “Making real large-scale grids for real money-making users: why, how and when?” August 2005 Achim Streit Forschungszentrum Jülich in der.
Identity Management in DEISA/PRACE Vincent RIBAILLIER, Federated Identity Workshop, CERN, June 9 th, 2011.
Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,
EUFORIA FP7-INFRASTRUCTURES , Grant JRA3, SA1, SA2 & SA3 parallel session 23 January 2008 Kick-Off Meeting January 2008 Goteborg (Sweden)
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Interactive Data Analysis on the “Grid” Tech-X/SLAC/PPDG:CS-11 Balamurali Ananthan David Alexander
Fourth EGEE Conference Pise, October 23-28, 2005 DEISA Perspectives Towards cooperative extreme computing in Europe Victor Alessandrini IDRIS - CNRS
Tool Integration with Data and Computation Grid “Grid Wizard 2”
EUFORIA FP7-INFRASTRUCTURES , Grant Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center.
MGRID Architecture Andy Adamson Center for Information Technology Integration University of Michigan, USA.
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poznan, Poland EGEE’07, Budapest, Oct.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poland EGEE’08 Conference, Istanbul, 24 Sep.
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
EGEE Workshop on Management of Rights in Production Grids Paris, June 19th, 2006 Victor Alessandrini IDRIS - CNRS DEISA : status, strategies, perspectives.
Page : 1 SC2004 Pittsburgh, November 12, 2004 DEISA : integrating HPC infrastructures in Europe DEISA : integrating HPC infrastructures in Europe Victor.
Monterey HPDC Workshop Experiences with MC-GPFS in DEISA Andreas Schott
IoT R&I on IoT integration and platforms INTERNET OF THINGS
1 MSWG, Amsterdam, December 15, 2005 DEISA security Jules Wolfrat SARA.
GWE Core Grid Wizard Enterprise (
DEISA : integrating HPC infrastructures in Europe Prof
Component--based development
Presentation transcript:

14, Chicago, IL, 2005 Science Gateways to DEISA Motivation, user requirements, and prototype example Thomas Soddemann, RZG, Germany

14, Chicago, IL, 2005

To deploy and operate a persistent, production quality, distributed supercomputing environment with continental scope To enable scientific discovery across a broad spectrum of science and technology. Scientific impact (enabling new science) is the only criterion for success.

14, Chicago, IL, 2005 DEISA is an European Supercomputing Service built on top of existing national services. DEISA deploys and operates a persistent, production quality, distributed supercomputing environment with continental scope

14, Chicago, IL, 2005 DEISA Infrastructure Dedicated 1GBit/s Network Global File System (GPFS) UNICORE centric Grid Middleware Infrastructure PKI based security solution (EUGridPMA)

14, Chicago, IL, 2005 AIX SUPER-CLUSTER JUNE 2005 First global file system worldwide in production environments at continental scope Global File System CINECA (I) IDRIS (F) Global File System RZG (GER) FZJ (GER)

14, Chicago, IL, 2005 GPFS demo at European Scale (June 16, 2005, Paris) CINECA (I) FZJ (GER) 2) The application writes the restart data to the Jülich GPFS file system and result data to RZG 3)The results are interpreted and displayed in CINECA, reading the data from RZG (Germany) RZG (GER) IDRIS (F) Global File System 1)A 256 processor job is running at RZG (Germany). The data for this run have been read from IDRIS (France), where hey have been produced by a former job (No ftp, transparent for the user as in a local cluster)

14, Chicago, IL, 2005 Ways of Access to Resources: CLI ssh, qsub/llsubmit, qstat/llq, …

14, Chicago, IL, 2005 Ways of Access to Resources: Rich Client Solution

14, Chicago, IL, 2005 Ways of Access to Resources: Web Portal Solution

14, Chicago, IL, 2005 Ways of Access to Resources: Web Services

14, Chicago, IL, 2005 Ways of Access to Resources: other Globus2 CORBA WebDAV …

14, Chicago, IL, 2005 User Requirements Easy access to computing resources Simple access to computing resources Hide the complexity of the Grid Infrastructure

14, Chicago, IL, 2005 First Time Contact Obstacle: understanding PKI obtaining a certificate handling of certificate and private key Proxy Key, Proxy Certificate Certificate Authority GridPMA Obstacle: understanding the Grid Infrastructure Why does my job not run? Why does my job die? Where are my data?

14, Chicago, IL, 2005 Unsophisticated and intuitively usable GUI  Let the user decide on the level of sophistication  E.g. use of known keywords Help with the creation of input files for complex Applications  Wizards  Upload facilities, server side file browsing Help the user to focus on science

14, Chicago, IL, 2005 The Material Science and Fusion Portal Solution (Prototype) Secure PKI infrastructure for Authentication/Authorization Extensible Concept of pluggable modules in UNICORE client and Portal prototype Built on open standard and enterprise quality components Tomcat/JBoss, Cocoon, org.apache.*, … Separation of concerns Design adheres to several widely accepted Patterns

14, Chicago, IL, 2005 WAN EAS Client Applic ation (Web Brows er) Client Applic ation (Web Brows er) WAS View MD EJB Session EJB Persistent Component Controller DB MBean Package Portal Application UNICORE WebDAV LDAP

14, Chicago, IL, 2005

The Extreme Computing Initiative Identification, deployment and operation of a number of « flagship » applications in selected areas of science and technology Applications must rely on the DEISA Supercomputing Grid services (application profiles have been clearly defined). They will benefit from exceptional resources from the DEISA pool. Applications are selected on the basis of scientific excellence, innovation potential, and relevance criteria. European call for proposals: April 1st -> May 30, 2005

14, Chicago, IL, 2005 Extreme Gyrokinetic Turbulence Simulations The nonlinear particle-in-cell code TORB uses a Monte Carlo particle approach to simulate the time evolution of turbulent field structures in fusion plasmas (J. Nuehrenberg, IPP, Greifswald & L. Villard, CRPP, Lausanne) Within DEISA, TORB has been improved for extreme scalability at IBM system at ECMWF: On 2048 procs: Speedup = 1680 Parallel efficiency = 82% Sustained performance = 1.3 TF 64 nodes = 2048 processors

14, Chicago, IL, 2005 To enable Europe’s terascale science by the integration of Europe’s most powerful supercomputing systems. Enabling scientific discovery across a broad spectrum of science and technology is the only criterion for success DEISA is an European Supercomputing Service built on top of existing national services. DEISA deploys and operates a persistent, production quality, distributed supercomputing environment with continental scope.