German Astrophysical Virtual Observatory

Slides:



Advertisements
Similar presentations
Challenges for Interactive Grids a point of view from Int.Eu.Grid project Remote Instrumentation Services in Grid Environment RISGE BoF Manchester 8th.
Advertisements

Distributed Data Processing
A Dynamic World, what can Grids do for Multi-Core computing? Daniel Goodman, Anne Trefethen and Douglas Creager
Towards Autonomic Adaptive Scaling of General Purpose Virtual Worlds Deploying a large-scale OpenSim grid using OpenStack cloud infrastructure and Chef.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Computational Steering on the GRID Using a 3D model to Interact with a Large Scale Distributed Simulation in Real-Time Michael.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Astrophysics, Biology, Climate, Combustion, Fusion, Nanoscience Working Group on Simulation-Driven Applications 10 CS, 10 Sim, 1 VR.
Grids and Globus at BNL Presented by John Scott Leita.
Dagstuhl, February 16, 2009 Layers in Grids Uwe Schwiegelshohn 17. Februar 2009 Layers in Grids.
Cloud Computing for the Enterprise November 18th, This work is licensed under a Creative Commons.
Copyright © cs-tutorial.com. Introduction to Web Development In 1990 and 1991,Tim Berners-Lee created the World Wide Web at the European Laboratory for.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.
Remote Access Chapter 4. Learning Objectives Understand implications of IEEE 802.1x and how it is used Understand VPN technology and its uses for securing.
Software Architecture
OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.
GAVO – after one year H.-M. Adorf & the GAVO team.
Maximilian Berger David Gstir Thomas Fahringer Distributed and parallel Systems Group University of Innsbruck Austria Oct, 13, Krakow, PL.
Theory in the German Astrophysical VO Summary: We show results of efforts done within the German Astrophysical Virtual Observatory (GAVO). GAVO has paid.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Grid Basics Adarsh Patil
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Mainframe (Host) - Communications - User Interface - Business Logic - DBMS - Operating System - Storage (DB Files) Terminal (Display/Keyboard) Terminal.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Wiss. Beirat AIP, ClusterFinder & VO-Methods H. Enke German Astrophysical Virtual Observatory ClusterFinder VO Methods for Astronomical Applications.
Cracow Grid Workshop October 2009 Dipl.-Ing. (M.Sc.) Marcus Hilbrich Center for Information Services and High Performance.
The project of application for network computing in seismology --The prototype of SeisGrid Chen HuiZhong, Ze Ren Zhi Ma, Hu Bin Institute.
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
LOGO Development of the distributed computing system for the MPD at the NICA collider, analytical estimations Mathematical Modeling and Computational Physics.
Faucets Queuing System Presented by, Sameer Kumar.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Structural Biology on the GRID Dr. Tsjerk A. Wassenaar Biomolecular NMR - Utrecht University (NL)
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarksEGEE-III INFSO-RI Astro-Wise and EGEE.
Data Communications and Networks Chapter 9 – Distributed Systems ICT-BVF8.1- Data Communications and Network Trainer: Dr. Abbes Sebihi.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
LSF Universus By Robert Stober Systems Engineer Platform Computing, Inc.
An Architectural Approach to Managing Data in Transit Micah Beck Director & Associate Professor Logistical Computing and Internetworking Lab Computer Science.
Derek Weitzel Grid Computing. Background B.S. Computer Engineering from University of Nebraska – Lincoln (UNL) 3 years administering supercomputers at.
Developing GRID Applications GRACE Project
September 2003, 7 th EDG Conference, Heidelberg – Roberta Faggian, CERN/IT CERN – European Organization for Nuclear Research The GRACE Project GRid enabled.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
INTRODUCTION TO HIGH PERFORMANCE COMPUTING AND TERMINOLOGY.
Enabling Grids for E-sciencE University of Perugia Computational Chemistry status report EGAAP Meeting – 21 rst April 2005 Athens, Greece.
Accessing the VI-SEEM infrastructure
Grid and Cloud Computing
Bentley Systems, Incorporated
Simulation Production System
Clouds , Grids and Clusters
Belle II Physics Analysis Center at TIFR
GWE Core Grid Wizard Enterprise (
Middleware independent Information Service
Grid Computing AEI Numerical Relativity Group has access to high-end resources in over ten centers in Europe/USA They want: Bigger simulations, more simulations.
Grid Computing.
Recap: introduction to e-science
Study course: “Computing clusters, grids and clouds” Andrey Y. Shevel
CIT 480: Securing Computer Systems
University of Technology
GRID COMPUTING PRESENTED BY : Richa Chaudhary.
Dynamic Grid Computing: The Cactus Worm
From Prototype to Production Grid
TeraScale Supernova Initiative
Grid Application Model and Design and Implementation of Grid Services
Internet Protocols IP: Internet Protocol
Large Scale Distributed Computing
Google Sky.
Expand portfolio of EGI services
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

German Astrophysical Virtual Observatory Gadget on GAVOGRID AEI-Clustertag, 12.05.2004 GAVO and GridComputing

GAVO Architecture VO-Sites Grid Enabled Sites GAVO WebPortal HTTP, SOAP Secure Protocols WebServices GridServices Temporary DataSpace UserSpace ConeSearch Matcher Abstract View of current architecture: GAVO uses two tiers of services: Access to ConesSearch, Matcher through http and soap-protocols, the services are running within the normal levels of security (provided through the firewalls of the sites, allowing acccess to dedicated machines on known ports The Cone-Search queries archives in local databases and files and VO-archives through http and soap-protocols 2. Access to Grid-managed ressources: The matcher-engine validates itself to the Grid, to get access to computing facilities for parallel-processing and temporary storage Users, who obtained Login, get access to Grid-managed ressources (parallel-computing jobs, runtime information, job-results) Stores virtual data from matcher results or cone-searches in userspace Files DB Computing Tasks Grid security realm Normal security realm AEI-Clustertag, 12.05.2004 GAVO and GridComputing

GAVO-GRID (testbed) using Globus GAVO-Grid AEI-Clustertag, 12.05.2004 GAVO and GridComputing

running MPI-application across site-boundaries: GAVO-GRID Testcase for GAVO: running MPI-application across site-boundaries: Gadget is a widely used particle-code for cosmological simulations Gadget (MPI-version) requires 2n processors Gadget roughly uses for each timestep 80% calculation, 20% communication (GAlaxies with Dark matter and Gas intEracT ) AEI-Clustertag, 12.05.2004 GAVO and GridComputing

Running MPI-applications with Globus / mpichG2 GAVO-GRID Running MPI-applications with Globus / mpichG2 - all nodes communicate with each other (ip-adresses known) - using ssh instead of rsh - requires a range of TCP/IP-ports open (globus-tcp-range) - allocation of bandwidth (GAlaxies with Dark matter and Gas intEracT ) AEI-Clustertag, 12.05.2004 GAVO and GridComputing

Results from tests with uniform nodes 167,05 0,11 GAVO-GRID Results from tests with uniform nodes Wall time Comm time On board 167,05 0,11 Across site 179,69 1,05 (np = 8) 105,3 1,30 (GAlaxies with Dark matter and Gas intEracT ) AEI-Clustertag, 12.05.2004 GAVO and GridComputing

Results from tests with heterogenous nodes 162,03 0,11 GAVO-GRID Results from tests with heterogenous nodes Np Wall time Comm time On site 2/2 AMD/ XEON 162,03 0,11 Across site 4 AMD 97,7 1,16 4/4 AMD/ XEON 85,9 0,15 105,33 1,18 8/8 AMD/ 77,63 1,96 (GAlaxies with Dark matter and Gas intEracT ) AEI-Clustertag, 12.05.2004 GAVO and GridComputing

(GAlaxies with Dark matter and Gas intEracT ) GRID-Collaboration Simulations for cosmological problems improve with the number of particles. There is a clear relation between available computing ressources and the number of particles a simulation can handle. Integration of clusters using grid-technology is an option which can significantly lower the costs of getting bigger simulations running. One of the main issues then is allocation of more bandwidth (GAlaxies with Dark matter and Gas intEracT ) AEI-Clustertag, 12.05.2004 GAVO and GridComputing

GRID-Collaboration in Potsdam: Potsdam has a good net infrastructure, where more bandwidth is relatively easy available For testing purposes, a low cost solution providing more bandwith could be installed, including AEI, AIP, PIK, Uni Potsdam This could be a first step of building part of the D-Grid at Potsdam. (GAlaxies with Dark matter and Gas intEracT ) AEI-Clustertag, 12.05.2004 GAVO and GridComputing

are using grid-technology do demanding cosmological simulations GRID-Collaboration AEI and AIP are using grid-technology do demanding cosmological simulations working towards a grid-integration of their respective clusters working on specific problems (visualization of simulation results, distributed file systems) (GAlaxies with Dark matter and Gas intEracT ) AEI-Clustertag, 12.05.2004 GAVO and GridComputing