Presentation is loading. Please wait.

Presentation is loading. Please wait.

09.04.2008 Theory, Grid and VO Matthias Steinmetz (AIP)

Published byJohnathan Booker Modified over 9 years ago

Similar presentations

Presentation on theme: "09.04.2008 Theory, Grid and VO Matthias Steinmetz (AIP)"— Presentation transcript:

1 09.04.2008 Theory, Grid and VO Matthias Steinmetz (AIP)

2 09.04.2008 application Data analysis Super Computer Super computer Telescopes Data Archive Data Archive PC Cluster Data analysis User MIDDLEWAREMIDDLEWARE Resources are "virtualized", i.e. can not be identified individually Characteristics of a Grid: network of IT-Ressourcen

3 3 VODCA: Theory, Grid and VO 09.04.2008 VO and Grid What is the dividing line between VO and Grid?  Not well defined  Example UK:  AstroGrid covers VO and Grid aspects  Example Germany  GAVO: application layer  AstroGrid-D: middle ware

4 4 VODCA: Theory, Grid and VO 09.04.2008 Theory and Grid Benefits of the Grid  Logistics (resource monitoring, scheduler/broker, virtual organizations, …)  Virtual Surveys (Millenium simulation)  Enterprise computing (access to supercomputers via grids, e.g. DEISA)  Cloud computing (“task farming”)  Volunteer computing (@home model)  Visualization

5 5 VODCA: Theory, Grid and VO 09.04.2008 StellarIS: resource monitoring Grid-Ressource- Map Basiert auf GoogleMap

6 6 VODCA: Theory, Grid and VO 09.04.2008 Stellaris: Job monitoring Webinterface for simple job monitoring Time table for submitted Jobs Minutes hours days

7 7 VODCA: Theory, Grid and VO 09.04.2008 Analysing Cosmological Simulations in the Virtual Observatory: Designing and Mining the Millennium Simulation Database Gerard Lemson German Astrophysical Virtual Observatory ARI, Heidelberg MPE, Garching bei München

8 8 VODCA: Theory, Grid and VO 09.04.2008 Time evolution: merger trees

9 9 VODCA: Theory, Grid and VO 09.04.2008

10 10 VODCA: Theory, Grid and VO 09.04.2008 Merger trees : select prog.* from galaxies des, galaxies prog where des.galaxyId = 0 and prog.galaxyId between des.galaxyId and des.lastProgenitorId Branching points : select descendantId from galaxies des where descendantId != -1 group by descendantId having count(*) > 1

11 11 VODCA: Theory, Grid and VO 09.04.2008

12 12 VODCA: Theory, Grid and VO 09.04.2008 Usage statistics Up since August 2006 (astro-ph/...) ~210 registered users > 4.4 million queries ~ 35 billion rows (since March 2007) # queries/day# rows/day # secs/day

13 13 VODCA: Theory, Grid and VO 09.04.2008 Enterprise Computing: Mare Nostrum Simulations at HLRZ WMAP3 parameters, w=0.8 Testrun using the grid: 1024 3 +1024 3 particles

14 14 VODCA: Theory, Grid and VO 09.04.2008 NBODY6++ UseCase Computer simulation of dense stellar systems Example: globular clusters Gravitational Star-Star interaction Complexity N 2 (N: number of stars)

15 15 VODCA: Theory, Grid and VO 09.04.2008 Enterprise Computers Recent Development: GPU – Graphics Cards GeForce 8800 GTX (NVIDIA) Using CUDA Library Special Interfaces and API from GRACE project ported. Berczik et al. 2008 Spurzem et al. 2008

16 16 VODCA: Theory, Grid and VO 09.04.2008 Cloud Computing: UseCase Dynamo Visualization of results Rechner 1Rechner 2 Rechner 3Rechner 4 2D-Darstellung der Magnetfeldstärke auf der Sternoberfläche Querschnitt durch den Stern

17 17 VODCA: Theory, Grid and VO 09.04.2008 <jsdl:JobDefinition xmlns="http://www.gacg-grid.de/namespaces/job-mgmt/2006/08/jsdl" xmlns:jsdl="http://schemas.ggf.org/jsdl/2005/11/jsdl" xmlns:jsdl-posix="http://schemas.ggf.org/jsdl/2005/11/jsdl-posix" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> Sample Dynamo run Use Case Dynamo n/a User's home directory […] test.x /${GLOBUS_USER_HOME}/ dynamo test.out 100 1 […] Dynamo JDSL und RSL

18 18 VODCA: Theory, Grid and VO 09.04.2008 Volunteer Computing: GEO600 / LIGO Laser Interferometer Gravitational Wave Observatory

19 19 VODCA: Theory, Grid and VO 09.04.2008 GEO600/LIGO Network von 4 Detectors Hanford (2000m side length) USA Livingston (4000m side length )USA GEO600( 600m side length )Germany Virgo(3000m side length )Italy Pathfinder for LISA, Satellite mission with 3 detectors side length: 5*10 9 m!

20 20 VODCA: Theory, Grid and VO 09.04.2008 Gravitationional waves: Data analysis via the Grid Data analysis via small data packages, “embarrassingly parallel”. Einstein@Home is, like SETI@Home, suitable to exploit idle cycles on work stations. Einstein@Home is an ideal, simple Grid application, supporting many operation system. Checkpointing and Recovery allows a very accurate control of CPU-Requirements and walltime. Automatic software deployment job submission and job management, a good scalability of grid application can be obtained Current workload: 30000 CPU h per week

21 21 VODCA: Theory, Grid and VO 09.04.2008 GEO600 – Resource Integration user friendly User-Management via VOMRS Resource information via MDS und StellarIS Grid Service Monitoring automatic job submission on D-Grid resources Job monitoring und job management using a Laptop data management on Astrogrid-D Storage Cluster

22 22 VODCA: Theory, Grid and VO 09.04.2008 Visualization of a galaxy merger Simulation: two galaxies on collision orbit Visualization: 2D-projections of 3D snapshots ZIBAIP SubmitExecution ProCSubmit Workflow Video Workflow A stop exit start GT4 submit Video Workflow B ARI...

23 23 VODCA: Theory, Grid and VO 09.04.2008 Grid-Visualization Submission Host: ZIB  ProC + Master workflow  Submission of video workflows  Display of videos Execution Hosts: AIP + ZAH  PiCo + Video workflow  Projection to 2D  Color coding Future:  Graphics rendering at LRZ, graphics output on local host

24 24 VODCA: Theory, Grid and VO 09.04.2008 Theory and Grid Benefits of the Grid  Logistics (resource monitoring, scheduler/broker, virtual organizations, …)  Virtual Surveys (Millenium simulation)  Enterprise computing (access to supercomputers via grids, e.g. DEISA)  Cloud computing (“task farming”)  Volunteer computing (@home model)  Visualization

Download ppt "09.04.2008 Theory, Grid and VO Matthias Steinmetz (AIP)"

Similar presentations

The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.

The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.

Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
BOINC Berkeley Open Infrastructure for Network Computing An open-source middleware system for volunteer and grid computing (much of the images and text.

BOINC Berkeley Open Infrastructure for Network Computing An open-source middleware system for volunteer and grid computing (much of the images and text.
The Open Science Grid: Bringing the power of the Grid to scientific research www.opensciencegrid.org.

The Open Science Grid: Bringing the power of the Grid to scientific research
Acceleration of the Smith– Waterman algorithm using single and multiple graphics processors Author : Ali Khajeh-Saeed, Stephen Poole, J. Blair Perot. Publisher:

Acceleration of the Smith– Waterman algorithm using single and multiple graphics processors Author : Ali Khajeh-Saeed, Stephen Poole, J. Blair Perot. Publisher:
Workload Management Workpackage Massimo Sgaravatto INFN Padova.

Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Sergey Belov, LIT JINR 15 September, NEC’2011, Varna, Bulgaria.

Sergey Belov, LIT JINR 15 September, NEC’2011, Varna, Bulgaria.
Workload Management Massimo Sgaravatto INFN Padova.

Workload Management Massimo Sgaravatto INFN Padova.
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.

Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.

Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.
The Grid is a complex, distributed and heterogeneous execution environment. Running applications requires the knowledge of many grid services: users need.

The Grid is a complex, distributed and heterogeneous execution environment. Running applications requires the knowledge of many grid services: users need.
INAF - National Institute for Astrophysics The National Institute for Astrophysics coordinates and participates in the Astronomy and Astrophysics (A&A)

INAF - National Institute for Astrophysics The National Institute for Astrophysics coordinates and participates in the Astronomy and Astrophysics (A&A)
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.

The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
2007-05-15TIG session 3+Millennium database Millennium Database Overview and some first usage experiences Gerard Lemson and the Virgo Consortium astro-ph/0608019.

TIG session 3+Millennium database Millennium Database Overview and some first usage experiences Gerard Lemson and the Virgo Consortium astro-ph/
Theory in the German Astrophysical VO Summary: We show results of efforts done within the German Astrophysical Virtual Observatory (GAVO). GAVO has paid.

Theory in the German Astrophysical VO Summary: We show results of efforts done within the German Astrophysical Virtual Observatory (GAVO). GAVO has paid.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.

A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
Grid Computing I CONDOR.

Grid Computing I CONDOR.
Www.g-vo.org 4th EGEE user forum / OGF 25 Catania, 5.3.2009 TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.

4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.
Dissemination of simulations in the Virtual Observatory Gerard Lemson German Astrophysical Virtual Observatory, Max-Planck Institute for extraterrestrial.

Dissemination of simulations in the Virtual Observatory Gerard Lemson German Astrophysical Virtual Observatory, Max-Planck Institute for extraterrestrial.

Similar presentations

Ads by Google