Theory, Grid and VO Matthias Steinmetz (AIP)

application Data analysis Super Computer Super computer Telescopes Data Archive Data Archive PC Cluster Data analysis User MIDDLEWAREMIDDLEWARE Resources are "virtualized", i.e. can not be identified individually Characteristics of a Grid: network of IT-Ressourcen

3 VODCA: Theory, Grid and VO VO and Grid What is the dividing line between VO and Grid?  Not well defined  Example UK:  AstroGrid covers VO and Grid aspects  Example Germany  GAVO: application layer  AstroGrid-D: middle ware

4 VODCA: Theory, Grid and VO Theory and Grid Benefits of the Grid  Logistics (resource monitoring, scheduler/broker, virtual organizations, …)  Virtual Surveys (Millenium simulation)  Enterprise computing (access to supercomputers via grids, e.g. DEISA)  Cloud computing (“task farming”)  Volunteer computing model)  Visualization

5 VODCA: Theory, Grid and VO StellarIS: resource monitoring Grid-Ressource- Map Basiert auf GoogleMap

6 VODCA: Theory, Grid and VO Stellaris: Job monitoring Webinterface for simple job monitoring Time table for submitted Jobs Minutes hours days

7 VODCA: Theory, Grid and VO Analysing Cosmological Simulations in the Virtual Observatory: Designing and Mining the Millennium Simulation Database Gerard Lemson German Astrophysical Virtual Observatory ARI, Heidelberg MPE, Garching bei München

8 VODCA: Theory, Grid and VO Time evolution: merger trees

9 VODCA: Theory, Grid and VO

10 VODCA: Theory, Grid and VO Merger trees : select prog.* from galaxies des, galaxies prog where des.galaxyId = 0 and prog.galaxyId between des.galaxyId and des.lastProgenitorId Branching points : select descendantId from galaxies des where descendantId != -1 group by descendantId having count(*) > 1

11 VODCA: Theory, Grid and VO

12 VODCA: Theory, Grid and VO Usage statistics Up since August 2006 (astro-ph/...) ~210 registered users > 4.4 million queries ~ 35 billion rows (since March 2007) # queries/day# rows/day # secs/day

13 VODCA: Theory, Grid and VO Enterprise Computing: Mare Nostrum Simulations at HLRZ WMAP3 parameters, w=0.8 Testrun using the grid: particles

14 VODCA: Theory, Grid and VO NBODY6++ UseCase Computer simulation of dense stellar systems Example: globular clusters Gravitational Star-Star interaction Complexity N 2 (N: number of stars)

15 VODCA: Theory, Grid and VO Enterprise Computers Recent Development: GPU – Graphics Cards GeForce 8800 GTX (NVIDIA) Using CUDA Library Special Interfaces and API from GRACE project ported. Berczik et al Spurzem et al. 2008

16 VODCA: Theory, Grid and VO Cloud Computing: UseCase Dynamo Visualization of results Rechner 1Rechner 2 Rechner 3Rechner 4 2D-Darstellung der Magnetfeldstärke auf der Sternoberfläche Querschnitt durch den Stern

17 VODCA: Theory, Grid and VO <jsdl:JobDefinition xmlns=" xmlns:jsdl=" xmlns:jsdl-posix=" xmlns:xsi=" Sample Dynamo run Use Case Dynamo n/a User's home directory […] test.x /${GLOBUS_USER_HOME}/ dynamo test.out […] Dynamo JDSL und RSL

18 VODCA: Theory, Grid and VO Volunteer Computing: GEO600 / LIGO Laser Interferometer Gravitational Wave Observatory

19 VODCA: Theory, Grid and VO GEO600/LIGO Network von 4 Detectors Hanford (2000m side length) USA Livingston (4000m side length )USA GEO600( 600m side length )Germany Virgo(3000m side length )Italy Pathfinder for LISA, Satellite mission with 3 detectors side length: 5*10 9 m!

20 VODCA: Theory, Grid and VO Gravitationional waves: Data analysis via the Grid Data analysis via small data packages, “embarrassingly parallel”. is, like suitable to exploit idle cycles on work stations. is an ideal, simple Grid application, supporting many operation system. Checkpointing and Recovery allows a very accurate control of CPU-Requirements and walltime. Automatic software deployment job submission and job management, a good scalability of grid application can be obtained Current workload: CPU h per week

21 VODCA: Theory, Grid and VO GEO600 – Resource Integration user friendly User-Management via VOMRS Resource information via MDS und StellarIS Grid Service Monitoring automatic job submission on D-Grid resources Job monitoring und job management using a Laptop data management on Astrogrid-D Storage Cluster

22 VODCA: Theory, Grid and VO Visualization of a galaxy merger Simulation: two galaxies on collision orbit Visualization: 2D-projections of 3D snapshots ZIBAIP SubmitExecution ProCSubmit Workflow Video Workflow A stop exit start GT4 submit Video Workflow B ARI...

23 VODCA: Theory, Grid and VO Grid-Visualization Submission Host: ZIB  ProC + Master workflow  Submission of video workflows  Display of videos Execution Hosts: AIP + ZAH  PiCo + Video workflow  Projection to 2D  Color coding Future:  Graphics rendering at LRZ, graphics output on local host

24 VODCA: Theory, Grid and VO Theory and Grid Benefits of the Grid  Logistics (resource monitoring, scheduler/broker, virtual organizations, …)  Virtual Surveys (Millenium simulation)  Enterprise computing (access to supercomputers via grids, e.g. DEISA)  Cloud computing (“task farming”)  Volunteer computing model)  Visualization