EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Support for Astrophysical applications in.

Slides:



Advertisements
Similar presentations
Results: Results: After 1 Gyr giant planets ejected a large number of planetesimals from the PPD to large heliocentric distances, where they form cometary.
Advertisements

1 Bridging Clouds with CernVM: ATLAS/PanDA example Wenjing Wu
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
INFSO-RI Enabling Grids for E-sciencE FloodGrid application Ladislav Hluchy, Viet D. Tran Institute of Informatics, SAS Slovakia.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Lessons learnt from the EGEE Application Porting Support activity Gergely Sipos Coordinator.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
INFSO-RI Enabling Grids for E-sciencE ES applications in EGEEII – M. Petitdidier –11 February 2008 Earth Science session Wrap up.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Provenance Challenge gLite Job Provenance.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Using DIANE for astrophysics applications Ladislav Hluchy, Viet Tran Institute of Informatics Slovak.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMSMonitor: a tool to monitor gLite WMS/LB.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Introduction to GILDA and gaining access.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE Gergely Sipos
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA2 Quality Plan for EGEE III Geneviève.
Enabling Grids for E- sciencE EGEE and gLite are registered trademarks EGEE-III INFSO-RI Analysis of Overhead and waiting times.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Overview of STEP09 monitoring issues Julia Andreeva, IT/GS STEP09 Postmortem.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support in EGEE Gergely Sipos MTA SZTAKI EGEE’08.
INFSO-RI Enabling Grids for E-sciencE SALUTE – Grid application for problems in quantum transport E. Atanassov, T. Gurov, A. Karaivanova,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Design of an Expert System for Enhancing.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
INFSO-RI Enabling Grids for E-sciencE Running ECCE on EGEE clusters Olav Vahtras KTH.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Ricardo Rocha CERN (IT/GS) EGEE’08, September 2008, Istanbul, TURKEY Experiment.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Support for New and Existing Users Gergely.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSG - A messaging system for efficient and.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks HYP3D Gilles Bourhis Equipe SIMPA, laboratoire.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Progress on first user scenarios Stephen.
INFSO-RI Enabling Grids for E-sciencE Charon Extension Layer. Modular environment for Grid jobs and applications management Jan.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
Eva Pajorova ( Institute of Informatics, Slovak Academy of Sciences, Bratislava, Slovakia 02/5477.
INFSO-RI NA2 meeting in Karlsruhe - FZK, 1-2 June 2006 Enabling Grids for E-sciencE - II EGEE-II NA2 Activities Miroslav Dobrucký.
INFSO-RI Enabling Grids for E-sciencE Use Case of gLite Services Utilization. Multiple Ligand Trajectory Docking Study Jan Kmuníček.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview &
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Computational chemistry with ECCE on EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to P-GRADE Portal hands-on Miklos Kozlovszky MTA SZTAKI
Enabling Grids for E-sciencE INFSO-RI rd EGEE User Forum – Clermont-Ferrand – February A&A Session Summary Six presentations reporting.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks On-line Visualization for Grid-based Astronomical.
EGEE-II INFSO-RI Enabling Grids for E-sciencE P-GRADE overview and introduction: workflows & parameter sweeps (Advanced features)
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CharonGUI A Graphical Frontend on top of.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Spanish National Research Council- CSIC Isabel.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA2 Networking support for EGEE III Xavier.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler.
Jiri Chudoba for the Pierre Auger Collaboration Institute of Physics of the CAS and CESNET.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Workflow management tool for Earth science applications Ladislav Hluchy, Viet Tran Institute of Informatics.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Bioinformatics activity Christophe BLANCHET.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Grid Observatory: goals and challenges.
EGEE-II INFSO-RI Enabling Grids for E-sciencE NA3 PAR review at EGEE'07 Conference, Budapest, 4 October, 2007 EGEE-II NA3 Activities.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using EGEE middleware: Putting it all together!
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell Activity Manager UEDIN (NeSC)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Astrophysical Cluster Session Claudio Vuerli,
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Bob Jones EGEE project director.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GOCDB4 Gilles Mathieu, RAL-STFC, UK An introduction.
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract IST Report from.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Computational Chemistry Cluster – EGEE-III.
SPEEch on the griD (SPEED)
Presentation transcript:

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Support for Astrophysical applications in Slovakia Ladislav Hluchy, Jan Astalos Institute of Informatics Slovak Academy of Sciences

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, Overview Support for Astrophysical application in EGEE-II Framework for parameter studies Planned applications for EGEE-III Typical scenario Expertise from other Grid projects that can be used in AA cluster

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, Support for AAA in EGEE II The unified theory of Kuiper-belt and Oort-cloud formation –Neslušan L., Jakubík M., Paulech, T. - AI SAS – EGEE –Leto, G. – Catania Observatory – TriGRID Main goal –working out a unified theory of the formation of all:  Jovian planets (Jupiter, Saturn, Uranus, and Neptune)  Kuiper belt and Scattered Disc (populations of small bodies beyond the Neptune’s orbit)  Oort cloud (very distant cometary reservoir) Method  simulation of the dynamical evolution of a large number (~10000) planetesimals (treated as test particles) in the proto-planetary disc; the trajectories of the particles are influenced by the perturbing forces from the giant planets, Galactic tide, and stars passing near or through the Oort cloud

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, More about the application Demands for CPU time –If a single 2.8GHz CPU was used, the computation of the orbits of 4 giant planets and test particles for 1 Gyr would last about 21 years –After the division of the computation to 240 tasks, each for a single CPU, the above mentioned computation can be performed within ~ 5 months Structure –Sequence of sub-simulations –Each sub-simulation consists of many independent tasks (180 EGEE/VOCE + 60 TriGRID) –Output from all tasks is needed for preparation of next sub-simulation

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, Parameter studies Main problem - reliability –Failed jobs need to be resubmited – decreasing throughput and productivity –Too much effort needed for analysing errors in Grid middleware or sites –Need to identify failed and waiting jobs ASAP. Solution used – pilot jobs –Generic, easy-to-use framework for pilot jobs was developed –Pilot jobs are running simulation model in cycle with input datasets obtained from working area in Storage Element –Monitoring information is being uploaded periodically to Storage Element – heartbeat + progress monitoring –Automatic job management - failed/waiting pilot jobs are cancelled and sites are added to blacklist, no user intervention needed.

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, Use case 1)User prepares input datasets on User Interface and application executing script. 2)User prepares working directory on Storage Element and transfers input datasets into it. 3)User prepares configuration files for job management script. 4)User starts job management script on UI. 5)User occasionally checks status of processing by obtaining monitoring information from SE. 6)Application runs until processing of all input datasets is finished. 7)User collects output datasets from SE to UI and based on them he prepares input data and parameters for next sub- simulation 8)User continues from point 2.) until whole sequence of sub- simulations is finished.

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, To be done Automatic detection of anomalies in processing –If some tasks run for unusually long or short time – it might indicate some problems at worker nodes –Periodic uploading of stdout/stderr to Storage Element – RFIO based utilities are ready, they will be integrated to the framework including automatic detection of errors. Notification of user when intervention is needed – , ICQ,...

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, Applications planned for EGEE-III Investigation of the structure of meteoroid streams (M. Jakubík 1, J. Svoreň 1, Z. Kaňuchová 1, V. Porubčan 1,2 ; – 1 AISAS, 2 Astron.-Geophys. Obs. Commenius Univ.) Transitions between the sub-populations of small bodies in the solar system –(E. Pittich, N. Solovaya; AISAS) Study of the stability of orbits of exo-planets in multiple systems –(M. Zboril; AISAS)

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, Typical scenario The described future applications includes numerical experiments; a typical procedure consists of following steps: –Creating the models of a variety of initial situations (choosing the initial values of free parameters in each model) –Computing the evolution for each model (typically by utilizing a single CPU) –Comparison the obtained final state with the well-known facts (observed reality) and evaluation of which model is the best for the approximation of the reality

Enabling Grids for E-sciencE EGEE-II INFSO-RI AA meeting at EGEE 2007 conference, Budapest, October 3, Technologies we can support II SAS has experience with variety of Grid technologies from participation in Grid projects: –Development and customisation of scientific Grid portals –Porting of advanced applications to Grid - workflow, semantic composition, MPI –Data management - metadata management, relational and XML database access (OGSA-DAI) –Interactive Grid applications –Visualisation of Grid applications Projects: –CrossGrid project - –KWfGrid project - –MediGrid project - –Int.eu.grid –