Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, 2007. Created by Akos Balasko balasko@sztaki.hu.

Slides:



Advertisements
Similar presentations
1 P-GRADE Portal and GEMLCA Legacy Code Architecture Peter Kacsuk MTA SZTAKI
Advertisements

LPDS MTA SZTAKI Equation Solver A Grid solution Important hint: A follow up example demonstrating the Parameter Study solution for the mass calculations.
P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann MTA SZTAKI.
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI
Program Flow Charting How to tackle the beginning stage a program design.
1 Application Specific Module for P-GRADE Portal 2.7 Application Specific Module overview Akos Balasko MTA-SZTAKI LPDS
1 Integrated Development Environment Building Your First Project (A Step-By-Step Approach)
1 portal.p-grade.hu További lehetőségek a P-GRADE Portállal Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
1 portal.p-grade.hu Further information on P-GRADE Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
Introduction to Visual Basic. Quick Links Windows Application Programming Event-Driven Application Becoming familiar with VB Control Objects Saving and.
Example Gridification via command-line Application Developer Training Day IV. Miklos Kozlovszky Ankara, 25. October, 2007.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Creating the Autodock gateway from WS-PGRADE/gUSE and making it cloud-enabled.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
Parameter Study (PS) Principles & Practices Note This document uses as starting example the non PS case discussed in document EquationSolver.ppt If you.
WS-PGRADE portal and its usage in the CancerGrid project M. Kozlovszky, P. Kacsuk Computer and Automation Research Institute of the Hungarian Academy of.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
E-science grid facility for Europe and Latin America E2GRIS1 Gustavo Miranda Teixeira Ricardo Silva Campos Laboratório de Fisiologia Computacional.
Programmable Logic Training Course HDL Editor
Implementation of the ABC Quantum Mechanical Reactive Scattering Program on the EGEE Grid Platform Alessandro Costantini 1, Dimitrios Skouteris 1, Osvaldo.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support in EGEE Gergely Sipos MTA SZTAKI EGEE’08.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
Parameter Study Principles & Practices. What is Parameter Study? Parameter study is the application of a single algorithm over a set of independent inputs:
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
FRANEC and BaSTI grid integration Massimo Sponza INAF - Osservatorio Astronomico di Trieste.
Metadata Input Tool for CADIS Scientists and Data Managers by D. Stott August 8, 2007.
Parameter Study Principles & Practices. Outline Data Model of the PS Part I Simple PS –Generating simple PS Workflow by introducing PS Input port – using.
Introduction to Programming and JavaScript. Programming.
1 P-GRADE Portal tutorial at EGEE’09 Introduction to hands-on Gergely Sipos MTA SZTAKI EGEE.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support Group Demonstration at EGEE’08 Conference Istanbul,
1 Practical information for the GEMLCA / P-GRADE hands-on Gergely Sipos On behalf of: MTA.
1 Practical information for the GEMLCA / P-GRADE hands-on Tamas Kiss University of Westminster.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to P-GRADE Portal hands-on Miklos Kozlovszky MTA SZTAKI
EGEE-II INFSO-RI Enabling Grids for E-sciencE P-GRADE overview and introduction: workflows & parameter sweeps (Advanced features)
1 Support for Parameter Study applications in the P-GRADE Portal Cevat Şener Dept. Of Computer Engineering, METU.
1 Egrid portal Stefano Cozzini and Angelo Leto. 2 Egrid portal Based on P-GRADE Portal 2.3 –LCG-2 middleware support: broker, CEs, SEs, BDII –MyProxy.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
1 P-GRADE Portal hands-on Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
1 Further information and next steps Further information and next steps Gergely Sipos MTA SZTAKI
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
Remote Api Tutorial How to call WS-PGRADE workflows from remote clients through the http protocol?
1 Support for parameter study applications in the P-GRADE Portal Gergely Sipos MTA SZTAKI (Hungarian Academy of Sciences)
Unity Application Generator How Can I… Export variables of a Control module with all parameters, modify the some of the parameters like Initial values.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Enabling Grids for E-sciencE University of Perugia Computational Chemistry status report EGAAP Meeting – 21 rst April 2005 Athens, Greece.
Lesson 9: SOFTWARE ICT Fundamentals 2nd Semester SY
Introduction to Vivado
Eclipse EHX System Logic Maestro
Tamas Kiss University Of Westminster
How to connect your DG to EDGeS? Zoltán Farkas, MTA SZTAKI
Introduction to Computer CC111
P-GRADE overview and introduction: workflows & parameter sweeps (Advanced features) Gergely Sipos MTA SZTAKI
Introduction to gUSE and WS-PGRADE portal
P-GRADE Portal tutorial
CMIP5 Questionnaire Roadmap – beta
Creating and running applications on the NGS
Introduction to P-GRADE Portal hands-on
Remote Api Tutorial How to call WS-PGRADE workflows from remote clients through the http protocol?
CCA Skill Certification
(Includes setup) FAQ ON DOCUMENTS (Includes setup)
Understanding the Visual IDE
Application development on EGEE with P-GRADE Portal
Code Analysis, Repository and Modelling for e-Neuroscience
Overview of Workflows: Why Use Them?
Automation of Control System Configuration TAC 18
Introduction to the SHIWA Simulation Platform EGI User Forum,
Workflow level parametric study support by the P-GRADE portal
Presentation transcript:

Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, 2007. Created by Akos Balasko balasko@sztaki.hu Gergely Sipos sipos@sztaki.hu MTA SZTAKI Grid Application Support Centre www.lpds.sztaki.hu/gasuc

Introduction ABC code Solution of Schrodinger equation for triatomic systems using time independent (ABC) method A single sequential FORTRAN 90 binary Statically compiled with different libraries Task: to execute on the grid with many parameters in a parameter study fashion Provided for GASuc by Department of Chemistry, University of Perugia

Gridification process Chosen infrastructure EGEE Chosen tool P-GRADE Portal 2.6 Chosen grid application structure Workflow with 3 stages: 1st stage: Generator job to generate input parameters for ABC parameter study jobs 2nd stage: ABC simulator jobs (run in SIMD parallelism) 3rd stage: Collector job to pack simulator results into a single archive file (to ease access)

Current status ABC workflow is ready and has been executed with 4 parameters on SEE-GRID VO (Southern Eastern European VO) Workflow can be managed and monitored through Graphical User Interfaces Input parameters can be modified and added through Graphical User Interfaces

Local Vs. Grid execution Execution of 4 ABC parameter study jobs on a local machine P4, 3.4GHz, 1GByte on 4 broker selected clusters of SEE VO of EGEE Better speed-up can be achieved with more parameter jobs.

Next steps for University of Perugia Try the workflow Browse the results of the finished workflow with 4 parameters Execute another copy of the workflow Configure the workflow Add more input parameters to generate more ABC simulations Feedback to GASuC and decide about possible next steps Migrate workflow to production environment Improve workflow Workflow information on the next slides

How to use the ABC workflow Instruction for users

ABC workflow: explanation of job flow Generator job to generate input parameters (currently 4 input) ABC job. Executed as many times in parallel as many parameters are generated by “Generator” Job that archives all output files into a single TAR file

ABC workflow: explanation of data flow Dark green box represents the 4 input files that differ for the 4 ABC simulations. These files are generated by the Generator component during workflow execution. ABC workflow: explanation of data flow Light green boxes represent the input files that are the same for every execution of the ABC simulation (ABC binary executable, BW.3p,SW.2p,SW.3p) The compressed output files (abc.outs) The result of the 4 parallel ABC simulation jobs are 4 files that are saved on EGEE Storage elements. The files are registered in the EGEE File Catalog with Logical File Names.

What should I modify to make a new run? Modify input parameters of ABC simulation and Modify grid parameters for the workflow

Modify input parameters of ABC simulation Double Click on it!

Modify input parameters of ABC simulation Hitting on a key opens the value definition window for that key. Template text with keys. Keys will be replaced with actual numbers by the Generator during the execution of the workflow. All the possible combinations of the replaced template are written into separate files. In the current workflow p_1 parameter defines values for “jmax” and p_2 defines values for “rmax” parameters of ABC. You can define more parameters by changing the template on the left. Generator job is a macro processor that generates text files by replacing keys with actual values in a template which is defined by the user.

Modify input parameters of ABC simulation In this form you can define actual values for the selected parameter. In the workflow the generated values are 17.0 and 21.0 for p_1 and 18.0 and 24.0 for p_2. You can modify this range in order to define larger parameter sets.

Modify grid parameters for the workflow This is necessary because the result files of the Generator job are saved on Storage Elements and are registered in the Grid File Catalog the result files of the ABC jobs are saved on Storage Elements and are registered in the Grid File Catalog File Catalog entries must be different for each workflow execution  Directory names for these files must be changed To modify grid directory names Properties of remote files must be modified. The following slides show how to do it.

Modify grid parameters for the workflow Double Click on it!

Modify grid parameters for the workflow Path syntax is (EGEE): /grid/VONAME/VOUSERNAME/custom_dir You must change ABC_AGEN_files10 to any other directory name to avoid data-rewrite on the grid

Modify grid parameters for the workflow Double Click on it!

Modify grid parameters for the workflow Type the same directory path that you chose for the Generator output files (slide 17). Do not modify the PS/abc.out postfix part of the path!

Modify grid parameters for the workflow Double Click on it!

Modify grid parameters for the workflow Type a new path here. The STDOUT and STDERR files of the jobs will be stored in this directory. Advice: Define a subdirectory within the directory that you chose for the Generator job (Slide 17).

Save and execute the workflow Click on “Workflow” then “Save as” and define a new name Go back to the Web interface and click on “Refresh” on the Portal interface (not the browser refresh button)  The new workflow appears in the list Click on “Submit” of the new workflow You need proxy certificate to execute the workflow on SEE-GRID resources. We provide you with a proxy for 100 hours. If that proxy expires please contact Akos Balasko to get a new one (balasko@sztaki.hu).

Possible next actions If you are satisfied with the workflow Setup a P-GRADE Portal for the Compchem VO (SZTAKI) Migrate the application to that VO (SZTAKI) Define more parameters for the application and execute it at a production level (University of Perugia) Train the users (SZTAKI and University of Perugia) If you are not satisfied with the workflow Discuss potential improvements with GASuC Improve the workflow yourself based on P-GRADE Portal user manual (online at www.portal.p-grade.hu)

Thank you! www.lpds.sztaki.hu/gasuc