The EDGeS project receives Community research funding 1 EDGeS infrastructure for the EGEE user community Peter Kacsuk MTA SZTAKI

2 What is EDGeS? EDGeS: Enabling Desktop Grids for e-Science 1.EDGeS was a 2-year FP7 project completed on the 31 st of March Its primary goal was to support EGEE user communities in running their applications on massive volunteer desktop grid (DG) systems 3.To achieve this EDGeS created an infrastructure to extend EGEE VOs with DG systems provided an application porting and validation service

3 The EDGeS infrastructure EGEE VO1 EGEE VO2 DG1DG2DGn EGEE VOn EDGeS bridge services Jobs WUs 3G Bridge EDGeS Appl Repository EDGeS portal (5.000 CPUs) Extremadura School DG ( CPUs)

Generic Grid-Grid (3G) Bridge to extend SGs with DGs Job Handler Interface Job Database Queue Manager GridHandler Interface OurGrid Plugin Our Grid XtremWe b Plugin Xtrem Web DC-API Plugin BOINC Job source EGEE GRAM EGEE Job source gUSE submitter gUSE/ WS- PGRADE portal 3G Bridge

5 3G Bridge as a WS 3G Bridge Job DB 3G Bridge Job DB Queue Manager Grid Handler Interface Grid Plugin 2 Grid Plugin 3 Grid Plugin n WSSubmitte r Grid Plugin 1 Download Manager Download Manager HTTP D Submit job Check status Get Output Fetch input files

6 EGEE VO  DG system EGEE WMS DG-CE EGEE UI EDGeS Application Repository Watch Get output DG-LRMS EGEE BDII (with DG-CE) Info provider Check EXE Send job Submit job EGEE LB EGEE VOMS X509 proxy 3G Bridge BOINC1 (SZDG) DC-API plugin 3G Bridge BOINC2 (UoW) DC-API plugin 3G Bridge XWeb IN2P3 XWeb plugin DG servers WS interface QM WS client EDGeS Services

7 EGEE VO  DG system EGEE WMS DG-CE EGEE UI EDGeS Application Repository Get EXE Watch Get output DG-LRMS EGEE BDII (with DG-CE) Info provider Report resources and performance Submit job Check EXE Send job Submit job EGEE LB Log events Send output EGEE VOMS X509 proxy 3G Bridge BOINC1 (SZDG) DC-API plugin 3G Bridge BOINC2 (UoW) DC-API plugin 3G Bridge XWeb IN2P3 XWeb plugin DG servers WS interface QM WS client EDGeS Services

8 GlobalDGLocalDG University DG e.g. Univ. of Westminster Volunteer DG e.g. Service Grid EGEE EGEE User access to various grids EDGeS Appl. Repository

9

10

EGEE VO extension with a single DG EDGeS VO UI machine WMS Machine Other EGEE services EDGeS CE machine LCG-CE WNWN WNWN WNWN WNWN WNWN WNWN BOINC1 server DB QM WS Interface DC-API plugin QM WS client

EGEE VO extension with a single DG EDGeS VO UI machine WMS Machine Other EGEE services EDGeS CE machine LCG-CE WNWN WNWN WNWN WNWN WNWN WNWN BOINC1 server DB QM WS Interface DC-API plugin QM WS client

EGEE VO extension with two DGs EDGeS VO UI machine WMS Machine Other EGEE services EDGeS CE machine LCG-CE WNWN WNWN WNWN WNWN WNWN WNWN BOINC1 server DB QM WS Interface DC-API plugin QM WS client BOINC2 server DB QM WS Interface DC-API plugin QM WS client

14 Portal -> SEEGRID ->DG and portal->VOCE infrastructure SEEGRID WMS CE+ Bridge Client WS Interface Core 3G Bridge DG Server DG server machine AR EDGeS Bridge Services CE AR Cache EDGeS portal VOCE WMS VOCE CE Desktop 1 Desktop 2 Desktop N

15 RI NA3 version: 1.0 Introduction Author: Ad Emmen MoUs with other projects Signed MoU with EGEE III Jointly select EGEE applications that should be migrated to EDGeS Collaboration in porting these appls to EDGeS EGEE support for the establishment and operation of the EDGeS VO Organizing joint events (summer school, user forum meetings) Signed MoU with EELA-2 IberCivis DG SEE-GRID-SCI 15

16 Ported Applications Application name Application description User community ISDEP Integrator of Stochastic Differential Equations in Plasmas, fusion plasma application BIFI, Spain, Fusion Community of EGEE X-ray Extraction of X-ray diffraction profilesUniversity of Extramadura, Spain VisIVO Visualisation Interface to the Virtual ObservatoryAstrophysical Observatory of Catania, Italy GRIMP Grid-based tool for high-speed analysis of large scale genome-wide association Erasmus Medical Centre, The Netherlands DASP Designing periodic non-uniform sampling sequences for digital alias free signal processing Centre for System Analysis, University of Westminster, UK Protein Protein carbohydrate docking simulations using AutoDock School of Biosciences, University of Westminster, UK EMMIL E-marketplace model integrated with logisticsInternational Business School, Hungary CancerGrid Anti-cancer drug designSME participants in the European CancerGrid Project Laserac Simulate the dynamics of laser devices using a cellular automata based discrete model University of Seville, Spain

17 Ported Applications Application name Application description User community Signal and Image Processing Signal and image processing using WSRF-compliant web services to distribute Java and Matlab based routines Forschungszentrum Karlsruhe, Germany PLINK Analysis of genotype/phenotype dataAtos Origin, Spain DART Distributed Audio Retrieval Using TrianaCardiff University, UK Blender 3D Video Rendering using BlenderBlender user community Patient Readmission Profiling hospitals based on patient readmission statistics Health and Social Care Modeling Group, University of Westminster, UK UC-Explorer Understand basic universality classes of non- equilibrium system KFKI Research Institute for Technical Physics and Materials Sciences, Hungary InterProScan Protein Functional AnalysisCNR, Italy SLinCa Scaling laws in cluster aggregation to detect defect aggregation in materials Kurdymov Institute, Ukraine MVP Multi-scale Video ProcessingKurdymov Institute, Ukraine BinSys Search for binary number systemsEötvös Lóránd University, Hungary

18 Using the EDGeS infrastructure outside the EU New FP7 project: DEGISCONew FP7 project: DEGISCO Objectives: to support non-EU countries to create their national EDGeS infrastructure:Objectives: to support non-EU countries to create their national EDGeS infrastructure: –Brazil –China –Kazakhstan –Russia –Taiwan –Ukraina Representatives of other national grids are welcome to join DEGISCORepresentatives of other national grids are welcome to join DEGISCO

19 Extension of the EDGeS infrastructure: EDGI EDGeS scope only for compute intensive apps for EGEE (glite) EDGI scope for both compute and data intensive apps for EMI/EGI (gLite, ARC, Unicore)

Academic Cloud Academic grid/cloud ecosystem Desktop grids (DGs) (volunteer DGs – home computers, organizational DGs – institutional desktops) Cluster based service grids (SGs) (EGEE, OSG, etc.) Supercomputer based SGs (DEISA, TeraGrid) OGF PGI EDGeS/EDGI EDGI

21 Summary EDGeS enables to extend gLite VOs withEDGeS enables to extend gLite VOs with –BOINC or XtremWeb public or local DGs –Current DGs: EDGeS is an open infrastructure:EDGeS is an open infrastructure: –Any gLite based VO can be extended with DGs –EDGI helps in EU countries and DEGISCO in non-EU countries to extend gLite based VOs with DGs –Anyone can support EGEE applications by donating desktop cycles to Any EGEE user can access EDGeS:Any EGEE user can access EDGeS: –EDGI and DEGISCO helps any EGEE user community in porting their applications into EDGeS –EDGeS Application Repository stores applications already ported to EDGeS and usable by any EDGeS users

22 For more information please visit the EDGeS Website: Join the EDGeS User & Industry Forum here! Please contact us if you need support in porting your application to EDGeS Thank you for your attention … Any questions?