1 IDGF International Desktop Grid Federation How can you benefit from joining IDGF? Hannover, Peter Kacsuk, MTA SZTAKI, EDGI is supported by the FP7 Capacities Programme under contract nr RI

2 EDGI NA2 17/10/ IDGF in a nutshell  Objectives – Build a community of those people who are interested in any form of desktop grids including Different technology developers and users (BOINC, Condor, XtremWeb, OurGrid, etc.) Service grid providers who would like to extend their resources with DG resources Scientists who want to build campus grid – Create forum for this community

3 EDGI NA2 17/10/ How to get benefit of joining IDGF?  Different type of communities can get different kind of benefits  In order to understand the potential benefits first we summarize the potential business models of using DG systems

4 EDGI NA2 17/10/ Typical current business model for volunteer desktop grids VDG DG project administrator defines the input data to be processed by the appl BOINC project runs 1 appl that runs for years

5 EDGI NA2 17/10/ business model for volunteer desktop grids VDG Many end-users can access the project via a web interface end-users define the input data to be processed by the appl Portal BOINC project runs one appl (genetics research) The appl runs if a user gives input data

6 EDGI NA2 17/10/ EDGeS, DEGISCO and EDGI business model for volunteer desktop grids VDG Many end-users can access the project via a web interface end-users define the input data to be processed by the appls Portal BOINC project runs several appls An appl runs if a user gives input data

7 EDGI NA2 17/10/ DEGISCO business model for volunteer desktop grids VDG Many end-users can access the project via a web interface end-users define the input data to be processed by the appls Portal BOINC project runs several appls An appl runs if a user gives input data DEGISCO provides SG VO resources SG VO

8 EDGI NA2 17/10/ EDGI business model for volunteer desktop grids VDG Many end-users can access the project via a web interface end-users define the input data to be processed by the appls Portal BOINC project runs several appls An appl runs if a user gives input data EDGI provides cloud resources for QoS Cloud

9 EDGI NA2 17/10/ EDGI business model for volunteer desktop grids VDG Many end-users can access the project via a service grid VO UI end-users define the input data to be processed by the appls BOINC project runs several appls An appl runs if a user gives input data EDGI provides cloud resources for QoS SG VO Cloud

10 EDGI NA2 17/10/ Benefits for potential DG communities Globe adapted from wikipedia/commons/f/fa/ Globe.svg IDGF International Desktop Grid Federation

11 EDGI NA2 17/10/ Benefit for new volunteer BOINC systems  It takes several years until a new volunteer BOINC system can collect substantial number of resources  IDGF will give access to the large set of SG VO resources that were created in the EDGeS and later in the DEGISCO project  It contains ~2000 computers

12 EDGI NA2 17/10/ Extending current business model of volunteer desktop grids with the DEGISCO business model VDG DG project administrator defines the input data to be processed by the appl BOINC project runs 1 appl that runs for years SG VO The SG VO maintained by DEGISCO (and later by IDGF) provides ~2000 computers to support a VDG

13 EDGI NA2 17/10/ Supporting many volunteer desktop grids by the DEGISCO business model VDG SG VO The SG VO maintained by DEGISCO (and later by IDGF) provides ~2000 computers to support VDGs VDG

14 EDGI NA2 17/10/ Desktop Grid VO Desktop Grid VO Statistics

15 EDGI NA2 17/10/

16 EDGI NA2 17/10/

17 EDGI NA2 17/10/ Examples of volunteer BOINC systems supported by the DEGISCO business model  (Ukraina)  (Germany)  IberCivis (Spain and Portugal)  (China)  (Russia)  (Germany)  Univ. of Westminster Campus Grid (UK)

18 EDGI NA2 17/10/ (over 1 TFlop/s)

19 EDGI NA2 17/10/ (over 1 TFlop/s)

20 EDGI NA2 17/10/

21 EDGI NA2 17/10/ Attracting more participants for volunteer desktop grids  EDGI introduces a new architecture where desktop grids (BOINC, XtremWeb) can be extended with cloud resources for QoS  However, in order to get cloud resources the user needs credits  In order to collect credit either the user or her organization should provide resources for volunteer DGs belonging to IDGF  If you joined to IDGF those who would like to earn more credit will support your DG system

22 EDGI NA2 17/10/ Benefits for those who would like to build a campus grid  There are several technologies (BOINC, Condor, OurGrid, XtremWeb, etc.) to build a campus grid  IDGF provides forum to – discuss and compare these technologies – make them popular to the scientific communities – elaborate the interconnection methods of campus grids built on these technologies  IDGF provides support to build the campus grid – Technology selection support – Installation, configuration and testing support – User interface (e.g. portal) provision support – Application porting support

23 EDGI NA2 17/10/ Benefits for those who would like to port applications to DG systems  Porting applications to volunteer DG is not easy  IDGF members have expertise in this field and can provide support for newcomers – Application porting technology selection support – Providing best practice case studies of application porting – Assistance in porting an application

24 EDGI NA2 17/10/ Application porting experience in EDGI ApplicationOrganizationStatus CORSIKA: Cosmic Ray Simulation Karlsruhe Institute for Technology, UoW Ported to BOINC, in AR, validated, deployed at UoW BWA: alignment of DNA sequences Academic Medical Center of the University of Amsterdam, UoW Ported to BOINC, in AR, validated, deployed at AMC and UoW AutoDock Vina: molecular docking University of Westminster Ported to BOINC, in AR, under validation, deployed at UoW GATE: Hadrontherapy simulation Creatis CNRS, SZTAKI Ported to BOINC, in AR, under validation

25 EDGI NA2 17/10/ Application porting experience in EDGI ApplicationOrganisationStatus Conformer Generator (Tinker), molecular modelling Biological Research Center (BRC) of the Hungarian Academy of Sciences, SZTAKI Ported to BOINC, in AR, under validation Classification: R based classification of patients Academic Medical Center of the University of Amsterdam, UoW Ported to BOINC, in AR, under validation, deployed at UoW Mental Ray: commercial rendering engine University of Westminster Ported to BOINC, in AR, under validation, deployed at UoW Guineapig++: simulate beam-beam interactions in high-energy colliders CNRS/IN2P3Ported to XW HEP, in AR, under validation, deployed at IN2P3

26 EDGI NA2 17/10/ Ported applications EGI AppDB

27 EDGI NA2 17/10/ Benefits for those who would like to extend SG VO with DG  The EDGI business model and architecture is a good example how to extend a SG VO with DGs  Small SG VOs can get additional resources for parameter sweep (PS) applications  IDGF members have expertise in this field  IDGF provides support to extend a SG VO with DGs – Technology selection support – Installation, configuration and testing support – User interface (e.g. portal) provision support – Application porting support

28 EDGI NA2 17/10/ Balanced usage of SG and DG systems within a country  With the technology provided by EDGI and DEGISCO processing load can be transferred towards the less loaded systems – Overloaded SGs can transfer jobs to DGs – Overloaded DGs can transfer WUs to SGs

29 EDGI NA2 17/10/ Benefit for technology and application developer organizations of the European Chapter  IDGF will participate in FP7 and FP8 EU projects  The work allocated for IDGF in these projects will be distributed among the member organizations of the European Chapter  To take IDGF as partner in EU projects will be attractive since IDGF will represent a large community (see the HealthGrid experience)

30 EDGI NA2 17/10/ Conclusions  Joining IDGF is worth for both SG and DG community members  DG community members can extend their DG with SG resources  SG community members can extend their SG VO with DG resources  Both communities can get application porting support  IDGF can significantly impact the community and can attract additional financial resources

31 Globe adapted from wikipedia/commons/f/fa/ Globe.svg IDGF International Desktop Grid Federation