EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interconnection & Interoperability of Grids between Europe and China -- the EUChinaGRID Project Prof. Sijin QIAN Peking University – Beijing, China Manchester

Enabling Grids for E-sciencE EGEE-II INFSO-RI Outline The EUChinaGRID project outline Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite (of EGEE) – GOS (of CNGRID) interoperability study between two middleware –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI Project Information EUChinaGRID is a Specific Support Action (SSA). The project started on the 1 January months duration. 10 partners (6 from EU and 4 from China). Project budget 1,299,998 €. A total of 495 Person Months (325 are funded).

Enabling Grids for E-sciencE EGEE-II INFSO-RI Participants PartnersThird Parties INFN (Italy) Coordinator Università di Roma Tre - Dip. di Fisica – Rome (IT) CERN – Geneva (CH) Academia Sinica Grid Computing Centre (ASGC) – Taipei Università di Roma Tre - Dip. di Biologia – Rome (IT) Consortium GARR (IT) GRNET (GR) Jagiellonian University-MC – Cracow (PL) Beihang University – Beijing (CN) CNIC-CAS – Beijing (CN) IHEP-CAS – Beijing (CN) Peking University – Beijing (CN)

Enabling Grids for E-sciencE EGEE-II INFSO-RI EUChinaGRID at a Glance Set-up and manage a Pilot Infrastructure Train users and site administrators to use and operate an e-Infrastructure Disseminate, both “bottom-up” and “top- down”, the e-Infrastruc- ture paradigm for long term sustainability of e-Science Attract new communities in learning, testing and using pilot infrastructure

Enabling Grids for E-sciencE EGEE-II INFSO-RI EUChinaGRID Main Objectives Support the Interconnection and Interoperability of Grids between Europe and China. Main focus is on two specific Grid infrastructures: –CNGRID in China (with the middleware of GOS) –EGEE in Europe (with the middleware of gLite) Dissemination of advanced knowledge in Grid technology is also an important part of the activity. Strengthening the collaboration between scientific groups in both regions, supporting existing and new Grid applications.

Enabling Grids for E-sciencE EGEE-II INFSO-RI The “Global” Network

Enabling Grids for E-sciencE EGEE-II INFSO-RI The “Global” Grid

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI A deliverable was produced Status and perspectives of network connectivity to Asia It describes the state of the art and the perspectives of network connectivity between Europe and Asia. Partners are using both CERNET, directly connected to TEIN2/ORIENT, and CSTNET, the two main Research Networks in China. EUChinaGRID is developing synergies with ORIENT/TEIN2 projects to improve the connectivity between China and Europe Network Planning

Enabling Grids for E-sciencE EGEE-II INFSO-RI TEIN2 and ORIENT connectivity upgrade 2.5Gbps Network Updating

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI IPv6 Compliance Investigated the IPv6 compliance of gLite and GOS middleware Implemented a tool to check the code Produced a guideline for developers Developed a useful collaboration with ETICS

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI EUChinaGrid Pilot Infrastructure

Enabling Grids for E-sciencE EGEE-II INFSO-RI Authorization and Security Completed D3.1 and D3.2 We set up the CA infrastructure reaching the goal of interoperable certificates on the pilot grid –CNIC Grid CA ( –Scientific DataGrid CA ( Accredited by Asian-Pacific Grid Policy Management Authority

Enabling Grids for E-sciencE EGEE-II INFSO-RI Infrastructure Services Installed, configured and currently maintained: Type of node WhereFunctionality RB/BDII/UIItaly (CNAF)Resource Broker and Catalog, User Interface GridICE collector Italy (CNAF)Grid Monitoring Service VOMSItaly (CNAF)Virtual Organization Management Service Sec. VOMSChina (CNIC)Virtual Organization Management Service SAMChina (IHEP)Service Availability Monitor GstatTaiwan (ASGC)Grid Information System stats

Enabling Grids for E-sciencE EGEE-II INFSO-RI ROC Website Regional Operations Center: Any kind of information about EUChinaGrid infrastructure Starting point for operations activity –Links to all useful EUChinaGrid monitoring pages Documentation for users and sites

Enabling Grids for E-sciencE EGEE-II INFSO-RI Monitoring Tools BEIJING - PKU

Enabling Grids for E-sciencE EGEE-II INFSO-RI Ticketing System Address: Powerful and flexible tool Successfully used for operation activity on the EUChinaGrid pilot infrastructure –Preliminary shifts done to improve grid availability

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI CNGrid and EGEE Interoperability We have achieved basic batch job submission between GOS (CNGrid) and gLite (EGEE) Studied and implemented plug-in to extend GOS batch service Studied the extension to allow CE to forward batch jobs to GOS Set up pilot testbed for interoperability test –Submission of batch jobs from GOS to GLite works by now  Simple batch job with “simple” data transfers  Large data transfers foreseen for this year Resource information of GOS can be published on BDII Extending LCG Job Manager to submit batch job to GOS feasible

Enabling Grids for E-sciencE EGEE-II INFSO-RI Pipeline-based Gateway GOS WMProxy batch job Extended LCG-CE batch job GOS batch job Thread Pool Scheduler Thread Pool Scheduler Pipeline for GLite to GOS Pipeline for GOS to GLite Different colors in pipeline stand for different stages (StageIn, StageOut, … ) Each pipeline has corresponding thread pool and scheduler Extended LCG-CE forwards batch jobs to gateway Extended GOS forwards batch job to gateway Idle thread pool used in scheduler Scheduler executes stage in pipeline using idle thread from thread pool

Enabling Grids for E-sciencE EGEE-II INFSO-RI Testbed portal.ct.infn.it gos.ct.infn.it glite-gos.ct.infn.it WMProxy glite-rb2.ct.infn.it OpenPBS GridSAM4GLite GridSAM4GOS WMS/RB edg glite-UI Extended LCG-CE jakarta-tomcat Portal or WS-Client Command Line CE WN JSDL JDL RSL JDL RSL JSDL

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI Applications EGEE ATLAS and CMS support ARGO Data mover MEDEA++ Corsika NBP Application Rosetta Early/Late stage

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI The Virtuous Cycle of Dissemination Wider dissemination Raises grid awareness and attracts new potential users Dissemination of advanced knowledge Provides potential users with grid expertise Promoting new communities New users can now use and deploy their applications and act as a dissemiation vehicle at a National level JOINING TRAINING DISSEMINATING

Enabling Grids for E-sciencE EGEE-II INFSO-RI Some Numbers 4 International Meetings, Workshops and Conferences organized –210 overall attendees 16 external events with EUChinaGRID presence Dissemination and training materials produced –>150 web pages –4 leaflets –3 press releases 5 tutorial events held –231 overall trained people 46 press cuttings collected in 9 different languages (including Chinese, English and Spanish) and 3 continents 48 questionnaires received from new potential users’ communities

Enabling Grids for E-sciencE EGEE-II INFSO-RI Project’s Website

Enabling Grids for E-sciencE EGEE-II INFSO-RI Training Events: Participants at a Glance

Enabling Grids for E-sciencE EGEE-II INFSO-RI To get a picture of new user communities adopting distributed and grid computing, in order to support their collaboration with EUChinaGRID activities. Published on the website (in English and Chinese): – – Advertised by partners in their communities. Survey on New Communities

Enabling Grids for E-sciencE EGEE-II INFSO-RI nd EUChinaGRID Conference Held in Beijing on April Jointly with EchoGRID Networking EU & Chinese Grid Experiences for Innovation

Enabling Grids for E-sciencE EGEE-II INFSO-RI Future Events Booth at G8—UNESCO World Forum on “Education, Research and Innovation” in Trieste, Italy, May 11 & 12, nd EUChinaGRID Workshop jointly to the Cracow Grid Workshop 2007 (Cyfronet) in Cracow, Poland, October 14 – 17, 2007

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project Activities and status –Network planning –IPv6 compliance –Infrastructure & operations –gLite – GOS interoperability study –Applications –Dissemination Summary & conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI Summary & Conclusions The EUChinaGRID project just passed the first annual review in 3/2007. Very noticeable technical results. Great progresses towards developing a human network collaborating to the creation of a common grid infrastructure for e-Science between Europe and China. The activities foreseen for this second year will further improve the results obtained so far, both from the technical and human networking points of view.

Enabling Grids for E-sciencE EGEE-II INFSO-RI Thank You for Your Attention! Questions?