Overview of Chinese Computing Grid Gang CHEN/IHEP-CC 12 December 2006 Chinese-French Workshop
Gang Chen/CC/IHEP Outline HEP Grid HEP Grid ExperimentsExperiments Grid servicesGrid services Hardware&SoftwareHardware&Software NetworkNetwork Other activitiesOther activities Future planFuture plan Other Chinese Grid Projects Other Chinese Grid Projects CNGridCNGrid ChinaGridChinaGrid
Gang Chen/CC/IHEP HEP Grid: Experiments Support CMS, ATLAS, about 80 physicists participating in the two experiments Support CMS, ATLAS, about 80 physicists participating in the two experiments CMS: Peking University(PKU), IHEPCMS: Peking University(PKU), IHEP Atlas: Shandong University(SDU), University of Science and Technology of China(USTC), Nanjing University(NJU), IHEPAtlas: Shandong University(SDU), University of Science and Technology of China(USTC), Nanjing University(NJU), IHEP Local Experiment: BES Local Experiment: BES 29 institutes from China, Japan, Germany, Russia US, UK, etc29 institutes from China, Japan, Germany, Russia US, UK, etc 5PB totally in next 5 years5PB totally in next 5 years 2000 kSpecInt2K2000 kSpecInt2K ARGO-YBJ Cosmic Ray Experiment ARGO-YBJ Cosmic Ray Experiment China-Italy projectChina-Italy project
Gang Chen/CC/IHEP Grid Services UI (User Interface) : Glite UI (User Interface) : Glite RB (Resource Broker) : Glite (LCG RB) RB (Resource Broker) : Glite (LCG RB) MyProxy : Glite MyProxy : Glite SE (SRM/Dcache/DPM) : Glite SE (SRM/Dcache/DPM) : Glite CE (Torque ): Glite (LCG-CE) CE (Torque ): Glite (LCG-CE) MON (R-GMA) : Glite MON (R-GMA) : Glite BDII : Glite3.0.2 BDII : Glite3.0.2 WNs : Glite WNs : Glite FTS: Glite FTS: Glite LFC : LHC File Catalogue LFC : LHC File Catalogue CA : IHEP CA CA : IHEP CA VOMS: for BES VO VOMS: for BES VO
Gang Chen/CC/IHEP Hardware Resources Computing Resources Computing Resources 28 CPUs (Xeon 3.2GHz/2GB/73SCSI, IBM Blade Server)28 CPUs (Xeon 3.2GHz/2GB/73SCSI, IBM Blade Server) 10 CPUs (Xeon 3.0GHz/2GB/80GB Sata,1U Rackmount).10 CPUs (Xeon 3.0GHz/2GB/80GB Sata,1U Rackmount). Storage resources Storage resources CMS SE (Dcache/srm): 1.2TB(SCSI Raid5)CMS SE (Dcache/srm): 1.2TB(SCSI Raid5) Atlas SE (Dcache/srm): 1.2TB(SCSI Raid5)Atlas SE (Dcache/srm): 1.2TB(SCSI Raid5)
Gang Chen/CC/IHEP m2 floor space refurbished by spring m2 floor space refurbished by spring 2006 PowerPower UPSUPS CoolingCooling Infrastructure
Gang Chen/CC/IHEP Software All machines running Scientific Linux CERN All machines running Scientific Linux CERN Quattor based OS installation Quattor based OS installation Network File System Network File System User home directory: AFSUser home directory: AFS Experiment data: NFS/Lustre(testing)Experiment data: NFS/Lustre(testing) Mass Storage System: CASTOR CASTOR2 Mass Storage System: CASTOR CASTOR2 Grid Middleware: gLite 3.0 based Grid Middleware: gLite 3.0 based Local Resource Manager: Torque Local Resource Manager: Torque Monitoring: ganglia Monitoring: ganglia Currently supported VOs: Currently supported VOs: ATLAS, CMS, BES, GILDA, EUCHINA, ARGOATLAS, CMS, BES, GILDA, EUCHINA, ARGO
Gang Chen/CC/IHEP CA and BES VOMS Operation IHEPCA is a CA, covering HEP and Biomedical. IHEPCA is a CA, covering HEP and Biomedical. Statistics: Statistics: Number of issued certificates: Number of issued certificates: TypesUserHostServerTotal Valid Revoked339143
Gang Chen/CC/IHEP VOMS for BES experiment
Gang Chen/CC/IHEP LCG Deployment in China UI CE_torque SE_classicl MON WN1 UI CE_torque SE_dcache BDII PX RB LFC_mysql WN2 SDU VO: ATLAS PC farm UI CE_torque SE_classicl WN1 WN2 PC farm UI WN1 WN2 PC farm PKU VO: CMS CSTNET\CERNET CNICIHEP
Gang Chen/CC/IHEP To lcg00123.grid.sinica.edu.tw
Gang Chen/CC/IHEP grid05.lal.in2p3.fr
Gang Chen/CC/IHEP The result of ping Ping – c hostname Ping – c hostname lcg00123.grid.sinica.edu.tw lcg00123.grid.sinica.edu.tw 1000 packets transmitted, 1000 received, 0% packet loss rtt min/avg/max/mdev = /56.120/57.655/0.363 ms rtt min/avg/max/mdev = /56.120/57.655/0.363 ms grid05.lal.in2p3.fr grid05.lal.in2p3.fr 1000 packets transmitted, 1000 received, 0% packet loss min/avg/max/mdev = / / /0.651 ms 1000 packets transmitted, 1000 received, 0% packet loss min/avg/max/mdev = / / /0.651 ms
Gang Chen/CC/IHEP Comments Performance largely affected by network Performance largely affected by network Multi-stream can achieve good performance Multi-stream can achieve good performance About 20MB/s to Taipei with 30 streamsAbout 20MB/s to Taipei with 30 streams Network to Europe is far from satisfactory Network to Europe is far from satisfactory CNIC is helping us to improve it CNIC is helping us to improve it
Gang Chen/CC/IHEP
Gang Chen/CC/IHEP Grid VPN between IHEP and USTC Motivation Motivation International bandwidth bottleneck of China universitiesInternational bandwidth bottleneck of China universities Academic users in universities have to use commercial service shared with millions of public users.Academic users in universities have to use commercial service shared with millions of public users. Grid won’t be function this way!Grid won’t be function this way! Solution Solution Virtual Private Network (VPN) channel between CSTNET (USTC) and CSTNET (IHEP). d0ustc gain kBps stable net connection.Virtual Private Network (VPN) channel between CSTNET (USTC) and CSTNET (IHEP). d0ustc gain kBps stable net connection.
Gang Chen/CC/IHEP Secure VPN
Other Activities Partner of EUChinaGRID project Partner of EUChinaGRID project Aims to support the interoperability of the Grid infrastructures in Europe (EGEE) and China (CNGRID) for the benefit of eScience applicationsAims to support the interoperability of the Grid infrastructures in Europe (EGEE) and China (CNGRID) for the benefit of eScience applications To foster the creation of a intercontinental eScience communityTo foster the creation of a intercontinental eScience community Training people Supporting existing and new applications The official start is 1st January 2006, 24 Months durationThe official start is 1st January 2006, 24 Months duration Support ATLAS and and the Cosmic Ray Experiment ARGO in YangbajingSupport ATLAS and and the Cosmic Ray Experiment ARGO in Yangbajing Attend WISDOM data challenge Attend WISDOM data challenge scheduled from 01/10/2006 to 15/12/2006scheduled from 01/10/2006 to 15/12/2006
Gang Chen/CC/IHEP Current Problems Network performance is limited Network performance is limited Well Trained Manpower is not sufficient Well Trained Manpower is not sufficient More user tutorials is needed More user tutorials is needed
Gang Chen/CC/IHEP Beijing Site in the Future Beijing site have been extended up to more computing power and storage capacity, will provide more powerful resource support. Beijing site have been extended up to more computing power and storage capacity, will provide more powerful resource support. Signed MOU for building two T2 for CMS and Atlas respectively: Signed MOU for building two T2 for CMS and Atlas respectively: 2 X Tier CPU (kSI2K) Disk (TB)
Gang Chen/CC/IHEP Other Chinese Grid Projects CNGrid CNGrid ChinaGrid ChinaGrid
Gang Chen/CC/IHEP CNGrid in Brief Key project supported by the National High-Tech R&D Program (the 863 program) Key project supported by the National High-Tech R&D Program (the 863 program) 4-year project 4-year project Launched in May 2002Launched in May 2002 Earliest and largest Grid project in ChinaEarliest and largest Grid project in China 100 million yuan fund from the Government (MoST)100 million yuan fund from the Government (MoST) Two to three times more associated funds from local governments, organizations and industryTwo to three times more associated funds from local governments, organizations and industry
Gang Chen/CC/IHEP CNGrid Sites
Gang Chen/CC/IHEP Applications on CNGrid Bioinformatics Bioinformatics Environment science Environment science Material Science Material Science Computational Chemistries Computational Chemistries Distributed java computing Distributed java computing Scientific visualization Scientific visualization …… ……
Gang Chen/CC/IHEP Deployment of grid software Web browser GT3core Grid Server Web Portal GT3core Grid Server Applications CNGrid GOS APIs Application server GT3 WS GS OGSA/OGSI WebSphere,.Net GS or wrappers Grid Site A Local resource Grid Site B Local resource CNGrid Info and Res. manager outsource CNGrid Info and Res. manager Internet CNGrid GOS APIs application GS or wrappers APIs Reg. Grid software RB1 2 3 RA Grid mgr.
Gang Chen/CC/IHEP Ground Water Survey
Gang Chen/CC/IHEP Result from GRAPES for forecasting snow (rain) in Dec. 21, 2004 ( grid : 30km )
Gang Chen/CC/IHEP Scientific Data Grid Portal
Gang Chen/CC/IHEP
Gang Chen/CC/IHEP ChinaGrid in Brief China Education and Research Grid China Education and Research Grid Funded by Ministry of Education Funded by Ministry of Education Based on CERNET (China Education and Research Network) Based on CERNET (China Education and Research Network) First Phase First Phase key universities as initiative12 key universities as initiative More than 6Tflops w/60TBMore than 6Tflops w/60TB 20 key universities now20 key universities now
Gang Chen/CC/IHEP ChinaGrid (The First Phase)
Gang Chen/CC/IHEP ChinaGrid Specific Application High performance computing environment (campus grid) Data grid Access grid Computational grid NUDT THU HUST ZSU PKU SJTU XJTU NEU SCUT BUAA SEU SDU Remote education grid Image processing grid Fluid dynamics grid Massive information processing grid Bioinformatics grid
Gang Chen/CC/IHEP Bio-info Grid To provide the bio-information data resources such as gene databases and Chinese medicine components databases, and bio- information analysis tools to grid users; To provide the bio-information data resources such as gene databases and Chinese medicine components databases, and bio- information analysis tools to grid users; To develop computing grid aided drug design systems based on the integration of the techniques of assembled biology, assembled chemistry, and computer aided filter, sequence analysis and structure, to optimize the drug design. To develop computing grid aided drug design systems based on the integration of the techniques of assembled biology, assembled chemistry, and computer aided filter, sequence analysis and structure, to optimize the drug design.
Gang Chen/CC/IHEP Course On-line Grid
Gang Chen/CC/IHEP Comments Middle-wares of CNGrid and ChinaGrid are different from gLite Middle-wares of CNGrid and ChinaGrid are different from gLite Security schema not based on CA Security schema not based on CA No efficient data management system No efficient data management system Interoperability work undergoing with BUAA and CNIC Interoperability work undergoing with BUAA and CNIC
Gang Chen/CC/IHEP Thank you!