Overview of Chinese Computing Grid Gang CHEN/IHEP-CC 12 December 2006 Chinese-French Workshop.

Slides:



Advertisements
Similar presentations
Kejun Dong, Kai Nan CNIC/CAS CNIC Resources And Activities Update Resources Working Group PRAGMA11 Workshop, Oct.16/17 Osaka, Japan.
Advertisements

Inetrconnection of CNGrid and European Grid Infrastructure Depei Qian Beihang University Feb. 20, 2006.
Jorge Gasós Grid Technologies Unit European Commission The EU e Infrastructures Programme Workshop, Beijing, June 2005.
CBPF J. Magnin LAFEX-CBPF. Outline What is the GRID ? Why GRID at CBPF ? What are our needs ? Status of GRID at CBPF.
EU-IndiaGrid (RI ) is funded by the European Commission under the Research Infrastructure Programme Sergio Fantinel (INFN-Padova/LNL)
CNIC Grid/SDG CA Updates 2 nd APGrid PMA meeting, October 15, 2006 Morrise Xu NTARL, CNIC, China.
BEIJING-LCG2 Tire2 Grid. Outline  Introduction about IHEP Grid  Fabric infrastructure of BeiJing-Lcg2  Middleware grid-service and supported VO’s.
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
FP6−2004−Infrastructures−6-SSA Data Grid Infrastructure for YBJ-ARGO Cosmic-Ray Project Gang CHEN, Hongmei ZHANG - IHEP.
Institute for High Energy Physics ( ) NEC’2007 Varna, Bulgaria, September Activities of IHEP in LCG/EGEE.
Site Report HEPHY-UIBK Austrian federated Tier 2 meeting
The Grid in China ACGRID Symposium Hanoi, 16/Nov./2007 Gang CHEN Institute of High Energy Physics Chinese Academy of Sciences.
HPC and e-Infrastructure Development in China’s High- tech R&D Program Danfeng Zhu Sino-German Joint Software Institute (JSI), Beihang University Dec.
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.
FP6−2004−Infrastructures−6-SSA EUChinaGRID Project Giuseppe Andronico Technical Manager EUChinaGRID Project INFN Sez.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Pilot Test-bed Operations and Support Work.
Division Report Computing Center CHEN Gang Computing Center Oct. 24, 2013 October 24 ,
Grid Activities in China CHEP’06 Mumbai, 16/Feb/2006 Gang CHEN Institute of High Energy Physics, CAS Baoping YAN Computer Network Information Center, CAS.
Status of CNGrid and Interests on International Testbed Depei Qian Sino-German Joint Software Institute (JSI) Beihang University SC12 BoF on Computing.
HEP Grid Computing in China Gang Workshop on Future PRC-U.S. Cooperation in High Energy Physics.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Configuring and Maintaining EGEE Production.
11 ALICE Computing Activities in Korea Beob Kyun Kim e-Science Division, KISTI
FP6−2004−Infrastructures−6-SSA IPv6 and Grid Middleware: the EUChinaGRID experience Gabriella Paolini – GARR Valentino.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
Grid Infrastructure for the ILC Andreas Gellrich DESY European ILC Software and Physics Meeting Cambridge, UK,
L ABORATÓRIO DE INSTRUMENTAÇÃO EM FÍSICA EXPERIMENTAL DE PARTÍCULAS Enabling Grids for E-sciencE Grid Computing: Running your Jobs around the World.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
ChinaGrid Experience with GT4 Hai Jin Huazhong University of Science and Technology
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
The ILC And the Grid Andreas Gellrich DESY LCWS2007 DESY, Hamburg, Germany
Site Report BEIJING-LCG2 Wenjing Wu (IHEP) 2010/11/21.
IHEP Computing Center Site Report Shi, Jingyan Computing Center, IHEP.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
FP6−2004−Infrastructures−6-SSA EUChinaGrid Infrastructure Giuseppe Andronico - INFN Catania Concertation Meeting – Budapest,
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Eine Einführung ins Grid Andreas Gellrich IT Training DESY Hamburg
FP6−2004−Infrastructures−6-SSA Interconnection & Interoperability of Grids between Europe and China the EUChinaGRID Project F. Ruggieri – INFN Project.
INFSO-RI Enabling Grids for E-sciencE Experience of using gLite for analysis of ATLAS combined test beam data A. Zalite / PNPI.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interconnection & Interoperability of Grids.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
IHEP(Beijing LCG2) Site Report Fazhi.Qi, Gang Chen Computing Center,IHEP.
FP6−2004−Infrastructures−6-SSA EUChinaGrid status report Giuseppe Andronico INFN Sez. Di Catania CERN – March 3° 2006.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
IAG – Israel Academic Grid, EGEE and HEP in Israel Prof. David Horn Tel Aviv University.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 The EU DataGrid Project Three years.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
INFSO-RI Enabling Grids for E-sciencE GILDA t-Infrastructure Antonio Fuentes Bermejo
First South Africa Grid Training June 2008, Catania (Italy) GILDA t-Infrastructure Valeria Ardizzone INFN Catania.
Gang Chen, Institute of High Energy Physics Feb. 27, 2012, CHAIN workshop,Taipei Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures.
IHEP Computing Center Site Report Gang Chen Computing Center Institute of High Energy Physics 2011 Spring Meeting.
Using HLRmon for advanced visualization of resource usage Enrico Fattibene INFN - CNAF ISCG 2010 – Taipei March 11 th, 2010.
The status of IHEP Beijing Site WLCG Asia-Pacific Workshop Yaodong CHENG IHEP, China 01 December 2006.
ChinaGrid: National Education and Research Infrastructure Hai Jin Huazhong University of Science and Technology
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
2 nd EGEE/OSG Workshop Data Management in Production Grids 2 nd of series of EGEE/OSG workshops – 1 st on security at HPDC 2006 (Paris) Goal: open discussion.
Grid Computing Activities in PKU Asso. Prof. CHEN Ping Prof. QIAN Sijin Asso. Prof. YU Huashan Peking University
Grids and SMEs: Experience and Perspectives Emanouil Atanassov, Todor Gurov, and Aneta Karaivanova Institute for Parallel Processing, Bulgarian Academy.
The Grid in China ISGC 2008 Taipei, 10/April/2008 Gang CHEN Institute of High Energy Physics Chinese Academy of Sciences.
Grid Computing: Running your Jobs around the World
The Beijing Tier 2: status and plans
Security Requirements for ChinaGrid Applications - What the current grid security solutions cannot do Hai Jin Huazhong University of Science and Technology.
Introduction to EPIKH Project and Site admin tutorial
The GENIUS portal and the GILDA t-Infrastructure
Presentation transcript:

Overview of Chinese Computing Grid Gang CHEN/IHEP-CC 12 December 2006 Chinese-French Workshop

Gang Chen/CC/IHEP Outline HEP Grid HEP Grid ExperimentsExperiments Grid servicesGrid services Hardware&SoftwareHardware&Software NetworkNetwork Other activitiesOther activities Future planFuture plan Other Chinese Grid Projects Other Chinese Grid Projects CNGridCNGrid ChinaGridChinaGrid

Gang Chen/CC/IHEP HEP Grid: Experiments Support CMS, ATLAS, about 80 physicists participating in the two experiments Support CMS, ATLAS, about 80 physicists participating in the two experiments CMS: Peking University(PKU), IHEPCMS: Peking University(PKU), IHEP Atlas: Shandong University(SDU), University of Science and Technology of China(USTC), Nanjing University(NJU), IHEPAtlas: Shandong University(SDU), University of Science and Technology of China(USTC), Nanjing University(NJU), IHEP Local Experiment: BES Local Experiment: BES 29 institutes from China, Japan, Germany, Russia US, UK, etc29 institutes from China, Japan, Germany, Russia US, UK, etc 5PB totally in next 5 years5PB totally in next 5 years 2000 kSpecInt2K2000 kSpecInt2K ARGO-YBJ Cosmic Ray Experiment ARGO-YBJ Cosmic Ray Experiment China-Italy projectChina-Italy project

Gang Chen/CC/IHEP Grid Services UI (User Interface) : Glite UI (User Interface) : Glite RB (Resource Broker) : Glite (LCG RB) RB (Resource Broker) : Glite (LCG RB) MyProxy : Glite MyProxy : Glite SE (SRM/Dcache/DPM) : Glite SE (SRM/Dcache/DPM) : Glite CE (Torque ): Glite (LCG-CE) CE (Torque ): Glite (LCG-CE) MON (R-GMA) : Glite MON (R-GMA) : Glite BDII : Glite3.0.2 BDII : Glite3.0.2 WNs : Glite WNs : Glite FTS: Glite FTS: Glite LFC : LHC File Catalogue LFC : LHC File Catalogue CA : IHEP CA CA : IHEP CA VOMS: for BES VO VOMS: for BES VO

Gang Chen/CC/IHEP Hardware Resources Computing Resources Computing Resources 28 CPUs (Xeon 3.2GHz/2GB/73SCSI, IBM Blade Server)28 CPUs (Xeon 3.2GHz/2GB/73SCSI, IBM Blade Server) 10 CPUs (Xeon 3.0GHz/2GB/80GB Sata,1U Rackmount).10 CPUs (Xeon 3.0GHz/2GB/80GB Sata,1U Rackmount). Storage resources Storage resources CMS SE (Dcache/srm): 1.2TB(SCSI Raid5)CMS SE (Dcache/srm): 1.2TB(SCSI Raid5) Atlas SE (Dcache/srm): 1.2TB(SCSI Raid5)Atlas SE (Dcache/srm): 1.2TB(SCSI Raid5)

Gang Chen/CC/IHEP m2 floor space refurbished by spring m2 floor space refurbished by spring 2006 PowerPower UPSUPS CoolingCooling Infrastructure

Gang Chen/CC/IHEP Software All machines running Scientific Linux CERN All machines running Scientific Linux CERN Quattor based OS installation Quattor based OS installation Network File System Network File System User home directory: AFSUser home directory: AFS Experiment data: NFS/Lustre(testing)Experiment data: NFS/Lustre(testing) Mass Storage System: CASTOR  CASTOR2 Mass Storage System: CASTOR  CASTOR2 Grid Middleware: gLite 3.0 based Grid Middleware: gLite 3.0 based Local Resource Manager: Torque Local Resource Manager: Torque Monitoring: ganglia Monitoring: ganglia Currently supported VOs: Currently supported VOs: ATLAS, CMS, BES, GILDA, EUCHINA, ARGOATLAS, CMS, BES, GILDA, EUCHINA, ARGO

Gang Chen/CC/IHEP CA and BES VOMS Operation IHEPCA is a CA, covering HEP and Biomedical. IHEPCA is a CA, covering HEP and Biomedical. Statistics: Statistics: Number of issued certificates: Number of issued certificates: TypesUserHostServerTotal Valid Revoked339143

Gang Chen/CC/IHEP VOMS for BES experiment

Gang Chen/CC/IHEP LCG Deployment in China UI CE_torque SE_classicl MON WN1 UI CE_torque SE_dcache BDII PX RB LFC_mysql WN2 SDU VO: ATLAS PC farm UI CE_torque SE_classicl WN1 WN2 PC farm UI WN1 WN2 PC farm PKU VO: CMS CSTNET\CERNET CNICIHEP

Gang Chen/CC/IHEP To lcg00123.grid.sinica.edu.tw

Gang Chen/CC/IHEP grid05.lal.in2p3.fr

Gang Chen/CC/IHEP The result of ping Ping – c hostname Ping – c hostname lcg00123.grid.sinica.edu.tw lcg00123.grid.sinica.edu.tw 1000 packets transmitted, 1000 received, 0% packet loss rtt min/avg/max/mdev = /56.120/57.655/0.363 ms rtt min/avg/max/mdev = /56.120/57.655/0.363 ms grid05.lal.in2p3.fr grid05.lal.in2p3.fr 1000 packets transmitted, 1000 received, 0% packet loss min/avg/max/mdev = / / /0.651 ms 1000 packets transmitted, 1000 received, 0% packet loss min/avg/max/mdev = / / /0.651 ms

Gang Chen/CC/IHEP Comments Performance largely affected by network Performance largely affected by network Multi-stream can achieve good performance Multi-stream can achieve good performance About 20MB/s to Taipei with 30 streamsAbout 20MB/s to Taipei with 30 streams Network to Europe is far from satisfactory Network to Europe is far from satisfactory CNIC is helping us to improve it CNIC is helping us to improve it

Gang Chen/CC/IHEP

Gang Chen/CC/IHEP Grid VPN between IHEP and USTC Motivation Motivation International bandwidth bottleneck of China universitiesInternational bandwidth bottleneck of China universities Academic users in universities have to use commercial service shared with millions of public users.Academic users in universities have to use commercial service shared with millions of public users. Grid won’t be function this way!Grid won’t be function this way! Solution Solution Virtual Private Network (VPN) channel between CSTNET (USTC) and CSTNET (IHEP). d0ustc gain kBps stable net connection.Virtual Private Network (VPN) channel between CSTNET (USTC) and CSTNET (IHEP). d0ustc gain kBps stable net connection.

Gang Chen/CC/IHEP Secure VPN

Other Activities Partner of EUChinaGRID project Partner of EUChinaGRID project Aims to support the interoperability of the Grid infrastructures in Europe (EGEE) and China (CNGRID) for the benefit of eScience applicationsAims to support the interoperability of the Grid infrastructures in Europe (EGEE) and China (CNGRID) for the benefit of eScience applications To foster the creation of a intercontinental eScience communityTo foster the creation of a intercontinental eScience community  Training people  Supporting existing and new applications The official start is 1st January 2006, 24 Months durationThe official start is 1st January 2006, 24 Months duration Support ATLAS and and the Cosmic Ray Experiment ARGO in YangbajingSupport ATLAS and and the Cosmic Ray Experiment ARGO in Yangbajing Attend WISDOM data challenge Attend WISDOM data challenge scheduled from 01/10/2006 to 15/12/2006scheduled from 01/10/2006 to 15/12/2006

Gang Chen/CC/IHEP Current Problems Network performance is limited Network performance is limited Well Trained Manpower is not sufficient Well Trained Manpower is not sufficient More user tutorials is needed More user tutorials is needed

Gang Chen/CC/IHEP Beijing Site in the Future Beijing site have been extended up to more computing power and storage capacity, will provide more powerful resource support. Beijing site have been extended up to more computing power and storage capacity, will provide more powerful resource support. Signed MOU for building two T2 for CMS and Atlas respectively: Signed MOU for building two T2 for CMS and Atlas respectively: 2 X Tier CPU (kSI2K) Disk (TB)

Gang Chen/CC/IHEP Other Chinese Grid Projects CNGrid CNGrid ChinaGrid ChinaGrid

Gang Chen/CC/IHEP CNGrid in Brief Key project supported by the National High-Tech R&D Program (the 863 program) Key project supported by the National High-Tech R&D Program (the 863 program) 4-year project 4-year project Launched in May 2002Launched in May 2002 Earliest and largest Grid project in ChinaEarliest and largest Grid project in China 100 million yuan fund from the Government (MoST)100 million yuan fund from the Government (MoST) Two to three times more associated funds from local governments, organizations and industryTwo to three times more associated funds from local governments, organizations and industry

Gang Chen/CC/IHEP CNGrid Sites

Gang Chen/CC/IHEP Applications on CNGrid Bioinformatics Bioinformatics Environment science Environment science Material Science Material Science Computational Chemistries Computational Chemistries Distributed java computing Distributed java computing Scientific visualization Scientific visualization …… ……

Gang Chen/CC/IHEP Deployment of grid software Web browser GT3core Grid Server Web Portal GT3core Grid Server Applications CNGrid GOS APIs Application server GT3 WS GS OGSA/OGSI WebSphere,.Net GS or wrappers Grid Site A Local resource Grid Site B Local resource CNGrid Info and Res. manager outsource CNGrid Info and Res. manager Internet CNGrid GOS APIs application GS or wrappers APIs Reg. Grid software RB1 2 3 RA Grid mgr.

Gang Chen/CC/IHEP Ground Water Survey

Gang Chen/CC/IHEP Result from GRAPES for forecasting snow (rain) in Dec. 21, 2004 ( grid : 30km )

Gang Chen/CC/IHEP Scientific Data Grid Portal

Gang Chen/CC/IHEP

Gang Chen/CC/IHEP ChinaGrid in Brief China Education and Research Grid China Education and Research Grid Funded by Ministry of Education Funded by Ministry of Education Based on CERNET (China Education and Research Network) Based on CERNET (China Education and Research Network) First Phase First Phase key universities as initiative12 key universities as initiative More than 6Tflops w/60TBMore than 6Tflops w/60TB 20 key universities now20 key universities now

Gang Chen/CC/IHEP ChinaGrid (The First Phase)

Gang Chen/CC/IHEP ChinaGrid Specific Application High performance computing environment (campus grid) Data grid Access grid Computational grid NUDT THU HUST ZSU PKU SJTU XJTU NEU SCUT BUAA SEU SDU Remote education grid Image processing grid Fluid dynamics grid Massive information processing grid Bioinformatics grid

Gang Chen/CC/IHEP Bio-info Grid To provide the bio-information data resources such as gene databases and Chinese medicine components databases, and bio- information analysis tools to grid users; To provide the bio-information data resources such as gene databases and Chinese medicine components databases, and bio- information analysis tools to grid users; To develop computing grid aided drug design systems based on the integration of the techniques of assembled biology, assembled chemistry, and computer aided filter, sequence analysis and structure, to optimize the drug design. To develop computing grid aided drug design systems based on the integration of the techniques of assembled biology, assembled chemistry, and computer aided filter, sequence analysis and structure, to optimize the drug design.

Gang Chen/CC/IHEP Course On-line Grid

Gang Chen/CC/IHEP Comments Middle-wares of CNGrid and ChinaGrid are different from gLite Middle-wares of CNGrid and ChinaGrid are different from gLite Security schema not based on CA Security schema not based on CA No efficient data management system No efficient data management system Interoperability work undergoing with BUAA and CNIC Interoperability work undergoing with BUAA and CNIC

Gang Chen/CC/IHEP Thank you!