Grid Status and Perspective in China Sun Gongxing IHEP, Beijing.

Slides:



Advertisements
Similar presentations
Grid Computing and Applications in China Kai Nan Computer Network Information Center (CNIC) Chinese Academy of Sciences (CAS) 17 Mar 2008.
Advertisements

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
Duke Atlas Tier 3 Site Doug Benjamin (Duke University)
FP6−2004−Infrastructures−6-SSA Data Grid Infrastructure for YBJ-ARGO Cosmic-Ray Project Gang CHEN, Hongmei ZHANG - IHEP.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.
Grid Activity in China Sun Gongxing, IHEP, Beijing.
A. Frank 1 Internet Resources Discovery (IRD) Peer-to-Peer (P2P) Technology (1) Thanks to Carmit Valit and Olga Gamayunov.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
Basic Research on Information Sciences Supported by NSFC 刘志勇 (Zhiyong LIU) 国家自然科学基金委员会信息科学部 (Directorate of Information Sciences, NSFC) 2006 年 5 月 23 日.
Introduction to Scientific Data Grid Kai Nan Computer Network Information Center, CAS
Chapter 5 Application Software.
HPC and e-Infrastructure Development in China’s High- tech R&D Program Danfeng Zhu Sino-German Joint Software Institute (JSI), Beihang University Dec.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Grid Information Systems. Two grid information problems Two problems  Monitoring  Discovery We can use similar techniques for both.
ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.
CNGI Applications in CSTNET QingHua Zhang CSTNET January 2007.
Division Report Computing Center CHEN Gang Computing Center Oct. 24, 2013 October 24 ,
Remote Production and Regional Analysis Centers Iain Bertram 24 May 2002 Draft 1 Lancaster University.
Scientific Data Grid on NGI Kai Nan Computer Network Information Center Chinese Academy of Sciences CANS 2004, Miami.
Medical Education and the Lambda Grid Parvati Dev, PhD Stanford University SUMMIT Lab Parvati Dev, PhD Stanford University SUMMIT Lab.
Computing for HEP in the Czech Republic Jiří Chudoba Institute of Physics, AS CR, Prague.
Data GRID Activity in Japan Yoshiyuki WATASE KEK (High energy Accelerator Research Organization) Tsukuba, Japan
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.
DATABASE MANAGEMENT SYSTEMS IN DATA INTENSIVE ENVIRONMENNTS Leon Guzenda Chief Technology Officer.
March 2003 CERN 1 EDG and AliEn in Prague Dagmar Adamova INP Rez near Prague.
BesIII Computing Environment Computer Centre, IHEP, Beijing. BESIII Computing Environment.
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
© Paradigm Publishing Inc. 5-1 Chapter 5 Application Software.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
THORPEX Interactive Grand Global Ensemble (TIGGE) China Meteorological Administration TIGGE-WG meeting, Boulder, June Progress on TIGGE Archive Center.
RAL Site Report John Gordon IT Department, CLRC/RAL HEPiX Meeting, JLAB, October 2000.
The II SAS Testbed Site Jan Astalos - Institute of Informatics Slovak Academy of Sciences.
An Introduction to Scientific Data Grid LUO Ze Computer Network Information Centre, Chinese Academy of Sciences.
October 2002 INFN Catania 1 The (LHCC) Grid Project Initiative in Prague Dagmar Adamova INP Rez near Prague.
Large Scale Parallel File System and Cluster Management ICT, CAS.
Distributed Computing for CEPC YAN Tian On Behalf of Distributed Computing Group, CC, IHEP for 4 th CEPC Collaboration Meeting, Sep , 2014 Draft.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
…building the next IT revolution From Web to Grid…
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Scientific Data Grid & China-VO Kai Nan Computer Network Information Center Chinese Academy of Sciences November 27, 2003.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
The Global Land Cover Facility is sponsored by NASA and the University of Maryland.The GLCF is a founding member of the Federation of Earth Science Information.
WebFTS File Transfer Web Interface for FTS3 Andrea Manzi On behalf of the FTS team Workshop on Cloud Services for File Synchronisation and Sharing.
IHEP(Beijing LCG2) Site Report Fazhi.Qi, Gang Chen Computing Center,IHEP.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
CSTNET and Its Applications Computer Network Info. Center, CAS.
Final Implementation of a High Performance Computing Cluster at Florida Tech P. FORD, X. FAVE, K. GNANVO, R. HOCH, M. HOHLMANN, D. MITRA Physics and Space.
October 2000GRNET GRNET Greek Research & Technology Network Tryfon K. Chiotis Dimitrios K. Kalogeras.
Computing Issues for the ATLAS SWT2. What is SWT2? SWT2 is the U.S. ATLAS Southwestern Tier 2 Consortium UTA is lead institution, along with University.
QI Fazhi / IHEP CC HEPiX IPv6 F2F Meeting IPv6 Network Status in IHEP/China QI Fazhi Computing Center, IHEP July 4, 2013.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
The Globus Toolkit The Globus project was started by Ian Foster and Carl Kesselman from Argonne National Labs and USC respectively. The Globus toolkit.
September 2003, 7 th EDG Conference, Heidelberg – Roberta Faggian, CERN/IT CERN – European Organization for Nuclear Research The GRACE Project GRid enabled.
Gang Chen, Institute of High Energy Physics Feb. 27, 2012, CHAIN workshop,Taipei Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures.
IHEP Computing Center Site Report Gang Chen Computing Center Institute of High Energy Physics 2011 Spring Meeting.
Tier2 Centre in Prague Jiří Chudoba FZU AV ČR - Institute of Physics of the Academy of Sciences of the Czech Republic.
The status of IHEP Beijing Site WLCG Asia-Pacific Workshop Yaodong CHENG IHEP, China 01 December 2006.
ChinaGrid: National Education and Research Infrastructure Hai Jin Huazhong University of Science and Technology
TEIN2 Report - CN TEIN2/ORIENT Orient is a project linking academic networks in China and Europe Aim is to provide a dedicated high-bandwidth.
Sun Gongxing, IHEP, Beijing
CUAHSI HIS Sharing hydrologic data
UK GridPP Tier-1/A Centre at CLRC
Computer Network Information Center, Chinese Academy of Sciences
Production Manager Tools (New Architecture)
Presentation transcript:

Grid Status and Perspective in China Sun Gongxing IHEP, Beijing

Main Grid Projects in China NHPCE—the National High Performance Computing Environment (MOST, 863 programme) VEGA—Grid Project around Dawning SuperServer (ICT,CAS). SDG—the Scientific Data Grid Project (CNIC, CAS) ChinaGrid—the MOE Project. HEP Data Grid (currently IHEP).

Network Infrastructure Overview in China

Overview of International Network Links of China CN-HK CERNET/HARNET 2Mbps CN-HK C&SNET 45Mpbs CN-JP CERNET 10Mpbs CN-US CERNET 10Mpbs CN-US CERNET 200Mpbs CN-UK CERNET 2Mpbs CN-US CSNET 55Mpbs CN IEEAF 10.6Gbps

1 Network Infrastructures for Science and Technology in China The CSTNET— the China Science and Technology Network - One of the earliest networks in China and the first full-functional interconnection with U.S - 55Mbps international link (upgrade to 100Mbps soon). - Topology as Fig. 1

2 NSFCNET—Natural Science Foundation of China Network Sponsor: National Science Foundation of China (NSFC) - A test bed for advanced high speed network research, native multicast enabled - 6 main nodes (all in Beijing) CNIC of CAS, THU, PKU, BUAA, BUPT, NSFC - Topology is as Fig. 2.

3 The Internet2 Testbed Support scientific research, development and test of next generation network. - High-speed connection with VBNS and Abiene (connected to STARTAP in Sep,2000) /10Gbps DWDM Backbone ( dual rings). - Will inter-connect 200 nodes, including 100 universities and 100 institutes.

- Networking infrastructure is a part of the effort, the more important is development of applications, particularly grid-enabled applications. - Funding 400 million Yuan (~40M US$).

4 CAINONET—China Advanced Info. Optic Net A key project self-owned technologies and products for next-generation inter-networks IP/DWDM , 2.5G. Topology as Fig. 3

Overview of Grid Projects in China

1 The VEGA Project Design and implement Grid level system software. Grid oriented super-server—the Dawning Service Grid—Providing various services to users, for instances, computation, messaging, knowledge services. Architecture, Grid Operating system, application development, etc.

Client Grid browser Grid://…… Vega Grid Architecture Resource router Grid server

Vega Applications Case 1 Global Grid batch system. Applications based on the GOS APIs. No center control. Shell commands: gsub, gstat, gkill, etc. All registered resources are available for users, CPU, disk spaces, networks, data, software, sercices…..

Global Batch System in Vega

On-line Transaction System Case 2: 4 different basic services registered to Grid. - Whether forcasting. - Airline ticket booking. - Sigh spot ticket booking. - Charging. Put these services into a special application.

AN Online Transaction

2 The China National Grid The National High Performance Computing Environment—the NHPCE. A key 863 programme (MOST). Including 9 sites for HPC in the Grid. - Interconnected them with available networks ( Cernet & NSTnet) - equipped each site with Dawning 2000/3000, Galaxy 3(20Gflops), Sunway 1(460Gflops), PC-cluster(8Gflops).

NHPCE Grid Portal (User Mgt)

NHPCE Grid Portal (Job Submit)

NHPCE Grid Portal(Resource Mgt)

NHPCE Grid Portal(System Monitoring)

NHPCE Grid Portal (utilities)

NHPCE Applications Weather forecasting. Petroleum reservoir simulation. Bio-information database and applications. Numerical wind tunnel simulation. Automobile collision simulation. Ship structure analysis. National scientific databases and applications. Digital library.

Audio Notebook HPC BP, Mobile phone Video Camera Tel. Game TV DVD PC Internet Gigabit IP Network Node DB Info lib. Instr. NHPCE

3 The SDG Project By Dec – 31 member institutions – 217 databases – 3.2 TB Classification – numerical: 46% – text: 18% – spatial: 22% – multimedia: 14%

SDG Universal Metadata Too many disciplines in SDG  similarly many or more metadata standards. it’s not good for us to develop a tool for every metadata schema individually. many disciplines in SDG  similarly many or more metadata standards. it’s not good for us to develop a tool for every metadata schema individually. input metadata for existing databases is more bothersome, so a ease-to-use tool might be in practice. input metadata for existing databases is more bothersome, so a ease-to-use tool might be in practice. input: a metadata schema (xml DTD). input: a metadata schema (xml DTD). output: Web-based, customizable UI. output: Web-based, customizable UI. LDAP-based Storage. LDAP-based Storage. Management functions (add, delete, modify and query), back-end is MDIS. Management functions (add, delete, modify and query), back-end is MDIS.

SDG Universal Metadata Tool MDIS (LDAP) interim XML MD schema User page Process (Java bean) XML engine install & configure universal, extensible customizable -metadata is tree-like and more flexible than fix-column tables, difficult to deal with on web UIuse xml files to store interim results -use xml files to store interim results

Applications Virtual Observatory – Astronomical data is huge & well documented – Most is online & sharable – So, Internet is becoming the world’s best telescope – Data integration and federation (by many different instruments from many different places and many different times) – Ease-to-use for astronomers – LAMOST (aperture: 4m, by 2004) – Collaboration between NAO and CNIC

4 The China Grid it is being proposed now, and will be founded by MOE ( the Ministry of Education), It’s bandwidth is 2.5Gbps, connect 100 universities across China. And to be inter-connected to NFSCNET. Discussion is under way, When? How?

5 HEP DataGrid in China (1) BES experiment: the tau-charm physics International collaboration with 18 domestic universities and 4 foreign universities. The major upgrade program BEPCII has been approved by Chinese Government. Increasing Luminosity by a factor of 100 produce about 3 PB data in 3-5 years.

(2) YangBaJing Cosmic-ray Lab. At Tibet China-Japan collaboration: air- shower array detector since 1990 China-Italy collaboration: RPC carpet detector of m 2, under construction. several domestic and foreign universities participate in both experiments Data Volume: about several hundreds of TB data.

(3)Experiments of LHC: CMS and Atlas -China physicists are participating in MC simulations, and will participate in physics analysis. - build Tier-2 Regional Center at least. - NSFC delegation visited CERN to discuss the collaboration in April this year.

(4) Belle and Babar (5) Alpha Magnetic Spectrometer (AMS)

The IHEP Campus Grid Building a Campus Grid Computing Environment at IHEP). Making full use of 7 PC Farms built at IHEP, which run separately for various experiments which leads to inefficient utilization of these PC Farms. Topology as Fig. IhepGrid monitoring system. Rebuilding higher bandwidth connection among these PC Farms.

Topological map of IHEP Computing Environment

The PC Farms Hardware Configuration at Computing Center PC FarmOSNo. CPUsBatch System Storage hepfarmLinux RH7.2 23×Intel PIII OpenPBS TB SCSI YBJfarmLinux RH7.2 32×AMD MP OpenPBS TB IDE LHCfarmLinux RH7.2 32×AMD MP OpenPBS TB IDE HP FarmHP-UX12 ×HP- PA NQS

The CMS and Atlas PC FARM RAID monitor

The IhepGrid Monitoring System

China HEP Top CA

The Connection of PC Farms at IHEP Computing Center

Components of Campus Grid Computing Environment at IHEP

National HEP DataGrid Testbed NFSC gives support for HEP application testbed. there are 2 or 4 universities and IHEP to join the project, including PKU, SDU, THU, USTC. Fund about 1.5million CNY (near 20USD). Hopefully, it is able to enhance the international collaboration of China.

The On-going and Future Work – Develop the Web-based portal of HEP and Web services in China. – And Develop various HEP Grid-enabled applications. – Make proposal for building HEP DataGrid across China and join Lambda ring or the like as a node. – And Regional Center Tier-2 for collaboration CMS and ATLAS of LHC in China. – ……

China HEP DataGrid in the Future BES On line system Offline processor farm YBJ CERN CMS & ATLAS IHEP Computer Center USTCTHUSDU pku CASTOR Physics data cache Tier 0 Tier 2 Tier 3 All data from experiments Goes to IHEP Computing Center This diagram only Shows HEP DataGrid in China

China HEP DataGrid Architecture Info discovery Job Mgt Authentication User Profile mgt GRAMGSIFTPGRIS Data Service Network service NWS Compute Service GIIS/GRIS Web browser USER Grid Portal Grid

The Grid Prospect in China NFSC organized the relevant officials and scientists to visit CERN, and seek the roadmap of grid development in China. And recently computer scientists and physicists …. sit down together to discuss how to move the China grid projects forwards(organized by NFSC). Conclusion is China should concentrate on Grid- based applications at first, and a few of nationwide testbeds need to be built, the first is HEP DataGrid one.