e-Science Activities in China

Slides:



Advertisements
Similar presentations
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
Advertisements

1 Chapter 11: Data Centre Administration Objectives Data Centre Structure Data Centre Structure Data Centre Administration Data Centre Administration Data.
Sergey Belov, LIT JINR 15 September, NEC’2011, Varna, Bulgaria.
Dell IT Innovation Labs in the Cloud “The power to do more!” Andrew Underwood – Manager, HPC & Research Computing APJ Solutions Engineering Team.
Sergey Belov, Tatiana Goloskokova, Vladimir Korenkov, Nikolay Kutovskiy, Danila Oleynik, Artem Petrosyan, Roman Semenov, Alexander Uzhinskiy LIT JINR The.
Authors: Mateusz Jarus, Ewa Kowalczuk, Michał Madziar, Ariel Oleksiak, Andrzej Pałejko, Michał Witkowski Poznań Supercomputing and Networking Center GICOMP.
Building Sustainable MIS Infrastuctures
China’s Scientific Data Sharing Initiatives and Future Perspective Pro. Peng, Jie Dr. Liu, Runda 5 March 2012,
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
CNGI Applications in CSTNET QingHua Zhang CSTNET January 2007.
Division Report Computing Center CHEN Gang Computing Center Oct. 24, 2013 October 24 ,
Scientific data cloud infrastructure and services in Chinese Academy of Sciences Jianhui Yuanke
BESIII Production with Distributed Computing Xiaomei Zhang, Tian Yan, Xianghu Zhao Institute of High Energy Physics, Chinese Academy of Sciences, Beijing.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Large Scale Parallel File System and Cluster Management ICT, CAS.
ORIENT/ORIENTplus - Connecting Academic Networks in China and Europe Jennifer(Jie) An CERNET Center/Tsinghua University 14 Feb.2012.
IHEP Computing Center Site Report Shi, Jingyan Computing Center, IHEP.
KISTI-GSDC SITE REPORT Sang-Un Ahn, Jin Kim On the behalf of KISTI GSDC 24 March 2015 HEPiX Spring 2015 Workshop Oxford University, Oxford, UK.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
Construction of Shanghai Life Science & Bio-technology Service Platform for Data Access and Sharing International Workshop on Strategies Presentation of.
IHEP(Beijing LCG2) Site Report Fazhi.Qi, Gang Chen Computing Center,IHEP.
CSTNET and Its Applications Computer Network Info. Center, CAS.
BEIJING-LCG Network Yan Xiaofei
QI Fazhi / IHEP CC HEPiX IPv6 F2F Meeting IPv6 Network Status in IHEP/China QI Fazhi Computing Center, IHEP July 4, 2013.
Building Virtual Scientific Computing Environment with Openstack Yaodong Cheng, CC-IHEP, CAS ISGC 2015.
NASA Earth Exchange (NEX) Earth Science Division/NASA Advanced Supercomputing (NAS) Ames Research Center.
11 e-Infrastructures for Agriculture in China: State of the Art and Requirements Meng Xianxue Qian Ping
IPCEI on High performance computing and big data enabled application: a pilot for the European Data Infrastructure Antonio Zoccoli INFN & University of.
The Status and Plans for SDN IHEP Fazhi Qi CC,IHEP Fazhi Qi/IHEPCC 1.
Unit 2 VIRTUALISATION. Unit 2 - Syllabus Basics of Virtualization Types of Virtualization Implementation Levels of Virtualization Virtualization Structures.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
Gang Chen, Institute of High Energy Physics Feb. 27, 2012, CHAIN workshop,Taipei Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures.
COMPUTER NETWORKS Quizzes 5% First practical exam 5% Final practical exam 10% LANGUAGE.
The status of IHEP Beijing Site WLCG Asia-Pacific Workshop Yaodong CHENG IHEP, China 01 December 2006.
ChinaGrid: National Education and Research Infrastructure Hai Jin Huazhong University of Science and Technology
Grid Computing 4 th FCPPL Workshop Gang Chen & Eric Lançon.
Scientific Computing at Fermilab Lothar Bauerdick, Deputy Head Scientific Computing Division 1 of 7 10k slot tape robots.
Grid Computing Activities in PKU Asso. Prof. CHEN Ping Prof. QIAN Sijin Asso. Prof. YU Huashan Peking University
Grids and SMEs: Experience and Perspectives Emanouil Atanassov, Todor Gurov, and Aneta Karaivanova Institute for Parallel Processing, Bulgarian Academy.
Al Lilianstrom and Dr. Olga Terlyga NLIT 2016 May 4 th, 2016 Under the Hood of Fermilab’s Identity Management Service.
Grid Activities in the Philippines Rey Vincent P. Babilonia Advanced Science and Technology Institute Department of Science and Technology PHILIPPINES.
IHEP Computing Center Site Report Shi, Jingyan Computing Center, IHEP.
A Data Application Environment for Space Science in China
CEPC software & computing study group report
Status of WLCG FCPPL project
The advances in IHEP Cloud facility
The Beijing Tier 2: status and plans
Volunteer Computing for Science Gateways
Elastic Computing Resource Management Based on HTCondor
Integration of Openstack Cloud Resources in BES III Computing Cluster
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
ATLAS Cloud Operations
Yaodong CHENG Computing Center, IHEP, CAS 2016 Fall HEPiX Workshop
Design and realization of Payload Operation and Application system of China’s Space Station Wang HongFei 首页.
Clouds of JINR, University of Sofia and INRNE Join Together
The LHC Computing Grid Visit of Her Royal Highness
Grid Computing.
New developments for deploying
University of Technology
Introduction to Cloud Computing
The Scheduling Strategy and Experience of IHEP HTCondor Cluster
ExaO: Software Defined Data Distribution for Exascale Sciences
EGI Webinar - Introduction -
Grid Computing 6th FCPPL Workshop
11th France China Particle Physics Laboratory workshop (FCPPL2018)
Status and prospects of computing at IHEP
This work is supported by projects Research infrastructure CERN (CERN-CZ, LM ) and OP RDE CERN Computing (CZ /0.0/0.0/1 6013/ ) from.
Hao Hu, Luo Qi, Fazhi Qi IHEP 22 Mar. 2018
The LHC Computing Grid Visit of Professor Andreas Demetriou
Presentation transcript:

e-Science Activities in China Gang Chen Institute of High Energy Physics,CAS Mingqi Chen Head, the Cyber-infrastructure office of CAS March 7, 2017, ISGC2017

e-Science in China Ministry of Education Ministry of Science and Technology Promote the construction of sci. & tech. information platform Super Computers: Sunway, Taihu Light Ministry of Education CERNet Computing, data services Education and Research Chinese Academy of Sciences CSTNet Supercomputing Clouds of sci. & tech. management education Data services National Development and Reform Commission Networks Large Scientific Facilities Chinese Academy of Social Sciences digital Chinese Academy of Social Sciences National Natural Science Foundation of China related basic scientific research China's new supercomputing system, Sunway-TaihuLight, was named the world's fastest computer at the International Supercomputing Conference in Germany in last Month. The National Supercomputing Center was also unveiled Monday in Wuxi, east China's Jiangsu Province, where the new-generation supercomputer is installed. With processing capacity of 125.436 petaflops (PFlops) per second, which means it can perform quadrillions of calculations per second at peak performance, Sunway-TaihuLight is the first supercomputer to achieve speeds in excess of 100 PFlops. The computing power of the supercomputer is provided by a China-developed many-core CPU chip == The Five-hundred-meter Aperture Spherical Telescope (FAST) is an Aricibo-type telescope. It is funded by the National Development and Reform Commission (NDRC) and managed by the National Astronomical observatories (NAOC) of Chinese Academy of Sciences (CAS), with the government of Guizhou province as a cooperation partner. When it is completed in 2016 , the five hundred meter aperture spherical telescope (FAST) will be the world's largest, overtaking Puerto Rico's Arecibo Observatory, which is 300 meters in diameter Academy of Agricultural Data resources sharing Digital academy of agricultural China Meteorological Administration Intelligence Meteorology

e-Science Deployment at CAS Field observation stations Large scientific facilities others data creation & acquisition e-Science Applications High Speed Network CSTNET CSTNET-CNGI GLORIAD Information Stream Information Stream Science Trans-mission Data Generation&Collection Trans-mission Storage &Curation Computing&Analysis Application - 1.Field observation station real time data collection 2.Large scientific facilities & field sensor network real time data collection 3.Mobile data collection Information Stream Information Stream Supercomputing Grid Computing Analysis Mining visualization Computing & Analysis Storage & Curation Data Centers Storage & preservation Curation Sharing and Service Information Stream

CSTNet Backbone Covers more than 30 Provinces 1 Core Center 12 Regional Centers 370+ Institutions supported Network topology map :Tree-like structure Backbone carriers :China Telecom ;China Mobile Chine Unicom; tele-grade network operaters. A dedicated line

Services of CSTNet 5 Collaboration Environment Domestic Connection International Connection 10G 10G 2.5/10G CSTNET provide many advanced scientific network services, there are mainly five categories. 5

Supercomputing – SCGrid Three-tier grid 1 head center 10 regional centers 18 institution centers 11 GPU centers Applications Computational Chemistry Physics Material science Life science CFD Industrial computing …  Comprehensive introduction by Dr. Chi’s plenary talk on Thursday.

Scientific Data Infrastructure 1 head center 1 backup center 12 branch centers 43PB of capacity Servers with 10000+ CPU cores

From Database to Data Cloud 高性能计算设施 数据管理服务 CAS Data Cloud various cloud services literature resources processing resources Storage resources data resources model resources Matlab desktop client web-based client mobile client other client such as television software resources Advanced scientific data infrastructure Integrate all kinds of resources as cloud services Support applications at CAS and beyond

WLCG in China WLCG Tier-2 site to support ATLAS and CMS Hardware renewed in 2016 940 TB disk space 400 TB, dpm for ATLAS 540 TB, dCache for CMS 888 cores, divided equally by ATLAS and CMS HEPSPEC06: 16710 5 Gbps link to Europe visa Orient-plus and 10 Gbps to US 9 9

WLCG Statistics

Astro-Cloud Project Telescope Open Access Data Discovery and Access 2.4m, 2.16m, radio telescopes, public telescopes Data Discovery and Access Virtual Observatory Seamless astronomy Data Mining and KDD Cloud computing Software and tools Data Visualization Interactive On-the-fly

ChinaFLUX Built for climate change and environment research. 12 Institue of Geographic Sciences and Natural Resources Research,CAS ChinaFLUX e-Science Environment: Real data from sensors to field stations, then to institutes, finally to data centers to process and share ChinaFLUX is an observation and research network that applies eddy covariance and chamber methods to measure the exchanges of carbon dioxide, water vapor and energy between terrestrial ecosystem and atmosphere in China. Principle Investigator(PI) 12

Projects at IHEP Accelerator Related Projects CSNS Neutrino Projects BEPCII/BESIII CEPC/SppC LHC … CSNS Chinese Spallation Neutron Source Neutrino Projects Daya Bay JUNO Astro-particle Projects ASγ and ARGO at Yangbajing LHAASO at Sichuan  Space based Projects HXMT AMS (Alpha Magnetic Spectrometer) 13

Infrastructure of Virtual Computing Cluster VPManager: Virtual resource pool manager PBS/HTCondor Dedicated SGE working physical nodes Openstack Physical machines Virtual machines Virtual resource Pool Manager RMS VPManager hypervisor hypervisor hypervisor Presentation by Dr. Yaodong Cheng on Friday

VPManager components VCondor VMQuota VMCtrl NetDB Agent A resources scheduler which Increasing or decreasing virtual resources to a queue VMQuota Responsible for resources quota control, vCondor allocates or recycles resources based on maximum or minimum resource limitation. VMCtrl To change virtual machine’s queue attribution according to vCondor’s request NetDB Agent A Collector which collects info of virtual resources A interface which provides resources status to vCondor Accounting system keeps all the usage information of each virtual machine and generate bills to user

VCondor scheduling ~50% resource utility with legacy management Resource minimum limit Job queued, automatically create virtual machines Resource maximum limit Histogram

Volunteer Computing and Desktop Grid Presentation by Dr. Wenjing Wu on Thursday.

SDN on WAN Network topology Presentation by Fazhi Qi / Shan Zeng IHEP CCNU SDU SJTU Network topology SJTU (Shanghai Jiao Tong University), SDU (Shandong University), CCNU (Central China Normal University), IHEP IPv4 & IPv6 Presentation by Fazhi Qi / Shan Zeng

SDN in Data Center Cloud Environment IHEP has built its own cloud platform based on OpenStack More and more applications have moved to this platform Compute and storage resources becomes flexible, however, under the traditional network architecture, network capability becomes the bottleneck SDN solution integrated with OpenStack at datacenter was introduced

The Next Five-Year Plan of e-Science at CAS Five main projects Chinese science and technology Cloud Intelligent CAS Scientific Big Data e-Science Applications Network Security

Computing and Data Platform for Next Five-Year Plan Chinese science and technology Cloud Dedicated computing and data resources Scientific infrastructures Public resource platform

Thank you