Download presentation
Presentation is loading. Please wait.
Published byWendy Lane Modified over 9 years ago
1
Building Cyber-Infrastructure and Supporting eScience Satoshi Sekiguchi Director, Grid Technology Research Center, AIST, JAPAN s.sekiguchi@aist.go.jp
2
Grid Technology Upper Middle HPC Portal/ASP Operation/Human resoure High speed network (over 1G – 10G) Ubiquitous Grid IPv6 Security Wireless network Tremendous Sensor Huge datastream GPS Cam sensor Mobile Blood pressure Blood pressure Earth Q Database/Expression FTTH/xDSL/Wireless AP/100M- Distributed Storage 10PB Distributed Storage 10PB Community Infra Science and Engineering platform Science and Engineering platform Mega Computing 1PFLOPS PC x 100M SC x 10000 Mega Computing 1PFLOPS PC x 100M SC x 10000 Peta Scale Grid Nano-tech Informatic s Nano-tech Informatic s Access Grid Chem Infoma Chem Infoma Personal Wether service Bio- Informatics Medical Informatic s Medical Informatic s Lower MIddle P2P grid Webservice eBiz, service Solution Utility Community ITBL/SuperSINET SETI/United Device METI program JST IPA JST Server tech Grid enabled Engineering Grid enabled Business
3
GRID: Concept and Reality Key Concept: Resource Virtualization Computers, storage, sensors, networks, softwares, people/organization … WWW – Whenever, Wherever, Whoever Transparency – Ubiquitous (?) Similarity – Electric Power Service Plug-in at consumer Public utilities – social infrastructure 99.9....9% availability, reliability, security 安定・安心・安全
4
Detector for ALICE experiment Detector for LHCb experiment GRID: Consumers scenario (sensors) VLBI: Kashima 34m telescope To provide infrastructure and facilities needed for next major stages of collaborative research in: genomics and bioscience particle physics astronomy climatology engineering design social sciences Medical Engineering JVO Bio Grid
5
Correspondences between agencies (US-JP) JPN METI MEXT AIST GTRC Univ U.Tokyo Titech JAERI JAMSTEC RIKEN NII Council S&T ES ctr US DOE DOC NSF Coordination Office JST JSSP NEDO IPA Sci, Tech,& Edu (sports, culture) Commerce, Industry, Energy RICS IMS Env.,nanotech, Bio, Life, etc TACC Matsuoka Sekiguchi E-Science & Computation Science SOUM CRL
6
AIST Grid Projects (Underway) projectparticipants Funding Agency, Period, Budget (2002/Total) FocusAccomplishment Ninf http://ninf.apgrid.org/ AIST TITECH U. Tsukuba Kyoto U. JST, METI, IPA 1994- $2.5M/6.0M Develop Grid Middleware and application (Ninf-G /Grid RPC) Ninf-G Release, Preliminary application development ApGrid http://www.apgrid.org/ Grid partnership in Asia Pacific Region MEXT, 2002-2004 $0.3M / $0.9M partnership for Grid computing in the Asia Pacific region. Resource sharing, Grid development, mutual support for applications development Engineering guideline available Annual workshops and core meeting for engineering Grid Data Farm http://datafarm.apgrid.org AIST,TITEC,KEK,U.- Tokyo,NEC METI, 2002 – 2002 $ 2.3M Construction of a Peta- to Exascale parallel filesystem exploiting local storages of PCs spread over the world- wide Grid Involved in the ATLAS/CERN Project and the preliminary version of the GFarm is available. Also, demonstrated at SC02 GRID Drug Design AIST U. Tsukuba Tokushima U. JST, 2001-03, $0.4M / 1.2M Drug design system on gridsPrototyped AIST Grid AIST Osaka U. AIST, 2002-04 $1.5M / 4M Access Grid, Medical application, tele science Prototyped Quantum Chemistry Grid AIST AIST, $1M Provide user friend portalsOpen for limited users Grid Consortium Japan AIST and Business section $0.1M Venues for info exchange, GGF franchise36 companies, 150 memberships
7
Other Grid related Projects (Underway) projectparticipants Contacts Support Agency, Period, Budget (2002/Total) FocusAccomplish ment Bio Grid Osaka-u, pharmacy Industry, NEC, AIST, MEXT 2002-2006Bio Application deployment Consortium organized ITBL JAERI, RIKEN, NAL, http://www.itbl. jp/ MEXT, 2001-2005Application for supercomputer ensemble 1 st phase done Super SINET Universitieshttp://www.nii.a c.jp/ MEXT, 2001-04 unknown 10G backbone1 st phase done NaReGI University National Labs NAMEXT, 2003-07, FY02 4.5B JPY Fy03 2B JPY (x5yrs) National Research Grid Infrastructure Inaugurated Business Grid IT vendors AIST NAMETI, 2003-05 Total 2.8B JPY x 3yrs Business applicationApproved/prepare for public call
8
National Research Grid Initiative (NAREGI) A new R&D project funded by MEXT FY2003-FY2007 ~2B JPY budget in FY2003 1.5B for Grid R&D, 0.5B for Nano-tech apps. One of Japanese Government’s Grid Computing Projects Selected National Labs. Universities and Industry are to be involved in the R&D activities
9
National Research Grid Initiative To develop a Grid Software System R&D in Grid Middleware and Upper Layer prototyping for future Grid Infrastructure in scientific research To provide a Testbed to prove that the High-end Grid Computing Environment 100+Tflop/s expected by 2007 practically utilized in the Nano-science Simulations over the Super SINET. To Contribute to Standardization Activities, e.g., GGF To Participate in International Collaboration Europe, U.S., Asian Pacific
10
Participating Organizations National Institute of Informatics (NII/MEXT) Site for R&D in Grid Software and Networking Institute for Molecular Science (IMS/MEXT) Site for R&D in Computational Nano-sciences and Simulation Software Platform Universities and National Laboratories(Joint R&D) AIST, Tokyo Inst. Tech, Osaka-u, Kyushu-u, Kyushu Inst. Tech., etc. Research Collaboration ITBL Project, National Supercomputing Centers etc. Participating Vendors IT and Chemicals/ Materials
11
Hokkaido University HITACHI SR8000 HP Exemplar V2500 HITACHI MP5800/160 Sun Ultra Enterprise 4000 Tohoku University NEC SX-4/128H4(Soon SX-7) NEC TX7/AzusA University of Tokyo HITACHI SR8000 HITACHI SR8000/MPP Others (in institutes) Nagoya University FUJITSU VPP5000/64 FUJITSU GP7000F model 900/64 FUJITSU GP7000F model 600/12 Osaka University NEC SX-5/128M8 HP Exemplar V2500/N Kyoto University FUJITSU VPP800 FUJITSU GP7000F model 900 /32 FUJITSU GS8000 Kyushu University FUJITSU VPP5000/64 HP GS320/32 FUJITSU GP7000F 900/64 Inter-university Computer Centers (excl. National Labs) circa 2002 Tokyo Inst. Technology (Titech) NEC SX-5/16, Origin2K/256 HP GS320/64 University of Tsukuba FUJITSU VPP5000 CP-PACS 2048 (SR8000 proto)
12
Proposed Solutions Diversity of Resources ( 松竹梅 “Shou-Chiku-Bai”) 松 (“shou” pine) – ES – like centers 40-100Teraflops x (a few), 100-300 TeraFlops nationwide 竹 (“chiku” bamboo) – Medium-sized machines at SCs, 5-10 TeraFlops x 5, 25-50 TeraFlops aggregate / Center, 250-500 TeraFlops total 梅 (“bai” plumb) – small clusters and PCs spread out throughout campus in a campus Grid x 5k-10k, 50 -100 TeraFlops / Center, 500-1 PetaFlop Nationwide Division of Labor between “Big” centers like ES and Univ. Centers, Large-medium-small resources A National Grid Infrastructure to virtualize/federate these Resources ($120 mil approved 2003-2007) Univ SCs ES’s Original slide: courtesy of S.Matsuoka
13
Everyday Grid – Tier model 高速ネットワーク (over 1G – 10G) Larger Jobs SITE-ASITE-B SITE-C 松 PINE 竹 Bamboo 梅 Plum
14
Center for Grid R&D (Jinbo-cho, Tokyo)
15
AIST super cluster for e-Science platform Target performance: 10 ~ 20 TFLOPS for Linpack Challenge for one of the fastest clusters in the world Development of ‘real-use’ cluster system Delivered 1Q(’04) Software SCore System Software for Cluster managemnet and communication Compilers and utilities C,C++ 、 FORTRAN(77, 90) MPI 、 OpenMP Parallel debugger, Performance monitoring tools GRID support Globus, condor, GridRPC, etc Computing nodes (2000 ~ 1000 Pus) Opteron 2GHz 4GB/proc Interactive nodes Network for computation RDMA support, >3Gbps/link, High bi- section BW Myrinet… Network for management and data transfer Gigabit Ethernet File system Disks of each node are used for scratch Shared file system (NAS …) Components
16
Overviews Original slide: courtesy of IBM Japan
17
Summary E-Science is a great concept for future our life Scientists, Education, School, Home Commercial scene Grid meets e-Science needs perfectly Resource sharing & virtualization Tele-Science, remote-collaboration Unfortunately Japan government tends to have “e-Japan” rather than “e-Science”, sigh Program like “e-Science” or “Cyber Infra” Projects launched separately
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.