Presentation is loading. Please wait.

Presentation is loading. Please wait.

KOLKATA Grid Site Name :- IN-DAE-VECC-02Monalisa Name:- Kolkata-Cream VO :- ALICECity:- KOLKATACountry :- INDIA Shown many data transfers.

Similar presentations


Presentation on theme: "KOLKATA Grid Site Name :- IN-DAE-VECC-02Monalisa Name:- Kolkata-Cream VO :- ALICECity:- KOLKATACountry :- INDIA Shown many data transfers."— Presentation transcript:

1 KOLKATA Tier-2@Alice Grid Site Name :- IN-DAE-VECC-02Monalisa Name:- Kolkata-Cream VO :- ALICECity:- KOLKATACountry :- INDIA Shown many data transfers (few are simultaneously going on) Kolkata Tier-2 and Network

2 KOLKATA Tier-2@Alice Grid level 0 - special hardware 8 kHz (160 GB/sec) level 1 - embedded processors level 2 - PCs 200 Hz (4 GB/sec) 30 Hz (2.5 GB/sec) 30 Hz ( 4 GB/sec ) data recording & offline analysis Total weight10,000t Overall diameter 16.00m Overall length25m Magnetic Field0.4Tesla ALICE Collaboration ~ 1/2 ATLAS, CMS, ~ 2x LHCb ~1100 people 30 countries, 80 Institutes Introduction to ALICE Lots of data to Process:- Solution  GRID COMPUTING Slide from Latchezar Betev PPT

3 KOLKATA Tier-2@Alice Grid Tier 0 Tier 1 8 centres Tier 2 Different Universities, Institutes Individual scientist’s PC Experimental site CERN computer centre, Geneva ASIA (KISTI) IndiaChinaJAPANPakistan FranceItalyGermanyTAIWAN EHEPAG (VECC) Jammu U. Panjab U. IN_DAE_VECC_02 ALICE Grid Structure Central Analysis Facility CAF (T1 +T2) Jaipur U. 10 -100 Gbps links Logical, geographical association of regional groups Tier 3 1 -10 Gbps links 100 -1000 Mbps links

4 KOLKATA Tier-2@Alice Grid Kolkata Tier-2 at Monalisa Vikas Singhal, VECC, INDIA Consistently 800 ALICE Jobs are running.

5 KOLKATA Tier-2@Alice Grid Vikas Singhal, VECC, INDIA Grid Computing Facility

6 KOLKATA Tier-2@Alice Grid Vikas Singhal, VECC, INDIA Total :- 888 Cores DELL Quad Core Blades 38 * 2 * 4 *2 = 608 (HT) HP Quad Core Blades 8 * 2 * 4 * 2 = 128 (HT) HP Dual Core Blades 38 * 4 = 156 Equivalent 9K HEPSpec 2006 Computing Resources. Storage :- 146 TB XrootD Redirector 3 Disk Servers SAN Based 78TB (IBM) + (36 + 32)TB (HP EVA) 1Gbps WAN Network speed. 10Gbps Backbone Network 3 M ALICE Job completed Successfully during last 5 Years

7 KOLKATA Tier-2@Alice Grid 7 NKN @ INDIA

8 KOLKATA Tier-2@Alice Grid 8 Dec. 23, 2009 April 22, 2009Developing e-inftrastructures in India NKN TOPOLOGY

9 KOLKATA Tier-2@Alice Grid TIFR Mumbai CERN LHCONE POP in Mumbai 4 Gbps/10 Gpbs Shared TEIN-3 Network 10 Gbps 10 Gbps (Under going) 1 Gbps POP in Kolkata 10 Gbps VECC Kolkata SINP Kolkata 1 Gbps Kolkata Tier-2 1 Gbps Physical Network Connectivity upto Kolkata Internet 10 Gbps 4-10 Gbps 1 Gbps x Gbps Core Network 10 Gbps 1 Gbps

10 KOLKATA Tier-2@Alice Grid NKN Router at VECC Grid Computing Facility 1Gb optical Fiber Link XrootD Redirector gridce02 DNS Server Grid-peergrid ALICE Tier-2 Worker nodes Tier-3 Nodes ALICE Centre 1 Gigabit Ethernet Link XrootD Disk Servers HP IBM SAN Storage 10 Gigabit Fiber Backbone 10 Gigabit Fiber Link

11 KOLKATA Tier-2@Alice Grid Vikas Singhal, VECC, INDIA Kolkata TIER-2 centre Network diagram Router Switch gridce02 Backup-server wn045 wn046 wn122 wn123 Switch-2 Internet 1Gbps Copper Computing Nodes 25 Nodes Dell and Wipro Blades Cluster with 25 TB of As Tier-3 192.168.x.x (Stand by) 144.16.112.xx/27 130 TB Backup grid Grid-peer gridse001 wn001 wn002 wn024 wn025 Switch-1 GRID-PEER Tier-3 cluster with 32 & 64 bit machine Computing Nodes IN-DAE-VECC-02 Site with 64 bit machine Installer DELL and HP Blade Server with Multi Core Xeon 3.0 GHz naamakDache-servergrid01 10G Backbone Switch 4 – Xrootd Disk Servers SINP 1Gbps Fiber Backbone 10 Gbps 10G Backbone Switch

12 KOLKATA Tier-2@Alice Grid Vikas Singhal, VECC, INDIA From 128Kbps to 1Gbps WAN Network Started with ----128Kbps shared link2002 ----512Kbps2003 ----2Mbps Dedicated Link2004 ----4Mbps from Bharti 2006 ----30Mbps from Reliance2008 ----100Mbps from VSNL (ERNET)2009 ----300 Mbps from NKN2011 ----1Gpbs 2014

13 KOLKATA Tier-2@Alice Grid Vikas Singhal, VECC, INDIA # cat route-eth0 default via 192.168.1.12 dev eth0 144.16.112.16 via 192.168.1.16 dev eth0 144.16.112.15 via 192.168.1.15 dev eth0 144.16.112.14 via 192.168.1.14 dev eth0 144.16.112.9 via 192.168.1.9 dev eth0 Kolkata SE Traffic

14 KOLKATA Tier-2@Alice Grid Tier-3 (grid-peer) cluster 1U Sliding LCD Monitor with 16 port KVM Dell PowerEdge M1000e Blade Server Chassis. 16 Number of Dell PowerEdge M610 High Performance Intel Blade Each blade has Nehalem based 2 * Intel Quad Core E5530 Xeon 2.4GHz CPU with 8MB cache. Each blade has16GB RAM. Each blade has 2 * 146GB Mounted as RAID1. Installed SLC 6.5 x86_64 OS IBM SAN Storage 3 * 16 * 2TB SAS hard disks. 3 * 26 TB = 78 TB Usable space after RAID5 and Hot Spare. Total 14 Nodes for VECC users and Collaborating Institutes. 13 Collaborating Institutes. 64bit computing nodes. 7 Non-interactive AMD nodes. 7 Interactive AMD + Intel nodes. 78 TB IBM SAN storage. Storage mounted via NAS on all the Compute Nodes. 10Gbps Network backbone. Managing via ROCKS6. Using PBS Job Scheduler. 50 + active users (across India.) 30 + active users (in VECC.) Quota implemented for the users. Root, Geant3, Aliroot, Alien, Fairsoft, CBMroot, gFortran etc user specific software installed. HP c7000e Blade enclosure. 8 Number of HP ProLiant DL585 G7 AMD Blade Each blade has 2 * 16 Core 2.5GHz AMD CPU Each blade has 256 GB RAM. Installed SLC 6.5 x86_64 OS

15 KOLKATA Tier-2@Alice Grid  Decided to increase Kolkata Tier-2 resources as per ALICE Fair Share rule.  10 Cooled Rack Space allotted.  Indent raised to procure more than 30K HEP Spec 2006 equivalent computing Power.  Will procure 1200 Physical cores or 2400 Hyperthreaded core.  12 Core processors are the best suitable as per price performance point.  Plan to purchase only bare disks as per requirement.  3 * 2U servers comprising 12*4TB disks configured under Open Source EOS storage, will be included into KOLKATA SE. Future Plan and Decisions

16 KOLKATA Tier-2@Alice Grid Vikas Singhal, VECC, INDIA Network Backbone Planning 10Gb backbone, 40Gb core switch connection. Both Fiber and Copper connectivity. Connection via DAC Cable. Dual path, Full Redundancy.

17 KOLKATA Tier-2@Alice Grid Vikas Singhal, VECC, INDIA Thank You DURGA POOJA Festival of GODESS DURGA. Celebrated in Month of October. Idol will be submerged into the Water.


Download ppt "KOLKATA Grid Site Name :- IN-DAE-VECC-02Monalisa Name:- Kolkata-Cream VO :- ALICECity:- KOLKATACountry :- INDIA Shown many data transfers."

Similar presentations


Ads by Google