KOLKATA Grid Kolkata Tier-2 Status and Plan Site Name :- IN-DAE-VECC-02 Gocdb Name:- IN-DAE-VECC-02 VO :- ALICE City:- KOLKATA Country :- INDIA Vikas Singhal and Prasun Singh Roy VECC, Kolkata, INDIA

KOLKATA Grid Mee ting Period Year Institute, PlaceLink May2009 CERN, Geneva, Switzerland January 2012 KIT, Karlsruhe Germany 5/ 34-6 June2013 CC-IN2P3, Lyon, France March2014Tsukuba, Japanhttp://indico.cern.ch/event/274974/ February 2015INFN, Torino, Italy 9/ April2016Bergen University, Bergen, Norway 5/ ALICE Tier1-Tier2 Meetings

KOLKATA Grid Kolkata On MonaLisa Vikas Singhal, VECC, INDIA

KOLKATA Grid ALICE Job completed during Last 3 Vikas Singhal, VECC, INDIA More than Jobs completed during last one year which is 1.15% of Total ALICE job. More than Jobs completed during last three year. Total :- 888 Cores DELL Quad Core Blades 38 * 2 * 4 *2 = 608 (HT) HP Quad Core Blades 8 * 2 * 4 * 2 = 128 (HT) HP Dual Core Blades 38 * 4 = 156 Equivalent 9K HEPSpec 2006 Computing Resources. Storage :- 146 TB XrootD Redirector 3 Disk Servers SAN Based 78TB (IBM) + ( )TB (HP EVA) 1Gbps WAN Network speed. 10Gbps Backbone Network

KOLKATA Grid ALICE Job submitted during Last 3 Years Vikas Singhal, VECC, INDIA More than Jobs completed during last one year which is 1.15% of Total ALICE job. More than Jobs completed during last three year More than 700 jobs consistently running. We reached upto 850.

KOLKATA Grid Traffic load during Last 3 Vikas Singhal, VECC, INDIA

KOLKATA Grid Vikas Singhal, VECC, INDIA Kolkata Tier-2 Facility

KOLKATA Grid NKN TOPOLOGY

KOLKATA Grid TIFR Mumbai CERN LHCONE POP in Mumbai 4 Gbps/10 Gpbs Shared TEIN-3 Network 10 Gbps 10 Gbps (Under going) 1 Gbps POP in Kolkata 10 Gbps VECC Kolkata SINP Kolkata 1 Gbps Kolkata Tier-2 1 Gbps Physical Network Connectivity upto Kolkata Internet 10 Gbps 4-10 Gbps 1 Gbps x Gbps Core Network 10 Gbps 1 Gbps

KOLKATA Grid Network Connectivity NKN Router in Computer Division L3 switch in Grid Computing Lab. 1GB optical Fibre Link XrootD Redirector gridce02 DNS Server grid-peerGrid ALICE Worker nodes Tier-3 Nodes ALICE Centre 1 Gbps Ethernet Link Public Network 10Gbps Fiber Private Network XrootD Disk Servers HP IBM SAN Storage Backbone connectivity with 10Gbps EOS MGM & FST

KOLKATA Grid Vikas Singhal, VECC, INDIA Last Three Year Utilization, Availability and Reliability On an average site availability and reliability is more than 90% during last 3 years. Availability: Jan Dec2013 : % Jan Dec2014 : % Jan2015 – Dec2015 : 98% More info

KOLKATA Grid Vikas Singhal, VECC, INDIA Kolkata::SE

KOLKATA Grid Vikas Singhal, VECC, INDIA Kolkata::SE Traffic

KOLKATA Grid NEW Storage Via EOS  Started long back, but due to Space and Speed problem could not configure properly.  Tried different Linux versions, Planned to deploy on CC7 such that not have to upgrade in near future.  For CC7 deploy script have to be properly checked.  Finally decided to configure on SLC 6 only.

KOLKATA Grid Elements of KOLKATA EOS SE name ALICE::Kolkata::EOS EOS Version EOS Beryl-Aquamarine 2 MGM(management) servers One master MGM: eos01.tier2-kol.res.in One slave MGM: eos02.tier2-kol.res.in Three nos. of FST eos01.tier2-kol.res.in eos02.tier2-kol.res.in eos03.tier2-kol.res.in Usable 96TB after RAIN-6 Configuration 4TB *12 nos of HDD in each storage. Vikas Singhal, VECC, INDIA

KOLKATA Grid EOS Installation at Kolkata Vikas Singhal, VECC, INDIA

KOLKATA Grid Planning and Roadmap  Last year did the Market Survey and discussed with Latchezar for the best configuration for the ALICE compute nodes:- – 2 * 12 core Intel Xeon Processors – Total 128GB of RAM ~ 5 GB/core or 2.5GB per Hyperthreaded Core – One 800 GB SSD – For better management and space requirement planed to have each server within 0.7 U – Total 48 Servers ~ 24 * 48 = 1152 Cores or 48*48 = 2304 logical Cores – Will be > 25K HEP Spec2006. – To avoid any SPF (Single Point of Failure) so decided to have N+N power supply and N+N Cooling Fans.

KOLKATA Grid Planning and Roadmap Cont..  For the same procurement started last year.  Received 3 offers from HP, DELL and Fujitsu.  Unfortunately no one qualified for the N+N FAN Redundancy for the Dense or Blade server architecture.  Re-tendered the indent with modified specifications (removed N+N FAN Redundancy).  Added ~100TB storage via EOS under Kolkata SE.  Will start procurement for more storage approx 6*100TB servers. And will configure via EOS RAIN-6.  10 RDHx type racks allotted in the New Computer Hall for all the new infrastructure.

KOLKATA Grid Vikas Singhal, VECC, INDIA Network Backbone for New Lab 10Gb backbone, 40Gb core switch connection. Both Fiber and Copper connectivity. Connection via DAC Cable. Dual path, Full Redundancy.

KOLKATA Grid Total 2000 Cores of Computing. More than 400TB of storage. Have a Tier-3 Cluster named grid-peer 8 Numbers of HP BL675G7 Blade servers each with 4 * AMD Opteron Processor 6380(16 Core) & 6 Number of Dell M610 Blade servers each with 2 * Intel Quad Core E5530 Xeon 2.4GHz CPU 8MB cache and 16GB RAM. Supporting ALICE, CBM, Medical Imaging, Nuclear theory users etc. Extensively used by VECC users and PMD Collaborators. 75 TB Tape backup active users (across India.) 45 + active users (in VECC.) Managing DNS, NFS, Monitoring, PXE etc servers. Grid Computing Facility Infrastructure

KOLKATA Grid HOLI Festival of Colors in Month of March Thank You