Computing Infrastructure

Slides:



Advertisements
Similar presentations
Hardware Lesson 3 Inside your computer.
Advertisements

IST346: Disaster Recovery Data Integrity Backups.
The Linux Storage People Simple Fast Massively Scalable Network Storage Coraid EtherDrive ® Storage.
Storage Devices.
Presented to CUGG by Jamie Leben 10/9/10 IT-Works Computer Services
Buffers & Spoolers J L Martin Think about it… All I/O is relatively slow. For most of us, input by typing is painfully slow. From the CPUs point.
XenData SX-520 LTO Archive Servers A series of archive servers based on IT standards, designed for the demanding requirements of the media and entertainment.
PowerEdge T20 Customer Presentation. Product overview Customer benefits Use cases Summary PowerEdge T20 Overview 2 PowerEdge T20 mini tower server.
MUNIS Platform Migration Project WELCOME. Agenda Introductions Tyler Cloud Overview Munis New Features Questions.
MONITORING THE CONNECTICUT EDUCATION NETWORK Aliza Bailey 10/20/2010.
Scale-out Central Store. Conventional Storage Verses Scale Out Clustered Storage Conventional Storage Scale Out Clustered Storage Faster……………………………………………….
Linux Clustering A way to supercomputing. What is Cluster? A group of individual computers bundled together using hardware and software in order to make.
Novell Server Linux vs. windows server 2008 By: Gabe Miller.
SUMS Storage Requirement 250 TB fixed disk cache 130 TB annual increment for permanently on- line data 100 TB work area (not controlled by SUMS) 2 PB near-line.
Teraserver Darrel Sharpe Matt Todd Rob Neff Mentor: Dr. Palaniappan.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Upgrading the Platform - How to Get There!
1 Virtualization Services. 2 Cloud Hosting –Shared Virtual Servers –Dedicated Servers Managed Server Options Multiple Access Methods –EarthLink Business.
CT NIKHEF June File server CT system support.
Mass RHIC Computing Facility Razvan Popescu - Brookhaven National Laboratory.
THE QUE GROUP WOULD LIKE TO THANK THE 2013 SPONSORS.
Cluster computing facility for CMS simulation work at NPD-BARC Raman Sehgal.
Windows Server MIS 424 Professor Sandvig. Overview Role of servers Performance Requirements Server Hardware Software Windows Server IIS.
LAN / WAN Business Proposal. What is a LAN or WAN? A LAN is a Local Area Network it usually connects all computers in one building or several building.
Chapter Sixteen Data Recovery and Fault Tolerance.
Introduction to Computers Personal Computing 10. What is a computer? Electronic device Performs instructions in a program Performs four functions –Accepts.
The Mass Storage System at JLAB - Today and Tomorrow Andy Kowalski.
Terabyte IDE RAID-5 Disk Arrays David A. Sanders, Lucien M. Cremaldi, Vance Eschenburg, Romulus Godang, Christopher N. Lawrence, Chris Riley, and Donald.
Secondary Storage Chapter 7.
Local IBP Use at Vanderbilt University Advanced Computing Center for Research and Education.
Planning and Designing Server Virtualisation.
Confidential1 Introducing the Next Generation of Enterprise Protection Storage Enterprise Scalability Enhancements.
Paul Scherrer Institut 5232 Villigen PSI HEPIX_AMST / / BJ95 PAUL SCHERRER INSTITUT THE PAUL SCHERRER INSTITUTE Swiss Light Source (SLS) Particle accelerator.
Hosting on a managed server hosted by TAG  No technical support required  Full backup of database and files  RAID 5 system means that if a hard drive.
Introduction to U.S. ATLAS Facilities Rich Baker Brookhaven National Lab.
HPC system for Meteorological research at HUS Meeting the challenges Nguyen Trung Kien Hanoi University of Science Melbourne, December 11 th, 2012 High.
Inside your computer. Hardware Review Motherboard Processor / CPU Bus Bios chip Memory Hard drive Video Card Sound Card Monitor/printer Ports.
 Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over a network (typically the Internet). 
21 st October 2002BaBar Computing – Stephen J. Gowdy 1 Of 25 BaBar Computing Stephen J. Gowdy BaBar Computing Coordinator SLAC 21 st October 2002 Second.
McLean HIGHER COMPUTER NETWORKING Lesson 15 (a) Disaster Avoidance Description of disaster avoidance: use of anti-virus software use of fault tolerance.
CIT 470: Advanced Network and System AdministrationSlide #1 CIT 470: Advanced Network and System Administration Disaster Recovery.
TATII ITS Network (Fiber ) Portal Server Fourth Avenue Building Database Server Dual Sparc SAN (RAID) 1.2 TB Direct Connection backup_tables raw_data_files.
Scientific Advisory Committee – September 2011COLA Information Systems COLA’s Information Systems 2011.
IDE disk servers at CERN Helge Meinhard / CERN-IT CERN OpenLab workshop 17 March 2003.
Virtualization Supplemental Material beyond the textbook.
 Introduction  Architecture NameNode, DataNodes, HDFS Client, CheckpointNode, BackupNode, Snapshots  File I/O Operations and Replica Management File.
ClinicalSoftwareSolutions Patient focused.Business minded. Slide 1 Opus Server Architecture Fritz Feltner Sept 7, 2007 Director, IT and Systems Integration.
Sydney Region Servers. Windows 2003 Standard Configuration Able to be supported remotely Antivirus updates managed from server.
January 30, 2016 RHIC/USATLAS Computing Facility Overview Dantong Yu Brookhaven National Lab.
The 2001 Tier-1 prototype for LHCb-Italy Vincenzo Vagnoni Genève, November 2000.
Install, configure and test ICT Networks
Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,
Pathway to Petaflops A vendor contribution Philippe Trautmann Business Development Manager HPC & Grid Global Education, Government & Healthcare.
CIT 140: Introduction to ITSlide #1 CSC 140: Introduction to IT Operating Systems.
12/19/01MODIS Science Team Meeting1 MODAPS Status and Plans Edward Masuoka, Code 922 MODIS Science Data Support Team NASA’s Goddard Space Flight Center.
Compute and Storage For the Farm at Jlab
Integrating Disk into Backup for Faster Restores
The demonstration of Lustre in EAST data system
HP MediaSmart Server.
Cloud Computing.
Cluster Active Archive
Computing Infrastructure for DAQ, DM and SC
הכרת המחשב האישי PC - Personal Computer
HYCOM CONSORTIUM Data and Product Servers
Chapter 7.
XenData SX-550 LTO Archive Servers
JDAT Production Hardware
Design Unit 26 Design a small or home office network
Network Attached Storage NAS100
Presentation transcript:

Computing Infrastructure Hardware & Software GrADS Project Athena Technical Issues Computing infustructure computing facilities grads project athena technical issues

IGES Computing Requirements Large model runs done offsite Requires high bandwidth connectivity to remote sites In house focus on data analysis Must provide shared access to data Requires large disk space Compute servers for analysis

Network Public Internet Internet 2 Firewall for all networking T-3 ~ 20Mb/s Internet 2 1Gb/s Firewall for all networking Internal Gigabit Ethernet Infiniband

Servers Dell hardware (linux) Public servers www.iges.org www.wxmaps.org www.monsoondata.org Front end servers (cola##) 8 cpu 32GB ram Public network Compute servers (cpu#) 24-32GB ram Private network

Data storage Dell Intel servers (linux) with direct attached disk Disks in RAID 6 Dual drive redundancy Gluster file-system High speed clustered file-system Open-source Data is stored on standard Linux file-systems (XFS) Shared over Infiniband network

Data access Gluster 6 servers No metadata server 100% scaling 24 disk bricks No metadata server 100% scaling ~2 GB/s aggregate throughput ~400 MB/s single stream

IGES DATA accessibility Single name space for storage, 191TB Mounted to every server All users have access to all data Saves on duplicate data sets Users on any server /homes /data Single namespace

Reliability / Backups No single point of failure Bacula for backups Dual drive redundancy 4 hour or NBD support contracts Spare parts onsite Bacula for backups All data backed up weekly 500 Slot Quantum i2000 tape loader 3 LTO-4 tape drives 2 copies of everything Up to 3000 slots, 96 drives

Future plans - hardware Data archiving 2 copies of data to tape Increased disk storage CPU servers with more cpu cores and large amounts of memory analysis 24 cores / 128 GB memory

Software stack Open source software whenever possible Servers run identical software Example open source packages R Flint On each server Operating system Compilers GrADS Home directory Data directory R Flint

Questions…