Welcome to our Nuclear Physics Computing System

Slides:

Advertisements

Similar presentations

ITR3 lecture 7: more introduction to UNIX Thomas Krichel

Advertisements

Computing Infrastructure

Linux can be generally divided into four major components: 1. KERNEL – OS, ultimate boss The kernel is the core program that runs programs and manages.

Novell Server Linux vs. windows server 2008 By: Gabe Miller.

SUMS Storage Requirement 250 TB fixed disk cache 130 TB annual increment for permanently online data 100 TB work area (not controlled by SUMS) 2 PB near-line.

Phones OFF Please Operating System Introduction Parminder Singh Kang Home:

Sun Grid Engine Grid Computing Assignment – Fall 2005 James Ruff Senior Department of Mathematics and Computer Science Western Carolina University.

K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.

Overview Basic functions Features Installation: Windows host and Linux host.

An Introduction to Operating Systems. Definition  An Operating System, or OS, is low-level software that enables a user and higher-level application.

The University of Akron Summit College Business Technology Department Computer Information Systems 2440: 145 Operating Systems Introduction to UNIX/Linux.

A crash course in njit’s Afs

1. Outline Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models 2.

MIGRATING TO THE SHARED COMPUTING CLUSTER (SCC) SCV Staff Boston University Scientific Computing and Visualization.

Data oriented job submission scheme for the PHENIX user analysis in CCJ Tomoaki Nakamura, Hideto En’yo, Takashi Ichihara, Yasushi Watanabe and Satoshi.

Eos Center-wide File Systems Chris Fuson Outline 1 Available Center-wide File Systems 2 New Lustre File System 3 Data Transfer.

Introduction to HPC resources for BCB 660 Nirav Merchant

Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.

University of Illinois at Urbana-Champaign NCSA Supercluster Administration NT Cluster Group Computing and Communications Division NCSA Avneesh Pant

ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.

VIPBG LINUX CLUSTER By Helen Wang March 29th, 2013.

New Employee Indoctrination Chris Biddick Paul Grenz Jan 30, cjb, pg.

3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.

Lab System Environment

Introduction to U.S. ATLAS Facilities Rich Baker Brookhaven National Lab.

CCPR Workshop Introduction to the Cluster July 13, 2006.

UNIX/LINUX SHELLS.  “A Unix shell is a command-line interpreter or shell that provides a traditional user interface for the Unix operating system and.

1 Operating Systems and Using Linux Topics What is an Operating System? Linux Overview Frequently Used Linux Commands Some content in this lecture added.

Parallel Programming on the SGI Origin2000 With thanks to Igor Zacharov / Benoit Marchand, SGI Taub Computer Center Technion Moshe Goldberg,

HPC for Statistics Grad Students. A Cluster Not just a bunch of computers Linked CPUs managed by queuing software – Cluster – Node – CPU.

Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April

FTP Short for File Transfer Protocol, the protocol for exchanging files over the Internet.protocolfilesInternet works in the same way as HTTP for transferring.

Running Parallel Jobs Cray XE6 Workshop February 7, 2011 David Turner NERSC User Services Group.

Linux History C151 Multi-User Operating Systems. Open Source Programming Open source programming: 1983, Richard Stallman started the GNU Project (GNU.

ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.

Advanced topics Cluster Training Center for Simulation and Modeling September 4, 2015.

CCJ introduction RIKEN Nishina Center Kohei Shoji.

Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.

NREL is a national laboratory of the U.S. Department of Energy, Office of Energy Efficiency and Renewable Energy, operated by the Alliance for Sustainable.

UNIX U.Y: 1435/1436 H Operating System Concept. What is an Operating System?  The operating system (OS) is the program which starts up when you turn.

Operating System Structure Lecture: - Operating System Concepts Lecturer: - Pooja Sharma Computer Science Department, Punjabi University, Patiala.

CFI 2004 UW A quick overview with lots of time for Q&A and exploration.

An Brief Introduction Charlie Taylor Associate Director, Research Computing UF Research Computing.

Advanced Computing Facility Introduction

Compute and Storage For the Farm at Jlab

Welcome to Indiana University Clusters

PARADOX Cluster job management

Chapter 1: Introduction

Assumptions What are the prerequisites? … The hands on portion of the workshop will be on the command-line. If you are not familiar with the command.

HPC usage and software packages

WP18, High-speed data recording Krzysztof Wrona, European XFEL

Welcome to Indiana University Clusters

Operating System.

Welcome to Linux Chap#1 Hanin Abdulrahman.

UBUNTU INSTALLATION

Hodor HPC Cluster LON MNG HPN Head Node Comp Node Comp Node Comp Node

CommLab PC Cluster (Ubuntu OS version)

Computing Infrastructure for DAQ, DM and SC

Welcome to our Nuclear Physics Computing System

Shell & Kernel Concepts in Operating System

NCSA Supercluster Administration

Outline Subversion server Sandpit cluster What is it?

CCR Advanced Seminar: Running CPLEX Computations on the ISE Cluster

Unit 1: Introduction to Operating System

High Performance Computing in Bioinformatics

Software - Operating Systems

Welcome to Linux Chap#1 Hanin Abdulrahman.

Welcome to Linux Chap#1.

Quick Tutorial on MPICH for NIC-Cluster

Working in The IITJ HPC System

Presentation transcript:

Welcome to our Nuclear Physics Computing System Software Hardware Servers login and interactive server file transfer server file server online station Batch system Storage 2018/11/27 RCNP, Osaka Univ.

Information is here http://www.rcnp.osaka-u.ac.jp/Divisions/CN/cn2015/ English version is available partly. main manual is at wiki (Japanese only) 2018/11/27 RCNP, Osaka Univ.

Software Compilers Intel Parallel Studio XE 2015 Cluster Edition(ifort/icc) Update to the latest version in this summer GCC (3.4.6, 4.1.2, 4.4.7, 4.9.3) before use, run setup script for each version. Libraries LAPACK, BLAS ROOT CERNLIB others MPI Intel MPI Applications emacs LaTeX 2018/11/27 RCNP, Osaka Univ.

Hardware login server login-1, login-2 access to these servers in order to login miho from outside RCNP interactive server miho-1, miho-2 interactive use except heavy computing and file transfer avoid long job ftp server ftp-1, ftp-2 file transfer especially for heavy use file server fs-1, fs-2 mainly for CIFS (SMB) server to be updated to the latest version online station aino-1, aino-2 for experiment at the cyclotron (DAQ) batch system 2018/11/27 RCNP, Osaka Univ.

Interactive server (1) interactive use only miho-1, miho-2 interactive login from outside RCNP slogin USERNAME@login-1.rcnp.osaka-u.ac.jp slogin USERNAME@login-2.rcnp.osaka-u.ac.jp select miho-1 or miho-2 by MENU screen interactive login from inside RCNP slogin USERNAME@miho-1.rcnp.osaka-u.ac.jp slogin USERNAME@miho-2.rcnp.osaka-u.ac.jp interactive use only DON’T USE long or heavy computing or file transfer emacs may be runaway. please watch. 2018/11/27 RCNP, Osaka Univ.

Interactive server (2) Shell login shell can be selected from tcsh and bash using “user management system”. other shell can be invoked by hand. zsh, mksh, sh, csh, ksh, dash sx2name command get username of miho from username of the super computer. 2018/11/27 RCNP, Osaka Univ.

file transfer server ftp-1, ftp-2 To avoid troubles concerning file transfer, file transfer severs are provided. DON’T transfer files on miho for large files or long time. File transfer scp USERNAME@ftp-1.rcnp.osaka-u.ac.jp:FILENAME1 FILENAME2 scp USERNAME@ftp-2.rcnp.osaka-u.ac.jp:FILENAME1 FILENAME2 bbftp can be used (client and server) the user computer needs to install bbftp software (free) parallel file transfer supported and fast ( >600Mbps) Please consult us for beginner GridFTP is now prepareing. 2018/11/27 RCNP, Osaka Univ.

File server fs-1, fs-2 have 2 x 10Gbps interfaces to fast access to clients and storage. We achieved total performance of >8Gbps when we copy data from old system to current system using NFS. NFS server for limited use. CIFS (SMB) server to access all files on miho can be accessed from Windows, MAC and linux even if you don’t use miho, it’s convenient to share files between PCs backup data on PCs. can be written by document scanner (Xerox Multifunction Device) 2018/11/27 RCNP, Osaka Univ.

online station aino-1, aino-2 for experiment at the cyclotron (DAQ) current experiment group has a priority. have 10Gbps interface to fast access to clients and storage. We achieved single performance of >1Gbps by scp. have 8TB of local storage for emergency use 2018/11/27 RCNP, Osaka Univ.

batch system (1) hardware total 46 nodes, 1096 cores, 3136GB memory normal nodes E5-2697v2 2.7GHz 12 cores x 2 CPU / node 24 cores x 44 nodes 64GB memory / node (2.6GB/core) large memory nodes E5-2680v2 2.8GHz 10 cores x 2 CPU / node 20 cores x 2 nodes 160GB memory / node (20GB/core) 2018/11/27 RCNP, Osaka Univ.

batch system (2) job scheduler qsub, qdel, qstat,,, default memory size is 1GB, which is intended to small value. default cpu (core) is 1. can use batch nodes interactively. ( qsub –I ) can send mail when start, end and abort. parallel job can be executed using MPI. scheduling by I/O requirement qsub –l highio=1 The jobs which declare “highio” should be assigned only 1 job per node. 2018/11/27 RCNP, Osaka Univ.

storage (1) total capacity is 5PB physically. High performance total 160 Gbps ( 20GB/s ) GPFS High reliability RAID 6 + hot spare All components are redundant. High function snapshot /home 1 snapshot / day other preparing ( How do you need ?? ) backup is now preparing /home 1 backup / 7 days others ?? ( How do you need ?? ) 2018/11/27 RCNP, Osaka Univ.

storage (2) current usage All file systems looks the same. df –a -a is required to show all file systems. quota /home 150GB / user other quota is effective but not set limits. you can see used space easily. current usage ～１５５０TB　＋５００TB　／５０００TB 2018/11/27 RCNP, Osaka Univ.

storage (3) each file systems home directory /home/USERNAME quota 150GB / user temporary area /tmp don’t use intendedly. not shared /tmp-common 10TB, shared by all machine. /tmp-cifs 2TB. temporary area for cifs user. mail/web /Maildir/USERNAME /HTMLpub/USERNAME operation area /miho common library, etc /cn work area for CN group /archive archived files /compaq old files in compaq era 2018/11/27 RCNP, Osaka Univ.

storage (4) each file systems data area /np1a experiment of the cyclotron (except below) /np1a/cagra cagra experiment /np1a/music music experiment /np1a/gtd gtd experiment /np1b LEPS /np1c other /np2 theory group /acc accelerator group /bnpc BNPC 2018/11/27 RCNP, Osaka Univ.

storage (5) each file systems super computer 500TB storage is used for JLDG project miho mounts the disk of the super computer The same directory structure as the super computer /sc/rcnp/home /sc/rcnp/short (/ext/rcnp/short) /sc/rcnp/work (/ext/rcnp/work) /sc/rcnp/work2 (/ext/rcnp/work2) not allocated for new user /sc/rcnp/work3 (/ext/rcnp/work3) not allocated for new user 2018/11/27 RCNP, Osaka Univ.