Using the division's Compute-servers PubH 8400 9/17/14.

Slides:



Advertisements
Similar presentations
NAGIOS AND CACTI NETWORK MANAGEMENT AND MONITORING SYSTEMS.
Advertisements

SSH SSH is “Secure SHell” Secure, compressed, widely supported, fast Allows both users to get jobs done, and also allows system administrators to sleep.
Server 2012 R2 Essentials - What’s new ? Bart #techninebe Technine Group.
MCTS GUIDE TO MICROSOFT WINDOWS 7 Chapter 10 Performance Tuning.
Module 4: Implementing User, Group, and Computer Accounts
1 Friday, June 16, 2006 "In order to maintain secrecy, this posting will self-destruct in five seconds. Memorize it, then eat your computer." - Anonymous.
Phones OFF Please Operating System Introduction Parminder Singh Kang Home:
1 Chapter 4 Threads Threads: Resource ownership and execution.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 8: Implementing and Managing Printers.
Server selection Multiple servers Add a server UDN selection Channel selection Time selection Duration selection Channel window Time window Current time.
MCITP Guide to Microsoft Windows Server 2008 Server Administration (Exam #70-646) Chapter 14 Server and Network Monitoring.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 8: Implementing and Managing Printers.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 8 Introduction to Printers in a Windows Server 2008 Network.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 8: Implementing and Managing Printers.
1 Chapter Overview Introduction to Windows XP Professional Printing Setting Up Network Printers Connecting to Network Printers Configuring Network Printers.
HPCC Mid-Morning Break Interactive High Performance Computing Dirk Colbry, Ph.D. Research Specialist Institute for Cyber Enabled Discovery.
M ONITORING SERVER PERFORMANCE Unit objectives Use Task Manager to monitor server performance and resource usage Use Event Viewer to identify and troubleshoot.
Monitoring and Troubleshooting Chapter 17. Review What role is required to share folders on Windows Server 2008 R2? What is the default permission listed.
ITIS 2110 Class # No home network devices devices devices devices devices devices devices 9.
Chapter 7: Using Windows Servers to Share Information.
MCTS Guide to Microsoft Windows 7
1 Guide to Novell NetWare 6.0 Network Administration Chapter 11.
Information and Process Management Kevin Jacobson.
Chapter 6 Operating System Support. This chapter describes how middleware is supported by the operating system facilities at the nodes of a distributed.
Network Operating Systems versus Operating Systems Computer Networks.
Shadow Security Scanner Li,Guorui. Introduction Remote computer vulnerabilities scanner Runs on Windows Operating Systems SSS also scans servers built.
CPTE 212 “Lab” Configuration 1/13/2015 John Beckett.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
NETWORK FILE ACCESS SECURITY Daniel Mattingly EKU, Dept. of Technology, CEN/CET.
Get Started with IOA Communities: Look for this button!
Understanding Perfmon The Performance Testing Tool >>>>>>>>>>>>>>>>>>>>>>
Fault Detection Sathish S. Vadhiyar Source/Credits: From Referenced Papers.
Process Control. Module 11 Process Control ♦ Introduction ► A process is a running occurrence of a program, including all variables and other conditions.
Learningcomputer.com SQL Server 2008 – Profiling and Monitoring Tools.
CS Operating System & Database Performance Tuning Xiaofang Zhou School of Computing, NUS Office: S URL:
A User-Lever Concurrency Manager Hongsheng Lu & Kai Xiao.
Chapter 10: Rights, User, and Group Administration.
{ Cloud computing. Exciting and relatively new technologies allow computing to be a part of our everyday lives. Cloud computing allows users to save their.
Using Event Viewer Event Levels Creating Custom Views Windows Logs Monitoring Performance.
Page 1 Printing & Terminal Services Lecture 8 Hassan Shuja 11/16/2004.
Operating Systems Concepts 1/e Ruth Watson Chapter 8 Chapter 8 Network Administrator Ruth Watson.
Organising of the NetIIS System Information System Monitoring System.
Cluster Computing Applications for Bioinformatics Thurs., Sept. 20, 2007 process management shell scripting Sun Grid Engine running parallel programs.
Timeshared Parallel Machines Need resource management Need resource management Shrink and expand individual jobs to available sets of processors Shrink.
Unix Servers Used in This Class  Two Unix servers set up in CS department will be used for some programming projects  Machine name: eustis.eecs.ucf.edu.
Threads. Readings r Silberschatz et al : Chapter 4.
Configuring, Managing and Maintaining Windows Server® 2008 Servers Course 6419A.
Unit 4: Processes, Threads & Deadlocks June 2012 Kaplan University 1.
CSC414 “Introduction to UNIX/ Linux” Lecture 3
Bio 271 Lecture 1. Robert Gentleman Office M1B28, Mayer Building at DFCI Phone:
Page 1 Monitoring, Optimization, and Troubleshooting Lecture 10 Hassan Shuja 11/30/2004.
1 Introduction to Shared Folders Shared folders provide network users access to files. Users connect to the shared folder over the network. Users must.
Hands-On Microsoft Windows Server Implementing User Profiles A local user profile is automatically created at the local computer when you log on.
Research Computing at the SSCC. What We Do Provide computing support of Social Science researchers. Focus on statistical computing.
Printing. Printing Terminology Logical Printer Physical Printer/Print Device Print Server Locally vs network attached printer Non-remote vs remote printer.
-Active Directory is the brain of the Microsoft windows Server Network. -It’s a database that keeps track of huge amount of stuffs and gives us a centralized.
Understanding and Improving Server Performance
Troubleshooting Tools
2016 Citrix presentation.
MCTS Guide to Microsoft Windows 7
ASU Saguaro 09/16/2016 Jung Hyun Kim.
TYPES OF SERVER. TYPES OF SERVER What is a server.
SSH SSH is “Secure SHell” Secure, compressed, widely supported, fast
Chapter 2: System Structures
Example of usage in Micron Italy (MIT)
Time Gathering Systems Secure Data Collection for IBM System i Server
CPU scheduling decisions may take place when a process:
Process Management and System Monitoring
Presentation transcript:

Using the division's Compute-servers PubH /17/14

List of compute servers ● For students: ● potassium.biostat.umn.edu ● cesium.biostat.umn.edu ● carbon.biostat.umn.edu ● chromium.biostat.umn.edu ● For faculty: ● rubidium.biostat.umn.edu ● silicon.biostat.umn.edu ● All servers have 24 cores (processors)

How to access servers ● Directly ssh in from anywhere within the umn.edu domain (U of M network) ● If coming from outside of umn.edu ● ssh to merganser.biostat.umn.edu, then ssh to the desired server ● Log into the University VPN and ssh directly to the desired host

Server utilization - CPU days

Cesium usage, June 2012

Potassium usage, June 2012

Computing etiquette ● Don't run open-ended jobs ● Estimate of the job's duration ● Run a small version of the job to get estimate ● “nice” your jobs ● 'r' within “top” ● “renice 19 ” on command line ● Don't run too many concurrent jobs (or too many threads) on one server

Monitor your jobs ● Use “top” ● Know how to kill your jobs ● In “top” use “k” ● From command line: – kill – kill -1 – kill -9 (sure kill, use as last resort) ● Write to a file as job progresses

Automatic monitoring ● System programs monitor each user's compute- bound jobs ● If user runs too many compute-bound processes/threads, jobs are automatically “niced” to a lower priority ● Perhaps we will add annoying notifications if jobs run too many days

Threaded jobs ● A threaded job breaks into “threads” where each thread runs independently and can run on different processors ● A threaded job could saturate all 24 cores ● “top” can tell you if a job is threading ● Run only 1 or 2 threaded jobs per server ● Serialize threaded jobs, rather than running many such jobs concurrently

Using “top” ● 'q' to quit ● '1' toggle “show all cores/show summary” ● Need a window with at least 36 lines ● 'H' toggle “show all threads/show summary” ● 'k' kill a job ● 'h' help