Presentation is loading. Please wait.

Presentation is loading. Please wait.

Services for Experienced and Starting HPC Tier 3 Users (SES-HPC)

Published byAlfred Hertz Modified over 6 years ago

Similar presentations

Presentation on theme: "Services for Experienced and Starting HPC Tier 3 Users (SES-HPC)"— Presentation transcript:

1 Services for Experienced and Starting HPC Tier 3 Users (SES-HPC)
Jan Steiner Zentrum für Informations- und Medientechnologie Universität Siegen

2 Outline Motivation Project Structure First Experiences Status 4.12.17
SES-HPC

3 National/ International
Motivation: Tier 1 National/ International Permeability between Tier 3 and higher tiers Code development on Tier 3 – productive runs on Tier 1 Less experienced users Cheaper resources Start early Get people onto Tier 3 Facilitate movement to higher tiers Tier 2 National/Federal Tier 3 Federal/Local SES-HPC

4 Background: Existing Infrastructure
HorUS: Current Cluster at Uni Siegen Diverse users Planned future cluster Proposal underway Additional users, e.g. Big Data  Good position to support users early SES-HPC

5 Outline Motivation Project Structure First Experiences Status 4.12.17
SES-HPC

6 Five pillars of support
Teaching and Training Performance Anlysis Third-party Code Support Tier Change Support Knowledge Transfer SES-HPC

7 Five pillars of support
Teaching and Training Beginner and advanced devs Hold classes Advise on external courses Gauge demand for new courses Performance Analysis Third-party Code Support Tier Change Support Knowledge Transfer SES-HPC

8 Five pillars of support
Teaching and Training Beginner and advanced devs Hold classes Advise on external courses Gauge demand for new courses Performance Analysis Experienced code developers Performance reviews Performance measurement tools Third-party Code Support Tier Change Support Knowledge Transfer SES-HPC

9 Five pillars of support
Teaching and Training Beginner and advanced devs Hold classes Advise on external courses Gauge demand for new courses Performance Analysis Experienced code developers Performance reviews Performance measurement tools Third-party Code Support Users of comm-ercial/open-source codes Support in finding optimal settings Find most suitable hardware Tier Change Support Knowledge Transfer SES-HPC

10 Five pillars of support
Teaching and Training Beginner and advanced devs Hold classes Advise on external courses Gauge demand for new courses Performance Analysis Experienced code developers Performance reviews Performance measurement tools Third-party Code Support Users of comm-ercial/open-source codes Support in finding optimal settings Find most suitable hardware Tier Change Support Dev teams who want to apply for higher tier hardw. Find most suitable hardware Test and evaluation of software Knowledge Transfer SES-HPC

11 Five pillars of support
Teaching and Training Beginner and advanced devs Hold classes Advise on external courses Gauge demand for new courses Performance Analysis Experienced code developers Performance reviews Performance measurement tools Third-party Code Support Users of comm-ercial/open-source codes Support in finding optimal settings Find most suitable hardware Tier Change Support Dev teams who want to apply for higher tier hardw. Find most suitable hardware Test and evaluation of software Knowledge Transfer All HPC users Establish and maintain wiki Organize networking workshops SES-HPC

12 Outline Motivation Project Structure First Experiences Status 4.12.17
SES-HPC

13 Example consulting session
Client: PhD student R script, runs 24 cases in sequence Script runs 4 weeks, job would often die before that Paper deadline in 4 weeks This is not to make fun of him SES-HPC

14 Example consulting session
Act 1: Troubleshooting “What did you set the walltime to?” “What’s a walltime?” ”Default then, which queue was it in?” “What’s a queue?” “OK never mind, lets have a look at your script.” SES-HPC

15 Example consulting session
Act 2: The Script Script: same calculation done 24 times just within this script If-blocks with conditions for case 1, 2, …, 24 „OK, make a shell script with a loop, and set the condition via command line argument for the R script. Then call your script with &“ „What‘s a shell script?“ SES-HPC

16 Example consulting session
Act 3: Listen, the Mensa is About To Close “Copy your script 24 times, write condition=1,2,etc. at the top and name them script_1.r, script_2.r,…“ “In the shell script, you write:” ./script_1.r & ./script_2.r & ... “Thank you so much! It runs 24 times faster now!” SES-HPC

17 Lessons learned We let this guy on the cluster
Nobody told him anything Cluster website At least google “SLURM” He ran his jobs for months I met him by sheer coincidence We actually helped him a lot SES-HPC

18 Lessons learned Who is the bigger fool? The fool?
Source: New Line Cinema Who is the bigger fool? The fool? The fool who fails to take him by his hand? SES-HPC

19 Lessons learned Not just user’s job to inform themselves
Don’t know what they don’t know Not good: “Keep away from cluster” Help but also educate (sustainability) SES-HPC

20 Outline Motivation Project Structure First Experiences Status 4.12.17
SES-HPC

21 Status Interviews with all institutes that use cluster
R-script guy is not completely unique Cluster website review “Getting started” section Additional feedback: Mech.-Eng. Students Little prior knowledge of Linux Seminars “Cluster Introduction”, “Linux Introduction” SES-HPC

22 Wanted: second position
Teaching and Training Beginner and advanced devs Hold classes Advise on external courses Gauge demand for new courses Performance Analysis Experienced code developers Performance reviews Performance measurement tools Third-party Code Support Users of comm-ercial/open-source codes Support in finding optimal settings Find most suitable hardware Tier Change Support Dev teams who want to apply for higher tier hardw. Find most suitable hardware Test and evaluation of software Knowledge Transfer All HPC users Establish and maintain wiki Organize networking workshops SES-HPC

23 Thank You For Your Kind Attention.
SES-HPC

Download ppt "Services for Experienced and Starting HPC Tier 3 Users (SES-HPC)"

Similar presentations

Setting Up a Successful Advisement Program… AKA Dont Make the Same Mistakes We Did Martinsburg High School Martinsburg, WV.

Setting Up a Successful Advisement Program… AKA Dont Make the Same Mistakes We Did Martinsburg High School Martinsburg, WV.
Learning Enhances Awareness LEA – IJMA3 2008 Learning Enhances Awareness LEA 2008.

Learning Enhances Awareness LEA – IJMA Learning Enhances Awareness LEA 2008.
Slide: 1 3 rd WGCapD Meeting – Derhadum, India – April 23-25 WGCapD e-learning Course Hilcéa Ferreira/INPE.

Slide: 1 3 rd WGCapD Meeting – Derhadum, India – April WGCapD e-learning Course Hilcéa Ferreira/INPE.
1 CIS 607snd In beginning of quarter, meet both MW. Might change to one day a week later. There is no.

1 CIS 607snd In beginning of quarter, meet both MW. Might change to one day a week later. There is no.
Copyright © 2003 Bolton Institute Dept. of Computing and Electronic Technology - Multimedia Integration and Applications Lecture 3 - Project Planning.

Copyright © 2003 Bolton Institute Dept. of Computing and Electronic Technology - Multimedia Integration and Applications Lecture 3 - Project Planning.
Www.transact-innovation.com TRANSACT – the collaborative approach and its influence on networking Petra Brüning PAXIS PROJECTS JOINT WORKSHOP Salamanca,

TRANSACT – the collaborative approach and its influence on networking Petra Brüning PAXIS PROJECTS JOINT WORKSHOP Salamanca,
Lecture 6 - Project Planning. Lecture 6: Project Planning Overview Creating an outline plan –Work Breakdown Structure –Identifying tasks Waterfall and.

Lecture 6 - Project Planning. Lecture 6: Project Planning Overview Creating an outline plan –Work Breakdown Structure –Identifying tasks Waterfall and.
Basic Unix Dr Tim Cutts Team Leader Systems Support Group Infrastructure Management Team.

Basic Unix Dr Tim Cutts Team Leader Systems Support Group Infrastructure Management Team.
Postgraduates who Teach Workshop Cardiff University 2008 Getting a Job as a Researcher or Lecturer in Psychology/Social Science Nicola Weston UPSI, Cardiff.

Postgraduates who Teach Workshop Cardiff University 2008 Getting a Job as a Researcher or Lecturer in Psychology/Social Science Nicola Weston UPSI, Cardiff.
HPCC Mid-Morning Break Interactive High Performance Computing Dirk Colbry, Ph.D. Research Specialist Institute for Cyber Enabled Discovery.

HPCC Mid-Morning Break Interactive High Performance Computing Dirk Colbry, Ph.D. Research Specialist Institute for Cyber Enabled Discovery.
Copyright Summer of Code 2007 Summer of Code 2.0 What are you doing this summer ? Victoria University 15 th August 2007.

Copyright Summer of Code 2007 Summer of Code 2.0 What are you doing this summer ? Victoria University 15 th August 2007.
Begin with the end in mind... Engaged & motivated students meeting learning outcomes Teaching & learning that offers students the opportunity to explore.

Begin with the end in mind... Engaged & motivated students meeting learning outcomes Teaching & learning that offers students the opportunity to explore.
Online Learning Unit Wise and Pearce, HIC, Aug 2005 Challenges for a faculty-based online learning unit in supporting the development of online projects.

Online Learning Unit Wise and Pearce, HIC, Aug 2005 Challenges for a faculty-based online learning unit in supporting the development of online projects.
Developing Your Course Training. Can you tell me who my rep is please? Luke Burton, University of Nottingham Students’ Union.

Developing Your Course Training. Can you tell me who my rep is please? Luke Burton, University of Nottingham Students’ Union.
Training transfer from the classroom to the workplace

Training transfer from the classroom to the workplace
Maintaining a Microsoft SQL Server 2008 Database SQLServer-Training.com.

Maintaining a Microsoft SQL Server 2008 Database SQLServer-Training.com.
VSS supports knowledge management Knowledge based organizations and improving the absorption capacity.

VSS supports knowledge management Knowledge based organizations and improving the absorption capacity.
Addressing National Priorities in TEMPUS Projects TEMPUS Project for Establishing a Center of Excellence for Research & Training at Damascus University.

Addressing National Priorities in TEMPUS Projects TEMPUS Project for Establishing a Center of Excellence for Research & Training at Damascus University.
Tom Campbell Empowering students to “articulate” what matters to them during the transition from college to university.

Tom Campbell Empowering students to “articulate” what matters to them during the transition from college to university.
Outline  Case study  Significance of study  Need of career guidance in under-developed countries  Process  Overview of Career Guidance Model  Innovative.

Outline  Case study  Significance of study  Need of career guidance in under-developed countries  Process  Overview of Career Guidance Model  Innovative.

Similar presentations

Ads by Google