Download presentation
Presentation is loading. Please wait.
Published byAmber Frost Modified over 11 years ago
1
BQS Update Architecture Scheduling Job Types New Users Needs More users & machines, Scalability issues Needs for more sophisticated monitoring and control over the system Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
2
Architecture Update Client Worker MySQL DB BQS Scheduler Worker DB Agent results spawn report submit query DB Agent Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
3
Scheduler Resources Quasi Interactive Jobs Scheduling Update Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
4
More Control for Operation and Administration: Weight of Past Resource Usage And Group Objectives Max Job Duration Small Jobs Bias Scheduler Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
5
Beyond Traditional Resources E.G. Disk, Time, Memory Logical Resources Name Max Available Restricted Flag Admin Defined Resources E.G. HPSS Logical Resources Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
6
Created & managed by Users: Decide of the Name: u_XXX Receive Privilege bqs.u_XXXadmin Set Max Available and Restricted Flag Grant/deny bqs.u_XXXusage privilege Logical U_Resource Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
7
A General Service, APIs, Commands To: Grant, Deny, Check & List Privileges Given to Users, Groups and Machines EG in BQS applid: bqs.admin, bqs.oper, bqs.spawn_forbidden Privilege Management Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
8
Parallel Jobs Arborescent Jobs GRID Jobs New Job Types Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
9
2 new submit options: proc, ptype proc: Number of WorkPoints ptype: PVM, MPICH, LAM-MPI Parallel Jobs Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
10
Parallel Jobs Client Worker MySQL DB BQS Master Worker BQS DB Agent results spawn parallel job report submit … query spawn task DB DB Agent global report Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
11
SNOVAE: many related small tasks need short global response time Schedule and spawn as one Job to reduce BQS latency Runs on a number of WorkPoints User must describe tasks dependencies Arborescent Job Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
12
Real and Generic Accounts AFS Tokens and Certificates Specific RH 7.3 + LCG Soft Full Production Farm (Currently a Specific lcg Logical Test Farm for Validation) GRID Jobs Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
13
BIO: Quasi Interactives Jobs Installation and documentation for LCG Other Projects Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.