Download presentation
Presentation is loading. Please wait.
Published byCandice Greer Modified over 8 years ago
1
Alain Roy Computer Sciences Department University of Wisconsin-Madison roy@cs.wisc.edu http://www.cs.wisc.edu/condor ClassAds: Present and Future
2
www.cs.wisc.edu/condor What Are ClassAds? › A ClassAd maps attributes to expressions › Expressions Constants: strings, numbers, etc. Expressions: other.Memory > 600M Lists: { “roy”, “pfc”, “melski” } Other ClassAds › Powerful tool for grid computing Semi-structured (you pick your structure) Matchmaking
3
www.cs.wisc.edu/condor ClassAd Example [ Type = “Job”; Owner = “roy”; Universe = “Standard”; Requirements = (other.OpSys == “Linux” && other.DiskSpace > 140M); Rank = (other.DiskSpace > 300M ? 10 : 1); ClusterID = 12314; JobID = 0; Env = “”; … ] (To see a real ClassAd, try: condor_q –l or condor_status –l )
4
www.cs.wisc.edu/condor ClassAd Matchmaking [ Type = “Job”; Owner = “roy”; Requirements = (other.OpSys == “Linux” && other.DiskSpace > 140M); Rank = (other.DiskSpace > 300M ? 10 : 1); ] [ Type = “Machine”; OpSys = “Linux”; DiskSpace = 500M; AllowedUsers = {“roy”, “melski”, “pfc”}; Requirements = (IsMember(other.Owner, AllowedUsers); ]
5
www.cs.wisc.edu/condor ClassAds Are Open Source › Library GNU Public License (LGPL) › Complete source code included Library code Test program › Available from: http://www.cs.wisc.edu/condor/classad › Version 0.9.3
6
www.cs.wisc.edu/condor Who Uses ClassAds? › Condor › European Data Grid › NeST › Web site › …You?
7
www.cs.wisc.edu/condor ClassAd User: Condor › ClassAds describe jobs and machines › Matchmaking figures out what jobs run on which machines › DAGMan will soon internally represent DAGs as ClassAds
8
www.cs.wisc.edu/condor ClassAd User: EU Datagrid › JDL: ClassAd schema to describe jobs/machines › ResourceBroker: matches jobs to machines
9
www.cs.wisc.edu/condor ClassAd User: NeST › NeST is a storage appliance › NeST uses ClassAd collections for persistent storage of: User Information File meta-data Disk Information Lots (storage space allocations)
10
www.cs.wisc.edu/condor ClassAd User: Web Site › Web-based application in Germany › User actions (transitions) are constrained › Constraints expressed through ClassAds
11
www.cs.wisc.edu/condor What’s New? › ClassAd collections › XML representation
12
www.cs.wisc.edu/condor New: ClassAd Collections › A collection is a “bag” of ClassAds › Can have views on a collection: Sub view: contains ClassAds matching a constraint, like (memory > 300M) Partition view: contains sub view for each value of a constraint
13
www.cs.wisc.edu/condor Collection Views Root View (all machine ClassAds)OpSys == “Linux”Memory > 600MOwner: royOwner: pfcOwner: ned
14
www.cs.wisc.edu/condor New: XML Representation › Does not replace original representation › Sample: Job Roy (other.Memory > 600M)
15
www.cs.wisc.edu/condor What’s Coming? › 1.0—real soon now Smoothing out minor issues Updated documentation › After 1.0 Set-extensions (with University of Chicago) Gang-matching, indexing Recoverable transmission of ClassAds (two- phase commit) Access from multiple languages (SWIG)
16
www.cs.wisc.edu/condor Cool! Tell Me More! Q&A: 9:00am-noon, Wed., Room 3393 http://www.cs.wisc.edu/condor/classad condor-admin@cs.wisc.edu ClassAd users mailing list
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.