Download presentation
Presentation is loading. Please wait.
Published byLisa Wright Modified over 9 years ago
1
Grid Workflow within Triana Ian Wang Cardiff University
2
Ian Wang, Cardiff University GridLab E.U. Funded 9 Institutions German (x2), Poland, Hungry, Czech, Holland, Greece, Italy, U.K. 13 Work-Packages GAT Resource Broker (GRMS) Data Management Portal (GridSphere) Monitoring (Mercury) Adaptive Components Information Services (iGrid) …
3
Ian Wang, Cardiff University GridLab GAT Application-level API Abstract ‘Common’ Capabilities required by Grid Applications Resource Discovery Job Submission File Transfer Capabilities extracted through a number of Grid Application Scenarios. Makes life as a Grid programmer easier … Motivation for the GGF SAGA research group (Simple API for Grid Applications)
4
Ian Wang, Cardiff University GAT Architecture GRMSGRAM Local File Service GridFTP HTTP Local Resource Broker File GridLab GAT API Application (e.g. Triana) Adaptors Services GRMS iGridMercury File Transfer GRAM Grid FTP HTTP
5
Ian Wang, Cardiff University Using the GAT GATContext context = new GATContext(); Preferences prefs = new Preferences(); prefs.put("ResourceBroker.adaptor.name", "grms"); URI exe = new URI("file:////bin/hostname"); File outFile = GAT.createFile(context, prefs, new URI("file:///out") SoftwareDescription sd = new SoftwareDescription(); sd.setLocation(exe); sd.setStdout(outFile); ResourceDescription rd = new HardwareResourceDescription(); rd.put("hostname", "bouscat.cs.cf.ac.uk"); JobDescription jd = new JobDescription(sd, rd); ResourceBroker broker = GAT.createResourceBroker(context, prefs); Job job = broker.submitJob(jd);
6
Ian Wang, Cardiff University Visual GAT GAT Primitives represented as Workflow Objects Job Tasks File Tasks Grid Data Flow implicit in Workflow Connections File Task -> File Task = Data Transfer File Task -> Job Task = Pre-Stage File File Task -> Local Task = File Read Grid Operations handled by GAT Adaptors Grid File -> Grid File = GridFTP HTTP File -> Local Task = HTTP Grid File -> GRMS Job = GRMS Pre-Stage
7
Ian Wang, Cardiff University Grid Workflow in Triana Local Java Unit File (Local/Remote) Temporary File Job (Local/Remote) File WritePre-StagePost-StageFile Read
8
Ian Wang, Cardiff University Visual GAT Alternative Grid Operations Expressed Explicitly GridFTP Tasks File Write Tasks File Read Tasks Not Intuitive Not Future Proof
9
Ian Wang, Cardiff University File Input (HTTP) GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Triana WaveToy.par
10
Ian Wang, Cardiff University GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed Triana File Staging (GridFTP) WaveToy.par
11
Ian Wang, Cardiff University Mercury GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed GRMS Data Mvment Testbed Triana Delphoi GAS iGrid Job Submission 1 WaveToy.par Cactus
12
Ian Wang, Cardiff University GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed GRMS Data Mvment Portal Triana GAS Job Submission 2 Testbed Cactus Instant Mess MercuryDelphoi iGrid
13
Ian Wang, Cardiff University GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed Portal Triana Job Submission (GRAM) Testbed Cactus Instant Mess GRAM
14
Ian Wang, Cardiff University GridMonSteer User Side Grid Side WSPeer User Interface Web Service GridMonSteer (gms) cactus phi_xy.jpg phi_yz.jpg submit Application (e.g. Triana) run monitor invoke using SOAP Resource Broker (e.g. GRMS) gms http://www.xyx.org:4802/axis/gms cactus phi_xy.jpgphi_yz.jpg rundir http://www.xyz.org/axis/gms
15
Ian Wang, Cardiff University Triana Grid Workflow Summary GridLab GAT Application-level API Abstracts Common Capabilities required by Grid Applications such as Triana Visual GAT GAT Primitives represented in Triana as Workflow Objects Grid Data Flow implicit in Workflow Connections GridMonSteer Generic Architecture for Monitoring and Steering Legacy Applications
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.