OGSA-WG Program Execution Status Update GGF9 Chicago, USA October, 2003 GLOBALGRIDFORUM.ORG

Agenda Introducing the PE Sub-group Status update What’s next

We are Program Execution Sub-group Ming Xu, Chris SmithPlatform Karl Cazjkowski, Alan Andrieux & Steve Tuecke Globus Jay Unger, Asit Dan & John RofranoIBM Ravi SubramaniamIntel Hiro Kishimoto, Andreas SavvaFujitsu Andrew GrimshawAvaki John TollefsrudSun When we first got together four months ago 

PE Applications and Resources Modeling and Simulation End of day processing with 15,000 to 500,000 processes to be run High Volume Trade pricing Real-time Information Display Interactive Information Retrieval Short bursty Compute Intensive requests Processing of large inter-related applications with large data sets Computation Intensiveness Data Size Low High Low High EDA Simulations EDA Industrial Manufacturing Life Science EDU/Gov Finance

Decide what we want… What’s the end-point characteristics for OGSA PE Services?

SGE PBSLSF Breaking down the dividing walls Division A Division BDivision C VO1 VO2

End Point Characteristics of PE services Through OGSA PE services, IT can precisely measure, dynamically allocate and control the distribution of capacity, where it is needed when it is needed to meet their business objectives for cost, risk, and productivity OGSA PE services app

Status: how we got here Ravi proposed The Workload Realization Model (Refactorization) WS-Agreement Proposed time JuneAugustOct Sept Reference Implementation Of WS-Agreement (CSF) OGSA-F2F Meeting First spec based on CSF Consensus  We’ve just started  WS-Agreement  Refactor the services PE Terms - Andrew Grimshaw Sub-group Teleconferences

Why isn’t OGSI enough? createService(…) CreateionParams & port types LSF Style createService(…) CreateionParams & port types PBS Style createService(…) CreateionParams & Port types SGE Style

WS Agreement & related working groups Initiator Service Provider WS-Agreement GRAAP Agreement Terms JSDL, GESA, DAIS …

Two Proposals Agreement Based PE Service Interfaces Service Refactorization

Agreement based Proposal: Bridging the demand & supply VO

Agreement terms for Advance Reservation type==LINUX86 <metascheduler:hostTerm gsa:Negotiability="gsa:Fixed"> dev04 <metascheduler:userTerm gsa:Negotiability="gsa:Fixed"> bingfeng 32 <metascheduler:startTime gsa:Negotiability="gsa:Fixed"> T17:00:00.000Z T23:00:00.000Z CONT

Job Terms Draft Spec “Job Terms for specifying computational jobs” by Globus and Platform Submitted for consideration to JSDL group Attend the JSDL session !

Workload Mgmt. Framework User/Job Proxies Environment Mgmt. Policies “Supply”“Demand” CMM Resource Mgmt. Framework Reservation Optimizing Framework Resource Selection Resource – Workload Optimal Mapping Workload Optimization Workload Post Balancing Resource Provisioning Workload Optimizing Framework Workload Optimization Workload Orchestration Workload Models (History/Prediction) Dependency management Scheduling Resource Optimizing Framework Capacity Management Resource Placement Primary Interaction Meta - Interaction Represents one or more OGSA services Resource Allocation (or Binding) Job Factory Admission Control (Resources) Admission Control (Workload) SLA Management (Workload) Quality of Service (Resources) Queuing Services Resource Factory Information Provider Selection Context (e.g. VO) Service Refactorization

Queues Interactive Workloads Events Workload Mgmt. Expected Work Expected Resource Availability Models Workload Prediction Resource Estimation System Inputs Dispatch/ Binding Capacity Mgmt. Provisioning Resource Topology Work Priority/ Work Migration/ Work Pre-emption Resource Balancing Scheduler Schedules & Resource Agreements Resource Mapping Optimizer (Framework + Models) System Analytics System Operation Assessments Reservation Workload Topology & Dependencies Establish Agreements Get Agreements Work - Resource combinations Resource Topology Allocation (Workload to Resource Binding) Running Job – Used Resources Running Job – Used Resources Running Job – Used Resources Placement Resource Maps - Placement: At runtime (i.e. post dispatch) - Resource map/optimization: pre-dispatch

Support Services - Auditing, Logging, Monitoring, Messaging, Event Management, Sensors, Metrics Security Services - (WS-Security; GSI) - Authentication, Authorization, Identity management, identity propagation and delegation, audit) OGSI (Grid Service) : Factory, Notification, introspection, lifecycle, policy Platform Hosting Env. Resource Binding & Allocations Work Distributed State Workload Management Services Workload Scheduling Services Workload & Resource Optimization Services Capacity Management Services (Resource Mgmt. & Provisioning) Service Level Management Services Configuration Services Job Grid Resource Manager or Virtualized Instance Business Services - Subscription, Accounting, Billing Resource Agent Admission Control

What’s next Planning 101 Decide where exactly we want to get to Gap analysis Set milestones Execute “JUST DO IT!”