© 2007 Open Grid Forum OGF Standards Development Chris Smith, VP of Standards, OGF DMTF Alliance Partner Technical Symposium Portland July 17 th, 2007
© 2007 Open Grid Forum 2 Overview OGF History & Mission Organization of OGF Groups & Documents Standards Function Technical Strategy for Standards OGF & DMTF Alliance
© 2007 Open Grid Forum 3 History Birthed in high performance computing community in 1998 Merged with European & Asian grid efforts in groups and 81 documents Birthed in enterprise data center community in 2004 Raised awareness of grids in “end-user” organizations 5 groups and several important documents Merger completed, June ’06; OGF Launched September of ‘06
© 2007 Open Grid Forum 4 Open Grid Forum Events & Forums Community Practice Industry Standards Bring communities together to share, innovate, workshop and outreach Leverage expertise & experience of the community to enable successful building and operating of grids Align with/influence other SDOs and/or develop specifications that lead to interoperable software standards
© 2007 Open Grid Forum 5 Events & Activities Events enable our “Open Forum” mission Assembles grid topic experts from around the world Provides opportunity for grid professionals to network together Allows buyers and sellers to interact Provides a venue for major grid projects to collaborate Enables cross-OGF alignment on technical strategy Delivers relevant content to interested parties Enables collaboration for the development of specifications
© 2007 Open Grid Forum 6 Events & Activities 3 major events a year: Winter, Spring, Fall Spread roughly equally by region (US, Europe, APAC) Driven by attendance and host offers Several types of content: Group Sessions: BoFs and chartered group f2f meetings eScience Program: refereed workshops and in-depth sessions on grid innovations and best practices Enterprise Program: end-user deployment-focused sessions and requirements gathering Tutorials: hands-on sessions; educational Shorter, more focused events also possible Occasional webcasts
© 2007 Open Grid Forum 7 Organization President BoD Operations Editor Enterprise eScienceStandardsMarketingRegional Nominating Committee Technical Strategy Committee Advisory Committee OGF Overview Document available at:
© 2007 Open Grid Forum 8 Functions/Areas/Groups/Chairs Standards Function Standards Council VP, Standards Area Directors Program Manager OGF Editor Management Application Security Architecture Infrastructure DataCompute Standards Areas Liaisons Areas managed by Area Directors Areas consolidate Groups of like focus Groups are led by Chairs Functions consolidate Areas of like focus
© 2007 Open Grid Forum 9 Example: SAGA-Working Group Standards Function Standards Council Chris Smith, VP Steven Newhouse, Dieter Kranzlmueller, AD’s Joel Replogle Greg Newby Application Area Standards Areas Each group has an list (saga- and a GridForge projectsaga- Simple API for Grid Applications (SAGA-WG) Co-Chaired by: Shantenu Jha, Thilo Kielmann, Tom Goodale Note that SAGA-WG is one of many groups in this Area
© 2007 Open Grid Forum 10 Group Types Working Groups (WG) Crisp focus on development of a specification or guideline Clear milestones based on delivery of drafts and publication dates Research Groups (RG) Focus can be broader than WG, but must be clear Milestones based on delivery of drafts, organization of workshops, and workshop reports Technology exploration (e.g., Semantic Grid-RG) Community Groups (CG) Explore grid usage and requirements in a sector (e.g., Telco-CG) Milestones based on delivery of requirements documents Full Listing:
© 2007 Open Grid Forum 11 How Groups Work Because every group has a different charter and leadership, every group is different Consistent things: Work is announced on the group list Deliverables are normally one or more documents Documents follow the same publication process (OGF Editor) “Rough consensus and working code” is the rule of thumb All work done under OGF IPR Policy Inconsistent things: Meeting cadence Use of GridForge (web-based collaboration tool) for group work Group deliverables differ based on chartered work
© 2007 Open Grid Forum 12 OGF Editor Manages the publication process (GFD-C.1) and “pipeline” Ensures documents are consistently formatted Works with Area Directors/VPs to ensure technical viability of documents Drafts submitted to the “editor pipeline” Editor project in GridForge
© 2007 Open Grid Forum 13 Deliverables Different Groups have different deliverables Research groups may hold workshops and create proceedings documents and/or “best practice” documents Working groups will likely deliver specifications but may have preliminary “informational” documents to lay the foundation Community groups may hold workshops that capture requirements which are documented and given to working groups Other groups may document a well-used process in the grid industry or in the OGF organization Different deliverables require different document types
© 2007 Open Grid Forum 14 OGF Document Types Informational Informs the community of an interesting and useful Grid-related technology, architecture, framework, or concept Specifies requirements related to a particular vertical application Experimental Informs the community of the results of Grid-related experiments, implementations, operational experience, or to propose an experimental specification
© 2007 Open Grid Forum 15 Document Types Community Practice Inform and influence the community regarding an approach or process that is considered to be widely accepted by consensus and practice in the Grid community or within the OGF organization Recommendations (2 stage) Documents a particular technical specification or a particular set of guidelines for the application of a technical specification. The recommendations documents are intended to guide interoperability and promote standard approaches.
© 2007 Open Grid Forum 16 Standards Function Overview Set in the context of of alignment with e-Science Enterprise Promote Uptake Interoperability Run a Process Output in the form of Standards Management Applications Security Architecture Infrastructure Data Compute Standards OGFLiaison Technical Strategy Committee
© 2007 Open Grid Forum 17 Standards Development Short Version of the Process A group of people interested in creating a standard hold a BoF (optional). Grid Forum Steering Committee Approves a WG In an open forum, the WG writes the specification GFSG Review Public Review Final approval and publication Complex Open Process, … but things can move very fast when there is energy available.
© 2007 Open Grid Forum 18 Technical Strategy Overview Defines the overall OGF technical strategy for the development of standards Three-year timeframe from 2006 to 2010 Describes the output of the OGF standards working groups as well as the requirements that drive them. Technical Strategy Document Focus Areas Goals Alignment Process Use Cases Roadmap
© 2007 Open Grid Forum 19 Broad and Narrow Grids The concept allows for clearer communication encompassing all aspects and points of view on Grids. A Broad Grid is any collection of services A Narrow Grid is defined by both the technologies used, as well as the application focus. Some examples: OGSA compliant Enterprise compute cluster Web 2.0 Sensor Net linked to Google maps
© 2007 Open Grid Forum 20 Narrow Grids of Focus Collaboration Grids Multiple institutions, secure, widely distributed, VOs Collaborative agreements & commercial partnerships Financial Model: Increase overall revenue Data Centre Grids Centralized management of multiple platforms Aggregation of enterprise resources and applications Financial Model: Reduce Total Cost of Ownership (TCO) Cluster Grids Networks of Workstations, Blades, etc. Cycle scavenging, Homogeneous workload Financial Model: Lower marginal costs
© 2007 Open Grid Forum 21 Goals of the TSC Identify use-cases, patterns, and scenarios Publish documents Design and drive the standards process. Identify and highlight core architectural standards Encourage software developers From open source community and the commercial To develop and implement standards Hold regular alignment summits
© 2007 Open Grid Forum 22 Technical Strategy Process OGF Technical Strategy & Roadmap Requirements Workshops Uses Cases Requirements Best Practices Architectures Specifications Milestones OGF Events OGF Document Series Alignment & Prioritization Open forum for grid innovation and outreach Open standards for grid software interoperability Alignment & Prioritization Technical Strategy Committee Standards Groups & Workshops
© 2007 Open Grid Forum 23 A More Refined View EGR-RG Financial Telco Pharma EDA SN-CG Vendors Requirements Solicitation Applications Compute Data Infrastructure Management Architecture Security Standards Groups Requirements Rollup, Analysis & Prioritization (EGR-RG) TSC GAP Analysis What WGs are doing i.e. WG roadmap Prioritized Req and Req Patterns Req Req and Req Patterns Requirements Specs Best Practices Req Best Practice Workshops Req Best Practices Overall standards roadmap Gap analysis of WG roadmap vs. prioritized Req Recommended actions
© 2007 Open Grid Forum 24 Technical Strategy & Roadmap “Moon Shot” Goal The Open Grid Forum should commit all its available resources to the goal that before this decade is out, commercial and academic organizations will build real operational grids using Open Grid Forum defined components.
© 2007 Open Grid Forum 25 High Value Use Cases Grid APIs Job Submit File Movement Application Provisioning Data Provisioning and Data Grids Grid Security
© 2007 Open Grid Forum 26 Concept - hold BOF to form… Working Group - generates a… Draft Specification - public comment… Proposed Recommendation - implementations… Interop - experience documents… Full Recommendation - GFSG review… Product - implemented in product… Deployment - customer use of standard Lifecycle of a Standard
© 2007 Open Grid Forum 27 Roadmap Snapshot
© 2007 Open Grid Forum 28 There is a Gap Analysis too The Maturity column indicates the rough State of the Art with respect to each capability. Categories: Out of Scope for the OGF Gap that OGF should be investigating Area of Grid Research Evolving area either in OGF or some other SDO Capability with Mature specifications or solutions.
© 2007 Open Grid Forum 29 Gap Analysis
© 2007 Open Grid Forum 30 TS&R Document Status Like all OGF documents it is always accessible in Gridforge forge.gridforum.org/sf/projects/tsc Has been through its Public Comment period To be published in time for OGF21 in October 2007
© 2007 Open Grid Forum 31 OGF & DMTF Alliance Intention of the alliance is to cross- leverage each organization’s domain strength DMTF focus on distributed management infrastructure and information/data modeling of resources OGF focus on the deployment, operation and access to resources in a Grid
© 2007 Open Grid Forum 32 Alliance Benefits Collaboration on broadening CIM to encompass Grid concepts Leverage technical and marketing resources in both DMTF and OGF Coordinate development processes and priorities between DMTF and OGF to ensure DMTF modeling standards address Grid technology, and that OGF Grid services address management requirements Education about technologies and activities across the organizations, and participation in each others events
© 2007 Open Grid Forum 33 Current Work Register Review / Comment (1Q2007) DSP 0225: URI Format for Published XML Schema DSP 0230: WS-CIM Mapping Specification Extrapolate from the OGSA-BES work and submit to DMTF a general container model (current work in progress) Identify the base set of grid resources that need to be advertised that applications can consume (via requirements) and update the CIM as needed including how best to map/leverage information models. (current work in progress)
© 2007 Open Grid Forum 34 Liaisons Tom Roney, OGF liaison to the DMTF Mike Baskey, DMTF liaison to the OGF
© 2007 Open Grid Forum 35 Other OGF Sessions Information Modeling of Grid Resources: the OGF GLUE WG Approach Sergio Andreozzi Tuesday, 3pm OGSA Information Model Updates Ellen Stokes Wednesday, 10am OGSA Reference Model Paul Strong Wednesday, 1pm
© 2007 Open Grid Forum 36 Questions?