© 2006 OpenGridForum e-Infrastructure Evolution, Accessibility & Societal Impacts July 16, 2009 Craig A. Lee President, OGF,

© 2009 OpenGridForum 2 Introduction A wide range of distributed computing application domains are beneficial to science, engineering, industry and society How can we best support them and realize their benefits? What technical requirements to they have in common? How can we support them in an economically efficient manner and make them accessible? How can we map the necessary common technical capabilities into economically self-sustaining business models? Can we support the required capabilities with IT as a Service? How can we do so in an open, non-proprietary manner to enable portability and interoperability? Let's Begin – with the rapidly evolving landscape...

© 2009 OpenGridForum 3 Vast Array of Application Scenarios Are Driving Technological Evolution IBM Second Life Data Center Migration

© 2009 OpenGridForum Evolving Infrastructures 4 Mainframes, minicomputers, networks, the web, clusters, grids, service-oriented architectures, … and now clouds OGF is committed to supporting our existing user base while actively pursuing the development and evolution of all effective distributed computing platforms

© 2009 OpenGridForum What is the OGF? The Open Grid Forum Mission Statement “OGF is an open community committed to driving the rapid evolution and adoption of applied distributed computing. Applied Distributed Computing is critical to developing new, innovative and scalable applications and infrastructures that are essential to productivity in the enterprise and within the science community.” How do we achieve these goals? Community Building & Outreach Best Practices & Standards 5

© 2009 OpenGridForum 6 OGF Organizational Structure OGF Europe OGF Europe eResearch

© 2009 OpenGridForum OGF-EUROPE: Making an impact Promoting standardisation to enable innovation Industry Expert Group Connecting user groups to share best practices and transform them into standards Community Outreach Seminars Supporting the development and implementation of European standards with diverse groups International Events Ensuring OGF standards are aligned with the needs of European stakeholders 7

© 2009 OpenGridForum OGF Goals and Activities Strategic Goals Lead technological evolution Facilitate the most effective distributed computing platforms Serve stakeholder requirements Provide societal benefit Major Activities Cloud Computing Green IT Geospatial Applications 8

© 2006 OpenGridForum 9 Cloud Computing -- What is it? A broad term used to denote abstraction and virtualization at any of several different system layers “Outsourcing” of hardware, system environment, or services Things just run “in the cloud”, i.e., somebody else’s data center Generally from a single provider through a very simple API Simple API eases adoption at the cost of insight and control Effective business model for provider to “sell” virtualized, back-end data center resources Infrastructure Level Platform Level Application Level Infrastructure as a Service (IaaS) Acquire a set of machines you can login to Example: Amazon EC2 Platform as a Service (PaaS) Acquire a set of hosting environments Example: Google App Engine (Python) Software as a Service (SaaS) Build an application from pre-defined services Example: Salesforce.com

© 2009 OpenGridForum 10 How Do Grids and Clouds Relate? Opinions vary … but … “Grids are an access model; Clouds are a business model” Chris Smith, Platform Computing, OGF VP Standards Grids: federated resources & environments Clouds: dynamic provisioning of virtualized resources No Shortage of (Grid & Cloud) Challenges Data access and interoperability Security Reliability Frameworks Performance management Costing models Distributed applications need both grid and cloud There is no real grid vs. cloud dichotomy

© 2009 OpenGridForum Deployment Models Blur the Boundaries of Grids and Clouds 11 Public Cloud Simple Client-Provider Interface Simple Client-Provider Interface

© 2009 OpenGridForum Private Cloud Private Cloud Enterprise A Private Cloud Private Cloud Enterprise B Deployment Models Blur the Boundaries of Grids and Clouds 12 Public Cloud Hybrid Cloud Hybrid Cloud Federated Cloud Federated Cloud Hybrid Cloud Hybrid Cloud

© 2009 OpenGridForum Public vs. Private Cloud Issues Cost & Cost Predictability Users expect to monitor & manage "their" infrastructure Will a public cloud provider expose enough information for a client to troubleshoot when something goes wrong? Security & Privacy You can store encrypted data in a clouds, but can you compute on it? Regulation Physical location of data Long-term audit trails (15-20 years) Individual vs. Corporate Requirements Corporate use of public clouds may entail legal & contracting overheads Ease of use and quick provisioning may tempt individuals to ignore corporate procedures Trade-off between quick results and risk exposure Internal IT departments may want to offer their own "seed cloud” Interoperability & portability between private and public clouds 13

© 2009 OpenGridForum The OGF Open Cloud Computing Interface 14 OCCI focused on IaaS Cloud API Requirements and Use Case documents also underway Goal was the creation of a simple and RESTful API Simple means ~15 commands Slim -- very extensible! OCCI collaborating with DMTF, SNIA and SCRM Provider Storage NetworkCompute Attributes & CRUD operations Attributes & CRUD operations WG chairs represent whole cloud community Academia – Andy Edmonds - Industry – Thijs Metsch (Sun Microsystems) End-Users – Sam Johnston (Australian Online Solutions) Service Providers – Alexis Richardson (RabbitMQ & CohesiveFT) Interest has been huge 160 members on mailing list Four providers and two projects to implement standard

© 2009 OpenGridForum 15 Green IT/Grids/Clouds Energy becoming defining issue for Data Centers Beyond cost: location feasibility Energy Management Architectures are Sensor & Control Systems Environmental Monitoring Decision Making Enacting Responses Control Mechanisms include: Scheduling Voltage-Frequency Scaling Powering racks up-down VM placement & migrationVM placement & migration Clouds can be used to enforce energy policy By abstracting the infrastructure, clouds can transparently manage workload on the back-end Consolidate jobs on servers Move work to where the green power is Several projects underway Reservoir (EU), OpenNebula (EU), GreenNet (INRIA), GreenLight (NSF), Low Carbon ICT (UK) More data centers are just not possible in NYC or London

© 2009 OpenGridForum 16 An Energy Management Architecture CO2 Working Group Starting Reporting interface between physical infrastructure management and workload management Orgerie, et al., Save Watts in your Grid: Green Strategies for Energy-Aware Framework in Large Scale Distributed Systems. 14th IEEE ICPDS, Dec

© 2009 OpenGridForum 17 Pushing for Cloud Coordination Cross-institutional Group Pursuing Cloud Standards cloud-standards.org announced at Cloud Standards Summit hosted by OMG, July 13, Washington, D.C. New incarnation of the SCRM WG Collaboration among OGF, DMTF, SNIA, CSA, OMG, … US Federal Cloud Symposium Draws 850 Hosted at National Defense University, July 15, Washington, D.C. Vivek Kundra (US Fed CIO) keynote: "Vision for Government Cloud Computing” Outbrief from Cloud Standards Summit presented UK "G Cloud" Initiative Announced Part of Digital Britain report released June 16 Rationalize telecommunications, data centers, green IT, open standards, information assurance, availability of services, … “Government as a Service” (GaaS Cloud)

© 2009 OpenGridForum 18 The OGC-OGF Collaboration OGF collaborating with the Open Geospatial Consortium on integrated geospatial processing standards Joint article published in IEEE Computer, November, 2008 OGF participated in OWS-6 (6 th OGC Web Services testbed project)

© 2009 OpenGridForum 19 OWS-6 Project: Debris Flow Monitoring Lan-Kun Chung, Feng Chia University, Taiwan

© 2009 OpenGridForum 20 OWS-6 Project: Airport Disaster Response Federal, local authorities and first responders integrated with geospatial services

© 2009 OpenGridForum 21 GDI-Grid Scenarios D-Grid Flooding Simulation Noise Propagation Emergency Routing Christian Kiehle lat/lon GmBH Dr. Kiehle guest-editing upcoming special issue of GIS Science Journal on “Grid Computing within SDIs”

© 2009 OpenGridForum 22 Another Example: GeoGrid – S. Sekiguchi, AIST, Japan

© 2009 OpenGridForum 5 days out Philip Bogden, (Past) SCOOP Program Director A Scientific and Operational Grand Challenge Predicting Probabilities, Ensemble Modeling

© 2009 OpenGridForum 24 Summary A wide range of distributed computing application scenarios are beneficial to science, engineering, industry and society Many of them have common requirements Cloud computing can offer on-demand resources, economies of scale, and sustainable business models Open, non-proprietary methods must be pursued by organizations like OGF to enable portability and interoperability OGF endeavors to provide a venue whereby we can: Build critical mass of stakeholders Clearly identify goals, schedule, responsibilities Properly provision the efforts (time, money, people) Get a clear return on investment (through collaboration) Stakeholders must engage! A Latin American OGF Regional Affiliate? And one last slide …

© 2009 OpenGridForum 25 Upcoming OGF Events! OGF-27 Banff, Alberta, Canada, Oct 12-16, 2009 With IEEE Grid 2009 & Cybera/CANARIE Natl Summit Combined “Grid to Cloud” & “HPC in Cloud” Workshops OGF-28 Munich, Germany March 8-12, 2010 Thank You