OGSA-WG EMS Architecture

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum GHPN-RG Status update co-chairss:Cees de Laat Dimitra Simeonidou GGF22, Boston, February 2008.
Advertisements

© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps OGF 23, June 2008, Barcelona, Spain.
© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps: Examples OGF 22, February 2008, Cambridge, MA.
© 2007 Open Grid Forum JSDL-WG Session OGF27 – General Session 10:30-12:00, 14 October 2009 Banff, Canada.
©2010Open Grid Forum OGF28 OGSA-DMI Status Chairs: Mario Antonioletti, EPCC Stephen Crouch, Southampton Shahbaz Memon, FZJ Ravi Madduri, UoC.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 20 - Manchester, 7 May 2007.
© 2007 Open Grid Forum JSDL-WG Session OGF21 – Activity schema session 17 October 2007 Seattle, U.S.
© 2006 Open Grid Forum 2 nd March 09 Enterprise Grid Requirements Research Group OGF25 EGR-RG Session Group.
© 2006 Open Grid Forum OGSA Next Steps Discussion Providing Value Beyond the Specifications.
Oct 15 th, 2009 OGF 27, Infrastructure Area: Status of FVGA-WG Status of Firewall Virtualization for Grid Applications - Working Group
© 2008 Open Grid Forum Resource Selection Services OGF22 – Boston, Feb
© 2006 Open Grid Forum Network Services Interface OGF29: Working Group Meeting Guy Roberts, 19 th Jun 2010.
© 2007 Open Grid Forum JSDL-WG Session 1 OGF25 – General Session 11:00-12:30, 3 March 2009 Catania.
© 2006 Open Grid Forum JSDL Optional Elements OGF 24 Singapore.
© 2006, 2007 Open Grid Forum Michel Drescher, FujitsuOGF-20, Manchester, UK Andreas Savva, FujitsuOGF-21, Seattle, US (update) Extending JSDL 1.0 with.
OGSA-WG Session #4 Usecase Document Overview Platform Service Next Step Discussion GGF10 Berlin March. 11, :30pm Audimax.
Basic POSIX component for EMS May 12 th, 2006 Hiro Kishimoto.
1 ©2013 Open Grid Forum OGF Working Group Sessions Security Area – FEDSEC Jens Jensen, OGF Security Area.
© 2006 Open Grid Forum DCI Federation Protocol BoF Alexander Papaspyrou, TU Dortmund University Open Grid Forum March 15-18, 2010, Munich, Germany.
© 2005 Global Grid Forum The information contained herein is subject to change without notice Leading the pervasive adoption of grid computing for research.
© 2007 Open Grid Forum Data Grid Management Systems: Standard API - community development Arun Jagatheesan, San Diego Supercomputer Center & iRODS.org.
© 2006 Open Grid Forum Service Level Terms Andrew Grimshaw.
Peter Ziu Northrop Grumman ACS-WG Grid Provisioning Appliance Concept GGF13, March 14, 2005 (Revised 8/4/2005)
© 2007 Open Grid Forum JSDL-WG Session OGF22 – General Session (11:15-12:45) 25 February 2008 Boston, U.S.
© 2006 Open Grid Forum FEDSEC-CG Andrew Grimshaw and Jens Jensen.
© 2006 Open Grid Forum GridRPC Working Group 15 th Meeting GGF22, Cambridge, MA, USA, Feb
OGSA-RSS Face-to-Face Meeting Sunnyvale, CA, US Aug 15-16, 2005.
© 2006 Open Grid Forum OGSA-WG: EGA Reference Model GGF18 Sept. 12, 4-5:30pm, #159A-B.
© 2006 Open Grid Forum Grid High-Performance Networking Research Group (GHPN-RG) Dimitra Simeonidou
© 2005 Global Grid Forum The information contained herein is subject to change without notice Leading the pervasive adoption of grid computing for research.
Peter Ziu Northrop Grumman ACS-WG Grid Provisioning Appliance Concept GGF13, March 14, 2005
© 2007 Open Grid Forum OGF Management Area Meeting OGF20 7 May, am-12:30pm Manchester, UK.
© 2006 Open Grid Forum Grid Resource Allocation Agreement Protocol GRAAP-WG working session 1 Thursday, 5 March, 2009 Catania, Sicily.
© 2006 Open Grid Forum 1 Application Contents Service (ACS) ACS-WG#1 Monday, September 11 10:30 am - 12:00 am (158A-B) ACS-WG#2 Wednesday, September 13.
© 2008 Open Grid Forum Production Grid Infrastructure WG State Model Discussions PGI Team.
Leading the pervasive adoption of grid computing for research and industry © 2005 Global Grid Forum The information contained herein is subject to change.
Leading the pervasive adoption of grid computing for research and industry © 2005 Global Grid Forum The information contained herein is subject to change.
OGSA Data Architecture WG Data Transfer Session Allen Luniewski, IBM Dave Berry, NESC.
© 2007 Open Grid Forum JSDL-WG Session OGF26 – General Session 11:00-12:30, 28 May 2009 Chapel Hill, NC.
Network Services Interface
ACS sample implementation
Mark Morgan February, 2006 (GGF16 in Athens)
SLIDES TITLE Your name Session Name, OGSA-WG #nn
GGF Intellectual Property Policy
Welcome and Introduction
OGSA EMS Session OGF19 OGSA-WG session #3 30 January, :30pm
RISGE-RG use case template
Hiro Kishimoto, OGSA-WG co-chair GGF16 in Athens February 17, 2006
OGSA Data Architecture WG Data Transfer Discussion
GridRPC Working Group 13th Meeting
Grid Resource Allocation Agreement Protocol
Service Virtualization via a Network Appliance….
OGF session PMA, Florence, 31 Jan 2017.
OGSA-WG Session #2 Program Execution Services
WS-Agreement Working Session
Sessions 1 & 3: Published Document Session Summary
Grid Scheduling Architecture – Research Group
Hiro Kishimoto, OGSA-WG co-chair GGF16 in Athens February 13, 2006
Network Services Interface
OGSA-Workflow OGSA-WG.
Naming service BoF #2 & report session
Information Model, JSDL and XQuery: A proposed solution
Network Measurements Working Group
WS Naming OGF 19 - Friday Center, NC.
Activity Delegation Kick Off
SAGA: Java Language Binding
Introduction to OGF Standards
SAGA: Java Language Binding
Proposed JSDL Extension: Parameter Sweeps
OGF 40 Grand BES/JSDL Andrew Grimshaw Genesis II/XSEDE
Presentation transcript:

OGSA-WG EMS Architecture Steven Newhouse & Andrew Grimshaw GGF17 in Tokyo Wed, May 10 5:45pm @ G405

GGF Intellectual Property Policy All statements related to the activities of the GGF and addressed to the GGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the GGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in GGF meetings, as well as written and electronic communications made at any time or place, which are addressed to any GGF working group or portion thereof, Where the GFSG knows of rights, or claimed rights, the GGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant GGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the GGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the GGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification.

EMS architecture scenarios (Steven) ESI & BES discussion (Andrew) Session Agenda EMS architecture scenarios (Steven) ESI & BES discussion (Andrew) Basic POSIX component (Hiro)

Deployment Infrastructure Host1 Host2 Host3 Portal Component archive (ACS?) Basic Posix component Basic Posix template Client BLAST binary Posix binary archive (ACS?)

BLAST CDL document Host1 Host2 Host3 Portal Component archive (ACS?) Basic Posix component CodeBase Basic Posix template Client Refer to <> BLAST binary executable Posix binary archive (ACS?) BLAST CDL document

Deploy Component Host1 Host2 Host3 Portal Component archive (ACS?) <> CodeBase Basic Posix component Refer to Basic Posix template Client executable BLAST binary Posix binary archive (ACS?) BLAST CDL document

Deploy BLAST binary Host1 Host3 Portal Component archive (ACS?) <> Portal Component archive (ACS?) <> executable Basic Posix component Basic Posix template Client executable BLAST binary Posix binary archive (ACS?) BLAST CDL document

Identified “gap” between family of CDDLM specs and EMS services Basic POSIX component Identified “gap” between family of CDDLM specs and EMS services Provide services Application binary installation File system mount Database setup (in case of BLAST) Provide output (will be incorporated in JSDL document) Application path Environment variables

CDL document includes Application binary installation If this application depends on specific libraries or other software, how to deploy them should be described by CDL File system mount <jsdl-posix:Executable>/usr/local/bin/blastall</jsdl-posix:Executable> Executable should be added from CDL output <jsdl:FileSystem name="TMP"> <jsdl:FileSystemType>temporary</jsdl:FileSystemType> <jsdl:Description> … </jsdl:Description> <jsdl:DiskSpace> <jsdl:LowerBoundedRange>10737418240.0</jsdl:LowerBoundedRange> </jsdl:DiskSpace> </jsdl:FileSystem> <jsdl:FileSystem name="HOME"> <jsdl:FileSystemType>normal</jsdl:FileSystemType> <jsdl:Description>Chris's home directory</jsdl:Description> <jsdl:MountPoint>/home/csmith</jsdl:MountPoint> Dejan to include filesystem mount in the CDL example

CDL document includes Database setup BLAST needs NDA sequence database(s) Popular databases are nr, nt, and est Each database is large file in specific format and should be deployed before running job <jsdl:Resources> …. <blast:database> <jsdl:FileName>db/ncbiblast/est</jsdl:FileName> <jsdl:FilesystemName>DB</jsdl:FilesystemName> </blast:database> </jsdl:Resources> Note by Chris Smith: There might be some more information needed depending on whether the database is already formatted, or if it's in FASTA format still. From the point of view of a provisioning engine, you might need to specify a command to run to format the FASTA file, or it might be a set of files that is the result of the formatting that need to be staged.

CDL document may include Set environment variables <jsdl-posix:Environment name="PATH">/usr/bin:/usr/local/bin:/usr/local/bio/bin </jsdl-posix:Environment> <jsdl-posix:Environment name="TMPDIR" filesystemName="TMP"/> Alternative: BES container sets them when job is initiated Env. Variables, path and tmpdir, are output of deployer JSDL document is instantiated by the output of deployer using CDL document

Companion template to Basic POSIX component Basic POSIX template Companion template to Basic POSIX component

Jointly develop BPC and BPT spec More example than BLAST Next steps Jointly develop BPC and BPT spec OGSA EMS & CDDLM-WG More example than BLAST OGSA EMS & JSDL-WG Put Job Manager in this deployment picture Put ACS in this picture Advanced Common Component