Distributed Account Management Middleware Glenn Bresnahan (PI), Boston University Steve Quinn (CoPI), NCSA Aaron Fuegi, Boston University Chris Pond, NCSA.

Slides:



Advertisements
Similar presentations
Competency Checklist Version 5. CREATING A CHECKLIST Authoring View.
Advertisements

By Ram Gopal, Alex Audu, Chaoping Wu, Hormuzd Khosravi Forwarding and Control Element Protocol (FACT)
Kathy Benninger, Pittsburgh Supercomputing Center Workshop on the Development of a Next-Generation Cyberinfrastructure 1-Oct-2014 NSF Collaborative Research:
Validata Release Coordinator Accelerated application delivery through automated end-to-end release management.
A Computation Management Agent for Multi-Institutional Grids
Network Layer and Transport Layer.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Distributed components
MS DB Proposal Scott Canaan B. Thomas Golisano College of Computing & Information Sciences.
COMPARING DIFFERENT SOFTWARE INTEGRATION TECHNOLOGIES Author Jones Olaiya Ogunduyilemi (Internet & Software Technology)
Application architectures
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Department of Electronic Engineering City University of Hong Kong EE3900 Computer Networks Transport Protocols Slide 1 Transport Protocols.
16: Distributed Systems1 DISTRIBUTED SYSTEM STRUCTURES NETWORK OPERATING SYSTEMS The users are aware of the physical structure of the network. Each site.
Resource Management Reading: “A Resource Management Architecture for Metacomputing Systems”
Today’s Agenda Chapter 12 Admin Tasks Chapter 13 Automating Admin Tasks.
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with permission by.
Users' Meeting San Francisco, CA April 18 th, 2006 RCRAInfo Network Exchange.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/ /09/2006.
Scaling Account Creation and Management through the TeraGrid User Portal Contact: Eric Roberts
Presentation on Osi & TCP/IP MODEL
Resource Management and Accounting Working Group Working Group Scope and Components Progress made Current issues being worked Next steps Discussions involving.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting June 13-14, 2002.
Networks – Network Architecture Network architecture is specification of design principles (including data formats and procedures) for creating a network.
1 Network Management Security Behzad Akbari Fall 2009 In the Name of the Most High.
6.1. Transport Control Protocol (TCP) It is the most widely used transport protocol in the world. Provides reliable end to end connection between two hosts.
Department of Electronic Engineering City University of Hong Kong EE3900 Computer Networks Introduction Slide 1 A Communications Model Source: generates.
PostalOne! / FAST Data Exchange - Vision 02/15/05.
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
Lecture 5: Sun: 1/5/ Distributed Algorithms - Distributed Databases Lecturer/ Kawther Abas CS- 492 : Distributed system &
Spring 2006Computer Networks1 Chapter 2 Network Models.
DEMO - 8/14/2007. R2 Feature List ReceiveDocumentBatch Web Service SendPESCAcknowledgment Web Service Validate Acknowledgment Upload Acknowledgment Transcript.
Implementing Remote Procedure Calls Authored by Andrew D. Birrell and Bruce Jay Nelson Xerox Palo Alto Research Center Presented by Lars Larsson.
OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Overview Michael Meisinger Life Cycle Architecture Review.
Reliable Communication in the Presence of Failures Based on the paper by: Kenneth Birman and Thomas A. Joseph Cesar Talledo COEN 317 Fall 05.
V. Tsaoussidis, DUTH – Greece
Middleware for FIs Apeego House 4B, Tardeo Rd. Mumbai Tel: Fax:
Lecture 4: Sun: 23/4/1435 Distributed Operating Systems Lecturer/ Kawther Abas CS- 492 : Distributed system & Parallel Processing.
TeraGrid CTSS Plans and Status Dane Skow for Lee Liming and JP Navarro OSG Consortium Meeting 22 August, 2006.
Oracle's Distributed Database Bora Yasa. Definition A Distributed Database is a set of databases stored on multiple computers at different locations and.
Rehab AlFallaj.  OSI Model : Open system Interconnection.  is a conceptual model that characterizes and standardizes the internal functions of a communication.
Folie 1 Analysis of SM-Exchange Protocol using SM&C MAL DLR/GSOC Author: S.Gully.
Enterprise Integration Patterns CS3300 Fall 2015.
X-WindowsP.K.K.Thambi The X Window System Module 5.
Agile SOA Agile EAI How do we achieve agility in Enterprise Integration?
Chapter 24 Transport Control Protocol (TCP) Layer 4 protocol Responsible for reliable end-to-end transmission Provides illusion of reliable network to.
Silberschatz, Galvin and Gagne  Operating System Concepts UNIT II Operating System Services.
Presented by: Tony Rimovsky TeraGrid Account Management Tony Rimovsky, Area Director for Network Operations and Security
© FPT SOFTWARE – TRAINING MATERIAL – Internal use 04e-BM/NS/HDCV/FSOFT v2/3 JSP Application Models.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Network Architecture Protocol hierarchies Design Issues for the layers
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Motivation FACE architecture encourages modularity of components on data boundaries Transport Services Segment interface is centered on sending and receiving.
Making Sense of Service Broker Inside the Black Box.
Designing a Federated Testbed as a Distributed System Robert Ricci, Jonathon Duerig, Gary Wong, Leigh Stoller, Srikanth Chikkulapelly, Woojin Seok 1.
Design of a Notification Engine for Grid Monitoring Events and Prototype Implementation Natascia De Bortoli INFNGRID Technical Board Bologna Feb.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
Business Process Execution Language (BPEL) Pınar Tekin.
Grid Account Management: A Case Study GGF 9 PGM-RG Chicago, IL October 5-8, 2003 Doru Marcusiu Assistant Director Grid and Security.
Computer and Information Security
#01 Client/Server Computing
Ch > 28.4.
Making Sense of Service Broker
What’s changed in the Shibboleth 1.2 Origin
e-Invoicing – e-Ordering 20/11/2008
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Sending data to EUROSTAT using STATEL and STADIUM web client
#01 Client/Server Computing
Presentation transcript:

Distributed Account Management Middleware Glenn Bresnahan (PI), Boston University Steve Quinn (CoPI), NCSA Aaron Fuegi, Boston University Chris Pond, NCSA Michael Shapiro, NCSA Ester Soriano, NCSA

Objective Provide mechanisms to allow for the automated management of resource allocations, resource access control, user information, user login accounts, and usage reporting in a grid environment spanning multiple administrative domains

Background Alliance partnership (PACI) –NCSA, Boston, Kentucky, New Mexico, Wisconsin, Maui NSF PACI Allocation Peer Review (NRAC and AAB) Manage accounts, allocations and reporting across Alliance resources

Requirements Compatible with current practices (e.g. PACI) Independent of local account management system Heterogeneous environment Multiple administration domains Economic model neutral

Strategy Provide grid services to exchange and manipulate shared accounting objects –Resource requests –Resources allocations –User information –Project/group information –Access permissions –Usage reports

AMIE Data Representation XML schema for Accounting Objects –Machines –Users –Accounts –Allocations –Usage

AMIE Architecture Transaction-based exchange mechanism –Transaction comprised of sequence of packets (messages) and acknowledgements Sites send Requests and Notifications –Site A requests site B to perform an action –Site B notifies site A of actions taken Independently or as the result of a request Set of objects and states –Well defined state change sequences Robust error detection and recovery Asynchronous or real-time communication –No transport reliability assumptions “Glue” modules to interface to site-specific accounting system

Configuration: Star

Configuration: Peer to Peer

Current Implementations Alliance Partner Sites (Version 1) Alliance Grid Testbed (Version 1) Teragrid (Version 2 – NMI) NEES Grid (Version 2 – NMI) (implementation in progress)

Transaction Example 1 Account Creation

Transaction Example 2 Modify User Information

Transaction Example 3 Usage Reporting

Transaction States Four possible states On-hold 1. On-hold - Waiting for another event. No further action should be taken until state changes. In-progress 2. In-progress – processing is underway Completed 3. Completed – processing completed Error 4. Error – processing failed. More information is available via the packet state

Transaction Packet States Incoming Packets Construct Construct – Message being assembled Received Received – Complete and ready to be processed Validate Validate – Waiting for XML validation Inbox Inbox – Waiting to be put into AMIE DB Done Done – All processing sucessfully completed Error Error – Awaiting error notification to be issued Failed Failed – Completed with failure

Transaction Packet States Outgoing Packets Construct Construct – Message being assembled Validate Validate – Waiting for XML validation Outbox Outbox – Waiting to be transmitted Sent Sent – Sucessfully sent to remote site Wait Wait – Waiting for a reply Done Done – All processing sucessfully completed Error Error – Awaiting error notification to be issued Failed Failed – Completed with failure

AMIE Reference Implementation

Current Status Items Complete Core AMIE system XML Schema XML validation Method call interface specification Transport/processing engine State tracking Error handling Testbed Implementation

Current Status Reference Implementation Reference implementation of AMIE method call interface Relational "intermediate DB" schema (Oracle, Postgres, Sybase support) to interface AMIE to local AM system

Current Status In Development Reference implementation of Account Management system –fully functional AM DB Schema –method call implementation –glue between AM system and AMIE implementation –Should be "drop in" AM system with grid capability through AMIE

Current Status Packaging Core implementation Reference implementation of method call interface Reference AM implementation Documentation

Distributed Account Management Questions?