1. HPSearch for Managing Distributed Services Authors Harshawardhan Gadgil, Geoffrey Fox, Shrideep Pallickara Community Grids Lab Indiana University, Bloomington

2. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session2 Quick Introduction What is HPSearch ? HPSearch (http://www.hpsearch.org) is a scripting based system to help manage data streams and services in distributed applications. HPSearch (http://www.hpsearch.org) is a scripting based system to help manage data streams and services in distributed applications. –We specifically orient HPSearch towards managing a distributed publish – subscribe infrastructure (NaradaBrokering). –Management can be viewed in 2 parts  Setting up the distributed application  Querying dynamic system metadata, such as –For logging purposes –Monitor metadata to help dynamically rewiring system to improve performance

3. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session3 Motivation SOAP processing essential in distributed applications (SOAP being the de-Facto standard) SOAP processing essential in distributed applications (SOAP being the de-Facto standard) Various Web Service specifications target specific aspects of communication between distributed services Various Web Service specifications target specific aspects of communication between distributed services –WS-Addressing to address resources using transport neutral mechanisms –WS-Reliable Messaging for reliable delivery of messages –WS-Security for message protection –… and many more ! Quality of service provided by inserting specific elements in the header of the SOAP message Quality of service provided by inserting specific elements in the header of the SOAP message Handlers are required for processing different kinds of header elements, since it is difficult to address arbitrary message exchange patterns using traditional RPC style synchronous, one-way request- response communication. Handlers are required for processing different kinds of header elements, since it is difficult to address arbitrary message exchange patterns using traditional RPC style synchronous, one-way request- response communication.

4. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session4 Motivation (contd.) NaradaBrokering (http://www.naradabrokering.org) has recently been augmented with support for SOAP processing NaradaBrokering (http://www.naradabrokering.org) has recently been augmented with support for SOAP processing NaradaBrokering presents a way of creating processing elements called handlers and chain different handlers to process the SOAP message NaradaBrokering presents a way of creating processing elements called handlers and chain different handlers to process the SOAP message Support for WS-Eventing, WS-RM, WS-Reliability and WS-Notification (in July) Support for WS-Eventing, WS-RM, WS-Reliability and WS-Notification (in July) –Federation among these specifications

5. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session5 Some Issues With bigger and more complex broker networks, management becomes difficult With bigger and more complex broker networks, management becomes difficult We imagine a similar problem of deployment and management of handlers within each broker We imagine a similar problem of deployment and management of handlers within each broker Currently, the Broker Instantiation service and scripting objects aid in the creation of remote brokers and deploying broker topology by adding / deleting links between brokers Currently, the Broker Instantiation service and scripting objects aid in the creation of remote brokers and deploying broker topology by adding / deleting links between brokers

6. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session6 HPSearch in the Picture HPSearch would act as the manager for deploying handlers at specific brokers HPSearch would act as the manager for deploying handlers at specific brokers Configuring and deploying remote services Configuring and deploying remote services Broker Network Blown-up view of a broker

7. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session7 R P 2 Proposed Architecture 2 pipelines P1 and P2. 2 pipelines P1 and P2. P1 does not satisfy certain QoS P1 does not satisfy certain QoS HPSearch selects P2. HPSearch selects P2. Configures Relay handler to use the specific handler chain and deploys the application Configures Relay handler to use the specific handler chain and deploys the application Application Handler Pipeline Relay Handler Communicates with the application in deciding what QoS is desired Communication with other Brokers / Services P 1

8. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session8 Example // Define some service s = new Application( “http://host:port/SecureReliableService”); // Define the relay handler h = new RelayHandler(“host:port”); // Set QoS requirements h.add(“security”, “URI:Security”); h.add(“reliablility”, “URI:Reliability”); s.setRelay(h); // Finally deploy the service s.deploy();

9. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session9 Advantages Existing Applications may be combined with NaradaBrokering’s existing infrastructure Existing Applications may be combined with NaradaBrokering’s existing infrastructure Applications may be deployed remotely along with handler chains meeting specific criteria Applications may be deployed remotely along with handler chains meeting specific criteria Can combine with Broker Discovery to find the best broker to connect to Can combine with Broker Discovery to find the best broker to connect to

10. May 11, 2005 Community Grids Lab Presentation for CCGrid 2005, WiP Session10 Questions / Comments Any Questions / Comments ? Any Questions / Comments ?THANKS for attending the presentation