Presentation is loading. Please wait.

Presentation is loading. Please wait.

Event Infrastructure Alasdair Allan University of Exeter Alasdair Allan University of Exeter Robert R. White Los Alamos National Laboratories The eSTAR/TALONS.

Published byMeryl Thornton Modified over 9 years ago

Similar presentations

Presentation on theme: "Event Infrastructure Alasdair Allan University of Exeter Alasdair Allan University of Exeter Robert R. White Los Alamos National Laboratories The eSTAR/TALONS."— Presentation transcript:

1 Event Infrastructure Alasdair Allan University of Exeter Alasdair Allan University of Exeter Robert R. White Los Alamos National Laboratories The eSTAR/TALONS Interconnect

2 VOEvent Workshop II, Tucson 1 The eSTAR concept It’s an ad-hoc peer-to-peer network of heterogeneous resources utilising a collaborative agent paradigm for decision making Treat telescopes and databases in a similar manner, both being made available on an observational grid Disguise complexity, users hate complexity

3 VOEvent Workshop II, Tucson 2 eSTAR in a nutshell

4 VOEvent Workshop II, Tucson 3 What is an agent anyway? An agent is “just software” not magic Loosely, an agent is a computational entity which: Acts on behalf of another entity in an autonomous fashion Performs its actions with some level of proactivity and/or responsiveness Exhibits some level of the key attributes of learning, co-operation and mobility

5 VOEvent Workshop II, Tucson 4 Multi-agent systems A multi-agent system is one that consists of a number of agents, which interact with one-another. In the most general case, agents will be acting on behalf of users with different goals and motivations. To successfully interact, they will require the ability to cooperate, coordinate, and negotiate with each other, much as people do…

6 VOEvent Workshop II, Tucson 5 Multi-agent systems for eSTAR We’ve built the first agent based astronomical system, and it was clearly the correct choice of architecture. What we’ve built in eSTAR is a collaborative agent system which schedules telescopes. Complicated telescope schedules are built by humans using a multi-pass approach. Traveling salesman problem…

7 VOEvent Workshop II, Tucson 6 Peer-to-Peer Agents operate in a peer-to-peer manner and can make use of these interconnections between people and data. Carrying out intelligent resource discovery could mean that your agent looks to your collaborators agent for data and expertise before it looks to “central” sources.

8 VOEvent Workshop II, Tucson 7 The world is flat… The world is small and flat, but it is none the less still very complex. Architectures which take account of this are intuitive, and will map well into the real world. © Terry Pratchett

9 VOEvent Workshop II, Tucson 8 The eSTAR network © Nik Szymanek User Agents Embedded Agent The VO Embedded Agents GRB rapid follow-up programme Search for exo-planets Testbed for Robonet-1.0 open time Gateway Service

10 VOEvent Workshop II, Tucson 9 The eSTAR network © Nik Szymanek User Agents Embedded Agent The VO Gateway Service Embedded Agents GCN Alert Agent Broker

11 VOEvent Workshop II, Tucson 10 What we’ve done so far? Convenience layer and parser (Perl & C++) –building common cases (including GCN) –different parser methodologies Prototype event network live and on sky Limited (hard-wired logic) brokering Archiving and persistent storage RSS test feed(s) –programmatic, or human readable?

12 VOEvent Workshop II, Tucson 11 Where are we going? Event brokering (aggregators) –time critical –non-time critical (data mining?) Event archiving and persistent storage –REST interface –persistence of data products Search service –REST interface Event Feeds –pull, or push?

13 VOEvent Workshop II, Tucson 12 Event feeds There are two ways to feed events to consumers, Pull model (feeds) –polling –e.g. RSS feed Push model (forwarding) –via REST, SOAP or vanilla TCP

14 VOEvent Workshop II, Tucson 13 Pull model Advantage –under client control Disadvantage –as slow as the polling interval A pull model, e.g. RSS, is never going to work for rapid response cases like GRB or transient follow-up.

15 VOEvent Workshop II, Tucson 14 Push model Advantage –theoretically faster, depending on architecture Disadvantage –administrative nightmare for publisher A push model, e.g. GCN, is the only way to do rapid response work. However it isn’t really optimal, so we’ll probably be stuck using both approaches. Shouldn’t optimise our standard for distribution via RSS model.

16 VOEvent Workshop II, Tucson 15 Aggregators Why should we aggregate event feeds? Consolidation –Do we need to support multiple publishers? Removal of duplicate events Added semantic content Trust issues

17 VOEvent Workshop II, Tucson 16 Storage Why should we permanently store event messages? The data itself will be replicated elsewhere in the VO. Why do we care about the original message? If we want to search, we have to store. However, to me, the best use case for persistent storage is actually event feeds…

18 VOEvent Workshop II, Tucson 17 Atom feed eSTAR/TALONS GCN Feed eSTAR Project aa@estar.org.uk ivo://gcn.gsfc/hete/396943a. ]]> GCN scott@milkyway.gsfc.nasa.gov.

19 VOEvent Workshop II, Tucson 18 RSS feed VOEvent GCN Notices en RSS feed for GCN notices http://voeventnet.caltech.edu/GCN.html MILAGRO_Source trigger 886-1 Possible GRB The event time is 2005-12-01T16:24:15 UT. Location RA 232.1248 Dec 62.9797 (J2000) Fri, 02 Dec 2005 16:09:52 PST http://voeventnet.caltech.edu/Notices/ivo_GCN_MILAGRO_58_886-1_2005-12-01T16:24:15.xml Scott Barthelmy GCN scott@milkyway.gsfc.nasa.gov http://gcn.gsfc.nasa.gov/gcn3_archive.html.

20 VOEvent Workshop II, Tucson 19 Its an optional sub-element of the RSS tag that allows the feed publisher to include a link to a file. It has three required attributes. The url=“ ” attribute says where the enclosure is located, length=“ ” says how big it is in bytes, and type=“ ” says what its type is, a standard MIME type. e.g, This is how podcasting works..

21 VOEvent Workshop II, Tucson 20 RSS feed VOEvent GCN Notices en RSS feed for GCN notices http://voeventnet.caltech.edu/GCN.html MILAGRO_Source trigger 886-1 Possible GRB The event time is 2005-12-01T16:24:15 UT. Location RA 232.1248 Dec 62.9797 (J2000) Fri, 02 Dec 2005 16:09:52 PST http://voeventnet.caltech.edu/Notices/ivo_GCN_MILAGRO_58_886-1_2005-12-01T16:24:15.xml Scott Barthelmy GCN scott@milkyway.gsfc.nasa.gov http://gcn.gsfc.nasa.gov/gcn3_archive.html.

22 VOEvent Workshop II, Tucson 21 RSS feed VOEvent GCN Notices en RSS feed for GCN notices http://voeventnet.caltech.edu/GCN.html MILAGRO_Source trigger 886-1 Possible GRB The event time is 2005-12-01T16:24:15 UT. Location RA 232.1248 Dec 62.9797 (J2000) Fri, 02 Dec 2005 16:09:52 PST http://voeventnet.caltech.edu/Notices/ivo_GCN_MILAGRO_58_886-1_2005-12-01T16:24:15.xml Scott Barthelmy GCN scott@milkyway.gsfc.nasa.gov http://gcn.gsfc.nasa.gov/gcn3_archive.html.

23 VOEvent Workshop II, Tucson 22 Unanswered questions We have our document standard, so at this stage there should be only two issues outstanding, Message passing protocol(s) –How the documents are passed Transport standard(s?) –How the documents are carried

24 VOEvent Workshop II, Tucson 23 Protocol work The recent work on interoperability between eSTAR and TALONS has show the importance of, ACK messages IAMALIVE messages Gateway Service eSTAR Broker

25 VOEvent Workshop II, Tucson 24 Should we mandate transport? Why? Nobody thought about RFC 1149 when IP datagram packets were standardised… See http://www.blug.linux.no/rfc1149/http://www.blug.linux.no/rfc1149/

26 VOEvent Workshop II, Tucson 25 Authentication Transport layer issue? Format issue?

27 VOEvent Workshop II, Tucson 26 Authorisation Transport layer issue?

28 VOEvent Workshop II, Tucson 27 Things to think about… Standards never survive widespread contact with users intact. At least no good standard does… If people twist and pull the standard to do something differently than we designed it to do, that’s our fault. The users are always right. No, seriously…

Download ppt "Event Infrastructure Alasdair Allan University of Exeter Alasdair Allan University of Exeter Robert R. White Los Alamos National Laboratories The eSTAR/TALONS."

Similar presentations

DISTRIBUTED COMPUTING PARADIGMS

DISTRIBUTED COMPUTING PARADIGMS
STAR Intelligent Agents and Web Services Alasdair Allan Tim Naylor University of Exeter Iain Steele Dave Carter Jason Etherton Chris Mottram Liverpool.

STAR Intelligent Agents and Web Services Alasdair Allan Tim Naylor University of Exeter Iain Steele Dave Carter Jason Etherton Chris Mottram Liverpool.
Robotic telescope networks, agent architectures and event messaging Alasdair Allan Tim Naylor Eric Saunders University of Exeter Iain Steele Chris Mottram.

Robotic telescope networks, agent architectures and event messaging Alasdair Allan Tim Naylor Eric Saunders University of Exeter Iain Steele Chris Mottram.
Hooking up a meta-network with VOEvent Robert White Stuart Evans W. Thomas Vestrand James Wren Przemyk Wozniak Los Alamos National Laboratory Alasdair.

Hooking up a meta-network with VOEvent Robert White Stuart Evans W. Thomas Vestrand James Wren Przemyk Wozniak Los Alamos National Laboratory Alasdair.
Www.telescope-networks.org Results of the HTN Workshop Allan, A. 1, Bischoff, K. 2, Burgdorf, M. 3, Cavanagh, B. 4, Christian, D. 5, Clay, N. 3, Dickens,

Results of the HTN Workshop Allan, A. 1, Bischoff, K. 2, Burgdorf, M. 3, Cavanagh, B. 4, Christian, D. 5, Clay, N. 3, Dickens,
Fujitsu Laboratories of Europe © 2004 What is a (Grid) Resource? Dr. David Snelling Fujitsu Laboratories of Europe W3C TAG - Edinburgh September 20, 2005.

Fujitsu Laboratories of Europe © 2004 What is a (Grid) Resource? Dr. David Snelling Fujitsu Laboratories of Europe W3C TAG - Edinburgh September 20, 2005.
The rise of the robots… Alasdair Allan School of Physics, University of Exeter Alasdair Allan School of Physics, University of Exeter.

The rise of the robots… Alasdair Allan School of Physics, University of Exeter Alasdair Allan School of Physics, University of Exeter.
Data Exploration or “What have those agents ever done for us?” Alasdair Allan University of Exeter, Exeter, U.K.

Data Exploration or “What have those agents ever done for us?” Alasdair Allan University of Exeter, Exeter, U.K.
A Heterogeneous Telescope Network Alasdair Allan Tim Naylor Eric Saunders University of Exeter Iain Steele Chris Mottram Liverpool John Moores University.

A Heterogeneous Telescope Network Alasdair Allan Tim Naylor Eric Saunders University of Exeter Iain Steele Chris Mottram Liverpool John Moores University.
Web Services Nasrullah. Motivation about web service There are number of programms over the internet that need to communicate with other programms over.

Web Services Nasrullah. Motivation about web service There are number of programms over the internet that need to communicate with other programms over.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 9 Distributed Systems Architectures Slide 1 1 Chapter 9 Distributed Systems Architectures.

©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 9 Distributed Systems Architectures Slide 1 1 Chapter 9 Distributed Systems Architectures.
Prentice Hall, 2003 1 Database Systems Week 1 Introduction By Zekrullah Popal.

Prentice Hall, Database Systems Week 1 Introduction By Zekrullah Popal.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.

Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.

1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Distributed Network and System Management Based on Intelligent and Mobile Agents Jianguo Ding 25/03/2002 DVT-DatenVerarbeitungsTechnik FernUniversität.

Distributed Network and System Management Based on Intelligent and Mobile Agents Jianguo Ding 25/03/2002 DVT-DatenVerarbeitungsTechnik FernUniversität.
Vanilla TCP? Alasdair Allan. IVOA Interop Meeting, May 2006 1 Why TCP? Traditional and still the best Because we’ve always done it that way –not always.

Vanilla TCP? Alasdair Allan. IVOA Interop Meeting, May Why TCP? Traditional and still the best Because we’ve always done it that way –not always.
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.

Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
Managing Data Resources

Managing Data Resources
FeedTree: Sharing Web Micronews with Peer-to-Peer Event Notification D. Sandler, A. Mislove, A. Post, P. Druschel Presented by: Andrew Sutton.

FeedTree: Sharing Web Micronews with Peer-to-Peer Event Notification D. Sandler, A. Mislove, A. Post, P. Druschel Presented by: Andrew Sutton.
A New Computing Paradigm. Overview of Web Services Over 66 percent of respondents to a 2001 InfoWorld magazine poll agreed that Web services are likely.

A New Computing Paradigm. Overview of Web Services Over 66 percent of respondents to a 2001 InfoWorld magazine poll agreed that "Web services are likely.

Similar presentations

Ads by Google