Presentation is loading. Please wait.

Presentation is loading. Please wait.

A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.

Published byKimberly O’Brien’ Modified over 9 years ago

Similar presentations

Presentation on theme: "A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh."— Presentation transcript:

1 A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh

2 2 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid overview Virtual Observatory infrastructure “The VO vision can be summed up as the desire to make all archives speak the same language − all searchable and analysable by the same tools, all data sources accessible through a common interface, all data held in distributed databases that appear as one.” Andy Lawrence, 09/2003 AstroGrid approach Build infrastructure first VObs  Web Mix-and-match, plug-and-play, …

3 3 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid project Duration:Sept 2001 – Dec 2007 Funding:£7.7M (PPARC) Personnel:~26 (23.4 FTE) Goal:Develop VObs Infrastructure Deploy UK VObs Scope:Astrophysics, Solar, STP, … Optical, X-Ray, Radio, … AG1 Phase A: Sept 2001 – Dec 2002 Analysis, R&D, Architecture AG1 Phase B: Jan 2003 – Dec 2004 Build, test & deliver V1.0 AstroGrid-2: Jan 2005 – Dec 2007 Develop & deploy

4 4 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid consortium Edinburgh Leicester Cambridge MSSL JBO RAL QUB From 2005, AstroGrid-2 + Bristol Exeter Leeds Portsmouth

5 5 Tony Linde 28-Apr-2006eScience meets eFrameworks Wider involvement Europe Euro-VO: http://euro-vo.orghttp://euro-vo.org VOTech project: http://www.eurovotech.orghttp://www.eurovotech.org  FP6 funded: €6M: 2005-7  Follows on from AVO (FP5 funded) International IVOA: http://ivoa.nethttp://ivoa.net Closer collaborations  RVO  JVO  SAAO  NVO

6 6 Tony Linde 28-Apr-2006eScience meets eFrameworks Project Approach Agile: iterative & incremental development Open project: Static http://www.astrogrid.org http://www.astrogrid.org Wiki http://wiki.astrogrid.org http://wiki.astrogrid.org Forum http://forum.astrogrid.org http://forum.astrogrid.org Jabber via jabber.astrogrid.org Open Source code Academic Free License http://www.opensource.org/licenses/academic.php http://www.opensource.org/licenses/academic.php AstroGrid releases http://software.astrogrid.org http://software.astrogrid.org

7 7 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid infrastructure

8 8 Tony Linde 28-Apr-2006eScience meets eFrameworks Deployments 1

9 9 Tony Linde 28-Apr-2006eScience meets eFrameworks Deployments 2

10 10 Tony Linde 28-Apr-2006eScience meets eFrameworks Deployments 3

11 11 Tony Linde 28-Apr-2006eScience meets eFrameworks How do the VO components that implement these interfaces relate to each other?

12 12 Tony Linde 28-Apr-2006eScience meets eFrameworks DSA: Architecture SkyNode SIAP/ SSAP Web Svc (CEA) ADQL Translator Plugins: JDBC/Db FITS etc VOTable DSADSA

13 13 Tony Linde 28-Apr-2006eScience meets eFrameworks Registry We can access data but how do we know where it can be found? Knowledge of the location and nature of resources is critical for all this to work The AstroGrid Infrastructure supplies a Registry (IVOA compliant of course!) which contains this information Registry is searchable by humans and by machines.

14 14 Tony Linde 28-Apr-2006eScience meets eFrameworks Common Execution Architecture Why would we want CEA/UWS? Same reason we need universal access to data AstroGrid supports the concept of workflow Essentially, remote execution of special scripts or jobs Allows data access and processing to be undertaken at source or where the compute power lies The Grid concept! The AG Infrastructure helps make the details transparent, keeping focus on the science.

15 15 Tony Linde 28-Apr-2006eScience meets eFrameworks Workflow

16 16 Tony Linde 28-Apr-2006eScience meets eFrameworks Compute grid JES Registry Common Execution Connector Application as.exe file (local) Common Execution Connector Common Execution Connector Common Execution Connector Application as.exe file (grid) Application as.HTTP service Application as Java class

17 17 Tony Linde 28-Apr-2006eScience meets eFrameworks MySpace If all this happens remotely, where do the results end up? Distributed data access and processing requires distributed data storage MySpace is the AstroGrid solution VOSpace/VOStore under review at IVOA Distributed, virtual data storage that appears to the user as a homogeneous collection of files Database tables coming soon!

18 18 Tony Linde 28-Apr-2006eScience meets eFrameworks Distributed Storage DSAProcess Desktop MySpace

19 19 Tony Linde 28-Apr-2006eScience meets eFrameworks MySpace

20 20 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid Actors Astronomers Incl PIs, management structure, … Instrument operators, … Data curators Publishers Administrators Systems managers Developers Standards definers …

21 21 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid and eFrameworks: Issues Security Shibboleth authentication:  Single-signon Authorisation  Common policy requirements? Service discovery Resource registries  Need for commonality?  Will others need to get at astro resources? Common identifiers?

22 22 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid and eFrameworks: Other Issues Service execution Workflow Shared storage Accounting Naming! e.g. VO Bottom line Standards & interoperability How do we get W3C, GGF, IVOA, IE & project standards to work?

Download ppt "A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh."

Similar presentations

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
AstroGrid: Past, Present & Future Bob Mann Institute for Astronomy & National e-Science Centre University of Edinburgh.

AstroGrid: Past, Present & Future Bob Mann Institute for Astronomy & National e-Science Centre University of Edinburgh.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.

A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
A PPARC funded project Common Execution Architecture Paul Harrison AstroGrid consortium meeting Edinburgh UK 14-15 Dec 2004.

A PPARC funded project Common Execution Architecture Paul Harrison AstroGrid consortium meeting Edinburgh UK Dec 2004.
A PPARC funded project The Grid Data Warehouse Description of prototype work in progress by AstroGrid. Access-Grid lecture to Universities of Leeds and.

A PPARC funded project The Grid Data Warehouse Description of prototype work in progress by AstroGrid. Access-Grid lecture to Universities of Leeds and.
AstroGrid Consortium Meeting PM Report. 26-27.06.2002AstroGrid Consortium Meeting Overview Activities Finance Recruitment Collaboration Phase B.

AstroGrid Consortium Meeting PM Report AstroGrid Consortium Meeting Overview Activities Finance Recruitment Collaboration Phase B.
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 27 September 2006 HELAS Workshop Nice.

ESDO Algorithms, Visualization and Data Access Elizabeth Auden 27 September 2006 HELAS Workshop Nice.
Geospatial Standards – Experiences for the UK Academic Community Workshop on Grid Middleware and Geospatial Standards for Earth System Science Data, National.

Geospatial Standards – Experiences for the UK Academic Community Workshop on Grid Middleware and Geospatial Standards for Earth System Science Data, National.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
A PPARC funded project AstroGrid’s Common Execution Architecture Guy Rixon, reporting on behalf of Paul Harrison and the other AstroGrid developers SC4DEVO-1,

A PPARC funded project AstroGrid’s Common Execution Architecture Guy Rixon, reporting on behalf of Paul Harrison and the other AstroGrid developers SC4DEVO-1,
AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.

AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.

A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.

Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.
A PPARC funded project AstroGrid Architecture Consortium Meeting, Leicester, 3 rd Nov 2003.

A PPARC funded project AstroGrid Architecture Consortium Meeting, Leicester, 3 rd Nov 2003.
A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.

A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.
AstroGrid Datacenters ESO M Hill (ROE), Aug 2004.

AstroGrid Datacenters ESO M Hill (ROE), Aug 2004.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.

A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.
Talk structure who are we ? what is a VO ? what are the challenges ? what is an e-project ? Andy Lawrence Garching June 2002.

Talk structure who are we ? what is a VO ? what are the challenges ? what is an e-project ? Andy Lawrence Garching June 2002.
Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.

Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.

Similar presentations

Ads by Google