A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.

Slides:

Advertisements

Similar presentations

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

Advertisements

AstroGrid: Past, Present & Future Bob Mann Institute for Astronomy & National e-Science Centre University of Edinburgh.

A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.

A PPARC funded project Common Execution Architecture Paul Harrison AstroGrid consortium meeting Edinburgh UK Dec 2004.

A PPARC funded project The Grid Data Warehouse Description of prototype work in progress by AstroGrid. Access-Grid lecture to Universities of Leeds and.

AstroGrid Consortium Meeting PM Report AstroGrid Consortium Meeting Overview Activities Finance Recruitment Collaboration Phase B.

ESDO Algorithms, Visualization and Data Access Elizabeth Auden 27 September 2006 HELAS Workshop Nice.

Geospatial Standards – Experiences for the UK Academic Community Workshop on Grid Middleware and Geospatial Standards for Earth System Science Data, National.

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

A PPARC funded project AstroGrid’s Common Execution Architecture Guy Rixon, reporting on behalf of Paul Harrison and the other AstroGrid developers SC4DEVO-1,

AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.

A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.

Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.

A PPARC funded project AstroGrid Architecture Consortium Meeting, Leicester, 3 rd Nov 2003.

A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.

AstroGrid Datacenters ESO M Hill (ROE), Aug 2004.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.

Talk structure who are we ? what is a VO ? what are the challenges ? what is an e-project ? Andy Lawrence Garching June 2002.

Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.

AstroGrid: Science Use Ready AstroGrid: Science Use Ready Nicholas Walton AstroGrid Project Scientist IoA, Cambridge A PPARC funded project.

NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.

AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.

JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),

Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.

1 19-Jun-2006Andy Lawrence : AstroGrid Consortium Meeting, RAL State of AstroGrid Meeting Goals News and updates Scorecard Prognosis.

A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.

AstroGrid status SOFT the VO the future AstroGrid presentation to GSC Andy Lawrence July 2003.

1 27-Apr-2004AstroGrid Consortium Meeting - PL talk Agenda Tuesday status review / goals / science Lunch + AGLI Itn-05 review Dinner at Coton (share.

AstroGrid presentation to GSC 12 th Feb, 2003 London.

A PPARC funded project Tony Linde Programme Manager AG-SAG FM6 Programme Manager Report Wed 25-May, 2005 UCL.

AstroGrid: The UK’s Virtual Observatory Dr Dugan Witherick – Astrophysics Group, UCL Wednesday 5 th December 2007 The University of Warwick.

1 10-June-2004Andy Lawrence : PPARC data curation panel meeting AstroGrid, Data Centres, & Edinburgh What is curation ? Data Centres in the VO era Data.

A PPARC funded project Astronomical services: situated software vs. commodity software Guy Rixon, AstroGrid/AVO/IVOA Building Service Based Grids - GGF11.

Understand how the future will work exchange information on key projects understand PPARC priorities debate (conclude?) community approach to the PPARC.

The Astrophysical Virtual Observatory to EURO-VO transition Paolo Padovani ESO Virtual Observatory Systems Department EURO-VO Facility Centre Scientist.

The Project The Virtual Observatory Technical Progress Andy Lawrence Nottingham All-Hands meeting Sept 2003 AstroGrid

A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.

The Virtual Observatory Europe and the VO: the Astrophysical Virtual Observatory and the EURO-VO Astrophysical Virtual Observatory and the EURO-VO Paolo.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.

Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,

EURO-VO Structure Data Centre Alliance (DCA) A collaborative and operational network of European data centres who, by the uptake of new VO technologies.

Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid

GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.

E-Science Research Councils awarded e-Science funds ” science increasingly done through distributed global collaborations enabled by the Internet, using.

1 18-Nov-2004Andy Lawrence :VO-TECH workshop, Cambridge VO-TECH : Intro Euro-VO VO-TECH project Key issues Goals of meeting.

The International Virtual Observatory Alliance (IVOA) interoperability in action.

1 08 -Feb-2005Andy Lawrence : Planning Meeting, Leicester AG2 Cycle-1 Planning meeting AG1 feedback AG2 and VOTECH status Cycle-1 plans.

A PPARC funded project Tony Linde Programme Manager AG-SAG FM5: AG2/VOTech Scope & Targets Glasgow, 7 Feb 2005 VOTech Project.

1 8-Jun-2004Andy Lawrence : PharmaGrid talk, Diessenhofen The Virtual Observatory The VObs concept The structure of the VObs Standards, Standards, Standards.

A PPARC funded project Workflow in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.

A PPARC funded project Tony Linde Programme Manager AstroGrid in the wider world AstroGrid Consortium meeting Cambridge, UK 10-July-2005.

AstroGrid How to make your data famous OR One-click PhD creation.

A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.

VO DCA WP5 EuroVO-DCA Review, 10 January 2007 Giuliano Taffoni & Fabio Pasian - INAF EuroVO DCA WP5 Coordination with Computational Grid Projects G. Taffoni.

AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.

A PPARC funded project Astro-Wise meeting April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester.

The Large Synoptic Survey Telescope Project Bob Mann Wide-Field Astronomy Unit University of Edinburgh.

1 15-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh AstroGrid2 and Euro-VO AstroGrid and AVO Euro-VO VO-TECH project How to manage the.

Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.

The National Grid Service Mike Mineter.

AstroGrid and the Virtual Observatory John Taylor Institute for Astronomy.

1 14-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh Meeting Goals review achievements review architecture identify targets for AG2 and.

Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.

AstroGrid and Virtual Observatories for Radio Interferometry arrays/ proposals Anita Richards Paul Harrison Noel Winstanley (Jodrell Bank Centre for Astrophysics,

MSSL Astrogrid Workshop

The Open Grid Service Architecture (OGSA) Standard for Grid Computing

CEA Experiences Paul Harrison ESO.

Presentation transcript:

A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh

2 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid overview Virtual Observatory infrastructure “The VO vision can be summed up as the desire to make all archives speak the same language − all searchable and analysable by the same tools, all data sources accessible through a common interface, all data held in distributed databases that appear as one.” Andy Lawrence, 09/2003 AstroGrid approach Build infrastructure first VObs  Web Mix-and-match, plug-and-play, …

3 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid project Duration:Sept 2001 – Dec 2007 Funding:£7.7M (PPARC) Personnel:~26 (23.4 FTE) Goal:Develop VObs Infrastructure Deploy UK VObs Scope:Astrophysics, Solar, STP, … Optical, X-Ray, Radio, … AG1 Phase A: Sept 2001 – Dec 2002 Analysis, R&D, Architecture AG1 Phase B: Jan 2003 – Dec 2004 Build, test & deliver V1.0 AstroGrid-2: Jan 2005 – Dec 2007 Develop & deploy

4 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid consortium Edinburgh Leicester Cambridge MSSL JBO RAL QUB From 2005, AstroGrid-2 + Bristol Exeter Leeds Portsmouth

5 Tony Linde 28-Apr-2006eScience meets eFrameworks Wider involvement Europe Euro-VO: VOTech project:  FP6 funded: €6M:  Follows on from AVO (FP5 funded) International IVOA: Closer collaborations  RVO  JVO  SAAO  NVO

6 Tony Linde 28-Apr-2006eScience meets eFrameworks Project Approach Agile: iterative & incremental development Open project: Static Wiki Forum Jabber via jabber.astrogrid.org Open Source code Academic Free License AstroGrid releases

7 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid infrastructure

8 Tony Linde 28-Apr-2006eScience meets eFrameworks Deployments 1

9 Tony Linde 28-Apr-2006eScience meets eFrameworks Deployments 2

10 Tony Linde 28-Apr-2006eScience meets eFrameworks Deployments 3

11 Tony Linde 28-Apr-2006eScience meets eFrameworks How do the VO components that implement these interfaces relate to each other?

12 Tony Linde 28-Apr-2006eScience meets eFrameworks DSA: Architecture SkyNode SIAP/ SSAP Web Svc (CEA) ADQL Translator Plugins: JDBC/Db FITS etc VOTable DSADSA

13 Tony Linde 28-Apr-2006eScience meets eFrameworks Registry We can access data but how do we know where it can be found? Knowledge of the location and nature of resources is critical for all this to work The AstroGrid Infrastructure supplies a Registry (IVOA compliant of course!) which contains this information Registry is searchable by humans and by machines.

14 Tony Linde 28-Apr-2006eScience meets eFrameworks Common Execution Architecture Why would we want CEA/UWS? Same reason we need universal access to data AstroGrid supports the concept of workflow Essentially, remote execution of special scripts or jobs Allows data access and processing to be undertaken at source or where the compute power lies The Grid concept! The AG Infrastructure helps make the details transparent, keeping focus on the science.

15 Tony Linde 28-Apr-2006eScience meets eFrameworks Workflow

16 Tony Linde 28-Apr-2006eScience meets eFrameworks Compute grid JES Registry Common Execution Connector Application as.exe file (local) Common Execution Connector Common Execution Connector Common Execution Connector Application as.exe file (grid) Application as.HTTP service Application as Java class

17 Tony Linde 28-Apr-2006eScience meets eFrameworks MySpace If all this happens remotely, where do the results end up? Distributed data access and processing requires distributed data storage MySpace is the AstroGrid solution VOSpace/VOStore under review at IVOA Distributed, virtual data storage that appears to the user as a homogeneous collection of files Database tables coming soon!

18 Tony Linde 28-Apr-2006eScience meets eFrameworks Distributed Storage DSAProcess Desktop MySpace

19 Tony Linde 28-Apr-2006eScience meets eFrameworks MySpace

20 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid Actors Astronomers Incl PIs, management structure, … Instrument operators, … Data curators Publishers Administrators Systems managers Developers Standards definers …

21 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid and eFrameworks: Issues Security Shibboleth authentication:  Single-signon Authorisation  Common policy requirements? Service discovery Resource registries  Need for commonality?  Will others need to get at astro resources? Common identifiers?

22 Tony Linde 28-Apr-2006eScience meets eFrameworks AstroGrid and eFrameworks: Other Issues Service execution Workflow Shared storage Accounting Naming! e.g. VO Bottom line Standards & interoperability How do we get W3C, GGF, IVOA, IE & project standards to work?