A PPARC funded project Astro-Wise meeting April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester

2 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid Overview Approach Architecture Usage Itn05/06 Astro-Wise & VObs Follow-up

3 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Overview of AstroGrid/-2 Duration:Sept 2001 – Dec 2007 Funding:£7.7M (PPARC) Personnel:~26 (23.4 FTE) Goal:Develop VObs Infrastructure Deploy UK VObs Scope:Astrophysics, Solar, STP, … Optical, X-Ray, Radio, … Phase A: Sept 2001 – Dec 2002 Analysis, R&D, Architecture Phase B: Jan 2003 – Dec 2004 Build, test & deliver AstroGrid-2: Jan 2005 – Dec 2007 Structure tbd

4 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid consortium Edinburgh Leicester Cambridge MSSL JBO RAL QUB AstroGrid-2 + Bristol Exeter Leeds Portsmouth

5 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Lead Personnel Project Lead Andy Lawrence (Edinburgh)  Project Scientist Nic Walton (Cambridge)  Project Manager Tony Linde (Leicester)  Technical Lead Keith Noddle (Leicester) 

6 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Links FP5 AVO, FP6 Euro-VO (UK rep) US-NVO IVOA Standards workgroups GGF, Globus, OGSA-DAI Other e-Science projects in UK GridPP, myGrid, EGSO, …

7 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Project Approach Agile: iterative & incremental development Open project: Wiki Forum News Jabber via jabber.astrogrid.org Open Source code

8 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Development Approach Iterative full cycle each iteration 3 month(-ish) iterations Incremental add functionality each iteration refactor wherever necessary Use-case driven from ‘key 10’ science cases Architecture led

9 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Technology choices design : UML, TogetherSoft ControlCenter development language : Java Web services source control : CVS IDE/build/integrate : Eclipse/Ant/Maven Java libraries: Apache Portal : Apache Cocoon

10 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen VObs Structure Component-based can install any/all components Decentralised no single product nor centre Service-based web services

11 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Components Portal Registry Security Community Workflow Data Access MySpace Applications

12 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid-2 Aspects Extension  Infrastructure  Grid (GT4 + ) integration  Intelligent resource discovery (semantic grid) Additional components  Data exploration  Agents: eStar integration  Client-based access: VO Workbench  Technical Scope

13 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid-2 Layer Diagram

14 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid use Portal  Workflow Workflow is key to AstroGrid

15 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Workflow Sequence Sequential steps Flow Steps executed in parallel Step Application/Tool, Data query Configured via XForm specification  To be enhanced later or Query form Workflow definition Subset of BPEL

16 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Create Workflow

17 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Add tools to steps

18 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Configure step: data query

19 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Configure step: tool

20 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Submit workflow, Check status

21 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Data query step Insert valid ADQL (v0.7.?) Assisted query builder this iteration

22 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen MySpace: virtual storage Operations: Copy, Delete, Move Upload from file, URL End-point Multiple servers per manager Usually hidden from user

23 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen eg Copy file, Upload file

24 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Registry: Query

25 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Registry details Conforms to IVOA std Extended: ApplicationDefinition AstroGrid CEA

26 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Registry harvest Admin function, so usually invisible

27 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Itn05: Complex workflow: AVO Demo Canned images ACE AstroGrid wrapping of SExtractor VOTMerge AstroGrid VOTable ‘federation’ HyperZ AstroGrid wrapping of HyperZ CEA

28 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Itn06: Jan 2005 AVO Demo Build on the Itn05 tool Image access (SIAP) Add in extra redshift applications  Bpz  ANNz Access wider data resources  WFS  GOODS plus IR Deploy on 'real' machines  Disk  Compute

29 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Itn06: Solar science case: CMEs

30 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Astro-Wise & VObs Key points Make data available Publish metadata  Rapid dissemination (push harvesting)  Versioning / describing / retiring of products Other Pipeline services available  Custom UIs Re-process data  User-derived products Agent interfaces

31 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Astro-Wise links Data model IVOA DM group (Jonathan McDowell) AstroGrid Interop group (Anita Richards) Beta testing AstroGrid software AstroGrid deployment AVO demos

32 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Follow-up Beta testing Contact Nic Walton Component Deployment  Data Centre  MySpace  Local Registry  Community Contact Nic Walton Software cooperation  MySpace  Workflow  Data Centre  Registry metadata updating Contact Tony Linde, Keith Noddle