1. A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester

2. 2 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid Overview Approach Architecture Usage Itn05/06 Astro-Wise & VObs Follow-up

3. 3 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Overview of AstroGrid/-2 Duration:Sept 2001 – Dec 2007 Funding:£7.7M (PPARC) Personnel:~26 (23.4 FTE) Goal:Develop VObs Infrastructure Deploy UK VObs Scope:Astrophysics, Solar, STP, … Optical, X-Ray, Radio, … Phase A: Sept 2001 – Dec 2002 Analysis, R&D, Architecture Phase B: Jan 2003 – Dec 2004 Build, test & deliver AstroGrid-2: Jan 2005 – Dec 2007 Structure tbd

4. 4 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid consortium Edinburgh Leicester Cambridge MSSL JBO RAL QUB AstroGrid-2 + Bristol Exeter Leeds Portsmouth

5. 5 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Lead Personnel Project Lead Andy Lawrence (Edinburgh)  al@roe.ac.uk al@roe.ac.uk Project Scientist Nic Walton (Cambridge)  naw@ast.cam.ac.uk naw@ast.cam.ac.uk Project Manager Tony Linde (Leicester)  ael@star.le.ac.uk ael@star.le.ac.uk Technical Lead Keith Noddle (Leicester)  ktn@star.le.ac.uk ktn@star.le.ac.uk

6. 6 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Links FP5 AVO, FP6 Euro-VO (UK rep) US-NVO IVOA Standards workgroups GGF, Globus, OGSA-DAI Other e-Science projects in UK GridPP, myGrid, EGSO, …

7. 7 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Project Approach Agile: iterative & incremental development Open project: Wiki http://wiki.astrogrid.org/bin/view/Astrogrid/WebHome http://wiki.astrogrid.org/bin/view/Astrogrid/WebHome Forum http://forum.astrogrid.org/index.php http://forum.astrogrid.org/index.php News http://news.astrogrid.org/index.php http://news.astrogrid.org/index.php Jabber via jabber.astrogrid.org Open Source code http://www.astrogrid.org/maven/build/index.html

8. 8 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Development Approach Iterative full cycle each iteration 3 month(-ish) iterations Incremental add functionality each iteration refactor wherever necessary Use-case driven from ‘key 10’ science cases http://wiki.astrogrid.org/bin/view/Astrogrid/ScienceProblems Architecture led http://wiki.astrogrid.org/bin/view/Agdoc/ArchVision http://wiki.astrogrid.org/bin/view/Agdoc/ArchOverview http://wiki.astrogrid.org/bin/view/AG2/ArchitectureNotes

9. 9 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Technology choices design : UML, TogetherSoft ControlCenter development language : Java Web services source control : CVS IDE/build/integrate : Eclipse/Ant/Maven Java libraries: Apache Portal : Apache Cocoon

10. 10 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen VObs Structure Component-based can install any/all components Decentralised no single product nor centre Service-based web services

11. 11 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Components Portal Registry Security Community Workflow Data Access MySpace Applications

12. 12 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid-2 Aspects Extension  Infrastructure  Grid (GT4 + ) integration  Intelligent resource discovery (semantic grid) Additional components  Data exploration  Agents: eStar integration  Client-based access: VO Workbench  Technical Scope http://wiki.astrogrid.org/bin/view/AG2/TechnicalScope

13. 13 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid-2 Layer Diagram

14. 14 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen AstroGrid use Portal  Workflow Workflow is key to AstroGrid

15. 15 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Workflow Sequence Sequential steps Flow Steps executed in parallel Step Application/Tool, Data query Configured via XForm specification  To be enhanced later or Query form Workflow definition Subset of BPEL

16. 16 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Create Workflow

17. 17 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Add tools to steps

18. 18 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Configure step: data query

19. 19 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Configure step: tool

20. 20 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Submit workflow, Check status

21. 21 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Data query step Insert valid ADQL (v0.7.?) Assisted query builder this iteration

22. 22 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen MySpace: virtual storage Operations: Copy, Delete, Move Upload from file, URL End-point Multiple servers per manager Usually hidden from user

23. 23 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen eg Copy file, Upload file

24. 24 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Registry: Query

25. 25 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Registry details Conforms to IVOA std Extended: ApplicationDefinition AstroGrid CEA

26. 26 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Registry harvest Admin function, so usually invisible

27. 27 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Itn05: Complex workflow: AVO Demo Canned images ACE AstroGrid wrapping of SExtractor VOTMerge AstroGrid VOTable ‘federation’ HyperZ AstroGrid wrapping of HyperZ CEA

28. 28 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Itn06: Jan 2005 AVO Demo Build on the Itn05 tool Image access (SIAP) Add in extra redshift applications  Bpz  ANNz Access wider data resources  WFS  GOODS plus IR Deploy on 'real' machines  Disk  Compute

29. 29 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Itn06: Solar science case: CMEs

30. 30 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Astro-Wise & VObs Key points Make data available Publish metadata  Rapid dissemination (push harvesting)  Versioning / describing / retiring of products Other Pipeline services available  Custom UIs Re-process data  User-derived products Agent interfaces

31. 31 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Astro-Wise links Data model IVOA DM group (Jonathan McDowell) AstroGrid Interop group (Anita Richards) Beta testing AstroGrid software AstroGrid deployment AVO demos

32. 32 06-May-2004Astro-Wise meeting, Kapteyn Institute, Groningen Follow-up Beta testing Contact Nic Walton Component Deployment  Data Centre  MySpace  Local Registry  Community Contact Nic Walton Software cooperation  MySpace  Workflow  Data Centre  Registry metadata updating Contact Tony Linde, Keith Noddle