AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.

Slides:



Advertisements
Similar presentations
AstroGrid: Past, Present & Future Bob Mann Institute for Astronomy & National e-Science Centre University of Edinburgh.
Advertisements

The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
National e-Science Centre Glasgow e-Science Hub Opening: Remarks NeSCs Role Prof. Malcolm Atkinson Director 17 th September 2003.
A PPARC funded project Common Execution Architecture Paul Harrison AstroGrid consortium meeting Edinburgh UK Dec 2004.
02/07/03 Grid Support Centre 1 UK Grid Support Centre Alistair Mills CLRC e-Science Centre
A PPARC funded project The Grid Data Warehouse Description of prototype work in progress by AstroGrid. Access-Grid lecture to Universities of Leeds and.
AstroGrid Consortium Meeting PM Report AstroGrid Consortium Meeting Overview Activities Finance Recruitment Collaboration Phase B.
A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
Teula Morgan The Adaptable Repository: Swinburne Online Journals.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.
A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.
The Queen’s University of Belfast The Queen’s University of Belfast GeneGrid : Using OgsaDai in Bioinformatics Noel Kelly Belfast.
A PPARC funded project Review of architecture document Consortium meeting Edinburgh December 2004 Guy Rixon AstroGrid Technical Architect University of.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.
Talk structure who are we ? what is a VO ? what are the challenges ? what is an e-project ? Andy Lawrence Garching June 2002.
AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.
1 10/14/2015ã 2007, Spencer Rugaber The Waterfall Process Software plans and requirements Validation System feasibility Validation Product design Verification.
ISM 5316 Week 3 Learning Objectives You should be able to: u Define and list issues and steps in Project Integration u List and describe the components.
Eighth Hour Lecture 7:30 – 8:20 pm, Thursday, September 13 Workflows of the Process (from Chapter 8 of Royce’ book)
A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.
T Final demo I2 Iteration Agenda  Product presentation (20 min) ‏  Project close-up (20 min) ‏ Evaluation of the results  Questions.
AstroGrid status SOFT the VO the future AstroGrid presentation to GSC Andy Lawrence July 2003.
1 27-Apr-2004AstroGrid Consortium Meeting - PL talk Agenda Tuesday status review / goals / science Lunch + AGLI Itn-05 review Dinner at Coton (share.
AstroGrid presentation to GSC 12 th Feb, 2003 London.
12 GeV Era Computing (MIS) Kari Heffner May 20, 2011.
The Project The Virtual Observatory Technical Progress Andy Lawrence Nottingham All-Hands meeting Sept 2003 AstroGrid
Grids - the near future Mark Hayes NIEeS Summer School 2003.
Astronomical Data Archiving and Curation Clive Page AstroGrid Project University of Leicester 2004 March 22.
A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.
WGISS Technology Subgroup Report WGISS-29 Bonn, 2010 Nataliia Kussul WGISS.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid
1 18-Nov-2004Andy Lawrence :VO-TECH workshop, Cambridge VO-TECH : Intro Euro-VO VO-TECH project Key issues Goals of meeting.
A PPARC funded project Architecture Appeal Guy Rixon AstroGrid Consortium meeting April 2004.
1 08 -Feb-2005Andy Lawrence : Planning Meeting, Leicester AG2 Cycle-1 Planning meeting AG1 feedback AG2 and VOTECH status Cycle-1 plans.
A PPARC funded project Tony Linde Programme Manager AG-SAG FM5: AG2/VOTech Scope & Targets Glasgow, 7 Feb 2005 VOTech Project.
1 8-Jun-2004Andy Lawrence : PharmaGrid talk, Diessenhofen The Virtual Observatory The VObs concept The structure of the VObs Standards, Standards, Standards.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
A PPARC funded project Tony Linde Programme Manager AstroGrid in the wider world AstroGrid Consortium meeting Cambridge, UK 10-July-2005.
AstroGrid How to make your data famous OR One-click PhD creation.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.
A PPARC funded project Astro-Wise meeting April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester.
1 OGSA Transition ATF Migration Strategy Prof. Malcolm Atkinson Director 28 th April 2003.
1 15-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh AstroGrid2 and Euro-VO AstroGrid and AVO Euro-VO VO-TECH project How to manage the.
Meghe Group of Institutions Department for Technology Enhanced Learning 1.
AstroGrid Oversight Committee MRC, London 30 July, 2002.
Phase-A close-out why do we need it ? Phase-A products messages structure of report timeline Andy Lawrence MSSL June 2002.
CNAP MEETING 7 October 2002 J.C.Sherman. AS&SG What was previously the Starlink line in the PPARC SLA is now the Astronomical Software and Services Group.
Welcome Grids and Applied Language Theory Dave Berry Research Manager 16 th October 2003.
ESDO: UK Access to the Solar Dynamics Observatory 1. Mullard Space Science Laboratory, University College London. Holmbury St. Mary, Dorking, Surrey SM2.
1 14-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh Meeting Goals review achievements review architecture identify targets for AG2 and.
AstroGrid & VO Structure NeSC, Edinburgh 21-March-2003 UK Astronomical Data Centres.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Bob Jones EGEE Technical Director
Shawn McClure, Rodger Ames and Doug Fox - CIRA
Supervisor : Trần Vinh Thu
MSSL Astrogrid Workshop
E.C. Auden1, J.L. Culhane1, Y. P. Elsworth2, A. Fludra3, M. Thompson4
UK e-Science OGSA-DAI November 2002 Malcolm Atkinson
Grid Portal Services IeSE (the Integrated e-Science Environment)
Software Development Life Cycle (SDLC)
Chapter 2 Software Processes
Google Sky.
Presentation transcript:

AstroGrid Group 7: Teemu Toivola Tero Viitala

Problem several separate databases no common interface between databases difficulties of joining related data limited observatory time resources lack of user skills

Shocks seen in the X- ray Heavy elements seen in the optical Dust seen in the IR Relativistic electrons seen in the radio

Goals a working datagrid for key UK databases uniform archive query and datamining interface the ability to browse simultaneously multiple datasets a set of tools for on-line database analysis and exploration

Members consortium members – School of Computer Science, Queens University of Belfast (QUB) –Institute of Astronomy, University of Cambridge –Institute for Astronomy, University of Edinburgh –Dept of Physics and Astronomy, University of Leicester –Mullard Space Science Laboratory, University of London (MSSL) –Jodrell Bank Observatory, University of Manchester (JBO) –Space Data Division, Rutherford Appleton Laboratory (RAL) financed by PPARC executive board AGLI day-to-day management

Project content Phase A –architecture definition –begin: –end: Phase B –implementation –begin: –end:

Phase A WP-A0 Project Management & Infrastructure WP-A1 Science Requirements WP-A2 - A4Technology assessment WP-A5Pilot programs WP-A6Support for future databases WP-A7Researching existing technologies WP-A8Phase B plan WP-A9User Interface

Phase B Iterations 1 & 2 (June 2003) –basic engine room components –preliminary interface and contents –OGSI experiments Iterations 3 & 4 (December 2003) –engine room continued –interface and contents –international program

Phase B Iteration 5 & 6 (June 2004) –datamining –workflow –visualisation –OGSA Integration (demo) Iteration 7 & 8 (December 2004) –datamining –query Estimator/Optimizer –resource Registry –visualisation –OGSA Integration

Progress

Difficulties social –organization –common procedures technical –lack of standards –uncertainty of future network bandwidth financial –lack of funding

"So Why No Integration Tests? So here we are 2 weeks from code freeze, and still the only bug reports I have on integration testing are from the It03 demo." "I get the feeling people are doing design -> write code -> reflect -> refactor, document -> test. This is a waterfall model and *not appropriate* (except over a day or two!). We should *not* be designing for next year. We have to get out of the waterfall and into coding!" RiskPIComment Grid software is late or non- functional HVHVH will design for this eventuality so that grid services can be replaced by simple web services