1 27-Sept-2004Andy Lawrence : IVOA workshop, Pune State of the IVOA state of the VO state of the IVOA.

Slides:



Advertisements
Similar presentations
Applications Interest Group Mark Allen, Tom McGlynn (lead)
Advertisements

VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
IVOA Interoperability Workshop Boston, May 2004.
Achievements in VOQL WG May 20, 2005 Masatoshi Ohishi.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
Applications Interest Group Tom McGlynn (based on Mark Allens summary from Cambridge)
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9/14/2006NVOSS III1 The Future of the Virtual Observatory Robert Hanisch US NVO Project Manager Space Telescope Science Institute T HE US N ATIONAL V IRTUAL.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
1 16-May-2005Andy Lawrence : IVOA workshop, Kyoto Roadmap and charge news roadmap issues goals.
A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.
David Schade Canadian Astronomy Data Centre Data Services Curation Practice and User Metrics.
The Virtual Observatory and other data issues computers and astronomy today background technology the future : opportunities and problems VO vision VO.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.
F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
The AstroGrid Desktop Suite Release 2008 what it is what you can do short demo (wireless permitting...) NAM2008 Belfast Andy Lawrence April 2008.
The data challenge in astronomy archives technology problems solution DCC conference Bath Andy Lawrence Sep 2005 the virtual observatory.
A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.
VOTech Stage 1 Meeting, DS4 User Tools, Univ. Leicester, 22-Feb-2005 VOTech DS4 Welcome to: DS4 * User Tools WP Manager Markus Dolensky, ESO * DS... Design.
NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.
Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.
AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.
1 19-Jun-2006Andy Lawrence : AstroGrid Consortium Meeting, RAL State of AstroGrid Meeting Goals News and updates Scorecard Prognosis.
A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.
AstroGrid status SOFT the VO the future AstroGrid presentation to GSC Andy Lawrence July 2003.
1 27-Apr-2004AstroGrid Consortium Meeting - PL talk Agenda Tuesday status review / goals / science Lunch + AGLI Itn-05 review Dinner at Coton (share.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
A PPARC funded project Tony Linde Programme Manager AG-SAG FM6 Programme Manager Report Wed 25-May, 2005 UCL.
1 10-June-2004Andy Lawrence : PPARC data curation panel meeting AstroGrid, Data Centres, & Edinburgh What is curation ? Data Centres in the VO era Data.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Understand how the future will work exchange information on key projects understand PPARC priorities debate (conclude?) community approach to the PPARC.
The Project The Virtual Observatory Technical Progress Andy Lawrence Nottingham All-Hands meeting Sept 2003 AstroGrid
The Virtual Observatory Europe and the VO: the Astrophysical Virtual Observatory and the EURO-VO Astrophysical Virtual Observatory and the EURO-VO Paolo.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.
Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid
1 18-Nov-2004Andy Lawrence :VO-TECH workshop, Cambridge VO-TECH : Intro Euro-VO VO-TECH project Key issues Goals of meeting.
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
1 08 -Feb-2005Andy Lawrence : Planning Meeting, Leicester AG2 Cycle-1 Planning meeting AG1 feedback AG2 and VOTECH status Cycle-1 plans.
1 8-Jun-2004Andy Lawrence : PharmaGrid talk, Diessenhofen The Virtual Observatory The VObs concept The structure of the VObs Standards, Standards, Standards.
May 19, 2006IVOA InterOp WS 2006 May, Victoria, Canada 1 Plenary (DAY2) Masatoshi Ohishi / NAOJ & Sokendai 大石雅寿 / 国立天文台 & 総合研究大学院大学
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
WP 7 - JRA2 - Data Access Protocols and Data Models EuroVO-AIDA – Final review – 5 October 2010 Christophe Arviset (ESA) Work Package 7 - JRA2 Data Access.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
1 15-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh AstroGrid2 and Euro-VO AstroGrid and AVO Euro-VO VO-TECH project How to manage the.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro Osuna VOSpec Kyoto May 2005 VOSpec: A Tool to Handle VO-Compatible.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
1 14-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh Meeting Goals review achievements review architecture identify targets for AG2 and.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
AIDA Fourth Technology Forum
IVOA Status Christophe Arviset
Google Sky.
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
VOQL WG Plenary Session
Presentation transcript:

1 27-Sept-2004Andy Lawrence : IVOA workshop, Pune State of the IVOA state of the VO state of the IVOA

2 27-Sept-2004Andy Lawrence : IVOA workshop, Pune IVOA : State of the Union STATE OF THE VO VO vision VO progress STATE OF THE IVOA news roadmap issues

Part 1 State of the VO

The VO vision

5 27-Sept-2004Andy Lawrence : IVOA workshop, Pune VO : Generic Science Drivers data growth : volume and richness desire to work on-line multi-archive science large database science empowerment

6 27-Sept-2004Andy Lawrence : IVOA workshop, Pune Data re-use : a market fact HST : more retrieval than ingest

multi- views of a Supernova Remnant Shocks seen in the X- ray Heavy elements seen in the optical Dust seen in the IR Relativistic electrons seen in the radio

needles in a haystack b - faint moving object is a cool white dwarf - may be solution to the dark matter problem - but hard to find : one in a million - even harder across multiple archives

9 27-Sept-2004Andy Lawrence : IVOA workshop, Pune VO : Technical Drivers data rate, storage and flops : x 1000 /decade but device bw x 10/decade search engines next to the data backbone network bw ~Gbps but end-end bw ~10Mbps analyse in situ : shift results not data

10 27-Sept-2004Andy Lawrence : IVOA workshop, Pune network development higher level protocols ==> transparency TCP/IP message exchange HTTPdoc sharing (web) grid suiteCPU sharing XML/SOAP data exchange

11 27-Sept-2004Andy Lawrence : IVOA workshop, Pune the VO concept web all docs in the world inside your PC VO all databases in the world inside your PC

VO structure

13 27-Sept-2004Andy Lawrence : IVOA workshop, Pune what its not not a monolith not a warehouse

14 27-Sept-2004Andy Lawrence : IVOA workshop, Pune VO framework standards inter-operable data inter-operable software modules no central VO-command

15 27-Sept-2004Andy Lawrence : IVOA workshop, Pune publishing metaphor experiments/facilities are authors data centres are publishers VO portals are shops end-users are readers VO infrastructure is distribution system.

16 27-Sept-2004Andy Lawrence : IVOA workshop, Pune work to do agree standards build software glue build VO-aware tools build VO-aware data services

Standards, Standards, Standards

18 27-Sept-2004Andy Lawrence : IVOA workshop, Pune International VO alliance (IVOA)

19 27-Sept-2004Andy Lawrence : IVOA workshop, Pune IVOA activities development of standards technical working groups bi-annual interoperability workshops exchange of best practice formal process modelled on W3C

Progress towards the VO

21 27-Sept-2004Andy Lawrence : IVOA workshop, Pune IVOA standards key standards so far protocols for tables, images, spectra resource and service metadata definitions standardised query language provisional semantic dictionary standardised grid and web service interfaces coming up ? generic data model, identification, semantics

22 27-Sept-2004Andy Lawrence : IVOA workshop, Pune glue accomplishments prelim versions of key components Registry, Workflow, Sign-on, VOSpace several crafted-demos some real science done first users starting to play AVO SWG; AstroGrid AGSAG NVO summer school

23 27-Sept-2004Andy Lawrence : IVOA workshop, Pune services and tools data centres upgrading worldwide many data centres now exporting VOTable real data services in SkyQuery and others standard tools being VO-ised Aladin, DS9, Sextractor, etc new tools : VOPlot, SEDTool, TOPCAT ambitious services : AusVO grid-visualisation

Part 2 State of the IVOA

news

26 27-Sept-2004Andy Lawrence : IVOA workshop, Pune IVOA news Successful showing at SPIE Glasgow new recommendation : VOTable 1.1 Prague IAU pre-proposal submitted OECD report released : IVOA praised

27 27-Sept-2004Andy Lawrence : IVOA workshop, Pune project news NVO : summer school a success France-VO plan similar event Euro-VO : VOTECH proposal funded Aus-VO : new Grid-funding AstroGrid : RC1 scheduled for end of year CVO : new VO Database Exploration Prototype IVO : Pune meeting a success (TBC)

Guest Spot

roadmap

30 27-Sept-2004Andy Lawrence : IVOA workshop, Pune Done. Demo 05Freeze Current Roadmap V1 SIA V1.0 Architecture RSM V1.0 UCD V1.0 VOTable V1.0 Spectrum Access V0.9 Observation Data Model V0.9 VOTable V1.1 Registry Interface V0.9 Image Access V1.1 UCD V1+ Roadmap V2 ADQL + SkyNode V0.9 Web Service V0.5 MySpace + MyDB + SRB VOSpace Workflow not yet subject to standardizationprogress on IVOA standard documents Roadmap as of Jun3 2004

Roadmap VOQL 1.0 ‘05 Full registry specification 1.0 ‘05 Single sign on 1.0 ‘05 VOSpace 1.0 ‘05?? Work flow 1.0 ‘06 Web Services Interfaces 1.0(inc logging) ‘05 Data Model plans (Registries - VOResource) ‘05 VOList 0.5 ‘05? Ontology (semantics) ‘05-> Simulation data (services) milestone’05 Preservation 1.0 ‘06 ??? January 2005 Coordinated complex demo July 2005 Data Centre take-up workshop and evaluation January 2006 Data Centre Interoperability Coordinated demo IAU August 2006 Data Centre take-up statistics (July 05, July 06) Reference implementations January 2006 Implementations feedback July 2006 VO-enable science metric August 2006 IAU January 2007 Community Applications in action? (Jan’05, Jan’06)

IVOA Calendar Jun IVOA Exec, Glasgow, UK Jun VO session at the SPIE - Glasgow, UK Sep 2004 NVO Summer School, Aspen, Colorado Sep IVOA InterOp Pune, India Sep Pune regional VO meeting Autumn Astro-RG at GGF12, Brussels Oct ADASS, Pasadena (no InterOp) Jan NVO demo at the AAS, San Diego with IVOA Exec ? Jan Euro-VO demo event - Madrid, Spain May IVOA InterOp, Kyoto, Japan - with IVOA Exec July Euro-VO tech workshop - Munich Autumn ADASS + IVOA InterOp Madrid, Spain Aug IAU Prague : VO Symposium

IVOA issues

34 27-Sept-2004Andy Lawrence : IVOA workshop, Pune IVOA issues whither DM useable product now or design of VO-to-come VOTable vs TabSky how do we evolve new standards ? proposed VOTransient WG schedule a discussion Grid-compliance vs W3 compliance IVOA "Business Plan" charter, strategic plan...

35 27-Sept-2004Andy Lawrence : IVOA workshop, Pune meeting goals general : exchange ideas, discuss issues confirm state of readiness for Jan demos draft 2005 roadmap for agreement Jan

provocative finale

37 27-Sept-2004Andy Lawrence : IVOA workshop, Pune are we getting there ? data interoperability resource interoperability data integration single sign on complex jobs

38 27-Sept-2004Andy Lawrence : IVOA workshop, Pune are we getting there ? data interoperability good progress VOtable, SIAP, SSAP will need refreshing

39 27-Sept-2004Andy Lawrence : IVOA workshop, Pune are we getting there ? resource interoperability good progress RSM doc, harvestable registries progress on WS interfaces prelim storage sharing (MySpace)

40 27-Sept-2004Andy Lawrence : IVOA workshop, Pune are we getting there ? data integration not really there plain proximity SkyQuery best attempt really science / algorithm problem not IT need real semantics - not just types UCNs; units; grammar concentrate on operations not philosophy who is the rescue team ?  UCD++ ? DM ? Semantic Web ?

41 27-Sept-2004Andy Lawrence : IVOA workshop, Pune are we getting there ? single sign on liimited IVOA attention (GWS-WG) primitive AstroGrid deployment need to cohere with rest of academia Shibboleth looks like the winner

42 27-Sept-2004Andy Lawrence : IVOA workshop, Pune are we getting there ? complex jobs : workflow negligible IVOA attention simple AstroGrid deployment Bio way ahead  talking about patenting workflows

FIN