2 Dec 2004 Technology Open House 2004 1 The National Virtual Observatory T HE US N ATIONAL V IRTUAL O BSERVATORY Bob Hanisch Gretchen Greene Wil O’Mullane.

Slides:



Advertisements
Similar presentations
1 Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research
Advertisements

VO/IVOA and The Astronomy Community Dave De Young NOAO.
Applications Interest Group Tom McGlynn (based on Mark Allens summary from Cambridge)
3 September 2004NVO Coordination Meeting1 Grid-Technologies NVO and the Grid Reagan W. Moore George Kremenek Leesa Brieger Ewa Deelman Roy Williams John.

NVO SSC1 NVO Science Overview for the NVO Science Steering Committee Alex Szalay, Dave De Young, Bob Hanisch US NVO Project T HE US N ATIONAL.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9/14/2006NVOSS III1 The Future of the Virtual Observatory Robert Hanisch US NVO Project Manager Space Telescope Science Institute T HE US N ATIONAL V IRTUAL.
Discovery and Exploration in the VO Chris Miller NOAO/CTIO La Serena, Chile T HE US N ATIONAL V IRTUAL O BSERVATORY.
Introduction: The Virtual Observatory and Astronomical Data Robert Hanisch Space Telescope Science Institute Baltimore, Maryland USA Project Manager, US.
14 Sept 2005NVO Summer School II1 Whats on Tap in the VO? T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US NVO Project Manager Space Telescope.
September 13, 2004NVO Summer School1 Exploring VO Registries, Resources and Software with The NVO DataScope and Other VO Tools Tom McGlynn NASA/GSFC T.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 Sept 2005NVO Summer School II1 NVO Science Applications T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US NVO Project Manager Space Telescope.
27 June 2005 National Virtual Observatory 1 The National Virtual Observatory: Publishing Astronomy Data Robert J. Hanisch US National Virtual Observatory.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
ESO-ESA Existing Activities Archives, Virtual Observatories and the Grid.
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
20 January 2004ESS Technical Colloquium1 NVO Infrastructure Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
Using Sakai to Support eScience Sakai Conference June 12-14, 2007 Sayeed Choudhury Tim DiLauro, Jim Martino, Elliot Metsger, Mark Patton and David Reynolds.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.
5-6 February 2007 Brazil VO1 The Origins, Formation, and Scientific Promise of the Virtual Observatory Robert Hanisch Space Telescope Science Institute.
Long-Term Preservation of Astronomical Research Results Robert Hanisch US National Virtual Observatory Space Telescope Science Institute Baltimore, MD.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
Long-Term Preservation of Astronomical Research Results Robert Hanisch US National Virtual Observatory Space Telescope Science Institute Baltimore, MD.
05/24/2004The 12th UN/ESA Workshop on Basic Space Science Chinese Virtual Observatory (China-VO) Chenzhou Cui Chinese Virtual Observatory Project National.
The NASA/NExScI/IPAC Star and Exoplanet Database 14 May 2009 David R. Ciardi on behalf of the NStED Team.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
16 Feb, 2005AAAC meeting1 The National Virtual Observatory Status, Plans & Vision Alex Szalay, JHU and the NVO Team.
Automated Classification of X-ray Sources R. J. Hanisch, A. A. Suchkov, R. L. White Space Telescope Science Institute T. A. McGlynn, E. L. Winter, M. F.
Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.
Alex Szalay, Jim Gray Analyzing Large Data Sets in Astronomy.
July 16, 2004P. Padovani, NEON Archive School Science with Multi- Archival Data Paolo Padovani (ST-ECF/ESO) Astrophysical Virtual Observatory Science Manager.
GAVO – after one year H.-M. Adorf & the GAVO team.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Hello!. International Virtual Observatory Alliance Ajit Kembhavi, IUCAA, Pune.
25 Jan The Virtual Observatory: Core Capabilities and Support for Statistical Analyses in Astronomy T HE US N ATIONAL V IRTUAL O BSERVATORY Robert.
Science with the Virtual Observatory Brian R. Kent NRAO.
National Virtual Observatory Theory,Computation, and Data Exploration Panel of the AASC Charles Alcock, Tom Prince, Alex Szalay.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.
July 16, 2004P. Padovani, NEON Archive School Science with multi-wavelength Archival Data Paolo Padovani (ESO) Virtual Observatory Systems Department &
26 October 2005HST Calibration Workshop1 The National Virtual Observatory and HST T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US National Virtual.
Using the NSA Presentation to NOAO Users Committee October 5, 2005.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
The Virtual Observatory Europe and the VO: the Astrophysical Virtual Observatory and the EURO-VO Astrophysical Virtual Observatory and the EURO-VO Paolo.
The VAO is operated by the VAO, LLC. LSST VAO Meeting Robert Hanisch Space Telescope Science Institute Director, Virtual Astronomical Observatory.
CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Data Archives: Migration and Maintenance Douglas J. Mink Telescope Data Center Smithsonian Astrophysical Observatory NSF
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Virtual Observatories, Press Release Images, and Web Services Dr. Frank Summers Space Telescope Science Institute November 3, 2005.
AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
Nov Virtual Astronomical Observatory (VAO) Gretchen Greene.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
February 12, 2002Tom McGlynn ADEC Interoperability Technical Working Group Report.
Moving towards the Virtual Observatory Paolo Padovani, ST-ECF/ESO
National Virtual Observatory
Long-Term Preservation of Astronomical Research Results
Google Sky.
Presentation transcript:

2 Dec 2004 Technology Open House The National Virtual Observatory T HE US N ATIONAL V IRTUAL O BSERVATORY Bob Hanisch Gretchen Greene Wil O’Mullane

2 Dec 2004 Technology Open House Abstract The National Virtual Observatory has been under development for three years, and is now at the point of making its first release of applications software and tools to the astronomy community. The team will describe the main technology development areas of the VO and demonstrate some of the tools that will be released for general community use in conjunction with the January AAS meeting. We will also briefly describe the software development toolkit that we assembled for the NVO Summer School, which includes software libraries and sample code for VO-compatible data publication and retrieval.

2 Dec 2004 Technology Open House Astronomy is facing a data avalanche Multi-Terabyte (soon: multi- Petabyte) sky surveys and archives over a broad range of wavelengths Billions of sources, hundreds of attributes per source 1 nanoSky (HDF-S) 1 microSky (DPOSS)

2 Dec 2004 Technology Open House The changing face of observational astronomy Large digital sky surveys are becoming dominant source of data in astronomy: > 100 TB, growing rapidly –SDSS, 2MASS, DPOSS, GSC, FIRST, NVSS, RASS, IRAS, QUEST, GALEX, SST; CMBR experiments; Microlensing experiments; NEAT, LONEOS, and other searches for Solar system objects –Digital libraries: ADS, astro-ph, NED, CDS, NSSDC –Observatory archives: HST, CXO, space and ground-based –Future: PanSTARRS, LSST, and other synoptic surveys; astrometric missions, GW detectors Data sets orders of magnitude larger, more complex, more homogeneous than in the past Roughly 1 TB/Sky/band/epoch –Human Genome is < 1 GB, Library of Congress ~ 20 TB

2 Dec 2004 Technology Open House Toward a “new astronomy” Past: Observations of small, carefully selected samples (often with a priori prejudices) of objects in one or a few wavelength bands Future: Multi-wavelength data for millions of objects, allowing us to –Discover significant patterns from the analysis of statistically rich and unbiased image/catalog databases (e.g., Gunn-Peterson effect in high-z quasars) –Understand complex astrophysical systems via confrontation between data and sophisticated numerical simulation Discovering new phenomena and patterns in these datasets will require simultaneous access to multi-wavelength archives, advanced visualization and statistical analysis tools

2 Dec 2004 Technology Open House Motivation National Academy of Sciences Decadal Survey recommended NVO as highest priority small (<$100M) project “ Several small initiatives recommended by the committee span both ground and space. The first among them—the National Virtual Observatory (NVO)—is the committee’s top priority among the small initiatives. The NVO will provide a “virtual sky” based on the enormous data sets being created now and the even larger ones proposed for the future. It will enable a new mode of research for professional astronomers and will provide to the public an unparalleled opportunity for education and discovery.” —Astronomy and Astrophysics in the New Millennium, p. 14

2 Dec 2004 Technology Open House History 1990s: NASA establishes wavelength-oriented science archive centers; multiple large ground-based digital sky survey projects initiated (following 1988 Astrophysics Data System report) April 1999, Decadal Survey Panel on Theory, Computation, and Data Discovery met in Los Alamos –Szalay, Prince, and Alcock coin the name “National Virtual Observatory” November 1999, NVO organizational workshop at JHU February 2000, 2 nd NVO workshop at NOAO-Tucson June 2000, conference held at Caltech, “Towards a Virtual Observatory” June 2000, ad hoc steering committee formed February 2001, AASC/NAS report “Astronomy and Astrophysics in the New Millennium” released April 2001, proposal submitted to NSF ITR program, 17 collaborating organizations, led by A. Szalay (JHU) September 2001, NSF announces proposal selection January 2003, first NVO science prototypes shown at Seattle AAS

2 Dec 2004 Technology Open House What is the Virtual Observatory… and what it is not… The VO is: A set of international standards to share complex data A modular set of tools to work with distributed data A simple environment to publish data to An essential part of the research astronomer’s toolkit A catalyst for world-wide access to astronomical archives A vehicle for education and public outreach The VO is not: A replacement for building new telescopes and instruments A centralized repository for data A data quality enforcement organization

2 Dec 2004 Technology Open House Who is the National Virtual Observatory? US NVO development project, funded by NSF Information Technology Program and managed by NSF Astronomy Division, is entering 4 th year of 5-year project Funding is $10M+ over the 5 years 17 organizations (astro, CS, IT) involved –JHU (PI Alex Szalay), STScI, Caltech (Astronomy, IPAC, CACR), HEASARC, SAO, NRAO, NOAO, NCSA, SDSC, FNAL, USNO, et al. Collaboration being extended to Gemini Science Archive, LSST, Keck

2 Dec 2004 Technology Open House International collaboration NVO is co-founder of the International Virtual Observatory Alliance IVOA now has 15 member projects Adopted a standards process based on W3C Forum for technical development, working groups, discussion and sharing of experience

2 Dec 2004 Technology Open House Exposure NVO Summer School (Sept. 2004, Aspen) trained 40 students and software developers in VO tools and technologyNVO Summer School Special Session scheduled for January 2005 AAS meeting: Astronomical Research with the Virtual Observatory; includes several papers based on Summer School projects (environments of radio galaxies, starburst galaxies)Astronomical Research with the Virtual Observatory IAU Joint Discussion on Future Large Telescopes and the Virtual Observatory (July 2003, Sydney)IAU Joint Discussion on Future Large Telescopes and the Virtual IAU Symposium being proposed for 2006 (Prague)

2 Dec 2004 Technology Open House Science prototypes Science demonstrations show capabilities of new infrastructure, motivate and guide technical developments. For example: –Data discovery, multi-λ comparisons –Search for brown dwarfs –Galaxy morphologies in clusters –Globular cluster simulations

2 Dec 2004 Technology Open House Science results Padovani et al. (2004)) demonstrates that VO tools are mature enough to produce cutting-edge science results by exploiting astronomical data beyond classical identification limits (R  25)Padovani et al. (2004)

2 Dec 2004 Technology Open House Science results McGlynn et al. (2004) classified all unidentified ROSAT WGACAT objects using VO data access methods to cross- correlate multi- wavelength catalogs –Technique applied to find candidate X-ray binaries and now to SDSS photometric catalog More than 400 papers related to “virtual observatory” in ADS

2 Dec 2004 Technology Open House Technology development Resource registries Data models Content description (UCDs) Data access layer (SIAP, SSAP, cone search) VO Query Language (ADQL, OpenSkyQuery) VOTable Grid and Web Services Activities can be followed on IVOA web (

2 Dec 2004 Technology Open House Software toolkit Assembled software development toolkit for NVO Summer School –AXIS (Java web services) –ANT (Java-based software build tool) –Mirage, Topcat, VOPlot applications –Sample data files STScI Web Services course ( STWebServicesCource) STWebServicesCource See school/proceedings/software/index.htmlhttp://us-vo.org/summer- school/proceedings/software/index.html Summer School proceedings available at vo.org/summer-school/proceedings/index.cfmhttp://us- vo.org/summer-school/proceedings/index.cfm

2 Dec 2004 Technology Open House Capabilities Tools and applications available at Data location and access –Resource registry (yellow pages) has thousands of catalogs and archives and is easily extendedResource registry –DataScope uses registry to locate data and allow user to display or download data of interest; can cache results on popular objects or for transient eventsDataScope Spectrum and filter database and analysis toolsSpectrumfilter HST/MAST VO services Catalog cross-correlation (test version)Catalog cross-correlationtest version SDSS web services Dynamic source-list generation and cross-correlation Visualization of tabular, spectral, and imaging datatabularspectralimaging Source classification Try these yourself at

2 Dec 2004 Technology Open House Future VO-enabled science January 2005: software release in conjunction with AAS, international data access through standard registries –Applications you have just seen January 2005 AVO demos focusing on dynamic generation of SEDs for galaxies and comparisons with stellar spectral evolution models, and search for stars in transition from AGB to PN (unidentified IR sources); seeJanuary 2005 AVO demos TeraGrid-based analyses (CPU time already allocated): standard “sky atlas” spatial sampling and data federation, galaxy SED fitting, image mosaicing, quasar spectral modeling, N-point correlation function for SDSS galaxies, CMB modelingTeraGrid-based analyses

2 Dec 2004 Technology Open House Future VO-enabled science NVO applications for TBD in consultation with Science Steering Committee –Dynamic time series analysis, period fitting –“VO-Google” –Fast data inventory service –Flux-recovery service –Image registration and subtraction services –VO integration with legacy software systems (web service interfaces, data access) –Datamining and data federation on increasingly large, distributed databases

2 Dec 2004 Technology Open House STScI/JHU activities NVO project management Technical development –Resource metadata and registry services –OpenSkyNodes (GALEX, HDF, UDF, GOODS) –HST/MAST catalog and image services with VOTable support and direct links to VOPlot –Links to/from the literature, ADS Collaboration with GOODS team on catalog and image cutout services Collaboration with JHU/SDSS personnel; joint technical discussions, augmented by co-location in Bloomberg building Subscribe to

2 Dec 2004 Technology Open House Ear to the ground NSF and NASA working to create joint program; draft RFP could be available as soon as next spring –Agency support is firm, but not unwavering Continuing to build community support from the ground up –Demonstrations –Software releases –Summer School –EPO partnerships

2 Dec 2004 Technology Open House Next steps Submitted white paper “The National Virtual Observatory: From Framework to Facility” to NSF and NASA this past summer –Suggests responsibilities and scope for eventual NVO operational (distributed) facility –Suggests smaller, tighter collaboration –Describes several possible management models, advocates management by consortium –Urges creation of joint NSF/NASA/other program to provide single point of contact for funding

2 Dec 2004 Technology Open House Summary $10M committed in US, >$40M worldwide, to VO development Active international community is working and meeting regularly to establish the VO Major archives and catalogs available through VO and more coming Refereed research papers utilizing VO now beginning to appear

2 Dec 2004 Technology Open House