1 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID eScience: making the most advanced tools of IT available to scientists.

Slides:

Advertisements

Similar presentations

8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.

Advertisements

The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.

GMD German National Research Center for Information Technology Darmstadt University of Technology Perspectives and Priorities for Digital Libraries Research.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Why Grids Matter to Europe Bob Jones EGEE.

Jens G Jensen Atlas Petabyte store Supporting Multiple Interfaces to Mass Storage Providing Tape and Mass Storage to Diverse Scientific Communities.

CCGrid2013 Panel on Clouds Henri Bal Vrije Universiteit Amsterdam.

CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.

ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.

Using Sakai to Support eScience Sakai Conference June 12-14, 2007 Sayeed Choudhury Tim DiLauro, Jim Martino, Elliot Metsger, Mark Patton and David Reynolds.

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

Long-Term Preservation of Astronomical Research Results Robert Hanisch US National Virtual Observatory Space Telescope Science Institute Baltimore, MD.

The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.

Planning for the Virtual Observatory Tara Murphy … with input from other Aus-VO members …

Modelling and Simulation for e-Social Science (MoSeS) Mark Birkin, Martin Clarke, Phil Rees, Andy Turner, Belinda Wu (School of Geography) Haibo Chen (Institute.

Panel Summary Andrew Hanushevsky Stanford Linear Accelerator Center Stanford University XLDB 23-October-07.

A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.

18:15:32Service Oriented Cyberinfrastructure Lab, Grid Deployments Saul Rioja Link to presentation on wiki.

Event Metadata Records as a Testbed for Scalable Data Mining David Malon, Peter van Gemmeren (Argonne National Laboratory) At a data rate of 200 hertz,

E. Solano Centro de Astrobiología (INTA-CSIC) I.P. Observatorio Virtual Español El Observatorio Virtual: una infraestructura básica para la investigación.

F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,

Virtual Observatory & LIGO Roy Williams California Institute of Technology.

Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.

HAH 2007/05/09 Connecting LOFAR to the GRID Hanno Holties, ASTRON IVOA - OGF Astro-RG Work Shop Manchester, 9th May 2007.

4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.

July 16, 2004P. Padovani, NEON Archive School Science with multi-wavelength Archival Data Paolo Padovani (ESO) Virtual Observatory Systems Department &

EScience May 2007 From Photons to Petabytes: Astronomy in the Era of Large Scale Surveys and Virtual Observatories R. Chris Smith NOAO/CTIO, LSST.

The GRelC Project: architecture, history and a use case in the environmental domain G. Aloisio - S. Fiore The Climate-G testbed is an interdisciplinary.

The Virtual Observatory Europe and the VO: the Astrophysical Virtual Observatory and the EURO-VO Astrophysical Virtual Observatory and the EURO-VO Paolo.

CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.

1 European e-Infrastructure experiences gained and way ahead OGF 20 / EGEE User’s Forum 9 th May 2007 Mário Campolargo European Commission - DG INFSO Head.

EURO-VO Structure Data Centre Alliance (DCA) A collaborative and operational network of European data centres who, by the uptake of new VO technologies.

Known Territories l There are several ways that Globus software has been used that are well-trod paths u General-purpose Grid infrastructures u Domain-specific.

Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.

Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.

Interoperability from the e-Science Perspective Yannis Ioannidis Univ. Of Athens and ATHENA Research Center

AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.

The International Virtual Observatory Alliance (IVOA) interoperability in action.

Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.

Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”

Scientific Workflow systems: Summary and Opportunities for SEEK and e-Science.

German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.

21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.

7. Grid Computing Systems and Resource Management

Strasbourg, EURO-VO DCA First Board Meeting (GA)VO projects at MPG(E) and participation in VO-DCA (tbcd) Wolfgang Voges, Gerard Lemson.

A centre of expertise in digital information management Shaping the e-future? Grids, Web Services and Digital Libraries Professor Tony.

The Large Synoptic Survey Telescope Project Bob Mann Wide-Field Astronomy Unit University of Edinburgh.

Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.

Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Outcome of the EuroVO-DCA WP5 Activities.

Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.

F. Genova, AstroNET meeting, Poitiers The Astrophysical Virtual Observatory.

14, Chicago, IL, 2005 Science Gateways to DEISA Motivation, user requirements, and prototype example Thomas Soddemann, RZG, Germany.

The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!

EGEE is a project funded by the European Union under contract IST Generic Applications Requirements Roberto Barbera NA4 Generic Applications.

Collection-Based Persistent Archives Arcot Rajasekar, Richard Marciano, Reagan Moore San Diego Supercomputer Center Presented by: Preetham A Gowda.

Fedora Commons Overview and Background Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.

RI EGI-InSPIRE RI Astronomy and Astrophysics Dr. Giuliano Taffoni Dr. Claudio Vuerli.

Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.

Virtual Laboratory Amsterdam L.O. (Bob) Hertzberger Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit van Amsterdam.

Tools and Services Workshop

Joslynn Lee – Data Science Educator

aspects of archive system design

Building a worldwide interoperable data infrastructure for astronomy: the International Virtual Observatory Alliance SciDataCon 2016, Denver, 13/Sept/2016.

Applications Using the EGEE Grid Infrastructure

Concluding Remarks Paolo Padovani Head, Virtual Observatory Project Office, ESO, Garching bei München, Germany & EURO-VO Facility Centre.

Grid Application Model and Design and Implementation of Grid Services

Web archives as a research subject

Fabio Pasian, Marco Molinaro, Giuliano Taffoni

Presentation transcript:

1 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID eScience: making the most advanced tools of IT available to scientists supercomputers data mining semantic web && more defining the advanced challenges for IT development (astronomy) data streams of > 100 Gbit/s distributed data sets > 100 Petabytes multi-layered, multi-dimensional

2 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID Grid History: development was driven by High Energy Physics -only few data sources - clearly structured data - well known methods of data handling: (Monte Carlo simulations with data slices) Earth & climate science with a narrowed set of data followed suit

3 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID Pre VO history: Multiple archives Multiple data sources Insufficient data exchange protocols (except FITS) Scientific methods not shaping up to data sizes

4 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID VO history: Multi wave length view Standards for publishing data Standards for exchanging data New tools building on these standards Concepts as VOSpace, SingleSignOn Focus on Domain perspective (AstroRG in OGF)

5 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID AstroGrid-D: Experience in running the community grid Basic infrastructure components ready for real science cases Heading for a sustainable way to run the grid for Astronomy in Germany Smoothing the path to Grid usage for the community

6 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID AstroGrid-D: Development focus for new proposal Virtual Data Center  Distributed data (storage locations)  Based on grid-infrastructure  Providing advanced methods  data-stream management  publish / subscribe facilities  Long Term Archiving  Efficient data processing

7 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID Cooperation with GAVO (VDZ-Proposal) Indexing and Metadata extraction service Combining VOSpace and Grid Storage VOQL support for VDZ Tools collection combining IVOA registry and Grid registry

8 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID Cooperation with GAVO Publishing new archives (+ mining tools) Simulation archives Combined service offers (e.g.: LBTB data) Running VO tools on Grid (T. Rauch’s Spectra service) Supporting German consortia for LOFAR, LSST, PanSTARRS on data management and data minig issues