Data Centre Activities at Leicester LEDAS and Swift UKDC AstroGrid Consortium Meeting: 11 July 2005.

Slides:

Advertisements

Similar presentations

Data mirrors: Techniques and Issues

Advertisements

What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.

The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.

A PPARC funded project The Grid Data Warehouse Description of prototype work in progress by AstroGrid. Access-Grid lecture to Universities of Leeds and.

Development of China-VO ZHAO Yongheng NAOC, Beijing Nov

DEPARTMENT OF PHYSICS AND ASTRONOMY Professor Bob Warwick Head of Department.

Saving Time and Money The Future of Data For the CIO.

A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

National Astronomy Meeting 5 th April 2006 The X-Ray Synoptic Viewer: X-Ray Data Access and Reduction in the Virtual Observatory Duncan Law-Green (LEDAS:

Long-Term Preservation of Astronomical Research Results Robert Hanisch US National Virtual Observatory Space Telescope Science Institute Baltimore, MD.

Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.

Leicester Database & Archive Service J. D. Law-Green, S. W. Poulton, J. Osborne, R. S. Warwick Dept. of Physics & Astronomy, University of Leicester LEDAS.

AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.

Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.

Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.

X-ray Astronomy School 2007 Databases, software, etc. for X-ray astronomy Keith Arnaud NASA Goddard University of Maryland.

Solar-B Global DataGrid 21 st September 2006 UK e-Science All Hands Meeting 2006 RALMSSL Tim Folkes Elizabeth Auden Jens Jensen Paul Lamb Matthew WildMatthew.

A PPARC funded project AstroGrid Architecture Consortium Meeting, Leicester, 3 rd Nov 2003.

A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.

AstroGrid Datacenters ESO M Hill (ROE), Aug 2004.

EdSkyQuery-G Overview Brian Hills, December

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.

Swift HUG 14 Feb Swift archive Lorella Angelini/HEASARC.

Science Archive for Sky Surveys Data Providers and the VO - NeSC 2003 March Wide Field Astronomy Unit Institute for Astronomy.

VOTech Stage 1 Meeting, DS4 User Tools, Univ. Leicester, 22-Feb-2005 VOTech DS4 Welcome to: DS4 * User Tools WP Manager Markus Dolensky, ESO * DS... Design.

Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.

AstroGrid: Science Use Ready AstroGrid: Science Use Ready Nicholas Walton AstroGrid Project Scientist IoA, Cambridge A PPARC funded project.

SDSS-KSG 08 Workshop1 The SDSS DR7 and KIAS SDSS mirror Won-Kee Park ARCSEC, Sejong University 2008 SDSS-KSG Workshop.

NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.

How to Adapt existing Archives to VO: the ISO and XMM-Newton cases Research and Scientific Support Department Science Operations.

AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.

The SOC Pilot and the ATOA Jessica Chapman CASS Observatory Operations Research Program Leader 28 June 2011.

The DARTS database Yoshihiro Ueda (ISAS) on behalf of the PLAIN members

A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.

Strasbourg astronomical Data Centre (DS) Françoise GENOVA.

1 27-Apr-2004AstroGrid Consortium Meeting - PL talk Agenda Tuesday status review / goals / science Lunch + AGLI Itn-05 review Dinner at Coton (share.

AstroGrid: The UK’s Virtual Observatory Dr Dugan Witherick – Astrophysics Group, UCL Wednesday 5 th December 2007 The University of Warwick.

X-Ray Data Archives X-Ray Data Archives

Astronomical Data Archiving and Curation Clive Page AstroGrid Project University of Leicester 2004 March 22.

A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.

The Virtual Observatory Europe and the VO: the Astrophysical Virtual Observatory and the EURO-VO Astrophysical Virtual Observatory and the EURO-VO Paolo.

GLAST Science Support CenterJuly, 2003 LAT Ground Software Workshop Status of the D1 (Event) and D2 (Spacecraft Data) Database Prototypes for DC1 Robert.

Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,

HEASARC and Related Data Center Activities Nicholas White HEASARC Director.

Swift HUG April Swift data archive Lorella Angelini HEASARC.

EURO-VO Structure Data Centre Alliance (DCA) A collaborative and operational network of European data centres who, by the uptake of new VO technologies.

+ SUH Incorporated Executive Briefing. + SUH Business Opportunity I.T. solutions are needed to improve SUH’s ability to operate Sales Support team would.

1 08 -Feb-2005Andy Lawrence : Planning Meeting, Leicester AG2 Cycle-1 Planning meeting AG1 feedback AG2 and VOTECH status Cycle-1 plans.

A PPARC funded project Tony Linde Programme Manager AG-SAG FM5: AG2/VOTech Scope & Targets Glasgow, 7 Feb 2005 VOTech Project.

06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.

AstroGrid Usability & Docs, JBO, 6 th Dec 2005 Jonathan Tedds Leicester University AstroGrid Usability & Documentation Usability –Documentation –Infrastructure.

The HEASARC Coordinate data, software, and media standards with other astrophysics sites. Established December 1990 The HEASARC Charter: Maintain and disseminate.

AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.

The Large Synoptic Survey Telescope Project Bob Mann Wide-Field Astronomy Unit University of Edinburgh.

1 ISO WAF Community Catalog Product Access Servers Registry Clearinghouse(s) GEO Portals Community Portals Users Client Apps GetCapabilities ISO

Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.

1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.

X-ray Astronomy School 2005 Databases, software, etc. for X-ray astronomy Keith Arnaud NASA Goddard University of Maryland.

HEASARC and Related Data Center Activities Frank Marshall Acting HEASARC Director.

A PPARC funded project PM Report Grid Steering Committee MRC, London 18-Feb-2004.

1 14-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh Meeting Goals review achievements review architecture identify targets for AG2 and.

AstroGrid & VO Structure NeSC, Edinburgh 21-March-2003 UK Astronomical Data Centres.

1 18-Feb-2004AstroGrid-2 plans Deployment Propose is the main focus of Iteration-6.

Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.

MSSL Astrogrid Workshop

The CSIRO ASKAP Science Data Archive Progress and Plans

HYCOM CONSORTIUM Data and Product Servers

Presentation transcript:

Data Centre Activities at Leicester LEDAS and Swift UKDC AstroGrid Consortium Meeting: 11 July 2005

LEDAS homepage What is LEDAS? UK’s high-energy astrophysics data centre, located at Leicester In continuous operation since Current data holdings >1.6TB processed and calibrated bulk data from several major X-ray astronomy satellites (Einstein, EXOSAT, ROSAT, Ginga, ASCA, XMM-Newton, Chandra). Access to >400 astronomical catalogues and reference data (spectral line lists) Database search and display facilities developed in- house (ARNIE5) DBMS: HEASARC Browse (legacy), TDB binary, Sybase (Chandra mirror), MySQL. Successful, attracting >250,000 hits/month in Q1 2005, c.f. 2 million hits/month for SDSS SkyServer.

AstroGrid Deployment at LEDAS Feb 04:Itn05 PAL test implementation, legacy hardware, work incomplete Mar 04: Purchase of new server “Galahad” (Dual Xeon 2.6, 2GB RAM, 1TB RAID) Jul 04:Further work with Itn05. Some LEDAS MySQL tables copied to Galahad. PAL installed. Successful test deployment of one catalogue table (HEASARC Master Optical, ~4 million rows) Feb 05: Leicester AG staff begin using Galahad for v1.0 release work. v1.0 components installed on Galahad: Registry, XrayDSA, FileStore, JES. Registry: operational XrayDSA: work in progress (building metadata) Future: SIA/SSA for bulk data Support for Swift UKDC (Cat’s already in ARNIE5) LEDAS-branded portal for high-energy data Community for high-energy researchers High-energy science workflows

grid.ledas.ac.ukwww.ledas.ac.ukwww.swift.ac.uk application server xraydsa (middleware) MySQL (~400 ARNIE5 tables) webserver + PHP MySQL (~400 ARNIE5 tables) webserver + PHP MySQL Swift Archive tables galahad lyonesse avalon Astrogrid WWW HEASARC Penn State catalogue updates (‘TDATs’) via FTP pull archive updates via DTS Dataflows in LEDAS and Swift Data Centre burst coords

LEDAS & Swift UKDC: A Common Infrastructure LEDAS and Swift UKDC use common software infrastructure Separate hardware, but same DBMS (MySQL) and catalogue table/metadata structures Swift UKDC middleware code for search and display of archive data is fork of LEDAS code LEDAS staff experienced with VO deployment, AG and VOTECH staff onsite to assist. DSA already proven working with LEDAS. Implementation on Swift UKDC should be straightforward. …watch this space!