1. Science Archive for Sky Surveys Data Providers and the VO - NeSC 2003 March Wide Field Astronomy Unit Institute for Astronomy

2. Data Sources UKIRT Wide-Field Camera (WFCAM) early 2004 –100 GB/night (four 2048 x 2048 infrared arrays) –~24 TB/year pixel data + ~2 TB/year object data from data-reduction pipeline operated by CASU VISTA Infrared camera from 2006-07 400 GB/night (sixteen 2048 x 2048 infrared arrays) ?? from a future optical camera...

3. What is the Science Archive? Not a simple repository of data, but a system that: enables access to large data volumes provides reduced-size results sets provides tools to enable science exploitation can become part of a Virtual Observatory

4. Design approach Requirements & specification developed in collaboration with stakeholders (UKIDSS &c) Design governed by agreed requirements Build on existing experience (e.g. SSS, 6dF GS) Scalability..........

5. Phased approach V1 Archive System for WFCAM first light Jan 2004 V2 one year after survey operations begin allowing further studies of DBMS scalability V3 Grid-enabled, at some future point

6. Overall project plan VISTA first light

7. Version 1 Archive System Following SDSS DR-1 (not EDR) for catalogues: “SkyServer” system employing MS SQL Server running on W2K PC(s); browser-based GUIs with clickable options and SQL editor Additional simple web-page interfaces for pixel data Facilities for joins with other catalogues e.g. 2MASS

8. SSS pixel data interface WWW interface to extract pixel or object data by (RA,Dec) selection Or, access via CDS Aladin tool

9. SSS pixel/obj data interface After extracting data from WWW interface, upload them straight into GAIA.

10. Form access to 6dFGS generates SQL for you

11. e.g. choose table from menu

12. and get the results

13. or write SQL directly

16. Migrate SSS to SQL Server DB Schemas for SSS developed subset of SSS installed on a laptop Put SSS catalogue data in SQL Server to gain experience and test scalability in preparation for Version 1 of Archive

17. SSS SQLServer database ultimate SSS archive and precursor to WFCAM/VISTA

18. Version 2.0 and beyond Version 2.0 will, in addition to V1.0: - enhanced GUI functionality (e.g. plotting) - on-the-fly cats and pix over arbitrary areas - generate stacked frames with user-specified options - provide new source extraction options Version 3.0 will, in addition to V2.0: - return data in VOTable using VO transfer protocols - recast the online services as web services - develop (or install) advanced visualisation tools - develop (or install) advanced analysis tools - allow upload of user analysis codes - ……

19. Remote client GUI access SDSS JavaQT Complex queries using SQL