Sky Survey Database Design National e-Science Centre Edinburgh 8 April 2003.

Slides:

Advertisements

Similar presentations

Microsoft Research Microsoft Research Jim Gray Distinguished Engineer Microsoft Research San Francisco SKYSERVER.

Advertisements

Trying to Use Databases for Science Jim Gray Microsoft Research

Online Science -- The World-Wide Telescope Archetype

World Wide Telescope mining the Sky using Web Services Information At Your Fingertips for astronomers Jim Gray Microsoft Research Alex Szalay Johns Hopkins.

1 Online Science the New Computational Science Jim Gray Microsoft Research Alex Szalay Johns Hopkins.

1 Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research Talk at

1 Online Science -- The World-Wide Telescope as an Archetype Jim Gray Microsoft Research Collaborating with: Alex Szalay, Peter Kunszt, Ani

1 Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research

Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research

1 Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research

Astronomy Data Bases Jim Gray Microsoft Research.

AstroGrid Consortium Meeting PM Report AstroGrid Consortium Meeting Overview Activities Finance Recruitment Collaboration Phase B.

National Center for Supercomputing Applications 259 th fastest computer in the world Michael Remijan NCSA –Research Programmer –Web-based Distributed Programming.

Virtual Observatory & Grid Technique ZHAO Yongheng (National Astronomical Observatories of China) CANS2002.

The aims of SC4DEVO and SC4DEVO-1 Bob Mann Institute for Astronomy and National e-Science Centre, University of Edinburgh.

Fundamentals, Design, and Implementation, 9/e Chapter 1 Introduction to Database Processing.

Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

BinX and Astronomy Bob Mann Institute for Astronomy and National e-Science Centre.

18 April 2007 Second Generation VLT Instruments 1 VIRCAM & CPL: Lessons Learned Jim Lewis and Peter Bunclark Cambridge Astronomy Survey Unit.

Data provenance in astronomy Bob Mann Wide-Field Astronomy Unit University of Edinburgh

Requirements from astronomy in the Virtual Observatory era Bob Mann Institute for Astronomy & NeSC University of Edinburgh.

Mini-workshop: e-Science & Data Mining. e-Science & Data Mining Special Interest Group Bob Mann Institute for Astronomy & NeSC University of Edinburgh.

VO as a Data Grid, NeSC ‘03 WFCAM Science Archive Nigel Hambly Wide Field Astronomy Unit Institute for Astronomy, University of Edinburgh.

Introduction to Sky Survey Problems Bob Mann. Introduction to sky survey database problems Astronomical data Astronomical databases –The Virtual Observatory.

Ling Guo Feb 15, 2010 Database(RDBMS) Software Review Oracle RDBMS (Oracle Cooperation) 4()6 Oracle 10g Express version DB2 (IBM) IBM DB2 Express-C SQL.

A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.

E-Science: Stuart Anderson National e-Science Centre Stuart Anderson National e-Science Centre.

Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.

Introduction to Database Systems Motivation Irvanizam Zamanhuri, M.Sc Computer Science Study Program Syiah Kuala University Website:

HP e3000 Migration Seminar Jean-Pierre (JP) Fortin ADT Worldwide Solution Architect.

Alex Szalay, Jim Gray Analyzing Large Data Sets in Astronomy.

EdSkyQuery-G Overview Brian Hills, December

CS461: Principles and Internals of Database Systems Instructor: Ying Cai Department of Computer Science Iowa State University Office:

Talk structure who are we ? what is a VO ? what are the challenges ? what is an e-project ? Andy Lawrence Garching June 2002.

Science Archive for Sky Surveys Data Providers and the VO - NeSC 2003 March Wide Field Astronomy Unit Institute for Astronomy.

Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.

NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.

Public Access to Large Astronomical Datasets Alex Szalay, Johns Hopkins Jim Gray, Microsoft Research.

WFCAM Science Archive Critical Design Review, April 2003 The SuperCOSMOS Science Archive (SSA) WFCAM Science Archive prototype Existing ad hoc flat file.

The Data Avalanche Jim Gray Microsoft Research Talk at HP Labs/MSR: Research Day July 2004.

Handling complexity (mess?) integration or federation Stephen Todd IBM WebSphere MQ e-Science Institute: Edinburgh 14 October 2003 The opinions expressed.

Science In An Exponential World Alexander Szalay, JHU Jim Gray, Microsoft Reserach Alexander Szalay, JHU Jim Gray, Microsoft Reserach.

EScience May 2007 From Photons to Petabytes: Astronomy in the Era of Large Scale Surveys and Virtual Observatories R. Chris Smith NOAO/CTIO, LSST.

Astronomical Data Archiving and Curation Clive Page AstroGrid Project University of Leicester 2004 March 22.

1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.

NVO Review -- San Diego Jan The VO compared to Other O‘s Jim Gray Microsoft T HE US N ATIONAL V IRTUAL O BSERVATORY.

SkyServer: Public Access to the Sloan Digital Sky Survey Alex Szalay, Jim Gray, Ani Thakar, Peter Kunszt, Tanu Malik, Tamas Budavari, Jordan Raddick, Chris.

Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid

Database Administration An Introduction Database Processing DBA Introduction.

Real Web Services Jim Gray Microsoft Research 455 Market St, SF, CA, Talk at Charles Schwab.

Introduction to the Microsoft Access Database Why use Microsoft Access.

Edinburgh e-Science MSc Bob Mann Institute for Astronomy & NeSC University of Edinburgh.

Mining real world data RDBMS and SQL. Index RDBMS introduction SQL (Structured Query language)

1 Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research

Microsoft “information at your fingertips” for scientists Collaborating with Scientists to build better ways to organize, analyze, and understand.

NeSC/eDIKT & AstroGrid Phase B NeSC and IBM Grid work NeSC and IBM Grid work NeSC/WFAU sky survey DB design work NeSC/WFAU sky survey DB design work Astro-related.

CS240A: Databases and Knowledge Bases Temporal Databases Carlo Zaniolo Department of Computer Science University of California, Los Angeles.

An Automated Classification Algorithm for Multi-wavelength Data Yanxia Zhang, Ali Luo,Yongheng Zhao National Astronomical Observatories, China ,

Annotation of “special structures” in astronomy Bob Mann Institute for Astronomy and National e-Science Centre University of Edinburgh.

Microsoft Research San Francisco (aka BARC: bay area research center) Jim Gray Researcher Microsoft Research Scalable servers Scalable servers Collaboration.

DBM 380 Week 2 Individual Assignment Database Design Paper Write a 350- to 700-word paper in which you do the following: Explain what database systems.

Critical Design Review, April 2003

Understanding the nature of matter -

K-Plex, Inc. We Develop Technology for… Personalization Integration

Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research

Integrating with LexisNexis InterAction

"שינוק", אלוף העולם בדמקה לאדם ולמכונה זיו בן-אליהו

نحو مفهوم شامل للجودة ومتطلبات التأهيل للأيزو

Jim Gray Microsoft Research

Presentation transcript:

Sky Survey Database Design National e-Science Centre Edinburgh 8 April 2003

Agenda Start Welcome, introductions & goals – Bob Mann Sky survey databases – problems Introduction – Bob Mann Recent/current work in Edinburgh – Nigel Hambly Thoughts on spatial indexing – Clive Page, Bob Mann Lunch Sky survey databases – solutions Oracle AstroGrid testbed – Ian Carney Discussion What to do, when and how? (15.00 Tea) Close…beer?

Meeting goals Aid DBMS choice for new Edinburgh databases –WFCAM & VISTA Science Archives (WSA, VSA) –Use SQL Server, learn about DB2 & Oracle Investigate possibilities for collaboration in areas of mutual interest Investigate possibilities for collaboration in areas of mutual interest –Large, spatial, distributed databases –DBMS integration into web/Grid service framework

Why Astronomy Data? Why Astronomy Data? It has no commercial value –No privacy concerns –Can freely share results with others –Great for experimenting with algorithms It is real and well documented –High-dimensional data (with confidence intervals) –Spatial data –Temporal data Many different instruments from many different places and many different times Federation is a goal The questions are interesting –How did the universe form? There is a lot of it (petabytes) IRAS 100  ROSAT ~keV DSS Optical 2MASS 2  IRAS 25  NVSS 20cm WENSS 92cm GB 6cm Slide from Jim Gray (Microsoft Research)

Meeting goals (cont’d) Anything else? –What do our IBM & Oracle colleagues want: from today? from today? from interaction with astronomers? from interaction with astronomers?