1. COMPASS Database SPACE TELESCOPE SCIENCE INSTITUTE Gretchen Greene
Operated for NASA by AURA
COMPASS Database
Gretchen Greene 1

2. COMPASS - (Catalogs of Objects and Measured Parameters for All-Sky Surveys)
Key Element for GSC 2 catalog production
Online access to processed plate data
Identification of unique sources
Cross-indexing of multiple observations
Overlapping photographic plates
Multiple epochs
Global recalibration capability
GSC 2 is exported from COMPASS
One of the first large-scale astronomical archives
Estimated 2 billion objects, 10 billion sources/entries
4 TB catalog derived from 8 TB image archive!
Collaborative project with OATo and SDSS Science Archive
12/7/2018

3. Highlights since the 1999 Meeting
Moved to a new server, fully online database
10X I/O boost, 5X CPU gain in performance
Dell NT Server with 2 TB RAID Array
HSM system proved inadequate for required migration rates
Expertise spread in multiple areas: configuration, development, and database administration
Production operations stabilized
Integration with plate processing, utilities, streamlined
New APIs: GSPC2, gsh metadata loading developed
User Interfaces developed for QA and cross-correlation to external archives – Beta versions
CIQA IDL/C++ and ShowSky Java-RMI, Jini
12/7/2018

4. COMPASS Server with RAID
100 Mb Network
CHART
12/7/2018

5. Database Hierarchy [ COMPASS Federated Database ] 12/7/2018
HTM Region Database
for each of regions
Plate Database
PlateInfoContainer
GSH
for each plate
RegionInfoContainer
RegionCatalogContainers
for each plate section within region
Plate Source Objects
SourceIndex
Page = Federated Database
Redundant, but shows how the overall model fits into the Objectivity hierarchy. Simplified view.
We were able to extend this model to another proposed space mission project (GAIA). Rather than plates, there was an
instrumental time interval class, and then the ephermerides
(planetary motion ).
Section of reference catalog within region
= Database
GSPC2
= Container
= Class/Basic Object
[ COMPASS Federated Database ]
12/7/2018

6. Production Status 2576 Plates Loaded 2313 Plates Cross Matched
1.484 Billion plate observations
2313 Plates Cross Matched
730 Million Unique sources identified
Apply Calibrations task implemented
improved photometry
Calibration FDB ~ 40+ plates (2% of sky)
Metric - Average 20+plates/day load and match
Automated Full Backup with each delivery
0.01% database corruption
discovered with GSC2.1.1 Colour Task and GSC-2 Export
12/7/2018

7. Sky Coverage...
XP, ER, and XS are plotted in red, XJ, or S plates are plotted in blue, and the remaining short and intermediate exposure plates are plotted in yellow.
12/7/2018

8. COMPASS User Interfaces
CIQA - see OATo presentation
ShowSky –Java tool developed with Wil O’Mullane
Jini capable
multiple catalogs accessed remotely
12/7/2018

10. Filterable Catalog Retrieval
12/7/2018

11. Development Expansion to 4TB system Production operations utilities
gsh MetaData production load
Reference catalog loading and cross-matching
GSPC2 production FDB load pending
New ObjectMatch task based on HTM
FindCat equivalent
evolve SourceIndex for small area retrieval
Query support for User Interfaces
Higher resolution, similar to export catalog for area and nearest neighbor search
QA tools - production safe issues
12/7/2018

12. Conclusions In the past year we have successfully…
Upgraded ENTIRE database configuration
production operations controlled
COMPASS data volume significantly increased
100% from last year => 900 GB
Move toward all sky public distribution
WWW access, integration with MAST
Science goals
Advanced recalibrations
12/7/2018