COMPASS Database SPACE TELESCOPE SCIENCE INSTITUTE Gretchen Greene Operated for NASA by AURA COMPASS Database Gretchen Greene 1

COMPASS - (Catalogs of Objects and Measured Parameters for All-Sky Surveys) Key Element for GSC 2 catalog production Online access to processed plate data Identification of unique sources Cross-indexing of multiple observations Overlapping photographic plates Multiple epochs Global recalibration capability GSC 2 is exported from COMPASS One of the first large-scale astronomical archives Estimated 2 billion objects, 10 billion sources/entries 4 TB catalog derived from 8 TB image archive! Collaborative project with OATo and SDSS Science Archive 12/7/2018

Highlights since the 1999 Meeting Moved to a new server, fully online database 10X I/O boost, 5X CPU gain in performance Dell NT Server with 2 TB RAID Array HSM system proved inadequate for required migration rates Expertise spread in multiple areas: configuration, development, and database administration Production operations stabilized Integration with plate processing, utilities, streamlined New APIs: GSPC2, gsh metadata loading developed User Interfaces developed for QA and cross-correlation to external archives – Beta versions CIQA IDL/C++ and ShowSky Java-RMI, Jini 12/7/2018

COMPASS Server with RAID 100 Mb Network CHART 12/7/2018

Database Hierarchy [ COMPASS Federated Database ] 12/7/2018 HTM Region Database for each of 32768 regions Plate Database PlateInfoContainer GSH for each plate RegionInfoContainer RegionCatalogContainers for each plate section within region Plate Source Objects SourceIndex Page = Federated Database Redundant, but shows how the overall model fits into the Objectivity hierarchy. Simplified view. We were able to extend this model to another proposed space mission project (GAIA). Rather than plates, there was an instrumental time interval class, and then the ephermerides (planetary motion ). Section of reference catalog within region = Database GSPC2 = Container = Class/Basic Object [ COMPASS Federated Database ] 12/7/2018

Production Status 2576 Plates Loaded 2313 Plates Cross Matched 1.484 Billion plate observations 2313 Plates Cross Matched 730 Million Unique sources identified Apply Calibrations task implemented improved photometry Calibration FDB ~ 40+ plates (2% of sky) Metric - Average 20+plates/day load and match Automated Full Backup with each delivery 0.01% database corruption discovered with GSC2.1.1 Colour Task and GSC-2 Export 12/7/2018

Sky Coverage... XP, ER, and XS are plotted in red, XJ, or S plates are plotted in blue, and the remaining short and intermediate exposure plates are plotted in yellow. 12/7/2018

COMPASS User Interfaces CIQA - see OATo presentation ShowSky –Java tool developed with Wil O’Mullane Jini capable multiple catalogs accessed remotely 12/7/2018

Filterable Catalog Retrieval 12/7/2018

Development Expansion to 4TB system Production operations utilities gsh MetaData production load Reference catalog loading and cross-matching GSPC2 production FDB load pending New ObjectMatch task based on HTM FindCat equivalent evolve SourceIndex for small area retrieval Query support for User Interfaces Higher resolution, similar to export catalog for area and nearest neighbor search QA tools - production safe issues 12/7/2018

Conclusions In the past year we have successfully… Upgraded ENTIRE database configuration production operations controlled COMPASS data volume significantly increased 100% from last year => 900 GB Move toward all sky public distribution WWW access, integration with MAST Science goals Advanced recalibrations 12/7/2018