1. August 2009 Proof of Concept Planning

2. Objectives » Mutual understanding of » Scope of SQLstream/OOI POC » Intended architecture of POC » Discussion of draft plan » Shared implementation roles » Rough Timeframes Confidential and Trade Secret SQLstream Inc. Copyright © 2008

3. Agenda » OOI POC data flow » Dataflow diagram » Sample SQL » POC Plan elements » Discussion Confidential and Trade Secret SQLstream Inc. 2007

4. BUSINESS CONTEXT POC Data Flow Confidential and Trade Secret SQLstream Inc. Copyright © 2009

5. Data Flow Overview Confidential and Trade Secret SQLstream Inc. Copyright © 2009

6. Data Flow (1) Confidential and Trade Secret SQLstream Inc. Copyright © 2009

7. Data Flow (2) Confidential and Trade Secret SQLstream Inc. Copyright © 2009

8. Data Flow (3) Confidential and Trade Secret SQLstream Inc. Copyright © 2009

9. Confidential and Trade Secret SQLstream Inc. 2007

10. BUSINESS CONTEXT POC Plan Elements Confidential and Trade Secret SQLstream Inc. Copyright © 2009

11. Data Acquisition » AMQP exchange with live data [UCSD] » source queue to which we can subscribe for testing and demo » AMQP adapter and SQL [SQLstream] » wrapper, server, source foreign stream » spec for binary AMQP payload format [UCSD] » UDX to decompose/decompress payload [SQLstream] » "codec" for UCSD binary format » Static sample data [UCSD] » exported to a file from AMQP exchange/topic so we can test against fixed data Confidential and Trade Secret SQLstream Inc. 2009

12. Channel Signal Conditioning » UDX for FilteredSignals [SQLstream + UCSD] » default parameter file w/ multiple filters per channel [UCSD] (no per-station/channel overrides for POC) » UDX loads parameter file(s) [SQLstream] » API spec for bandpass filters [UCSD] » UDX calls dummy bandpass filter with appropriate buffering and result tracking [SQLstream] » UDX calls real bandpass filter(s) [UCSD] » no other SQL signal conditioning needed Confidential and Trade Secret SQLstream Inc. 2009

13. Orbdetect (per-channel stream processing) » FilteredSignalsWithAverages [SQLstream] » SQL for STA and LTA partitioned WinAggs » Ratio1 and Ratio2 calculations » SQL UDF for clamped-LTA used for Ratio2 [SQLstream] » FilteredSignalsWithTransitions [SQLstream] » SQL uses STA, LTA, Ratio1, Ratio2 to compute state indicator » continuous {OFF, D, ON} values based on per-row column values » Detections [SQLstream] » SQL to produce {ON, D, OFF} detection transition rows Confidential and Trade Secret SQLstream Inc. 2009

14. Visualization of orbdetect output data » MATLAB? [Juan research] » API, socket interface, file-based integration, etc. » UCSD charting code? [Juan research] » Juan has determined it is not available/suitable » adapt Mozilla/canvas code? [SQLstream research] » possibly significant SQLstream effort Confidential and Trade Secret SQLstream Inc. 2009

15. Publish Results » UDX to compose payload [SQLstream] » "codec" for UCSD binary format » AMQP adapter and SQL [SQLstream] » sink foreign stream, same wrapper and server as for source FS » AMQP exchange [UCSD] » sink queue(s) to which we can publish results Confidential and Trade Secret SQLstream Inc. 2009

16. Discussion Confidential and Trade Secret SQLstream Inc. 2009

17. Confidential and Trade Secret SQLstream Inc. 2007

18. Transition Detection Confidential and Trade Secret SQLstream Inc. Copyright © 2009 CREATE OR REPLACE STREAM "signalsWithState" ( "sta" CHAR(6), "chan" CHAR(3), "seq" SMALLINT, "state" CHAR(3), "note" VARCHAR(20) ) DESCRIPTION 'simulated data stream with state indicators'; CREATE OR REPLACE VIEW "stateTransitions" DESCRIPTION 'just the "edges" from the state stream' AS SELECT STREAM * FROM (SELECT STREAM *, FIRST_VALUE("state") OVER (PARTITION BY "sta", "chan" ROWS 1 PRECEDING) AS "prevState" FROM "signalsWithState") AS S2 WHERE S2."state" <> S2."prevState";

19. Transition Detection (input) Confidential and Trade Secret SQLstream Inc. Copyright © 2009 > SELECT STREAM * FROM "signalsWithState"; +--------+------+-------+-------+----------------------+ | sta | chan | seq | state | note | +--------+------+-------+-------+----------------------+ | AZ_BAR | BHZ | 0 | OFF | | | AZ_BAR | BHZ | 1 | OFF | | | AZ_BAR | BHZ | 2 | OFF | | | AZ_BAR | BHZ | 3 | OFF | | | AZ_BAR | BHZ | 4 | OFF | | | AZ_BAR | BHZ | 5 | ON | ON 1 | | AZ_BAR | BHZ | 6 | ON | ON 2 | | AZ_BAR | BHZ | 7 | ON | ON 3 | | AZ_BAR | BHZ | 8 | ON | ON 4 | | AZ_BAR | BHZ | 9 | D | D 1 | | AZ_BAR | BHZ | 10 | OFF | OFF 1 | | AZ_BAR | BHZ | 11 | OFF | | | AZ_BAR | BHZ | 12 | OFF | | | AZ_BAR | BHZ | 13 | OFF | | | AZ_BAR | ABC | 14 | OFF | new channel | | AZ_BAR | BHZ | 15 | OFF | | | AZ_BAR | ABC | 16 | OFF | | | AZ_BAR | ABC | 17 | ON | ON 1 | | AZ_BAR | BHZ | 18 | OFF | | | AZ_BAR | ABC | 19 | ON | ON 2 | | AZ_BAR | BHZ | 20 | OFF | | | AZ_BAR | ABC | 21 | D | D 1 | | AZ_BAR | BHZ | 22 | ON | ON 1 | | AZ_BAR | ABC | 23 | D | D 2 | | AZ_BAR | BHZ | 24 | D | D 1 | | AZ_BAR | ABC | 25 | OFF | OFF 1 | | AZ_BAR | BHZ | 26 | OFF | OFF 1 | | AZ_BAR | ABC | 27 | OFF | OFF 2 | | AZ_BAR | BHZ | 28 | OFF | OFF 2 | | AZ_BAR | ABC | 29 | OFF | | | AZ_BAR | BHZ | 30 | OFF | | | AZ_FOO | BHZ | 31 | OFF | new station | | AZ_BAR | ABC | 32 | OFF | | | AZ_BAR | BHZ | 33 | OFF | | | AZ_FOO | BHZ | 34 | OFF | | | AZ_BAR | ABC | 35 | OFF | | | AZ_BAR | BHZ | 36 | OFF | | | AZ_FOO | BHZ | 37 | ON | ON 1 | | AZ_BAR | ABC | 38 | OFF | | | AZ_BAR | BHZ | 39 | OFF | | | AZ_FOO | BHZ | 40 | ON | ON 2 | | AZ_BAR | ABC | 41 | OFF | | | AZ_BAR | BHZ | 42 | ON | ON 1 | | AZ_FOO | BHZ | 43 | ON | ON 3 | | AZ_BAR | ABC | 44 | OFF | | | AZ_BAR | BHZ | 45 | ON | ON 2 | | AZ_FOO | BHZ | 46 | D | D 1 | | AZ_BAR | ABC | 47 | ON | ON 1 | | AZ_BAR | BHZ | 48 | ON | ON 3 | | AZ_FOO | BHZ | 49 | D | D 2 | | AZ_BAR | ABC | 50 | D | D 1 | | AZ_BAR | BHZ | 51 | ON | ON 4 | | AZ_FOO | BHZ | 52 | OFF | OFF 1 | | AZ_BAR | ABC | 53 | OFF | OFF 1 | | AZ_BAR | BHZ | 54 | D | D 1 | | AZ_FOO | BHZ | 55 | OFF | OFF 2 | | AZ_BAR | ABC | 56 | OFF | OFF 2 | | AZ_BAR | BHZ | 57 | OFF | OFF 1 | | AZ_FOO | BHZ | 58 | OFF | OFF 3 | | AZ_BAR | ABC | 59 | OFF | OFF 3 | | AZ_BAR | BHZ | 60 | OFF | OFF 2 | +--------+------+-------+-------+----------------------+

20. Transition Detection (output) Confidential and Trade Secret SQLstream Inc. Copyright © 2009 > SELECT STREAM * FROM "stateTransitions"; +--------+------+-------+-------+----------------------+-----------+ | sta | chan | seq | state | note | prevState | +--------+------+-------+-------+----------------------+-----------+ | AZ_BAR | BHZ | 5 | ON | ON 1 | OFF | | AZ_BAR | BHZ | 9 | D | D 1 | ON | | AZ_BAR | BHZ | 10 | OFF | OFF 1 | D | | AZ_BAR | ABC | 17 | ON | ON 1 | OFF | | AZ_BAR | ABC | 21 | D | D 1 | ON | | AZ_BAR | BHZ | 22 | ON | ON 1 | OFF | | AZ_BAR | BHZ | 24 | D | D 1 | ON | | AZ_BAR | ABC | 25 | OFF | OFF 1 | D | | AZ_BAR | BHZ | 26 | OFF | OFF 1 | D | | AZ_FOO | BHZ | 37 | ON | ON 1 | OFF | | AZ_BAR | BHZ | 42 | ON | ON 1 | OFF | | AZ_FOO | BHZ | 46 | D | D 1 | ON | | AZ_BAR | ABC | 47 | ON | ON 1 | OFF | | AZ_BAR | ABC | 50 | D | D 1 | ON | | AZ_FOO | BHZ | 52 | OFF | OFF 1 | D | | AZ_BAR | ABC | 53 | OFF | OFF 1 | D | | AZ_BAR | BHZ | 54 | D | D 1 | ON | | AZ_BAR | BHZ | 57 | OFF | OFF 1 | D | +--------+------+-------+-------+----------------------+-----------+

21. Confidential and Trade Secret SQLstream Inc. 2007

22. Key Components Confidential and Trade Secret SQLstream Inc. Copyright © 2008

23. Confidential and Trade Secret SQLstream Inc. 2007