1. ISUAL Data Formats & Science Data Processing S. Geller

2. PDR 31 August 20002NCKU UCB Tohoku Data Formats S. Geller Astrium Specification on ISUAL T/M Follows CCSDS Format:

3. PDR 31 August 20003NCKU UCB Tohoku Data Formats S. Geller ISUAL T/M Detailed Data Format Common format used for Science Data, SOH Data, and ISUAL communications with Spacecraft –Standard CCSDS Primary Header APID’s 700 to 74A are assigned to ISUAL –Secondary Header Comprised of a 9 byte Time Code –Variable number of data bytes Total Packet Length limited to 256 bytes for SOH channel and 4096 bytes for Science Data channel –One byte of filler if needed to make total packet length even –One byte of Check Sum –One byte Trailer = hex AA Same packets can be sent over either SOH or Science Data channel provided length constraint is met UCB Drawing 8565-x7 lists all T/M data formats

4. PDR 31 August 20004NCKU UCB Tohoku Data Formats S. Geller Currently Defined T/M Packets APID Packet Name 701 MBR 703 Command Echo 705 Ancillary Data 706 Housekeeping 709 Memory Dump 70B MM Bad Sections 70C Aurora Header 70D Aurora Data 70E Sprite Header 70F Sprite Data 710 Spectrophotometer Header 711 Spectrophotometer Data 712 SP Group-Average Header 713 SP Group-Average Data 714 Array Photometer Header 715 Array Photometer Data 716 AP Group-Average Header 717 AP Group-Average Data 7FF Idle Packet

5. PDR 31 August 20005NCKU UCB Tohoku Data Formats S. Geller Example Telemetry Data Source Packet (1)

6. PDR 31 August 20006NCKU UCB Tohoku Data Formats S. Geller Example Telemetry Data Source Packet (2)

7. PDR 31 August 20007NCKU UCB Tohoku Data Formats S. Geller Astrium Specification on ISUAL Commands Again CCSDS Format is Followed –Type bit now a 1 Includes Secondary Header consisting of 9 byte Time Code

8. PDR 31 August 20008NCKU UCB Tohoku Data Formats S. Geller ISUAL Detailed Command Format Common format used for Ground Commands and On-Board Commands –Standard CCSDS Primary Header APID’s 700 to 70F are assigned to ISUAL –No Secondary Header used –Variable number of data bytes Total Packet Length limited to 240 bytes –One byte of filler if needed to make total packet length even –One byte of Check Sum –One byte Trailer = hex AA APID used to differentiate between on-board and ground commands Presence on check sum in on-board commands subject to negotiation with Astrium UCB Drawing 8564-x7 shows detailed structure of all commands

9. PDR 31 August 20009NCKU UCB Tohoku Data Formats S. Geller ISUAL Science Data Types Sprite Mode –Sprite Event: 8 or more Images –Spectrophotometer: N Sample Sets –Array Photometer: N Sample Sets Aurora Mode –Aurora/Airglow Image –Spectrophotometer: MS average groups –Array Photometer: MA average groups

10. PDR 31 August 200010NCKU UCB Tohoku Data Formats S. Geller Ancilliary Data Spacecraft position and attitude are received as TPA messages. Packets are generated with this information, interleaved with the science data. In ground processing, position and attitude will be averaged from two TPA messages bracketing the data time.

11. PDR 31 August 200011NCKU UCB Tohoku Data Formats S. Geller Data Compression Normally, all science data will be compressed. For diagnostic and perhaps other purposes, some uncompressed data will be sent. Data compression may be turned on and off by command; the default is on - compressed.

12. PDR 31 August 200012NCKU UCB Tohoku Data Formats S. Geller Science Data Flow Readout raw images and/or photometer samples. Compress the data arrays Generate CCSDS source packets Pack packets in to PVCFs Pack PVCFs into Spacecraft Data Block Send Data Block to spacecraft

13. PDR 31 August 200013NCKU UCB Tohoku Data Formats S. Geller

14. PDR 31 August 200014NCKU UCB Tohoku Data Formats S. Geller Level-Zero Data This is the first level of ground processing. Extract CCSDS Source Packets Eliminate duplicates; put into ascending time order The result is “Level-zero” data: CCSDS source packets made available as a binary file or network socket data stream.

15. PDR 31 August 200015NCKU UCB Tohoku Data Formats S. Geller Corrupted Data If CCSDS header is corrupted, packet is lost. –This can cause loss of multi-packet compressed data. If part of data is corrupted, the “bad bytes” will be filled with zeroes. –Prompts use of internal checksum in ISUAL packets.

16. PDR 31 August 200016NCKU UCB Tohoku Data Formats S. Geller Stages of Data Generation Raw readout within ISUAL –into Mass Memory areas –DCM compresses raw data, stores output in other Mass memory areas Data Packets –Uncompressed –Compressed

17. PDR 31 August 200017NCKU UCB Tohoku Data Formats S. Geller Raw Camera Data A Camera image is read out as 128 rows of 512 pixels (may be commanded to be smaller) Each pixel is 16 bits, of which 12 bits are significant. Storage in memory is “big endian” -- high order first.

18. PDR 31 August 200018NCKU UCB Tohoku Data Formats S. Geller Sprite Image Arrays A single image is 128 * 512 * 2 = 131,072 bytes. A Sprite Event generates 8 or more images –Trigger - when the event happened (1) –Before - taken before the event (usually 1) –After - taken after the event (usually 6)

19. PDR 31 August 200019NCKU UCB Tohoku Data Formats S. Geller Aurora / Airglow Images One 131,072-byte image per exposure There is no Event trigger. Exposures are taken at regular intervals.

20. PDR 31 August 200020NCKU UCB Tohoku Data Formats S. Geller Raw Spectrophotometer Data 6 channels 12-bit sample values Sample values are stored in memory as 16-bit words (low 12 are significant) “big endian” - high order first Sample size is 6 * 2 = 12 bytes

21. PDR 31 August 200021NCKU UCB Tohoku Data Formats S. Geller Raw Array Photometer Data 16 “A” channels (short wavelength) 16 “B” channels (long wavelength) Samples are stored in memory as 16-bit words (low 12 are significant) “big endian” - high order first ample size is 32 * 2 = 64 bytes

22. Preliminary Plans for Processing ISUAL Telemetry

23. PDR 31 August 200023NCKU UCB Tohoku Data Formats S. Geller What the Flight Software does Reads out raw data Generates compressed data Generates CCSDS source packets –stamps them with time of generation (secondary header) Packs packets into PVCFs and sends them to the spacecraft.

24. PDR 31 August 200024NCKU UCB Tohoku Data Formats S. Geller What the Spacecraft does Receives data from ISUAL as “files” of PVCFs. Stores data in on-board bulk memory Encapsulates data as transfer frames, and sends it all to the ground.

25. PDR 31 August 200025NCKU UCB Tohoku Data Formats S. Geller What the Ground Software does Decodes CCSDS packets from the transfer frames. Sorts packets in ascending time order, using the time-stamp in the secondary header Eliminates duplicates Deals with corrupted data –if header corrupted, drops packet –otherwise does zero fill

26. PDR 31 August 200026NCKU UCB Tohoku Data Formats S. Geller Level 0 Data CCSDS packets, in time order, duplicates removed. Except for possible dropped packets, these are the CCSDS packets that were generated by ISUAL, and in the same order. ISUAL should include a checksum in each packet, in case of corruption.

27. PDR 31 August 200027NCKU UCB Tohoku Data Formats S. Geller Raw Data Products The CCSDS packets are used to construct raw data products Raw Products are the original data, with CCSDS header and other telemetry artifacts removed. In raw products, compressed data is converted to its original uncompressed form.

28. PDR 31 August 200028NCKU UCB Tohoku Data Formats S. Geller Sprite Data Product Number of images Image arrays (512 cols, 128 rows) index of event image Time of Sprite Event number of post-trigger images Exposure duration milliseconds after event before 1st exposure

29. PDR 31 August 200029NCKU UCB Tohoku Data Formats S. Geller Sprite Data Product (cont.) Which was triggering photometer (1..6) Trigger level MCP HV; Phosphor HV Filter code First TPA; Second TPA

30. PDR 31 August 200030NCKU UCB Tohoku Data Formats S. Geller Aurora Data Product Time of start of exposure duration of exposure (millisecs) MCP HV; Phosphor HV Filter code First TPA; Second TPA One image array

31. PDR 31 August 200031NCKU UCB Tohoku Data Formats S. Geller Spectrophotometer Data Product Total number of samples Index number of time-stamped sample Time-stamp Sampling rate (millisec/sample) HV setting First TPA; Second TPA Up to N groups of 6 photometer values

32. PDR 31 August 200032NCKU UCB Tohoku Data Formats S. Geller Spectrophotometer Averages Product Total number of groups Index number of time-stamped group Time-stamp Number of samples averaged per group Sampling rate (millisec/sample) HV setting First TPA; Second TPA Up to N groups of 6 averages

33. PDR 31 August 200033NCKU UCB Tohoku Data Formats S. Geller Array Photometer Data Product Total number of samples Index number of time-stamped sample Time-stamp Sampling rate (millisecs/sample) HV setting First TPA; Second TPA Sample Array (N x 32)

34. PDR 31 August 200034NCKU UCB Tohoku Data Formats S. Geller Array Photometer Averages Product Total number of groups Index number of time-stamped group Time-stamp Number of samples/group Sampling rate (millisec/sample) HV setting First TPA; Second TPA Array of averages (N x 32)