1. Storage and Dissemination of SEGY Data in JPEG2000 Format Bob Courtney Geological Survey of Canada (Atlantic) Bob.courtney@nrcan.gc.ca

2. 2 The Context & Problem  Marine program collecting digital SEGY data since early 90’s  Scientists use printed field records in preference to digital products  New digital systems (e.g., 3.5 khz chirp on multibeam vessels) strictly digital.  Digital processing issues – data size ( > 1 TB/yr), comparison to gold-standard printed records, time vs return  Discovery and Dissemination problems – cost of copying analog records, record degradation, size of digital SEGY archives  Database population and update issues – no validation of digital data The Context & Problems

3. 3  GSC has implemented the JPEG2000 framework to consolidate, encode, archive, interpret and disseminate digital SEGY data.  Experience suggests between 10:1 to 40:1 compression effective  Approach applied to seismic, sidescan, and sounder data. Will (?) be extended to image trace data of multibeam sounders (water column imaging), other gridded data sets.  All ancillary data encoded via XML schemas  metadata harvesting for database during normal processing (carrot vs stick approach) GSC Implementation of JPEG2000

4. 4  Open file standard ISO/IEC 15444-1:2000  Wavelet based, multiresolution representation  Up to 38 bit signed data – not just images  Up to 16,000 planes/channels  Entropy-based (MQ) bit-plane encoding (save 20 bits instead of 32, white space costs almost nothing)  Lossless/lossy encoding - harmonic distortion for lossy compression  Flexible file format –XML-aware, UUID defined boxes  Random access to ROI, transcoding, quality layers,etc  Internet ready : JPIP => low bandwidth optimized  Industry support: e.g., Lizardtech, Adobe Photoshop What is JPEG2000 ? JPEG2000 is definitely not JPEG

5. 5 SEGY  JPEG2000 Processing Framework Tape DVD Harvest Scan EncodeInterpret Register GIS Archive Internet JPEG2000 Viewers Convert QC

6. 6 Harvest Demultiplex and Combine File n Demultiplex File n-1 File 1 File 2 Combine Channels Big SEGY >200,000 pings 2 GB Concatenate

7. 7 Harvest Demultiplex and Combine  Reduce number of files => 1 file/day rather than 50  Database-linked nomenclature  Composite channel files; sidescan, 2 channel high res  Self descriptive file names  Expedition_datatype_instrument_xdcr_starttime_endtime  2007006_SEISMIC_KNUDSON_3.5khz_132_0007_to_132_1217.sgy

8. 8 Encode SEGY  SGYJP2 SEGY Filter Signal Cond. Outliers XML SEGY headers Summary data Waveform Data Bipolar Envelope Half-wave JPEG2000 Compression Engine SGYJP2 GZIP SEGY.xsd 10:1 10:1 - 40:1 - zero padding trace delays - lossless or lossy - keep only significant bit-depth - choose reduced bit-depth scaled to highest amplitude; 1:1 XML to Database

9. 9 Encode SEGY  SGYJP2

10. 10 Encode SEGY  SGYJP2

11. 11 Encode SEGY  SGYJP2

12. 12 Encode SEGY  SGYJP2 Sample from 3.5 khz Knudsen – Creed St.Lawrence Estuary 69333 traces; 13333 samples/tr ; 12 hr data; 10:1 compression Lizardtech IE plugin

13. 13 Encode SEGY  SGYJP2 Signal amplitudes (in this case; envelope) encoded in file; Anti-aliasing at all zoom levels

14. 14 Encode SEGY  SGYJP2 Comparison => 10:1 to 50:1 compression 10:1 1.6 bpp 50:1 / 0.3 bpp

15. 15 Encode SEGY  SGYJP2 Sidescan trace encoding; equally effective for MBES

16. 16 Interpret SGYJP2 SGYJP2 XML Horizons View & Interpret SGYJP2 GZIP horizons.xsd XML to Database XML Markers XML Sections Shapefiles GIS Automation

17. 17 Interpret SGYJP2

18. 18 Interpret SGYJP2

19. 19 Ongoing Efforts SGYJP2 Shapefiles and ESRI automation Google Earth KMZ Drivers for Klein digital formats GSF, XTF encoding ( XML schemas)

20. 20 Research Efforts SGYJP2 Multiplane data => MBES; multichannel seismic Wavelet transforms – custom based, KLT? Web services => extend/adapt JPIP Multiscale methods of data cleaning, characterization Bathymetry gridding => 1m, 2m,4m =>multiscale Rate versus distortion =>how much accuracy do you need? 1%, 0.1%, etc

21. 21 Software SGYJP2 Tools and schemas developed to disseminate GSC data Tools and schemas are free Single user, no distribute (need to measure impact) Email request to bob.courtney@nrcan.gc.ca No support – we have limited capacity Welcome research partnerships to extend and continue efforts