Testing Multibit Encoding Schemes

Slides:



Advertisements
Similar presentations
Shapelets Correlated with Surface Normals Produce Surfaces Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
Advertisements

Fixed Point Numbers The binary integer arithmetic you are used to is known by the more general term of Fixed Point arithmetic. Fixed Point means that we.
Copyright 2001, Agrawal & BushnellVLSI Test: Lecture 181 Lecture 18 DSP-Based Analog Circuit Testing  Definitions  Unit Test Period (UTP)  Correlation.
DFT Filter Banks Steven Liddell Prof. Justin Jonas.
RFI Subtraction with a reference horn… F. Briggs & M. Kesteven illustrations from Parkes Telescope… (Jon Bell et al.) origins in Int-Mit group at CSIRO.
Ninth Synthesis Imaging Summer School Socorro, June 15-22, 2004 Cross Correlators Walter Brisken.
Spectra of random processes Signal, noise, smoothing and filters.
Floating Point Numbers.  Floating point numbers are real numbers.  In Java, this just means any numbers that aren’t integers (whole numbers)  For example…
Binary Number Systems.
Prepared by: Hind J. Zourob Heba M. Matter Supervisor: Dr. Hatem El-Aydi Faculty Of Engineering Communications & Control Engineering.
Transition Converter " Supply signals from new antennas to old correlator. " Will be discarded or abandoned in place when old correlator is turned off.
ELEN 5346/4304 DSP and Filter Design Fall Lecture 12: Number representation and Quantization effects Instructor: Dr. Gleb V. Tcheslavski Contact:
Backend electronics for radioastronomy G. Comoretto.
Floating Point vs. Fixed Point for FPGA 1. Applications Digital Signal Processing -Encoders/Decoders -Compression -Encryption Control -Automotive/Aerospace.
Computing Systems Basic arithmetic for computers.
Update on LBA Technical Developments CASS Chris Phillips 11 October 2013.
Design and performance of fast transient detectors Cathryn Trott, Nathan Clarke, J-P Macquart ICRAR Curtin University.
TOW 2007: Correlator Theory Kerry Kingham - U.S. Naval Observatory Roger Cappallo – Haystack Observatory Mike Titus - Haystack Observatory.
HW/SW PARTITIONING OF FLOATING POINT SOFTWARE APPLICATIONS TO FIXED - POINTED COPROCESSOR CIRCUITS - Nalini Kumar Gaurav Chitroda Komal Kasat.
DATA REPRESENTATION, DATA STRUCTURES AND DATA MANIPULATION TOPIC 4 CONTENT: 4.1. Number systems 4.2. Floating point binary 4.3. Normalization of floating.
EDGE DETECTION IN COMPUTER VISION SYSTEMS PRESENTATION BY : ATUL CHOPRA JUNE EE-6358 COMPUTER VISION UNIVERSITY OF TEXAS AT ARLINGTON.
GPU DAS CSIRO ASTRONOMY AND SPACE SCIENCE Chris Phillips 23 th October 2012.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
Introduction to Digital Signals
Tenth Synthesis Imaging Summer School UNM, June 13-20, 2006 Cross Correlators Walter Brisken.
NASSP Masters 5003F - Computational Astronomy Lecture 12 Complex numbers – an alternate view The Fourier transform Convolution, correlation, filtering.
A real-time software backend for the GMRT : towards hybrid backends CASPER meeting Capetown 30th September 2009 Collaborators : Jayanta Roy (NCRA) Yashwant.
ATCA GPU Correlator Strawman Design ASTRONOMY AND SPACE SCIENCE Chris Phillips | LBA Lead Scientist 17 November 2015.
CO5023 Introduction to Digital Circuits. What do we know so far? How to represent numbers (integers and floating point) in binary How to convert between.
Learning Objectives 3.3.1f - Describe the nature and uses of floating point form 3.3.1h - Convert a real number to floating point form Learn how to normalise.
Fake Data Generator ASTRONOMY AND SPACE SCIENCE Chris Phillips 16 November 2015.
FP7 Uniboard project Digital Receiver G. Comoretto, A. Russo, G. Tuccari, A Baudry, P. Camino, B. Quertier Dwingeloo, February 27, 2009.
Floating Point Numbers Dr. Mohsen NASRI College of Computer and Information Sciences, Majmaah University, Al Majmaah
FLOATING-POINT NUMBER REPRESENTATION
MATH Lesson 2 Binary arithmetic.
CHAPTER 5: Representing Numerical Data
CSCI206 - Computer Organization & Programming
Floating Point. Binary Fractions.
Floating Point Numbers
Floating Point Representations
Lecture 6. Fixed and Floating Point Numbers
Fundamentals of Computer Science
Backgrounder: Binary Math
Dr.Faisal Alzyoud 2/20/2018 Binary Arithmetic.
Data Representation.
Digital Receivers for Radio Astronomy
National Mathematics Day
Data Representation Binary Numbers Binary Addition
Numbers in a Computer Unsigned integers Signed magnitude
LFD Correlator MWA-LFD Kick-off Meeting San Diego 5-June-2006
Sampling rate conversion by a rational factor
Chapter 5 Data representation.
James K Beard, Ph.D. April 20, 2005 SystemView 2005 James K Beard, Ph.D. April 20, 2005 April 122, 2005.
Binary Numbers Material on Data Representation can be found in Chapter 2 of Computer Architecture (Nicholas Carter) CSC 370 (Blum)
Introduction to Frequency Domain TIPL 4301 TI Precision Labs – ADCs
Chapter 2 Bits, Data Types & Operations Integer Representation
CSCI206 - Computer Organization & Programming
CSCE 643 Computer Vision: Thinking in Frequency
Telecommunications Engineering Topic 2: Modulation and FDMA
Faculty of Cybernetics, Statistics and Economic Informatics –
October 17 Chapter 4 – Floating Point Read 5.1 through 5.3 1/16/2019
Storing Negative Integers
Chapter 6: Computer Arithmetic
C Model Sim (Fixed-Point) -A New Approach to Pipeline FFT Processor
Correlation, Energy Spectral Density and Power Spectral Density
8.6 Autocorrelation instrument, mathematical definition, and properties autocorrelation and Fourier transforms cosine and sine waves sum of cosines Johnson.
CS 286 Computer Architecture & Organization
IT11004: Data Representation and Organization
Computer Organization and Assembly Language
ID1050– Quantitative & Qualitative Reasoning
Presentation transcript:

Testing Multibit Encoding Schemes Chris Phillips 11 October 2017 Astronomy and space science

Why more bits - Efficiency? # of Levels # Bits Efficiency 3 2 80.983% 4 88.115% 8 96.256% 9 96.930% 16 98.846% 32 5 99.651% 256 99.991% Traditionally don’t go past 2 bits with VLBI as bits are expensive This analysis considers weak signals only and no RFI All schemes (except 2 bit) use linear translation of sample voltage to bit value. TMS 3rd Edition, Table 8.2 IVTW2017– Multibit Encoding | Chris Phillips

Why more bits – Dynamic Range! Need additional bits for dynamic range Cope with (possibly transient) RFI much stronger than astronomical signal and system noise Avoid non-linear effects Every stage of digital filtering requires additional bits to preserve full dynamic range Traditionally the disadvantage of FX correlators Current CASS instruments (ASKAP, Parkes UWB) use 16 bit samples after coarse filterbanks This is expensive to receive for software backends Traditionally don’t go past 2 bits with VLBI as bits are expensive This analysis considers weak signals only and no RFI All schemes (except 2 bit) use linear translation of sample voltage to bit value. IVTW2017– Multibit Encoding | Chris Phillips

Multibit considerations Need to set voltage separation between levels Enough bits for the “noise”, retain dynamic range Compromise between most efficient sampling and large dynamic range Is there a way to optimize both? Do we really need the same amount of precision for all voltage levels? Does 16bit sampling really give significantly better results that 8bit if “real world” situatons? IVTW2017– Multibit Encoding | Chris Phillips

How many bits do we need? What do we loose if we drop from 16 to 8 bits? Specifically in a world of increasing RFI How can we quantitatively measure different bit depths/encoding schemes? Are non-linear sampling schemes suitable? * Surely we should be able to justify multibit systems better than “better dynamic range” IVTW2017– Multibit Encoding | Chris Phillips

8 bit floats 8 bit floating point proposed by Dr John Bunton (CSIRO) 1 sign bit 4 bit mantissa (0..15) 3 bit unsigned exponent Exponent 0, mantissa just 4bit quantity (0..15) Exponent 1-7, val = (M+15)*2^(Exponent-1) ±0..32,34,36..64,68,72…1920,1984 Sign Mantissa Exponent Encode integers only – no need to encode teeny tiny numbers 64 “linear” samples – efficiency as should be > 99.5% IVTW2017– Multibit Encoding | Chris Phillips

Testing Create “fake” voltage data Gaussian Noise Optional correlated Gaussian noise (ie common seed) Optional 1 – 2 tones Optional FIR filter to give bandpass shape Concern FIR filter ripple artificially increasing measured RMS Quantize as 2bit, 8bit or 16 bit integer, 8 bit float or 32 bit IEEE float Raw voltage format to allow exotic encoding Compute auto or ”zero delay” cross correlation Also can channelize/filter data for separate investigation IVTW2017– Multibit Encoding | Chris Phillips

IVTW2017– Multibit Encoding | Chris Phillips

Things to remember Uncorrelated noise generated with RMS of 1.0 95% of samples will be within ±2σ Data later multiplied by 10 before quantizing Except 2 bit data scaled to achieve 17.3/32.7/32.7/17.3% 8 bit tones will clip when amplitude of Sine > 12.7 Power 161 Float8 clips at 198.4, non-linear from 3.4 Clip at power ~40,000 Data created as voltage, displayed as power ( 𝑉 2 ) IVTW2017– Multibit Encoding | Chris Phillips

Noise + Tone Gaussian noise voltage Single tone at middle of band Increase power linearly from weak to very strong Calculate autocorrelation of 1 second of data Measure peak of tone & SNR of tone to amplitude RMS on autocorrelation IVTW2017– Multibit Encoding | Chris Phillips

Tone IVTW2017– Multibit Encoding | Chris Phillips

Tone IVTW2017– Multibit Encoding | Chris Phillips

Tone IVTW2017– Multibit Encoding | Chris Phillips

SNR, weak(ish) tone IVTW2017– Multibit Encoding | Chris Phillips

Tone IVTW2017– Multibit Encoding | Chris Phillips

Tone IVTW2017– Multibit Encoding | Chris Phillips

2 Tone Gaussian noise plus 2 tones Increase power of one tone linearly 15 and 49 MHz in 64 MHz band Increase power of one tone linearly Calculate autocorrelation of voltages IVTW2017– Multibit Encoding | Chris Phillips

2 Tone IVTW2017– Multibit Encoding | Chris Phillips

2 Tone IVTW2017– Multibit Encoding | Chris Phillips

2 Tone IVTW2017– Multibit Encoding | Chris Phillips

2 Tone IVTW2017– Multibit Encoding | Chris Phillips

Noise Correlation Create 2 voltage data sets Uncorrelated Gaussian noise plus common (same seed) Gaussian noise Cross correlate both sets and compute power (FFT voltages and sum) Inverse FFT cross correlation spectrum and calculate lag spectrum IVTW2017– Multibit Encoding | Chris Phillips

Noise Correlation IVTW2017– Multibit Encoding | Chris Phillips

Noise + Tone Correlation Create 2 voltage data sets Uncorrelated Gaussian noise plus common (same seed) Gaussian noise plus tone Increase power of Tone Cross correlate both sets and compute power (FFT voltages and sum) Inverse FFT cross correlation spectrum and calculate lag spectrum IVTW2017– Multibit Encoding | Chris Phillips

Noise + Tone Correlation IVTW2017– Multibit Encoding | Chris Phillips

Noise + Tone Correlation IVTW2017– Multibit Encoding | Chris Phillips

Intermodulation Common problem is intermodulation between strong RFI tones With numerous tones, intermodulation products fill spectrum Worse with less bits IVTW2017– Multibit Encoding | Chris Phillips

IVTW2017– Multibit Encoding | Chris Phillips

Intermodulation IVTW2017– Multibit Encoding | Chris Phillips

Intermodulation IVTW2017– Multibit Encoding | Chris Phillips

Intermodulation IVTW2017– Multibit Encoding | Chris Phillips

Intermodulation IVTW2017– Multibit Encoding | Chris Phillips

Conclusion Better tests are needed to quantitatively compare different encoding approaches “Float8” shows some promise, but possible issues Need to investigate effect with adaptive RFI mitigation Increase mantissa, reduced exponent? Presentation title | Presenter name

Thank you Chris Phillips LBA Lead Scientist t +61 2 9123 4567 e Chris.Phillips@csiro.au w www.atnf.csiro.au CSIRO Astronomy and space science

Aside - Unums Dr. John L. Gustafson Proposes replacing IEEE Floating point with Unums Claims all sorts of improvements Can beat IEEE 32bit floats wrt precision on matrix operations with 16bit Unum Has initial hardware developed with silicon implementation of Unum Potentially really useful for astronomy Replace 32 floats with 16 bit Unum for Spectral line data Image cubes Visibility data etc 64 pJ multiply and add 4200 pJ Read 64bit float from memory http://johngustafson.net/publications.html IVTW2017– Multibit Encoding | Chris Phillips

Aside – Intel Performance Primitives Ignoring initialization, just 6 IPP calls needed ippsRandGauss_32f ippsTone_32f / ippsTone_32fc ippsAdd_32f_I ippsFIRSR_32f / ippsFIRSR_32fc ippsMulC_32f_I ippsMeanStdDev_32f IVTW2017– Multibit Encoding | Chris Phillips