Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array CASPER Workshop 2009 Cape Town, South Africa Matt Luce NRAO-Socorro 10/12/2009

Introduction CASPER? CASPER Workshop 2009 – Applications – Hardware – Tool flow – Tutorials

What is CASPER? Collaboration for Astronomy Signal Processing and Electronics Research Original group at UC Berkeley (Dan W.) – Distributed community of developers and users. – UC Berkeley, MeerKAT, NRAO, GMRT, SETI …

CASPER Goals Streamline and simplify the design flow of radio astronomy instrumentation. Design reuse through the development of platform-independent, open- source hardware and software.

CASPER Religion & Philosophy Big projects are “dinosaurs” by release. Faster development time is an absolute necessity. Custom backplanes are the wrong way to interface with electronics. The signal processing libraries are a very important part of any project. “Hardware is free.” Use commercial, off-the-shelf network hardware to connect together samplers and computing resources so that it can be easily replaced as technology improves (Moore’s Law). The future will be clusters of general purpose computing hardware connected by fast Ethernet, instead of “hard” correlators. There is a sweet spot of cost versus capability for deploying a new technology. Too soon and it’s very expensive. Too late and it’s outdated at deployment.

CASPER Hardware: iBoB 6

Virtex-II Z-DOK CX4 ADC-to-iBoB-to-10GbE-to-BEE2 7

CASPER Hardware: BEE2 8

General-purpose processing module Five Virtex-II FPGAs 20GB DDR2 DRAM 9

CASPER Hardware: ROACH 10

CASPER Hardware: ROACH Reconfigurable Open Architecture Computing Hardware Merges iBoB/BEE2 functionality onto a single board with a more modern FPGA (Virtex-5) 11

CASPER Hardware: ADCs ADC2x ( present | dual 1GSa/sec) ADC2x – Dual 8-bit, 1000Msps (or single 8-bit 2000Msps), Atmel/e2v AT84AD001B ADC1x ( present | 3GSa/sec) ADC1x – Single-8 bit, 3000Msps National ADC ADC 64ADCx64-12 ( present | 64x 50MSa/sec) 64ADCx64-12 – 64 inputs, 64 Msps, 12 bit, double wide board ADC4x250-8 (present | quad 250MSa/sec) ADC4x250-8 – Quad 8-bit, 250 Msps, Analog Devices AD9480 ADC katADC (summer 2009 | dual 1.5GSa/sec) katADC – Dual 8-bit, 1500Msps, National ADC08D1500 ADC ADC2x (summer 2009 | dual 550 Msps) ADC2x – Dual 12-bit, 550 Msps, TI ADS54RF63I ADC2x (summer 2009 | dual 400 Msps) ADC2x – Dual 14-bit, 400 Msps, TI ADS

CASPER Software/Libraries MATLAB/Simulink Xilinx System Generator – Custom DSP Libraries BORPH – Debian Linux – FPGA=CPU – Gateware (BOF) – File System Registers –

2009 Workshop Overview Applications: 3 days Working Groups: 2 days – Hardware – Tool flow – Applications Tutorials

Application: CASPER Correlators “The” CASPER Correlator – – FX using iBoB/BEE2 PAPER (A. Parsons) – Based on CASPER KAT-7 (J. Manley) – ROACH Medicina – iBoB/BEE2 – 10 day development

Application: CASPER Spectrometers Fly’s ATA (A. Siemion) – 11 iBoBs, ea. 4 independent spectrometers, MHz w/128 channles, 0.6 ms integration time. SERENDIP Arecibo (L. Spitler) – iBoB/BEE2: 200MHz/128M channel Nancay CoDeDi Pulsar Machine (I. Cognard) – iBoB: 400MHz/128 channel – GPU de-dispersion GBT (J. Ford) –

Application: Other OVRO Polarimeter (M. Stevenson) – ROACH Phased Array SMA (R. Primiani) – iBoB/BEE2 – Modified Haystack DBE to Mark5B Kinetic Inductance of Superconducting Resonators (L. Swenson) – ROACH driving DAC boards

Hardware WG: ROACH2 Virtex6 LX475T 4xCX4 => 6xSFP+ Two additional QDR – 65MB/F-engine FTDI USB-JTAG bridge

Hardware WG: future ADCs E2v 20Gsps – ~8GHz analog bandwidth Agilent 20 Gsps – ~13Ghz analog bandwidth 19

Toolflow WG: Current Pros – Ease-of-use (Graphical) – Parameterized designs – Full tool flow from DSP through bit files to drivers – Coregen Highly efficient resource utilization Cons – Portability – Language stability – Backwards compatibility – Simulation speed – Platform lock-in – Unit testing – Cost 20

Toolflow WG: Future HDL Cores – Parameterization – Simulink wrappers – Simulation – Documentation Open source Simulink replacement 21

Tutorials 1: LED blinking on ROACH (Complete) II: 10GbE (Complete) III: Wideband Spectrometer (WIP) IV: Pocket Correlator (WIP) V: High Resolution Spectrometer (WIP) Available in the CASPER SVN: – 22

Questions?