Hardware: Old, New, Future Hardware: Old, New, Future Dan Werthimer and Casper Collaborators.

Slides:



Advertisements
Similar presentations
West Coast Spectrometer Team Mark Wagner, Berkeley project manager, FPGA designer Terry Filiba, data transport: FPGA --> CPU --> GPU Suraj Gowda, boosting.
Advertisements

Digital FX Correlator Nimish Sane Center for Solar-Terrestrial Research New Jersey Institute of Technology, Newark, NJ EOVSA Technical Design Meeting.
Digital RF Stabilization System Based on MicroTCA Technology - Libera LLRF Robert Černe May 2010, RT10, Lisboa
8xADC AMC board Tomasz Klonowski Warsaw University of Technology PERG – ISE
Ultrafast 16-channel ADC for NICA-MPD Forward Detectors A.V. Shchipunov Join Institute for Nuclear Research Dubna, Russia
Digital FX Correlator Nimish Sane Center for Solar-Terrestrial Research New Jersey Institute of Technology, Newark, NJ EOVSA Technical Design Meeting.
All things DBE… Francois Kapp Sub-system Manager: DBE On behalf of the DBE team present and past... S Rajan, E Bauermeister, A.
Offering the freedom to design solutions Sundance PXIe Solution.
Performance Characterization of the Tile Architecture Précis Presentation Dr. Matthew Clark, Dr. Eric Grobelny, Andrew White Honeywell Defense & Space,
Shilpa Bollineni, Glen Langston, John Ford, Randy McCullough and Paul Demorest DATA ACQUISITION ON THE 43M TELESCOPE.
Digital FX correlator Samuel Tun. FASR Subsystem Testbed (FST) 1-9 GHz in 500 MHz band recorded at 1 GS/s from each antenna. Correlation carried out offline.
An ATCA and FPGA-Based Data Processing Unit for PANDA Experiment H.XU, Z.-A. LIU,Q.WANG, D.JIN, Inst. High Energy Physics, Beijing, W. Kühn, J. Lang, S.
NgVLA Correlator with 2015ish Technology Jack Hickish, Dan Werthimer, and CASPER Collaboration
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Spectrometer PDR John.
UCT Software-Defined Radio Research Group
5 Feb 2002Alternative Ideas for the CALICE Backend System 1 Alternative Ideas for the CALICE Back-End System Matthew Warren and Gordon Crone University.
First Paper in 1984 on FADCS FADC Cost Power RAM Power ECL TTL Narrow & Deep Need: Wide & Shallow More Expensive then FADC.
© Copyright Xilinx 2004 All Rights Reserved 9 November, 2004 XUP Virtex-II Pro Development System.
Highly Scalable Packetised correlators Jason Manley CASPER workshop 2009.
September 22, 2005 ESF Workshop-Perugia 1 Virgo Control Electronic upgrade Annecy/Pisa/EGO B.Mours.
ASKAP Signal Processing Overview DIFX Users and Developers Meeting
A Low-Cost Phase Cal Monitor and RFI Spectrum Analyzer for VLBI2010 Mark-5 / Mark-6 using Cheap,COTS Software Defined Radio (SDR) Hardware & Software Gleaned.
DLS Digital Controller Tony Dobbing Head of Power Supplies Group.
SLAAC SV2 Briefing SLAAC Retreat, May 2001 Heber, UT Brian Schott USC Information Sciences Institute.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array A New Multibeam Spectrometer.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array The VLBA Sensitivity.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array The VLBA Sensitivity.
SLAC Particle Physics & Astrophysics The Cluster Interconnect Module (CIM) – Networking RCEs RCE Training Workshop Matt Weaver,
Galfa Spectrometer Jeff Mock, Dan Werthimer Jeff Mock, Dan Werthimer Students: Henry Chen, Pavel Monat, Aaron Parsons, Wonsop Sim Science Advisors: Carl.
XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Dariusz Makowski, Technical University of Łódź LLRF review, DESY, 3-4 December 2007 Advanced.
Annapolis Micro Systems, Inc. 190 Admiral Cochrane Dr., Ste 130, Annapolis, MD Web: HQ Phone: (410) HQ Fax: (410)
The BEST-2 SKA pathfinder is composed by 32 receivers. The front ends are installed on the focal lines of 8 cylinders, offering a collecting area of about.
Nov 3, 2009 RN - 1 Jet Propulsion Laboratory California Institute of Technology Current Developments for VLBI Data Acquisition Equipment at JPL Robert.
CASPER Packetised correlators Jason Manley CASPER workshop 2009.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array CASPER Workshop 2009.
BEE3 Updates June 13 th, 2007 Chuck Thacker, John Davis Microsoft Research Chen Chang UC Berkeley.
MeerKAT DBE Past Present Future Alan Langman 28 September 2009.
S.Montebugnoli BEST 4 th SKADS Workshop, Lisbon, 2-3 October 2008 Stelio Montebugnoli IRA -INAF- Bologna –Italy- SKADS 4th -Lisbon- Oct 2-3, 2008.
Jason Manley, Aaron Parsons, Don Backer, Henry Chen, Terry Filiba, David MacMahon, Peter McMahon, Arash Parsa, Andrew Siemion, Dan Werthimer, Mel Wright.
Short introduction Pulsar Parkes. Outline PDFB – Single beam pulsar timing system CASPER – Single beam pulsar coherent dedispersion system.
Offering the freedom to design solutions Sundance OEM Solution.
CASPER Open Source Hardware Current and Future ADC’s
ATCA GPU Correlator Strawman Design ASTRONOMY AND SPACE SCIENCE Chris Phillips | LBA Lead Scientist 17 November 2015.
April 8/9, 2003 Green Bank GBT PTCS Conceptual Design Review John Ford September 28, 2009 Casper Instrumentation at Green Bank The NRAO is operated for.
Networking update and plans (see also chapter 10 of TP) Bob Dobinson, CERN, June 2000.
1 Conduant Mark5C VLBI Recording System 7 th US VLBI Technical Coordination Meeting Manufacturers of StreamStor ® real-time recording products
LIGO-G9900XX-00-M LIGO II1 Why are we here and what are we trying to accomplish? The existing system of cross connects based on terminal blocks and discrete.
BPM stripline acquisition in CLEX Sébastien Vilalte.
16 February 2011Ian Brawn1 The High Speed Demonstrator and Slice Demonstrator Programme The Proposed High-Speed Demonstrator –Overview –Design Methodology.
Performed By: Tal Goihman & Irit Kaufman Instructor: Mony Orbach Bi-semesterial Spring /04/2011.
Exploring the Unknown with CASPER Instrumentation Andrew Siemion CASPER Workshop 2011.
CPT week May 2003Dominique Gigi CMS DAQ 1.Block diagram 2.Form Factor 3.Mezzanine card (transmitter SLINK64) 4.Test environment 5.Test done 1.Acquisition.
Mircea Bogdan Chicago, Oct. 09, BIT, 500 MHz ADC Module for the KOTO Experiment The University of Chicago.
ROD Activities at Dresden Andreas Glatte, Andreas Meyer, Andy Kielburg-Jeka, Arno Straessner LAr Electronics Upgrade Meeting – LAr Week September 2009.
FP7 Uniboard project Digital Receiver G. Comoretto, A. Russo, G. Tuccari, A Baudry, P. Camino, B. Quertier Dwingeloo, February 27, 2009.
E. Hazen -- Upgrade Week1 AMC13 Project Status E. Hazen - Boston University for the CMS Collaboration.
E. Hazen -- Upgrade Meetings1 AMC13 Project DAQ and TTC Integration For MicroTCA in CMS Status Report E. Hazen - Boston University for the CMS.
SETI Spectrometer Development for ALFA
AMC13 Project Status E. Hazen - Boston University
The SLAC Instrumentation and Control Platform
Digital Down Converter (DDC)
AMC13 Status Report AMC13 Update.
Mark 5 / VLBA Correlator Topics
Future Hardware Development for discussion with JLU Giessen
Front-end electronic system for large area photomultipliers readout
05/08/09.
Commodity Flash ADC-FPGA Based Electronics for an
EVLA Advisory Panel Mtg. System Overview
Presentation transcript:

Hardware: Old, New, Future Hardware: Old, New, Future Dan Werthimer and Casper Collaborators

Existing Multi-purpose Hardware Existing Multi-purpose Hardware BEE2 (5 2VP70-7, 20 GB, 18 CX4)BEE2 (5 2VP70-7, 20 GB, 18 CX4) iBOB (1 2VP50-7, 8 MB, 2 CX4)iBOB (1 2VP50-7, 8 MB, 2 CX4) iADC (Atmel/E2V, 2 Gsps or 2*1Gsps, 8bit)iADC (Atmel/E2V, 2 Gsps or 2*1Gsps, 8bit) National ADC (3 Gsps, >2.5 GHz bandwidth)National ADC (3 Gsps, >2.5 GHz bandwidth) (can ping pong for 6 Gsps, can use dual 1.5 Gsps) (can ping pong for 6 Gsps, can use dual 1.5 Gsps) DAC Board, Dual DAC Board (10 bits (9 usuable), 1.5 Gsps)DAC Board, Dual DAC Board (10 bits (9 usuable), 1.5 Gsps) SERENDIP 5 (2V6000, 2V1000, 4 ADC’s 128 Msps)SERENDIP 5 (2V6000, 2V1000, 4 ADC’s 128 Msps) 10 Gbe Switches (HP, Foundry, Fujitsu….)10 Gbe Switches (HP, Foundry, Fujitsu….) 10 Gbe cables (Gore….)10 Gbe cables (Gore….)

Compute Module Diagram

Multi-Purpose Spectrometer – Low Bandwidth Aaron Parsons Xilinx Virtex-II 6000 FPGA Xilinx Virtex-II 1000 FPGA 256 MB DRAM 200 Mhz ADC Compact PCI Backplane Software 200 Mhz ADC 200 Mhz ADC 200 Mhz ADC I I Q Q Pol. 1 Pol. 2 { { 200 Aux. I/O

Agilent ADC-FGPA-CX4 board - ?? 20 Gsps 8 bit Agilent ADC XC5VSX240T 6 CX4 ports 120 Gbps xaui 100 Gbps infiniband 60 Gbps 10 Gbe

BEE3 BEE3 Chen Chang (designer of Bee1, Bee2 (PhD)) Chen Chang (designer of Bee1, Bee2 (PhD)) Microsoft, Celestica, Berkeley Microsoft, Celestica, Berkeley available from BeeCube available from BeeCube not open source not open source

ROACH (virtex 5) Reconfiguable Open Architecture Compute Hardware Mini-Roach – Henry Chen, Rick Raffanti Roach: Francois Kapp (lead), Alan Langman… -- KAT George Peck, Mike Revnell, Steve Durand -- NRAO Henry Chen – UCB CASPER Hayden So – Univ. Hong Kong Next gen correlators, beam formers, spectrometers, VLBI

Roach Mechanical Roach Mechanical 1 U ATX Enclosure $1501 U ATX Enclosure $150 ATX power supply $50ATX power supply $50

ATA quad digitizer, packetizer (planned ) ATA quad digitizer, packetizer (planned )

New FPGA Boards New FPGA Boards MiniRoach (V5 test board, spectrometer)MiniRoach (V5 test board, spectrometer) Roach (MeerKat, NRAO, Hong Kong, UCB)Roach (MeerKat, NRAO, Hong Kong, UCB) (V5, CX4, DRAM, SRAM) (V5, CX4, DRAM, SRAM) Bee3 (4*V5, CX4, DRAM, Microsoft, BeeCube)Bee3 (4*V5, CX4, DRAM, Microsoft, BeeCube) Roach II – XC5VSX240T, 6*CX4, 2DDR2, 3 QDRRoach II – XC5VSX240T, 6*CX4, 2DDR2, 3 QDR

ADC Boards – Current ADC Boards – Current Atmel: dual 1 Gsps, single 2 Gsps, 8 bit, 1.5 GHz Atmel: dual 1 Gsps, single 2 Gsps, 8 bit, 1.5 GHz National: 3 Gsps, 8 bit, 2.5 GHz bandwidthNational: 3 Gsps, 8 bit, 2.5 GHz bandwidth two can be interleaved to get 6 Gsps two can be interleaved to get 6 Gsps can also install dual 1.5 Gsps (ADC08D1500) can also install dual 1.5 Gsps (ADC08D1500) need Roach or Miniroach to get full sample rate need Roach or Miniroach to get full sample rate 64 channel ADC board – 12 bit, 65 Msps (2wide) 64 channel ADC board – 12 bit, 65 Msps (2wide)

ADC Boards - Planned Quad ADC (200 Msps, 8 bit), PCB Layed Out, HenryQuad ADC (200 Msps, 8 bit), PCB Layed Out, Henry MeerKat ADC – single 3 Gsps, or dual 1.5 Gsps, 8bitMeerKat ADC – single 3 Gsps, or dual 1.5 Gsps, 8bit programmable attenuation, gain, sample clock, Oct programmable attenuation, gain, sample clock, Oct ATA – ADC and FPGA, quad 1.5 Gsps, 8 bitATA – ADC and FPGA, quad 1.5 Gsps, 8 bit with programmable attenuation, gain with programmable attenuation, gain Agilent 20Gsps, 8 bit (unfunded)Agilent 20Gsps, 8 bit (unfunded) JPL optically isolated ADC (Robert Navarro)JPL optically isolated ADC (Robert Navarro) E2V ADC ? (5 Gsps, 2 * 2.5 Gsps, 4 * 1.25 Gsps)E2V ADC ? (5 Gsps, 2 * 2.5 Gsps, 4 * 1.25 Gsps)

Misc. Boards Misc. Boards Programmable Attenuator/Gain (RAL, Oren)Programmable Attenuator/Gain (RAL, Oren) 4 GHz BW, -16 to +16 dB in 0.5 db step, Notch Filter 4 GHz BW, -16 to +16 dB in 0.5 db step, Notch Filter (or minicircuits, $50, programable atten/gain) (or minicircuits, $50, programable atten/gain) 1 PPS distribution (RAL- Oren Milgrome)1 PPS distribution (RAL- Oren Milgrome) VSI connector (converts ZDOC to VSI)VSI connector (converts ZDOC to VSI) DAC board, 9 bits, ~1.5 Gsps DAC board, 9 bits, ~1.5 Gsps Dual Dac Board, 9 bits, ~1.5 GspsDual Dac Board, 9 bits, ~1.5 Gsps

Board Interconnect - Upgradable Board Interconnect - Upgradable Problem: Backplanes are short lived Problem: Backplanes are short lived (S100, Multibus, VME, ISA, EISA, PCI, PCIx, PCIe, compactPCI, compactPCIe, ATCA…) (S100, Multibus, VME, ISA, EISA, PCI, PCIx, PCIe, compactPCI, compactPCIe, ATCA…) Solution: Use 10Gbit EthernetSolution: Use 10Gbit Ethernet (10Gbe, Infiniband, Myrinet, Xaui, Aurora) (10Gbe, Infiniband, Myrinet, Xaui, Aurora) Copper CX4 (40 meters max) or Optical Copper CX4 (40 meters max) or Optical

CX4 cables CX4 cables Gore CX4 10Gbe cables (1, 2, 3, 15 meter…) Gore CX4 10Gbe cables (1, 2, 3, 15 meter…) about $75 each about $75 each (not infiniband cables) (not infiniband cables) (see cable length memo for V2Pro (see cable length memo for V2Pro 1-3 Meter max) 1-3 Meter max) Active CX4 Cables – 45 meter max Active CX4 Cables – 45 meter max Optical CX4 Cables – Matt Dexter tests ~$300 Optical CX4 Cables – Matt Dexter tests ~$300

10 Gbit Ethernet Switches, NIC’s 10 Gbit Ethernet Switches, NIC’s HP – Procurve 6 to 8 ports CX4, GbeHP – Procurve 6 to 8 ports CX4, Gbe Foundry – 16 XFP portsFoundry – 16 XFP ports Fujitsu – XG700 (12 CX4 ports)Fujitsu – XG700 (12 CX4 ports) Fujitsu – XG2000C (20 ports, 16 CX4, 4 XFP)Fujitsu – XG2000C (20 ports, 16 CX4, 4 XFP) Myricom – 10 Gbe NIC boards (PCIe)Myricom – 10 Gbe NIC boards (PCIe)

Where to get tested boards Where to get tested boards Build and test them yourself (cheapest for large Q))Build and test them yourself (cheapest for large Q)) iBOB, iADC, 5 volt cables, Digicom ElectronicsiBOB, iADC, 5 volt cables, Digicom Electronics Mo Ohady, Mo Ohady, Bee2, enclosure and power supply, SAE MaterialsBee2, enclosure and power supply, SAE Materials Mario Salazar, Mario Salazar, coordinate with Ken Lutz, BWRC, coordinate with Ken Lutz, BWRC, iBOB mounting plates, front panels – make or buy – NRAO? iBOB mounting plates, front panels – make or buy – NRAO? Other Vendors?? Rakesh Mehta, MTE India? Other Vendors?? Rakesh Mehta, MTE India?

Logistics – Presentations Logistics – Presentations Get your PPT,.PDF to Jason Manley Get your PPT,.PDF to Jason Manley Install on Presentation Laptop Install on Presentation Laptop DO NOT USE YOUR OWN LAPTOP DO NOT USE YOUR OWN LAPTOP Please wear microphone (see Jason) Please wear microphone (see Jason) We are posting video and ppt to web site We are posting video and ppt to web site Let Jason know if you don’t want your presentation posted Let Jason know if you don’t want your presentation posted

Logistics – Location Logistics – Location Saturday,Sunday at BWRC,Saturday,Sunday at BWRC, BWRC doors locked – buzz or call BWRC doors locked – buzz or call Sunday Night Pizza/Beer at Dan’s – all invitedSunday Night Pizza/Beer at Dan’s – all invited Monday, Tuesday at Space Sciences LabMonday, Tuesday at Space Sciences Lab Take Bus to SSL: $1, 12 mins, see program Take Bus to SSL: $1, 12 mins, see program Monday Tuesday Lunch will be provided Monday Tuesday Lunch will be provided Tours of BWRC lab, SSL in the afternoonsTours of BWRC lab, SSL in the afternoons

Logistics: Suggested Donation Logistics: Suggested Donation $ 50 ( $ 25 for students ) $ 50 ( $ 25 for students ) covers morning refreshments, two lunches… covers morning refreshments, two lunches… $  Andrew Siemion $  Andrew Siemion

Casper Advisory Board Casper Advisory Board Matthew Bailes, John Ford, Yashwant Gupta, Matthew Bailes, John Ford, Yashwant Gupta, Glen Jones, Alan Langman, Jonathan Weintroub Glen Jones, Alan Langman, Jonathan Weintroub Brainstorming Session – Open Mic – Tuesday AM Brainstorming Session – Open Mic – Tuesday AM Constructive Criticism Constructive Criticism Ideas for Future Directions, Long Term Strategy Ideas for Future Directions, Long Term Strategy How best to collaborate How best to collaborate Organizational Structure Organizational Structure Anything else  REPORT Anything else  REPORT

Thanks to Workshop Organizers Henry Chen, Terry Filiba, Griffin Foster, Suraj Gowda, Jason Manley, Billy Mallard, Peter McMahon, Andrew Siemion, Peter McMahon, Andrew Siemion, Laura Spitler, Mark Wagner