PXD DAQ News S. Lange (Univ. Gießen) Belle II Trigger/DAQ Meeting (Jan 16-18, 2012, Hawaii, USA) Today: only topics important for CDAQ - GbE Connection.

Slides:



Advertisements
Similar presentations
Network II.5 simulator ..
Advertisements

Copyright© 2000 OPNET Technologies, Inc. R.W. Dobinson, S. Haas, K. Korcyl, M.J. LeVine, J. Lokier, B. Martin, C. Meirosu, F. Saka, K. Vella Testing and.
An ATCA and FPGA-Based Data Processing Unit for PANDA Experiment H.XU, Z.-A. LIU,Q.WANG, D.JIN, Inst. High Energy Physics, Beijing, W. Kühn, J. Lang, S.
06-Dec-2004 HCAL TriDAS 1 TriDAS Status HF Luminosity HF Trigger Slicing.
System Architecture A Reconfigurable and Programmable Gigabit Network Interface Card Jeff Shafer, Hyong-Youb Kim, Paul Willmann, Dr. Scott Rixner Rice.
The TrainBuilder ATCA Data Acquisition Board for the European XFEL The TrainBuilder ATCA Data Acquisition Board for the European-XFEL John Coughlan, Chris.
The Train Builder Data Acquisition System for the European-XFEL John Coughlan, Chris Day, Senerath Galagedera and Rob Halsall STFC Rutherford Appleton.
Networking Virtualization Using FPGAs Russell Tessier, Deepak Unnikrishnan, Dong Yin, and Lixin Gao Reconfigurable Computing Group Department of Electrical.
1.  Project Goals.  Project System Overview.  System Architecture.  Data Flow.  System Inputs.  System Outputs.  Rates.  Real Time Performance.
Status Report of CN Board Design Zhen’An LIU Representing Trigger Group, IHEP, Beijing Panda DAQ Meeting, Munich Dec
DEPFET Backend DAQ, Giessen Group 1 ATCA based Compute Node as Backend DAQ for sBelle DEPFET Pixel Detector Andreas Kopp, Wolfgang Kühn, Johannes Lang,
SODA: Synchronization Of Data Acquisition I.Konorov  Requirements  Architecture  System components  Performance  Conclusions and outlook PANDA FE-DAQ.
TRIGGER-LESS AND RECONFIGURABLE DATA ACQUISITION SYSTEM FOR POSITRON EMISSION TOMOGRAPHY Grzegorz Korcyl 2013.
RiceNIC: A Reconfigurable and Programmable Gigabit Network Interface Card Jeff Shafer, Dr. Scott Rixner Rice Computer Architecture:
GBT Interface Card for a Linux Computer Carson Teale 1.
SLAC Particle Physics & Astrophysics The Cluster Interconnect Module (CIM) – Networking RCEs RCE Training Workshop Matt Weaver,
N33-6 NSS2006 Development of a TCP/IP Processing Hardware 1,2) Tomohisa Uchida and 2) Manobu Tanaka 1) University of Tokyo, Japan 2) High Energy Accelerator.
Data Acquisition for the 12 GeV Upgrade CODA 3. The good news…  There is a group dedicated to development and support of data acquisition at Jefferson.
R&D for First Level Farm Hardware Processors Joachim Gläß Computer Engineering, University of Mannheim Contents –Overview of Processing Architecture –Requirements.
Management of the LHCb DAQ Network Guoming Liu * †, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.
1 Network Performance Optimisation and Load Balancing Wulf Thannhaeuser.
XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Communication in ATCA-LLRF System LLRF Review, DESY, December 3rd, 2007 Communication in.
Lecture 4 Overview. Ethernet Data Link Layer protocol Ethernet (IEEE 802.3) is widely used Supported by a variety of physical layer implementations Multi-access.
McGraw-Hill©The McGraw-Hill Companies, Inc., 2004 Connecting Devices CORPORATE INSTITUTE OF SCIENCE & TECHNOLOGY, BHOPAL Department of Electronics and.
Takeo Higuchi (KEK); CHEP pptx High Speed Data Receiver Card for Future Upgrade of Belle II DAQ 1.Introduction – Belle II DAQ Experimental apparatus.
Kraków4FutureDaQ Institute of Physics & Nowoczesna Elektronika P.Salabura,A.Misiak,S.Kistryn,R.Tębacz,K.Korcyl & M.Kajetanowicz Discrete event simulations.
Modeling PANDA TDAQ system Jacek Otwinowski Krzysztof Korcyl Radoslaw Trebacz Jagiellonian University - Krakow.
US Peripheral Crate VMEbus Controller Ben Bylsma EMU – ESR CERN, November 2003.
XLV INTERNATIONAL WINTER MEETING ON NUCLEAR PHYSICS Tiago Pérez II Physikalisches Institut For the PANDA collaboration FPGA Compute node for the PANDA.
1 Conduant Mark5C VLBI Recording System 7 th US VLBI Technical Coordination Meeting Manufacturers of StreamStor ® real-time recording products
DAQ interface + implications for the electronics Niko Neufeld LHCb Electronics Upgrade June 10 th, 2010.
LKr readout and trigger R. Fantechi 3/2/2010. The CARE structure.
Management of the LHCb DAQ Network Guoming Liu *†, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.
S.Anvar, V.Gautard, H.Le Provost, F.Louis, K.Menager, Y.Moudden, B.Vallage, E.Zonca, on behalf of the KM3NeT consortium 1 IRFU/SEDI-CEA Saclay F
ROM. ROM functionalities. ROM boards has to provide data format conversion. – Event fragments, from the FE electronics, enter the ROM as serial data stream;
New ATCA compute node Design for PXD Zhen-An Liu TrigLab, IHEP Beijing Feb , 6th International Workshop on DEPFET Detectors and Applications.
Report from Grünberg Workshop Sören Lange, Universität Gießen 5 th International Workshop on DEPFET Detectors and Applications , Valencia,
Grzegorz Korcyl - Jagiellonian University, Kraków Grzegorz Korcyl – PANDA TDAQ Workshop, Giessen April 2010.
Report from 5th PXD DAQ Workshop Tokyo University, November 19-20, 2012 Tokyo Daigakku = „Todai“ symbol is Ginkgo leafs.
Prototype of the SVD Finesse Transmitter Board (FTB) (Sender Part for HSD Link) wacek ostrowicz 14 slides The Prototype of the SVD FTB Recent.
August 24, 2011IDAP Kick-off meeting - TileCal ATLAS TileCal Upgrade LHC and ATLAS current status LHC designed for cm -2 s 7+7 TeV Limited to.
Status of the SVD DAQ Koji Hara (KEK) 2012/1/16 TRG/DAQ meeting1.
PXD ATCA DAQ Issues and Announcements S. Lange (Universität Gießen) Belle PXD and SVD Workshop Göttingen,
DHH Status Igor Konorov TUM, Physics Department, E18 PXD DAQ workshop Münzenberg –June 9-10, 2011.
ROD Activities at Dresden Andreas Glatte, Andreas Meyer, Andy Kielburg-Jeka, Arno Straessner LAr Electronics Upgrade Meeting – LAr Week September 2009.
Compute Node Tutorial(2) Agenda Introduce to RocketIO How to build a optical link connection Backplane and cross link communications How to.
Data Acquisition of the PXD Takeo Higuchi (KEK) PXD follow up meeting on Nov.7,2010 « DISCLAIMER» Materials prepared for and presented in PXD follow up.
PXD DAQ in Giessen 1. How we do programming 2. Proposal for link layer Bonn+Giessen Meeting, Feb 2, 2011.
Firmware and Software for the PPM DU S. Anvar, H. Le Provost, Y.Moudden, F. Louis, E.Zonca – CEA Saclay IRFU – Amsterdam/NIKHEF, 2011 March 30.
SVD → PXD Data Concentrator (DC) Jochen Dingfelder Carlos Mariñas Michael Schnell
Status Report of the PC-Based PXD-DAQ Option Takeo Higuchi (KEK) 1Sep.25,2010PXD-DAQ Workshop.
Status of Compute Node Zhen’an Liu, Dehui Sun, Jingzhou Zhao, Qiang Wang, Hao Xu Triglab, IHEP, Beijing Wolfgang Kühn, Sören Lange, Univ. Giessen Belle2.
Mitglied der Helmholtz-Gemeinschaft Status of the MicroTCA developments for the PANDA MVD Harald Kleines, ZEL, Forschungszentrum Jülich.
DHH at DESY Test Beam 2016 Igor Konorov TUM Physics Department E18 19-th DEPFET workshop May Kloster Seeon Overview: DHH system overview DHE/DHC.
Demo system of Belle2link Sun Dehui, Zhao Jingzhou,Liu zhen’an Trigger Lab IHEP.
Eric Hazen1 Ethernet Readout With: E. Kearns, J. Raaf, S.X. Wu, others... Eric Hazen Boston University.
Private Notes on the 3 rd PXD DAQ/Trigger Workshop T.Higuchi (KEK) Jul.8,2011B2GM.
Modeling event building architecture for the triggerless data acquisition system for PANDA experiment at the HESR facility at FAIR/GSI Krzysztof Korcyl.
Data and Control link via GbE
Modeling event building architecture for the triggerless data acquisition system for PANDA experiment at the HESR facility at FAIR/GSI Krzysztof Korcyl.
PXD DAQ Workshop June 9 and 10, 2011 Münzenberg (near Gießen) Goals: 1
PANDA collaboration meeting FEE session
Future Hardware Development for discussion with JLU Giessen
The Train Builder Data Acquisition System for the European-XFEL
PXD ATCA DAQ for DESY Test
CMS DAQ Event Builder Based on Gigabit Ethernet
Development of new CN for PXD DAQ
New Crate Controller Development
8-layer PC Board, 2 Ball-Grid Array FPGA’s, 718 Components/Board
Data Link Issues Relates to Lab 2.
Presentation transcript:

PXD DAQ News S. Lange (Univ. Gießen) Belle II Trigger/DAQ Meeting (Jan 16-18, 2012, Hawaii, USA) Today: only topics important for CDAQ - GbE Connection to CDAQ - DATCON All other new discussions and results  Vienna PXD+SVD Workshop

2 Connection of PXD DAQ (ATCA) to CDAQ (EVB #2)

3 Send PXD data by GbE to CDAQ  Plan A: GbE by PowerPC (Linux) UDP or TCP/IP software  Plan B (only if plan A does not work)  GbE by optical link UDP hardware  GbE by siTCP TCP/IP hardware  Related questions:  do we need a GbE switch ARISTA 7500 ? (150kEuro) (see Yamagata-san‘s talk at Yugawara)  should ATCA do PXD subevent building, or not?  requires ATCA backplane discouraged by PAC report  needs 3rd Ph.D. student (decision about BMBF application expected 06/2012)  [SVD+PXD] subevents required by GPU farm

4 1. Send GbE by PowerPC  Embedded PPC on Virtex-4 or -5  3% PXD occupancy = 540 MB/s factor 3 reduction by HLT factor 10 reduction by ATCA (design goal of algorithm) = 18 MB/s required  TCP/IP tested o.k. ~26 MB/s achieved at IHEP on PPC405 on Virtex-4 (CN Vers. 1) (~22.5 MB/s in Giessen by Björn Spruck, CN Vers. 2) Compute Node Version #2 Virtex-4 FX60 Compute Node Version #3 Virtex-5 FX70T

5 2. Send GbE by optical link  Only necessary, if design reduction factor not achievable  Guest project at Giessen Greg Korcyl (Panda) 2-3 weeks in August weeks in November 2010 work continues in Krakow with a CN Vers. 2  UDP  So far optical links, but copper GbE should be possible work in progress  in any case, can be used as Bonn  Giessen interface (DATCON sending SVD ROI to ATCA)  See next 2 slides: - test system - test results

6 Test System optical RJ45

7 Test Results (report by G. Korcyl, )  Sucessfully implemented and tested  DHCP address acquisition  Address based filtering  ARP discovery  Ping (just to check the status)  Stat: a module that sends a frame each few seconds with current statistics, (rx, tx, frames counters etc.)  DataRX: a module to receive detector data receives all the frames sent to a given UDP port and stores the data to the CN memory  Loopback test (G. Korcyl and B. Spruck)  Packet sent from PC received by fpga logic  Data transferred to the CN memory  Application running on PPC gets notified that new has been stored in the memory  Application initiates the transmission of the data back to fpga logic  TX module of fpga constructs a packet and sends it back to the PC  Conclusions:  solution is working but for the moment is not stable (bytes get lost, garbage bytes appear etc.)  achieved rate at <60 MB/s

8 2. Send GbE by siTCP  Only necessary, if design reduction factor not achievable  FPGA TCP/IP firmware - supported by KEK (Tomohisa Uchida-san, Manobu Tanaka-san) many thanks for their help - licenses are commercial, 8000,- Yen per 1 MAC addr  Test by Thomas Geßler at KEK, 2 weeks in Dec 2011  tested sucessfully on ML403 (Virtex-4 FX20) and CN Vers. 3 (Virtex-5 FX70T)  resources usage very small 9% Slice Registers, 7% Slice LUTs, 9% BRAM  >100 MB/s achieved from CN3 to PC  disadvantage: only 1 connection open at a time  generates overhead, if packets are send to different EVB receivers (open, send, acknowledge, close = 4 packets for 1 packet payload) -> principally only 1 EVB (fixed MAC addr) -> there is no advantage compared to UDP most probably ruled out

9 Proposal for Discussion: 1:1 MAC addr assignment RJ45 UDP On PC: - UDP checking algorithm (package dropped?) - conversion from UDP to TCP/IP - PXD subevent builder No fixed MAC addr assignment RJ45 TCP/IP ATCAEVB #2 /40/~10

DATCON Bonn System for SVD ROI J. Dingfelder, C. Marinas, M. Schnell

11 Data Concentrator (DatCon) for data reduction with an FPGA-based track finding algorithm Input: 42 optical links with 1.5 Gbps line rate Output: One Ethernet and two 6.25 Gbps high speed links Hardware : 12 AMC cards in an ATCA shelf with 3 carrier boards Data Concentrator: Concept and implementation

12 Custom protocol "BELLE II Link" for data transmission Aurora protocol for internal high speed data routing Multiplexer and Memory Management Unit for data collection and storage "Fast Hough Transformation" or "cellular automaton" implemented in FPGA for track finding Hardware solution and future plans

Mahalo.