Michigan State University 7/12/2015 1 The Standard L2 Crate James T. Linnemann Michigan State University FNAL L2 Workshop December 19, 1997.

Slides:



Advertisements
Similar presentations
J. Linnemann, MSU 4/15/ Global L2 Outputs (and inputs) James T. Linnemann Michigan State University NIU Trigger Workshop October 17, 1997.
Advertisements

Ancillary firmware for the NSW Trigger Processor Lorne Levinson, Weizmann Institute for the NSW Trigger Processor Working Group NSW Electronics Design.
1/1/ / faculty of Electrical Engineering eindhoven university of technology Processor support devices Part 1:Interrupts and shared memory dr.ir. A.C. Verschueren.
CS-334: Computer Architecture
FIU Chapter 7: Input/Output Jerome Crooks Panyawat Chiamprasert
A Gigabit Ethernet Link Source Card Robert E. Blair, John W. Dawson, Gary Drake, David J. Francis*, William N. Haberichter, James L. Schlereth Argonne.
L1CAL Online Software Philippe Laurens 31-May-2005.
Uli Schäfer 1 JEM PRR Design changes Post-FDR tests FDR issues.
12 GeV Trigger Workshop Session II - DAQ System July 8th, 2009 – Christopher Newport Univ. David Abbott.
Michigan State University 6/20/ L2 Status James T. Linnemann Michigan State University DØ Collaboration Meeting April 3, 1998.
J. Linnemann, MSU 6/21/ Agenda L2 monitoring and readout Jim Linnemann 20 min Magic Bus Transceiver Dan Edmunds 20 min Plans for the GL2 Card Drew.
TECH CH03 System Buses Computer Components Computer Function
Chapter 13: I/O Systems I/O Hardware Application I/O Interface
Ionization Profile Monitor Project Current Status of IPM Buffer Board Project 10 February 2006 Rick Kwarciany.
Michigan State University 6/28/ L2 I/O Transfer James T. Linnemann Michigan State University Trigger Meeting February 20, 1998.
Sept TPC readoutupgade meeting, Budapest1 DAQ for new TPC readout Ervin Dénes, Zoltán Fodor KFKI, Research Institute for Particle and Nuclear Physics.
Chapter 13: I/O Systems I/O Hardware Application I/O Interface
CS-334: Computer Architecture
Input/Output. Input/Output Problems Wide variety of peripherals —Delivering different amounts of data —At different speeds —In different formats All slower.
Chapter 10: Input / Output Devices Dr Mohamed Menacer Taibah University
DDL hardware, DATE training1 Detector Data Link (DDL) DDL hardware Csaba SOOS.
Trigger Supervisor (TS) J. William Gu Data Acquisition Group 1.TS position in the system 2.First prototype TS 3.TS functions 4.TS test status.
Input/OUTPUT [I/O Module structure].
MICROPROCESSOR INPUT/OUTPUT
CHAPTER 3 TOP LEVEL VIEW OF COMPUTER FUNCTION AND INTERCONNECTION
Top Level View of Computer Function and Interconnection.
PHENIX upgrade DAQ Status/ HBD FEM experience (so far) The thoughts on the PHENIX DAQ upgrade –Slow download HBD test experience so far –GTM –FEM readout.
Input/Output 2 What is I/O? How we get the CPU to communicate with devices From the computer’s point of view, it’s just 1’s and 0’s Gets interpreted.
2009 Sep 10SYSC Dept. Systems and Computer Engineering, Carleton University F09. SYSC2001-Ch7.ppt 1 Chapter 7 Input/Output 7.1 External Devices 7.2.
Dr Mohamed Menacer College of Computer Science and Engineering Taibah University CE-321: Computer.
Interrupts, Buses Chapter 6.2.5, Introduction to Interrupts Interrupts are a mechanism by which other modules (e.g. I/O) may interrupt normal.
Input/Output Computer component : Input/Output I/O Modules External Devices I/O Modules Function and Structure I/O Operation Techniques I/O Channels and.
EEE440 Computer Architecture
FNAL STT Meeting  H.Evans 8/9/99 Communication & Control H.EvansColumbia U. Overview of FRC Functions:  Road Info STCs,TFCs –Device Independent Data.
ECEG-3202 Computer Architecture and Organization Chapter 3 Top Level View of Computer Function and Interconnection.
Michigan State University 11/26/ Overview of Level 2 James T. Linnemann Michigan State University Level 2 Review Feb 6, 1999.
1 07/10/07 Forward Vertex Detector Technical Design – Electronics DAQ Readout electronics split into two parts – Near the detector (ROC) – Compresses and.
1 Programming of FPGA in LiCAS ADC for Continuous Data Readout Week 5 Report Tuesday 29 th July 2008 Jack Hickish.
Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.
Samuel Silverstein Stockholm University CMM++ firmware development Backplane formats (update) CMM++ firmware.
June 17th, 2002Gustaaf Brooijmans - All Experimenter's Meeting 1 DØ DAQ Status June 17th, 2002 S. Snyder (BNL), D. Chapin, M. Clements, D. Cutts, S. Mattingly.
9/12/99R. Moore1 Level 2 Trigger Software Interface R. Moore, Michigan State University.
Input/Output Problems Wide variety of peripherals —Delivering different amounts of data —At different speeds —In different formats All slower than CPU.
Chapter 13: I/O Systems Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 13: I/O Systems Overview I/O Hardware Application.
IT3002 Computer Architecture
J. Linnemann, MSU 2/12/ L2 Status James T. Linnemann MSU PMG September 20, 2001.
1 Level 1 Pre Processor and Interface L1PPI Guido Haefeli L1 Review 14. June 2002.
LIGO-G9900XX-00-M LIGO II1 Why are we here and what are we trying to accomplish? The existing system of cross connects based on terminal blocks and discrete.
Bob Hirosky L2  eta Review 26-APR-01 L2  eta Introduction L2  etas – a stable source of processing power for DØ Level2 Goals: Commercial (replaceable)
بسم الله الرحمن الرحيم MEMORY AND I/O.
Chapter 3 System Buses.  Hardwired systems are inflexible  General purpose hardware can do different tasks, given correct control signals  Instead.
Proposal for a “Switchless” Level-1 Trigger Architecture Jinyuan Wu, Mike Wang June 2004.
B. Hirosky 12/14/00 FPGA + FIFO replaces: DMA P/IO buffers TSI device Keep ECL drivers BUY THIS! Same Basic Concept as L2Alpha, but with simplified implementation.
ATLAS Pre-Production ROD Status SCT Version
AFE II Status First board under test!!.
TTC system and test synchronization
Communication & Control
Chapter 13: I/O Systems I/O Hardware Application I/O Interface
Idle Setup Run Startup Process Wait Event Event Wait Answer Send
Chapter 13: I/O Systems.
Presentation transcript:

Michigan State University 7/12/ The Standard L2 Crate James T. Linnemann Michigan State University FNAL L2 Workshop December 19, 1997

Michigan State University 7/12/ L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME Standard Crate JTL, MSU 12/18/ TCC VBDVBD Inputs MBus SCL Outputs to Global (preprocessors only) L2 Answer L2 HWFW (Global only) 8 VME slots minimum

Michigan State University 7/12/ Bit3 MPM l PCI Card for PC, cable, and VME master l Add Multiport Memory Module l Perform general VME I/O, generate interrupts l Download parameters for run l Run begin/end commands l Collect Monitoring information preferably, already placed in MPM by Administrator Alpha If necessary, can collect from other modules

Michigan State University 7/12/ VBD l VME Master to read out to L3 l Not interruptable during Readout l Probably MB/s effective l Must read from SAME set of VME addresses every event some of wordcounts may be zero faster if fewer addresses intent is readout from Worker Alpha

Michigan State University 7/12/ Alphas l Up to 1 GIP Alpha on VME card small local disk for bootup Enet to Dec Unix Alpha for user.EXE, debugging l All Mbus I/O via MBT card Mbus DMA input MB/s Mbus bidirectional programmed I/O 20 MB/s? l 64b parallel I/O l 2 per crate Workerformatting, Output to Global Administratorhousekeeping, L3 R/O

Michigan State University 7/12/ MBT Magic Bus Transceiver l Vme slave; Mbus Master and slave Administrator controls card(s) l 7-8 Cypress Hotlink inputs 160 or 320 MB/s in Copper Cables  broadcast to Alphas (Workers & Admin) on Mbus normal data Input path l 2 Cypress Outputs Preprocessor output to L2 Global input MBT’s

Michigan State University 7/12/ MBT, continued l Serial Command Link (SCL) Receiver broadcast L1 to Alphas on Mbus –synchronization check –L1 Qualifiers Queue L2 for Administrator Mbus reads l 128 b Parallel I/O Global uses to send L2 decision to L2 HWFW Misc communication/control signals (VBD?)

Michigan State University 7/12/ Standard Crate Uses l Global JUST Standard Crate described so far l Cal: more workers l Standard Crate can also be used with non-Alpha, non-MBus pre-preprocessor Cypress inputs to Worker via MBT –format, massage data for Global handle L2, L3 buffering & I/O, most of monitoring Completely standard data movement software –User code testable once data structure fixed Penalty: extra latency (lose a buffer) –“pre-preprocessor”

Michigan State University 7/12/ SLIC: Serial Link Input Card l 16 Cypress serial inputs VME slave card (single slot?) l 4 TI DSP’s, up to 2 GIPS each l more inputs, CPU / slot than Alpha l output via Hotlink to MBT l Readout via Worker Alpha via MBT Acts as pre-preprocessor l test registers on all inputs (eg. SCL)

Michigan State University 7/12/ SFO: SCL Fanout l Receives L1 SCL information l Fans out as Cypress output to 16 SLIC cards event synchronization L1 Qualifiers l functional blocks all from MBT l No VME interface required except for testing? need not be in VME crate?

Michigan State University 7/12/ Standard Crate with SLIC JTL, MSU 12/18/97 L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME TCC VBDVBD Inputs MBus SCL Outputs to Global 10 VME slots minimum SFOSFO SLICSLIC Inputs

Michigan State University 7/12/ Fiber Input Converter (FIC) l Convert Fiber Input to Cu Cypress Hotlink What Cypress speed? 160 or 320? What Speed Fiber? LED or Laser? l Front end to either SLIC or MBT avoids variants of complex card l No VME needed (need not live in VME crate) l Need if inputs are long haul from platform ? (vs. transformers?) l Harder (more expensive, fewer channels) if full-speed g-link conversion needed

Michigan State University 7/12/ Standard Crate with FIC to SLIC JTL, MSU 12/18/97 L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME TCC VBDVBD Inputs MBus SCL Outputs to Global 11 VME slots minimum SFOSFO SLICSLIC FICFIC Inputs

Michigan State University 7/12/ Standard Crate with FIC to MBT JTL, MSU 12/18/97 L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME TCC VBDVBD MBus SCL Outputs to Global 9 VME slots minimum FICFIC Inputs

Michigan State University 7/12/ SCL Fanout Questions l Modest project, small production run l Needed only by SLIC’s l 11channels for crate filled with SLIC’s l When? Only by Commissioning no trigger framework: fake SCL on SLIC l Who? MBT designer, in series? SLIC designer or someone else? –after relevant MBT blocks designed

Michigan State University 7/12/ FIC: L2CFT from L1 CFT trigger l Presently, plan g-link 1.3Gb/s = 100MB/s L1CFT: 100B (50 tracks)/fiber to STT in 1  s –L1CFT plans to send fixed length, pad w/ trailing zeros l 4 g-link inputs per card max l 8 fibers = 2 cards for L2CFT l Advantage of g-link FIC: could accept raw data (e.g. for CPS) l 320MB/s Cu Cypress + transformer??? only if lower to 24 tracks, and time budget to 2  s cheaper, 8 inputs, single card for L2CFT –no buffering needed? Fiber or copper+Xformer for platform inputs L2 CFT, perhaps L2 FPS? l Who needs what speed? L1 trigger info: just do fiber to copper? –Presently: plan How many channels per card? 4 if glink; else 8 HOW MANY INPUT CHANNELS? –CFT=_________CPS=_____________ What are breakpoints for cost: LED vs Laser –160 vs 320 vs faster? l Who? When needed? commercial building blocks? Modest project

Michigan State University 7/12/ FIC: Raw Data Input l Split of raw data fiber requires 1.3 Gb/s g-link l needed if do CPS no cable count yet use as part of STT? –More likely, recycle part of VRB input

Michigan State University 7/12/ MBT Simplifications: are all sources intelligent? l Enforce padding to 16 B? No? probably can’t if accepting raw data l Enforce maximum event size? Try. Input FIFOs hold 16 worst-case M+P events –need definition from EVERY know source Truncate if overflow anyway (no marker added!) –In-band marker makes assumptions about data formats! –OK if processors can recognize w/o extra work l OK for L2-formatted inputs (trailers broken) l what about raw fiber data? l SAME issues for SLIC inputs

Michigan State University 7/12/ MBT Testing Questions l VME OR MBus Control/Setup Fake data for inputs, outputs Loopback test of output(s) to inputs at full speed –VME readback of filled FIFO’s needed l MBus only: need MBus, Alphas Broadcast input test Parallel I/O test Mbus Control/Setup l SCL Test Jig? SCL L1formatting + standard input SCL L2: need Alpha? Check with SCL designers: Walter Knopf in Barsotti group

Michigan State University 7/12/ Development System Questions l Digital Unix Alpha required for debugging compile, link at any Alpha; serve disk anywhere? l Most user software needs only simulator with correct data format and buffer structure should build into simulator l Data movement software from Global & Cal MINOR modifications –specific qualifiers needed

Michigan State University 7/12/ Development System, II l How long do which systems stay at home? Current estimate is 50K for a Standard Crate Attempt communication with Global before commissioning--requires extra development crate Timing may force production of Alpha cards early –lose potential for later speedup?

Michigan State University 7/12/ Test Stand at Fermi l Global, Cal-like, Mu/Track-like, Data Source l Incomplete system-- no HWFW not enough parts for full code of any/all crates –except maybe full playback for Global –could reconfigure if need be--painful!

Michigan State University 7/12/