Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Timing and Event System S. Allison, M. Browne, B. Dalesio, J. Dusatko, R. Fuller, A. Gromme, D. Kotturi, P. Krejcik, S. Norum, D. Rogind, H. Shoaee, M. Zelazny

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Outline Overview – HW Block Diagram and Reqts Progress since Oct, 2006 Outstanding Issues Task List HW Status & Long-Haul Fiber Issues

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Timing Architecture ~ Linac main drive line FIDO E V G SLC MPG PNETPNET 119 MHz360 Hz SLC pattern Events & Data PNETPNET PP STBSTB EVREVR OCOC TTL-NIM convert. LCLS Digitizer LLRF BPMs Toroids Cameras GADCs TTL SLC Trigs OCOC Old klystrons Events & Data

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Beam Path Existing Control System 119MHz Clock EVREVR Hardware Block Diagram 2007 Commissioning IOCIOC EVGEVG PNETPNET Fiber Distribution: Timing Pattern, Timestamp, Event Codes EVR1EVR1 Acc and Standby Triggers 360Hz Fiducial Beam Rate, Beam Path Future MPS RF Timing Modulator Triggers PADs and PACs FAN1FAN1 FAN2FAN2 FAN3FAN3 EVR1EVR1... IOC1IOC1 CAM1CAM1 EVR8EVR8 IOC8IOC8 CAM8CAM8 Trigger Laser Steering Crate FAN4FAN4 EVR1EVR1 … IOC1IOC1 CAM1CAM1 EVR4EVR4 IOC4IOC4 CAM7CAM7 Profile Monitor Crate CAM2CAM2 CAM8CAM8 … … Triggers IOCIOC BPM FEE Acq and Calibration Triggers BPM Crates Timing Crate LLRF Crate EVR2EVR2 IOCIOC EVR3EVR3 EVREVR IOCIOC TORO FEE Toro Farc Crate

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Event System Requirements Event Generator IOC : Send out proper event codes at 360Hz based on: PNET pattern input (beam code and bits that define beam path and other conditions) Add LCLS conditions such as BPM calibration on off-beam pulses, diagnostic pulse etc. Future – event codes also based on new MPS and user input Send out system timestamp with encoded pulse ID from PNET Send out PNET pattern to be used by SLC-aware IOCs Manage user-defined beam-synchronous acquisition measurement definitions Check for match between user meas definitions and input PNET pattern at 360Hz and tag matches in outgoing pattern MPS Algorithm Processors and Master Pattern Generator (MPG): Rate-liming logic including beam “burst” and “single-shot” modes Send out PNET pattern to EVG and CAMAC controls (for modulator triggers)

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Event System Requirements, cont Event Receiver IOC: Receive event pattern 8.3 msec before corresponding pulse Set trigger delays, pulse widths, and enable/disable via user requests (not yet done on a pulse-by-pulse basis) Perform beam-synchronous acquisition based on tags set by EVG in the pattern Perform beam-synchronous acquisition for the SLC- aware IOC based on the PNET part of the event pattern Set event code per trigger (triggering done in HW when event code received) Process pre-defined records when specific event codes are received (not yet available)

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 EVG Event Time Line – 4 Fiducials F1 (n=1) F2 (n=2) F3 (n=3) Hz Fiducial Time (msec) B0 P0 P1 P2 Receive Fn+3 PNET, determine Fn+3 LCLS pattern, and advance pipeline (n-2->n-1->n) HW starts sending event codes, starting with fiducial event code R1 9.3 R0 R2 E1E2 Set Event Codes in Alt RAM based on the last patterns for Fn+1 E3 F0 (n=0) 8.3 R3 P3 E4 B-3 120Hz BEAM 1.0 L0 L1 L3 Send LCLS pattern L2

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Trigger Event Time Line – 1 Beam Pulse (B0) F3 0 Fiducial Time (usec) B0 Acq Trigger 1023 Beam Kly Standby Record processing (event, interrupt) Fiducial Event Received Event Timestamp, pattern records, and BSA ready Receive pattern for 3 pulses ahead Hardware Triggers Triggering Event Codes Start Kly Accel

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Tallies for 2007 Commissioning # EVRs = 31 (mostly PMC) # IOCs with EVRs = 28 # EVR Fanouts = 4 # Hardware Triggers = 120 and counting All TTL except 2 NIM triggers for QDCs Most require short cables (except LLRF) EVR with clock not yet available All acquisition electronics using either internal clocks, clock output from the RF timing system, or other external clocks

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Progress since Oct, 2006 Installation in sector 20 and 21, commissioning in- progress, most timing delays are “iced-in” Finished hardware bench testing Finished PMC-EVR driver EVG sequence RAM programming at 360Hz, conditional logic is primitive but good enough for now Event pattern records and timestamp distribution on the EVR IOCs Finished cabling plans and documentation Finished beam-synchronous acquisition

Trigger Control Display

Trigger Event Assignment Display

EVG Displays

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Issues Outstanding problem (presumably software) where CPU hangs when EVR interrupts are enabled. Some IOCs running without interrupts (hardware triggers but without timestamps, BSA, or event code IRQs). Documentation and help screens sorely lacking. EVG IOC doesn’t know when there’s no beam, only when beam is possible – limits trigger conditions. Software not yet in place to handle hardware and communication errors.

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Tasks Long Haul Fiber Test – next month BC2 (sectors 21 to 30): 60 EVRs to order - 34 VME, 26 PMC 5 fanout modules (1 every 2 sectors) $250K, needed by August SW - only DB and display work planned Still some existing database and display work to do SLC-aware IOC BPM integration still in progress Software - fix hang problem, add HW error detection and recovery Beyond BC2: New LCLS MPS interface BSY/LTU/Undulator Procurement and Plans Changes to EVR firmware to change behavior when multiple triggers on a single pulse Generic trigger delay scan package Bunch charge change on pulse-by-pulse basis? More complex conditional logic for event codes (EVG) and pulse-to-pulse changes in trigger attributes?

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Event System – Hardware Status The New LCLS Event System has been installed in the Injector and S20 We have successfully integrated it with the SLC Timing System (required some mods to EVG) The Event System HW is performing as expected At the first order / Still in its infancy Other than EVR IRQ Problem / HW working The Next HW Challenge is Long-Haul Distribution of Timing

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 IN20 Installation Diagram shows IN20 / LI20 Event System installation Top-Level shows connections to SLC Timing, MDL The EVG Crate is shown with its fanouts to all subsystems

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Event System HW: Long-Haul Dist. For BC2 & beyond, the biggest challenge is Long- Haul distribution of timing data via the Fiber-Optical (F-O) Links Why? MRF Event System is designed around Multi-Mode SFP (Small Form-Factor Pluggable) F-O links which allow a maximum fiber length of ~300 meters Our requirements include runs of several Kilometers (at least) Cannot daisy-chain the event F-O links: exceeds the jitter budget Temperature effects on long fibers – drift, but how bad?

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Event System HW: Long-Haul Dist. Proposed Solution: New HW and some testing Single-Mode, pin-compatible SFP modules are commercially available (Agilent ACFT-57R5) All us to go ~10KM Should plug right into our event system HW Have ordered some, will test when they arrive Still does not solve temperature-induced phase- drift problem Propose to solve by either/and: Running Long Fiber in temperature-controlled environment Re-Syncing EVRs to a locally-distributed 119MHz source

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Event System HW: Special Test Long-Haul Event Fiber System Test: What it will determine: Function of Single-Mode SFP Modules Drift, Trigger time jitter, Phase Noise How: Compare two EVR’s triggers & RF Clocks One EVR Short-Haul Other EVR Long-Haul Also compare to reference RF Clock When: As soon as possible, have all components except EVRs New RF-recovery EVRs due in at end of April

Stephanie Allison Facility Advisory Committee Meeting Apr 16, 2007 Event System – Long-Haul Fiber System Test