Timing System of the Swiss Light Source Timo Korhonen Paul Scherrer Institute, Switzerland 1. Introduction 2. Components and technology 3. SLS Timing Application.

Slides:



Advertisements
Similar presentations
XFEL 2D Pixel Clock and Control System Train Builder Meeting, DESY 22 October 2009 Martin Postranecky, Matt Warren, Matthew Wing.
Advertisements

System Integration and Performance
01/11/2002SNS Software Final Design Review1 V123S Event Link Encoder, Transmission System and PLL Receiver Thomas M. Kerner (BNL) SNS Global Controls.
Stephanie Allison LCLS Event System 14 June LCLS Event System Outline HW Block Diagram Timing Requirements Time Lines EVG.
JLab High Resolution TDC Hall D Electronics Review (7/03) - Ed Jastrzembski.
1/1/ / faculty of Electrical Engineering eindhoven university of technology Architectures of Digital Information Systems Part 1: Interrupts and DMA dr.ir.
Wir schaffen Wissen – heute für morgen Babak Kalantari, PSI MRF workshop, Prague, Eli Beamlines Paul Scherrer Institut SwissFEL Timing System.
Overview of the current TDR system Introduction Electronics for instrumentation TDR core : Metronome, ADC, Merge Data Handling Pete Jones, University of.
Stephanie Allison/John Dusatko EPICS Collaboration Meeting May 1, Timing and Event System for the LCLS Electron Accelerator*
A Gigabit Ethernet Link Source Card Robert E. Blair, John W. Dawson, Gary Drake, David J. Francis*, William N. Haberichter, James L. Schlereth Argonne.
Dayle Kotturi SLC April 29, 2004 Outline Motivation Key Components Status Update SLC / EPICS Timing Software Tasks Hardware.
The TIMING System … …as used in the PS accelerators.
3/7/05A. Semenov Batch-by-Batch Intensity Monitor 1 Two-Channel Batch by Batch Intensity Monitor for Main Injector BBI.
SNS Integrated Control System EPICS Collaboration Meeting SNS Machine Protection System SNS Timing System Coles Sibley xxxx/vlb.
EPICS 2011 Spring Collaboration Meeting, Hsinchu, June 13-17, 2011 TPS Timing System & Plan of Machine Protection System TPS Timing System & Plan of Machine.
INTRODUCE OF SINAP TIMING SYSTEM
Overview of SINAP Timing System Electronics Group Beam Diagnostics & Control Division SINAP.
Trigger Supervisor (TS) J. William Gu Data Acquisition Group 1.TS position in the system 2.First prototype TS 3.TS functions 4.TS test status.
The GANDALF Multi-Channel Time-to-Digital Converter (TDC)  GANDALF module  TDC concepts  TDC implementation in the FPGA  measurements.
SVT workshop October 27, 1998 XTF HB AM Stefano Belforte - INFN Pisa1 COMMON RULES ON OPERATION MODES RUN MODE: the board does what is needed to make SVT.
Micro-Research Finland Oy Timing System with Two-Way Signaling cRIO-EVR Jukka Pietarinen EPICS Meeting Padova October 2008.
DLS Digital Controller Tony Dobbing Head of Power Supplies Group.
SNS Integrated Control System SNS Timing Master LA-UR Eric Bjorklund.
LCLS Timing Software and Plan 1 Controls Timing Workshop EPICS Collaboration Meeting SLAC LCLS Timing Software and Plan April Kukhee Kim.
U N C L A S S I F I E D FVTX Detector Readout Concept S. Butsyk For LANL P-25 group.
Status of BEPCII Timing System Presented by Ge Lei IMAC 2006.
Micro-Research Finland Oy Timing System Developments Jukka Pietarinen EPICS Collaboration Meeting Shanghai March 2008.
Leo Greiner IPHC meeting HFT PIXEL DAQ Prototype Testing.
Micro-Research Finland Oy Timing System Modules Jukka Pietarinen EPICS Collaboration Meeting, Argonne, June 2006.
Micro-Research Finland Oy MRF Timing System Jukka Pietarinen Timing Workshop CERN February 2008.
Micro-Research Finland Oy Components for Integrating Device Controllers for Fast Orbit Feedback Jukka Pietarinen EPICS Collaboration Meeting Knoxville.
MRF & Cosylab on timing system: integration support Joze Dedic the best people make cosylab … Head of Hardware.
1 Timo Korhonen PSI 1. Concepts revisited…again 3. New (Diamond) cards features and status 4. EPICS interface 5. Conclusions SLS & Diamond Timing System.
EEE440 Computer Architecture
SNS Integrated Control System Timing Clients at SNS DH Thompson Epics Spring 2003.
EPICS Collaboration Meeting Fall PAL October 22 ~ 26, 2012 LCLS Timing System (pattern design, evGUI, and high level) Mike Zelazny for LCLS Timing.
Timing Requirements for Spallation Neutron Sources Timing system clock synchronized to the storage ring’s revolution frequency. –LANSCE: MHz.
Fast Fault Finder A Machine Protection Component.
FPGA firmware of DC5 FEE. Outline List of issue Data loss issue Command error issue (DCM to FEM) Command lost issue (PC with USB connection to GANDALF)
Stephanie Allison LCLS Controls Software Meeting Dec 6, 2007 How To Set Up for the Event System on an IOC with an EVR(s) Assumes.
LHCb front-end electronics and its interface to the DAQ.
1 Timo Korhonen & Babak Kalantari PSI, Villigen, Switzerland 1. drvTS revisited 2. Wishlist 3. Current status 4. Proposal Updating IOC Time Capabilities.
IMAC 2007BEPCII Timing System Status1 Event timing system for BEPCII storage ring commissioning Presented by G. Lei May 2007.
Trigger Meeting: Greg Iles5 March The APV Emulator (APVE) Task 1. –The APV25 has a 10 event buffer in de-convolution mode. –Readout of an event =
BEPC II TIMING SYSTEM EPICS Seminar Presented by Ma zhenhan IHEP 20.August 2002.
XLV INTERNATIONAL WINTER MEETING ON NUCLEAR PHYSICS Tiago Pérez II Physikalisches Institut For the PANDA collaboration FPGA Compute node for the PANDA.
Lecture 4 General-Purpose Input/Output NCHUEE 720A Lab Prof. Jichiang Tsai.
Time Management.  Time management is concerned with OS facilities and services which measure real time.  These services include:  Keeping track of.
General Tracker Meeting: Greg Iles4 December Status of the APV Emulator (APVE) First what whyhow –Reminder of what the APVE is, why we need it and.
Rutherford Appleton Laboratory September 1999Fifth Workshop on Electronics for LHC Presented by S. Quinton.
Status and Plans for Xilinx Development
ESS Timing System Plans Timo Korhonen Chief Engineer, Integrated Control System Division Nov.27, 2014.
WIR SCHAFFEN WISSEN – HEUTE FÜR MORGEN SwissFEL Timing System status & plans Babak Kalantari :: Large Research Facilities /Controls :: Paul Scherrer Institut.
Architectures of Digital Information Systems Part 1: Interrupts and DMA dr.ir. A.C. Verschueren Eindhoven University of Technology Section of Digital.
Timer and Interrupts.
Smart Ethernet I/O P2P and GCL Introduction
SLS Timing Master Timo Korhonen, PSI.
Javier Serrano CERN AB-CO-HT 29 February 2008
LCLS Timing Software and Plan
Timing and Event System S. Allison, M. Browne, B. Dalesio, J
Fill-pattern Control System for KEKB
LCLS Event System - Software
Timing System GSI R. Bär / U. Krause 15. Feb. 2008
Timing and Event System for the LCLS Electron Accelerator
SLS & Diamond Timing System update
Beam Synchronous Acquisition on IOC
Timing and Event System S. Allison, M. Browne, B. Dalesio, J
Breakout Session: Controls
Timing and Event System Status DOE Review of the LCLS Project SC5 - Controls Systems Breakout Session S. Allison, M. Browne, B. Dalesio, J. Dusatko,
Red Pitaya with EPICS Andraz Pozar EPICS Collaboration Meeting
Presentation transcript:

Timing System of the Swiss Light Source Timo Korhonen Paul Scherrer Institute, Switzerland 1. Introduction 2. Components and technology 3. SLS Timing Application 4. Future plans and possibilities 5. Conclusions

Fundamental task : Injection control -reference generation, RF & AC line synchronization -distribution of fiducial signals But: a timing system can be more: -a means to synchronize operations in several IOCs -operation sequencing tool -global timebase (timestamp support) ideal: to have "single cable" delivering all the timing to (practically) all the IOCs -a means to bind a distributed system into a single coherent entity. We did not want (nor had the time) to start from scratch. Starting point and requirements

Roots Looking around for possible solutions, we found that the APS event system (ANL) had almost all that we wanted: -synchronous timing signal distribution -hardware timestamping mechanism -local integrated delay generators -interrupt support and -well integrated into EPICS But the original hardware did not have enough bandwidth and an additional (fast) timing system would have been necessary. (also component availability was becoming a problem) Decided to upgrade to a recent technology (but to let an external company to do the work)

Event System Concept (APS) Event generator Event receiver Event code The stimulus to send an event can be: -pulse on a hardware input -software event (write to a register) -an entry in an event playback RAM. Upon receival of an event code the receiver can: -output a pulse, of specified delay and width -process an EPICS record Each event receiver can be programmed to respond in a different way to the same event code. Optical fiber link Event receiver Event receiver(s) -star/tree topology, unidirectional transmission -raw data frames are transmitted at the hardware frame rate to event receivers (no handshaking)) -external stimuli are encoded to 8-bit event codes; when no stimulus is present, null frames are sent out

SLS Event system Technical Features Technology: Gigabit Ethernet (physical layer) short wavelength (860 nm) fiberoptic transceivers ->industry standard, several sources Multimode (50/125 um) fiber (long wavelength transceivers optional, drop-in) 50 MEvents/second (50 MHz event rate), 20 ns resolution. Directly clocked from the main RF oscillator XILINX Virtex FPGA for the logic, loaded from flash ROM (in-system reprogrammable) FPGA code about 4000 lines of VHDL for EVR & EVG Device support (EPICS) Register model(VHDL) Hardware (Gigabit) As a side benefit, the functionality was extracted into a portable description (VHDL) Any of the functional layers can be modified according to needs and availability of technology. Hardware (10 Gigabit)

(SLS) Event Generator 3 possible event sources: -hardware (TTL) inputs. 8 per card -event generation by software (register write) -event RAMs(2) for event storage and playback (sequencer) Time Injection A pulse triggers the sequence in event RAM The sequence is clocked out with steps synchronized to the main clock, for example at Booster revolution frequency The sequence RAMs are the central workhorse of SLS -the step clock can be set (to multiples of revolution period) -alternate mode: one RAM runs while the second is loaded. -any sequence can be programmed through EPICS records. A single reference signal input triggers the sequence. All other fiducials are sent from the event RAM.

SLS Timing Master Consists of one Event Generator card, using presently two signal inputs: RF bucket zero-crossing marker (synchronized with AC line) and a utility frequency Even these could be generated internally in EG from RF and AC frequency inputs (when using newer EVG version)

Event Receiver Receives event input stream, actions for events of interest can be programmed individually. -programmable pulse and set/reset "flip-flop" outputs. -delay & width generators down to 20 ns resolution -trigger outputs phase locked to RF with a jitter of about 25 ps RMS (PLL of Gigabit transceiver) -VME interrupt facility for software synchronization (also a hardware-delayed interrupt) -timestamp counter can count received frames (or "tick" events). This enables a very fine timestamp synchronization without using bandwidth for clock transmission. The receiver latches the timestamp counter and the event number into a FIFO when event is received. Synchronous actions across IOCs: EPICS records can be triggered to process when an event arrives and stamped with the time the event occurred (vs. time of processing); Timestamps across IOCs match exactly.

Master 500 Mhz Bunch Clock Timing System Structure -Booster revolution clock (1.111 Mhz) -Storage ring rev. clock (1.042 Mhz) -BO & SR coincidence clock (69.4 kHz) Reference generation EVREVR EVGEVG Linac gun timing: Presettable delay cards (KEK TD4V) -precision to RF (2 ns) -jitter 4 ps RMS -pulsed magnets -BPMs -magnet & RF ramp trigger -diagnostics over 100 EVRs Line Sync EVREVR -AC line sync & clock divider -synchroniser to external (RF) pulse fan out Master Timing IOC Event generation and distribution Operation sequences Filling pattern control RF frequency control Overall timing Linac timing

Beamline Timing at SLS EVREVR EVGEVG Beamline can have its own timing events multiplexed with machine timing, but not interfering with other branches Needs coordination of event allocation EVREVR fan out Master Timing IOC Event generation and distribution Operation sequences Filling pattern control RF frequency control Beamline timing Beamline master EVGEVG Event receivers and generators can be cascaded -> add a sub-branch for a beamline

Future Plans: Diamond Event system Further development by Diamond Light Source (UK), Micro-Research and PSI (to ensure compatibility with our existing system) Higher frame rates, 2.5 Gbit data rate (or higher) Integrated RF clock recovery (in receivers) High-resolution delay generators (and online jitter measurement) integrated Full VME64x implementation (geographical addressing, hot swap support, etc.) Improved VME interface (higher bandwidth, simplified access) XILINX Virtex-II Pro FPGA (with an integrated PowerPC CPU core) Better possibilities for customization (mezzanine card slots for piggyback cards)

Hardware Capabilities Raw data transfer 50 MHz 16-bit frame rate (SLS HW), corresponds to 100 Mbytes/second data rate SLS implementation: 8 bits used for events, 8 bits “free”. At SLS, the free bits are used for distributing discrete clock signals. With a simple extension these could be used to broadcast arbitrary data at a maximal rate of 50 MBytes/s (in practice, would be limited by the IOC/VME bus bandwidth.) Protocol can be modified. For example: Transmit beam “codes” as data and the strict timing as events. In this way, pulse-to-pulse control information can be transmitted together with the events. Delays from events can be generated locally with the receivers. Local delay generators At the moment, purely counters. In future, fine tunable delay generators will be available (mezzanine card) RF signal regeneration, using tunable local oscillators for better jitter performance. The functionality can be customized to do what the hardware allows.

Integration with EPICS  Specific records to control the hardware (inherited from APS, extended for new features) delays, widths, prescalers, etc. controllable via EPICS records software events can be generated via EPICS records error handling mechanisms (alarm when hardware failure detected)  Binding with EPICS “soft” events: dispatch soft events when a hardware event is received generate sequences of actions when an event happens  Timestamp support hardware-supported timestamps match exactly. Simplifies correlation of measurements and actions done at different IOCs.

Timestamp mechanism Timestamp facility: –Each EVR has a timestamp counter Can count incoming events or frame clock cycles (after prescaler) –Received events that have been programmed to cause an interrupt cause the event code and timestamp counter value to be put in FIFO -interrupt handler reads the FIFO and updates event times in a table -records can retrieve these timestamps. They are synchronous in all crates that have an even receiver -timestamp counters have to be synchronized and reset periodically (done through network broadcasts)

Summary  Gigabit Ethernet as a base technology –Widely used, several component sources, reliable –Room for extensions  Functionality implementation in VHDL –Had a good starting point (APS) –Portable to new platforms –Easy to add and modify functionality  EPICS integration –Could use existing drivers and concepts, very big help for a new project

Master timing IOC LINAC timing IOC Pulsed magnets IOC Injection timing control Gun trigger (sync &delay) Gun trigger (sync &delay) Event generator Event receiver The SLS Storage Ring has 480 RF buckets, the Booster has 450. At the coincidence of SR and Booster period pulses (superperiod) the rings have their #0 bucket in alignment. From that instant the buckets proceed as BO SR The #0 buckets will be in alignment every 16th Booster period. By delaying extraction from booster one turn, the injection to SR is shifted by 30 buckets. Finer adjustment is done in the linac (e-gun trigger)

Beamline experiments Beamline experiments Injector Top-up Injection Gun trigger (sync &delay) Gun trigger (sync &delay) Event generator Event receiver The basic logic for top-up: -inject every N:th cycle when the current is below a defined threshold operations: e-gun trigger, SR injection kickers trigger enabled when a top-up cycle occurs Possibly switch off booster cycle (not tried yet) Warn beamlines, send a gate event to disable DAQ Need to synchronize several IOCs -synchronously count cycles to determine when to trigger -cycle data preset through channel access, synchronized with an event Event receiver