1 The MICE Online Systems Linda R. Coney CHEP – May 2012

2L. Coney – CHEP2012Outline Intro – MICE Intro – MICE Muon Ionization Cooling Experiment Muon Ionization Cooling Experiment Controls & Monitoring Controls & Monitoring DAQ DAQ Online Monitoring & Reconstruction Online Monitoring & Reconstruction Conclusions Conclusions

3L. Coney – CHEP2012 MICE: Muon Ionization Cooling Experiment MICE Goals: MICE Goals: Design, build, commission, and operate a realistic section of cooling channel Design, build, commission, and operate a realistic section of cooling channel Measure its performance in a variety of modes of operation and beam conditions Measure its performance in a variety of modes of operation and beam conditions …results will be used to optimize Neutrino Factory and Muon Collider designs. …results will be used to optimize Neutrino Factory and Muon Collider designs. Spectrometer Solenoid & Tracker Absorber RFCC Module

4L. Coney – CHEP2012 MICE: Design MICE is designed to produce a 10% cooling effect on the muon beam MICE is designed to produce a 10% cooling effect on the muon beam Use particle detectors to measure the cooling effect to 1% Use particle detectors to measure the cooling effect to 1% Measurements will be done with muon beams having momentum of 140 MeV/c – 240 MeV/c Measurements will be done with muon beams having momentum of 140 MeV/c – 240 MeV/c Method: Method: Create beam of muons Create beam of muons Identify muons and reject background Identify muons and reject background Measure single particle parameters x, p x, y, p y, p z Measure single particle parameters x, p x, y, p y, p z Cool muons in absorber Cool muons in absorber Restore longitudinal momentum component with RF cavities Restore longitudinal momentum component with RF cavities Identify outgoing particles to reject electrons from muon decay Identify outgoing particles to reject electrons from muon decay

5L. Coney – CHEP2012 MICE: Beam Line Produce  from p interactions with a titanium target Transport  (Q123) and select momentum (D1) Collect  (DS) and select momentum (D2) Transport  to MICE and match to cooling channel Maximize  purity (reduce  contamination) Maximize transmission Define optics for the MICE program LM

6L. Coney – CHEP2012 Online Group Overview The MICE Online Group creates, maintains, and ensures proper use of all tools (hardware, software, documentation) within the MLCR (MICE Local Control Room) that allow the experiment to efficiently record high quality data. The MICE Online Group creates, maintains, and ensures proper use of all tools (hardware, software, documentation) within the MLCR (MICE Local Control Room) that allow the experiment to efficiently record high quality data. We are responsible for: We are responsible for: Controls & Monitoring (C&M) Controls & Monitoring (C&M) Data Acquisition (DAQ) Data Acquisition (DAQ) Online Monitoring and Reconstruction Online Monitoring and Reconstruction Data Transfer, Networking, and Computing Infrastructure Data Transfer, Networking, and Computing Infrastructure We also interface closely with systems related to the Online sector including MICE Operations, Offline Software, and Computing. We also interface closely with systems related to the Online sector including MICE Operations, Offline Software, and Computing.

7L. Coney – CHEP2012 Online Group Members Linda Coney (UCR) – head of Online Group Linda Coney (UCR) – head of Online Group David Colling (Imperial) – head of Software & Computing David Colling (Imperial) – head of Software & Computing Yordan Karadzhov (U. Geneve) – head of DAQ Yordan Karadzhov (U. Geneve) – head of DAQ Pierrick Hanlet (IIT) – head of C&M Pierrick Hanlet (IIT) – head of C&M Chris Rogers (RAL) – head of Software Chris Rogers (RAL) – head of Software Brian Martlew (Daresbury Lab) – C&M Brian Martlew (Daresbury Lab) – C&M Paul Hodgson (Sheffield U) – C&M (target) Paul Hodgson (Sheffield U) – C&M (target) Matt Robinson (Sheffield U) – System Admin; C&M (target, tracker) Matt Robinson (Sheffield U) – System Admin; C&M (target, tracker) Mike Courthold (RAL) – Networking Mike Courthold (RAL) – Networking Henry Nebrensky (Brunel) – GRID, data transfer Henry Nebrensky (Brunel) – GRID, data transfer Janusz Martynikk (Imperial) – data transfer Janusz Martynikk (Imperial) – data transfer Craig Macwaters (RAL) – MLCR Network, hardware, computing Craig Macwaters (RAL) – MLCR Network, hardware, computing Antony Wilson (RAL) – Config DB, PPD contact Antony Wilson (RAL) – Config DB, PPD contact Paul Kyberd (Brunel) – GRID Paul Kyberd (Brunel) – GRID

8L. Coney – CHEP2012Outline Intro – MICE Intro – MICE Muon Ionization Cooling Experiment Muon Ionization Cooling Experiment Controls & Monitoring Controls & Monitoring DAQ DAQ Online Monitoring & Reconstruction Online Monitoring & Reconstruction Conclusions Conclusions

9L. Coney – CHEP2012 MICE: Controls & Monitoring Controls Controls User interface to equipment – both beamline and detectors User interface to equipment – both beamline and detectors Mandates proper sequencing Mandates proper sequencing Monitoring Monitoring Protects equipment (early notification of problems) & data quality Protects equipment (early notification of problems) & data quality Required for proper sequencing in Controls Required for proper sequencing in Controls Use EPICS (Experimental Physics & Industrial Control Systems) interface Framework for C&M Open source, multiple platforms, stable Existing support for many devices Existing support for many devices

10L. Coney – CHEP2012 C&M: EPICS Start with hardware and LAN Start with hardware and LAN Use existing drivers or develop new ones Use existing drivers or develop new ones Build Input/Output Controllers (IOCs) which define Process Variables Build Input/Output Controllers (IOCs) which define Process Variables Make PVs available on LAN for users (clients) or other IOCs Make PVs available on LAN for users (clients) or other IOCs Clients: control or monitoring panels, Alarm Handlers, Archivers Clients: control or monitoring panels, Alarm Handlers, Archivers

11L. Coney – CHEP2012 C&M: Status Completed: All beamline and PID equipment Completed: All beamline and PID equipment Target Target Beamline magnets Beamline magnets BeamStop, Proton Absorber BeamStop, Proton Absorber Particle ID detectors, Hall environment Particle ID detectors, Hall environment Alarm Handler, Archiver Alarm Handler, Archiver External gateway for remote access External gateway for remote access

12L. Coney – CHEP2012 Cooling Channel: Spectrometer Solenoids & Focus Coil At Wang, NMR (CA) At Wang, NMR (CA) At TESLA (UK) At TESLA (UK)

13L. Coney – CHEP2012 SS Standalone System Operational SS: Quench protection (FNAL), power supply (LBNL), C&M hardware (Daresbury) SS: Quench protection (FNAL), power supply (LBNL), C&M hardware (Daresbury) FC standalone C&M ready FC standalone C&M ready

14L. Coney – CHEP2012 C&M: Current & Future Focus Config DB: Config DB: Ensure data taking parameters of all equipment carefully recorded/restored to/from the CDB Control all systematic errors Control all systematic errors Run Control Run Control Target DAQ, Experiment DAQ, beamline controls, MICE state machines, PID Target DAQ, Experiment DAQ, beamline controls, MICE state machines, PID All integrated into single Run Control process All integrated into single Run Control process Future: RFCC (RF cavities and coupling coils), further development of infrastructure monitoring (vacuum, compressed air, power, chilled water, etc) Future: RFCC (RF cavities and coupling coils), further development of infrastructure monitoring (vacuum, compressed air, power, chilled water, etc) Spectrometer Solenoid & Tracker Absorber RFCC Module

15L. Coney – CHEP2012 C&M: Run Control Target Monitoring Target Monitoring Beam Center Distance, ISIS current, Beam Loss due to MICE Target, Beam Position Beam Center Distance, ISIS current, Beam Loss due to MICE Target, Beam Position

16L. Coney – CHEP2012 C&M: Run Control DAQ Monitoring DAQ Monitoring Run number Run number DAQ status DAQ status Trigger type Trigger type Spill Gate width Spill Gate width Particle triggers Particle triggers Target info Target info All information sent to ConfigDB All information sent to ConfigDB Continue with State Machines Continue with State Machines

17L. Coney – CHEP2012Outline Intro – MICE Intro – MICE Muon Ionization Cooling Experiment Muon Ionization Cooling Experiment Controls & Monitoring Controls & Monitoring DAQ DAQ Online Monitoring & Reconstruction Online Monitoring & Reconstruction Conclusions Conclusions

18L. Coney – CHEP2012 MICE Timing MICE target dips into ISIS beam during last 3 ms of the cycle MICE target dips into ISIS beam during last 3 ms of the cycle MS signal used to time in target with correct pulse MS signal used to time in target with correct pulse MICE RF will be timed with last 1 ms of ISIS cycle MICE RF will be timed with last 1 ms of ISIS cycle

19L. Coney – CHEP2012 DAQ & Trigger Requirements Long-term stability Long-term stability Maintainable Maintainable Non-expert use  documentation Non-expert use  documentation Specifications: Specifications: 100s particles/1 ms spill at 1 Hz 100s particles/1 ms spill at 1 Hz Level 0 trigger only – all events read out Level 0 trigger only – all events read out Readout at end of spill – buffer in FEE Readout at end of spill – buffer in FEE Dead time not > 1 burst after that which generated particle event Dead time not > 1 burst after that which generated particle event Calibration runs possible between spills Calibration runs possible between spills Event size <60 MB (normally ~2 MB; will be ~5 MB with EMR & trackers) Event size <60 MB (normally ~2 MB; will be ~5 MB with EMR & trackers)

20L. Coney – CHEP2012 DAQ Software Framework Using DATE Using DATE ALICE DAQ software framework ALICE DAQ software framework Provided MICE with EventBuilder tool Provided MICE with EventBuilder tool Subevents collected by different processors are synchronized and assembled before storage Subevents collected by different processors are synchronized and assembled before storage Version 6.40  update to v7.34 next month Version 6.40  update to v7.34 next month LDC – Local Data Concentrator LDC – Local Data Concentrator PC connected to the VME crate PC connected to the VME crate Contains set of Equipment Contains set of Equipment GDC – Global Data Collector GDC – Global Data Collector Event builder Event builder Equipment – module in DAQ crate Equipment – module in DAQ crate DATE Event = DAQ Event DATE Event = DAQ Event Multiple Particle Events (100s) Multiple Particle Events (100s)

21L. Coney – CHEP2012 DAQ Requirements Flexible: Flexible: Performs initialization of FEE units Performs initialization of FEE units Read data from FEE through VME bus Read data from FEE through VME bus Select necessary equipment without modify code Select necessary equipment without modify code Run independently of target, MICE RF, and individual detectors Run independently of target, MICE RF, and individual detectors Interface with Controls & Monitoring Interface with Controls & Monitoring Interface with Online Monitoring and Reconstruction Interface with Online Monitoring and Reconstruction

22L. Coney – CHEP2012 DAQ Hardware Overview

23L. Coney – CHEP2012 DAQ Status TOF, CKOV, KL completed TOF, CKOV, KL completed Unpacking code finished for all current and future detectors Unpacking code finished for all current and future detectors Prototype EMR detector and electronics successfully integrated Prototype EMR detector and electronics successfully integrated Simultaneous readout of two scintillating fiber trackers with cosmic ray data completed Simultaneous readout of two scintillating fiber trackers with cosmic ray data completed Successful integration of prototype single station tracker into MLCR DAQ Successful integration of prototype single station tracker into MLCR DAQ Timing of tracker alive window and vetos completed Timing of tracker alive window and vetos completed Communication linking DAQ, C&M and Config DB done Communication linking DAQ, C&M and Config DB done Allows DAQ monitoring and archiving of DAQ parameters Allows DAQ monitoring and archiving of DAQ parameters

24L. Coney – CHEP2012Outline Intro – MICE Intro – MICE Muon Ionization Cooling Experiment Muon Ionization Cooling Experiment Controls & Monitoring Controls & Monitoring DAQ DAQ Online Monitoring & Reconstruction Online Monitoring & Reconstruction Conclusions Conclusions

25L. Coney – CHEP2012 Online Monitoring Interface is based on DATE monitoring facility Interface is based on DATE monitoring facility Runs over data on socket Runs over data on socket Online monitoring process produces histograms and makes them available on demand Online monitoring process produces histograms and makes them available on demand Online Monitoring GUI is just a ROOT macro allowing the user to request histograms Online Monitoring GUI is just a ROOT macro allowing the user to request histograms Run unpacker on DATE data Run unpacker on DATE data Fill plots for each type of board – no reconstruction Fill plots for each type of board – no reconstruction Fill histograms in real time while taking data Fill histograms in real time while taking data Use to debug operations & provides data quality check Use to debug operations & provides data quality check Three types of boards  three types of plots Three types of boards  three types of plots FADCs, Scalar, TDCs FADCs, Scalar, TDCs

26L. Coney – CHEP2012 Online Monitoring Typical online plots during data-taking Typical online plots during data-taking User selects what to view User selects what to view Displayed for each run Displayed for each run TOF hit profiles TDC scalars fADC trigger Part. Trigger Trg Req. GVA1 GVA3 CKOVA/B Clock 1MHz TOF0 For cumulative, average and last spill

27L. Coney – CHEP2012 Online Reconstruction Unpacker runs over data from DATE on socket Unpacker runs over data from DATE on socket Converts the raw data into information with physical meaning Converts the raw data into information with physical meaning Real-time physics and detector functionality Real-time physics and detector functionality First look at analysis quantities First look at analysis quantities Available now Available now TOF, CKOV, KL, Sci-Fi Tracker detector readout TOF, CKOV, KL, Sci-Fi Tracker detector readout Time-of-flight distributions Time-of-flight distributions Beam dynamics Beam dynamics Future: Future: EMR detector EMR detector Additional online analysis Additional online analysis

28L. Coney – CHEP2012 TOF0 TOF1 Hit Distribution in X Online Reconstruction TOF detectors TOF detectors Shape of beam, particle triggers Shape of beam, particle triggers CKOV detectors CKOV detectors Time-of-flight distribution Time-of-flight distribution PID PID TOF0 TOF1 Hit Distribution in Y Reconstructed Time of Flight e+e+ ++ ++

29L. Coney – CHEP2012Other Data transfer Data transfer Move data out of MLCR at end of each day and automatically transfer to RAL PPD and GRID for later analysis Move data out of MLCR at end of each day and automatically transfer to RAL PPD and GRID for later analysis Saves associated Online Monitoring and Reconstruction plots with data Saves associated Online Monitoring and Reconstruction plots with data Infrastructure Infrastructure Change in OS in progress, moving from CentOS to SL – using SLv5.7 Change in OS in progress, moving from CentOS to SL – using SLv5.7 Replacement of unreliable DAQ crates completed Replacement of unreliable DAQ crates completed Upgrade/replacement of critical machines in progress Upgrade/replacement of critical machines in progress Improving equipment protections in case of power outages Improving equipment protections in case of power outages Documentation – all has recently been reviewed, updated and posted Documentation – all has recently been reviewed, updated and posted

30L. Coney – CHEP2012 Online Future Prepare complete C&M for arrival of cooling channel elements in 2013 Prepare complete C&M for arrival of cooling channel elements in 2013 Spectrometer solenoids, full sci-fi trackers(2), AFC (absorber focus coil) in beam Spectrometer solenoids, full sci-fi trackers(2), AFC (absorber focus coil) in beam Move to latest version of DATE Move to latest version of DATE Finish integration of tracker DAQ into MLCR DAQ Finish integration of tracker DAQ into MLCR DAQ Add production versions of EMR equipment to DAQ & take data Add production versions of EMR equipment to DAQ & take data Complete timing with ISIS RF and prepare for running with MICE RF Complete timing with ISIS RF and prepare for running with MICE RF Continue improvement/addition of Online Reconstruction Continue improvement/addition of Online Reconstruction Add online accelerator physics analysis tools for beam in cooling channel Add online accelerator physics analysis tools for beam in cooling channel

31L. Coney – CHEP2012Conclusions MICE Online Systems are in place and performing well MICE Online Systems are in place and performing well Improvements to DAQ, C&M, and Online Reconstruction continue to develop as new requirements arise Improvements to DAQ, C&M, and Online Reconstruction continue to develop as new requirements arise Progressing on schedule toward arrival of Cooling Channel elements and subsequent data-taking campaign in 2013 Progressing on schedule toward arrival of Cooling Channel elements and subsequent data-taking campaign in 2013

32L. Coney – CHEP2012

33L. Coney – CHEP2012 MICE: International Involvement Institutions worldwide are contributing to the demonstration of muon ionization cooling at MICE Institutions worldwide are contributing to the demonstration of muon ionization cooling at MICE

34L. Coney – CHEP2012 Online Structure

35L. Coney – CHEP2012 MICE DAQ Terminology Isis Cycle: Isis Cycle: The injection and acceleration cycle of ISIS. It is 20 ms long (50 Hz). The injection and acceleration cycle of ISIS. It is 20 ms long (50 Hz). Machine Start (MS): Machine Start (MS): This is the pulse used for the ISIS synchronization This is the pulse used for the ISIS synchronization Spill Gate: Spill Gate: Time window during which the MICE Target is crossing the ISIS beam. Driven by the cycle of the MICE target. Time window during which the MICE Target is crossing the ISIS beam. Driven by the cycle of the MICE target. Burst: Burst: The ~100 ns time window during which muons are in the MICE detectors. Is the time it takes for a proton bunch in ISIS to cross through the MICE target. The ~100 ns time window during which muons are in the MICE detectors. Is the time it takes for a proton bunch in ISIS to cross through the MICE target. DAQ-Trigger: DAQ-Trigger: Signal triggering the readout of the FE-electronics modules of the MICE detectors. One DAQ-Trigger = one DAQ-Event Signal triggering the readout of the FE-electronics modules of the MICE detectors. One DAQ-Trigger = one DAQ-Event Particle-Trigger: Particle-Trigger: Signal generated when the desired Trigger Condition is met. Signal generated when the desired Trigger Condition is met. Distributed to the sub-detectors Front End Electronics and initiates the digitization of the data. Distributed to the sub-detectors Front End Electronics and initiates the digitization of the data.

36L. Coney – CHEP2012 DAQ Trigger Timing of DAQ with ISIS, Spill Gate, readout Timing of DAQ with ISIS, Spill Gate, readout MLCR hardware MLCR hardware DAQ Trigger distribution Scalars and particle trigger NIM Logic TOF discriminators & trigger CAMAC Logic Interface w/Target & Spill Gate KL Shapers GVA Discri, KL cosmics trg TOF & CKOV

37L. Coney – CHEP2012 TOF FEE Sensor: PMT (Hamamatsu R4998) Sensor: PMT (Hamamatsu R4998) Signal transmission: Single ended, 50 Ohm, coax cable (RG213) Signal transmission: Single ended, 50 Ohm, coax cable (RG213) Number of Channels Number of Channels 40 (TOF0) + 28 (TOF1) + 40 (TOF2) = 108 ch 40 (TOF0) + 28 (TOF1) + 40 (TOF2) = 108 ch Main Constraint Main Constraint Time Resolution Time Resolution -> Time-walk correction -> Time-walk correction TDC TDC CAEN V1290, 32 ch CAEN V1290, 32 ch Large Event Buffer Large Event Buffer ECL input ECL input Discriminator Discriminator Lecroy 4415 Lecroy Channels 16 Channels ECL output ECL output Twisted Pair Input (110 Ohm) Twisted Pair Input (110 Ohm) Need Signal splitting Need Signal splitting for charge measurement for charge measurement

38L. Coney – CHEP2012 KL FEE Sensor: PMT ( Hamamatsu R1355 ) Sensor: PMT ( Hamamatsu R1355 ) Signal transmission: Differential, 120 Ohm, Twisted pair cable Signal transmission: Differential, 120 Ohm, Twisted pair cable Number of Channels Number of Channels 42 ch 42 ch Main Constraint Main Constraint Charge measurement Charge measurement Time ~ 1 ns Time ~ 1 ns Flash ADC (WFD) Flash ADC (WFD) CAEN V1724 CAEN V MS/s, 14 bits 100 MS/s, 14 bits Best commercial deal Best commercial deal Single Ended, 50 Ohm Input Single Ended, 50 Ohm Input

39L. Coney – CHEP2012 CKOV FEE Sensor: PMT (8”) Sensor: PMT (8”) Signal transmission: Single ended, 50 Ohm, coax cable (RG58) Signal transmission: Single ended, 50 Ohm, coax cable (RG58) Number of Channels Number of Channels = 8 ch = 8 ch Main Constrain Main Constrain Rate (no segmentation) Rate (no segmentation) Small charge Small charge Flash ADC (WFD) Flash ADC (WFD) CAEN V1731 CAEN V MS/s, 8 bits 500 MS/s, 8 bits Single Ended, 50 Ohm Input Single Ended, 50 Ohm Input No Shaper ! No Shaper !

40L. Coney – CHEP2012 Tracker FEE 4 VLSB Boards in VME Crate = Data Buffer MICE HALL 1 Cryo-Cooler = ½ Tracker 4 AFE2-t Boards Fibers from VLPCs Digital Signal MIL1553 (Control) Read out PC In Control Room Optical Fiber Custom Made Digital Data Buffer Custom Made Digital Data Buffer VLSB = VME LVDS CERDES Buffer VLSB = VME LVDS CERDES Buffer MICE defined Data format MICE defined Data format Measure Both discriminated time and Zero suppressed Charge Measure Both discriminated time and Zero suppressed Charge = 8198 channels = 8198 channels

41L. Coney – CHEP2012 DAQ Equipment Readout code available and tested for Readout code available and tested for TDC V1290A (TOF) TDC V1290A (TOF) FADC V1724 (TOF and KL) FADC V1724 (TOF and KL) FADC V1731 (CKOV and EMR) FADC V1731 (CKOV and EMR) Scaler V830 Scaler V830 Trigger Receiver I/O V977 Trigger Receiver I/O V977 NI I/O PCi 6254 (Target) NI I/O PCi 6254 (Target) VLSB (Tracker) VLSB (Tracker) Prototype custom EMR Front End Board Prototype custom EMR Front End Board Trailer (special equipment handling the release of the busy) Trailer (special equipment handling the release of the busy)