1. LUSI Controls and Data Systems W.B.S. 1.6
Gunther Haller
Project Manager
April 20-22, 2009
Plenary Presentation

2. Near Experimental Hall
Controls W.B.S. Scope
Near Experimental Hall
X-ray Transport
Far Experimental Hall 1 3 2 4 5 6
XCSMono
AMO
SXR
XPP
XCS
CXI H6
Part of LCLS
Installation
Part of LCLS
FES
ARRA Funds
Separate WBS 1.6 to combine all LUSI control & data needs due to commonality in requirements, design, implementation, installation and integration
XPP, CXI, XCS, Diagnostics & Common Optics
Common control and data systems design for LUSI and rest of photon beam-line instruments (AMO, SXR, FES)

3. Scope – WBS 1.6 Control & Data Systems
Included in W.B.S. 1.6
All controls & DAQ, labor and M&S, for XPP, CXI, XCS instrument components and diagnostics/common optics included in baseline
Includes controllers, racks, cables, switches, installation
Data-storage and processing for FEH instruments
Initial offline (more effort will be on operating budget)
Input-signals to LCLS machine protection system link-node modules
Provided by LCLS X-Ray End Station controls (CAM is G. Haller)
Personnel protection system
Machine protection system (LCLS modules, fibers)
Laser safety system
Accelerator timing
Femto-second laser timing
Network architecture & security
Data-storage and processing for NEH
User safeguards
Laser controls
CXI 2D detector controls
Interfaces described in
ICD between XES and LUSI (released document)

4. 1.6 WBS to Level 4
Example XPP

5. ESD’s and ICD’s
Two types of controls documents required for each instrument
Engineering Specification Documents (ESD’s)
Interface Control Documents (ICD’s)
XPP
SP XPP Controls ESD
SP XPP Controls & DAQ ICD
SP XPP DAQ ESD
CXI
SP CXI Controls ESD
SP CXI Controls & DAQ ICD
SP CXI DAQ ESD
XCS
SP XCS Controls ESD
SP XCS Controls & DAQ ICD
SP XCS DAQ ESD
Diagnostics
SP LUSI Common Diagnostics & Optics ESD
All documents released at

6. Reviews
Preliminary Design Reviews for Instrument Controls and Data Systems held before the Instrument FIDR
XPP Controls and Common Diagnostics PDR’s
Held February 7, 2009
CXI and XCS PDR’s
Scheduled for May 11, 2009
X-Ray End-Station (XES) Reviews under LCLS XES, not part of LUSI
Common services: e.g. Networking, DAQ, PPS, LSS, MPS

7. Controls and Data Sub-System
Software: EPICS/Python/Qt
Vacuum
Motion
Viewing
Power Supplies
Racks and Cabling
Other items
Data Systems
Challenge is to perform data-correction and image processing while keeping up with continuous incoming data-streams
LUSI benefits that SLAC Particle Physics and Astro-Physics group is involved which has substantial experience acquiring, processing, and archiving large data volumes at high rates
Use common dataflow/processing/storage & offline interface DAQ for instrument components in the real-time detector data chain (BNL & Cornell 2-D detectors, future SXR detector, waveform sampler, etc)
Minimizes development, production, commissioning, and maintenance effort

8. Data System Architecture
Photon Control Data Systems (PCDS)‏
Instrument
specific
Digitizers, Cameras,
2D Detectors
Timing
L0: Control
L1: Acquisition
L2: Processing
L3: Data Cache
Beam Line
Data
To SCCS
Offline
Level 0: Control
Run & configuration control
Run & telemetry monitoring
Level 2: Processing
Pattern recognition, sort, classify, alignment, reconstruction
Level 1: Acquisition
Image acquisition, calibration
Event-building with beam-line data
Correction using calibration constants
Data reduction (vetoing, compression)
Level 3: Online Archiving
NEH/FEH local data-cache
Local cache can buffer up to 4-days worth of data
Offline will transport data to tape staging area in SCCS Computer Center

9. Example 2D-Detector Control and DAQ Chain
Beamline Instrument Detectors
Fiber
ATCA crate with SLAC DAQ boards, e.g. the SLAC Reconfigurable Cluster Element Module
SLAC FPGA front-end board
Cornell CXI 2D detector-ASIC
Brookhaven XPP/XCS 2D detector-ASIC
ATCA
Advanced Telecommunication Computing Architecture
Based on backplane serial communication fabric, 10-G E
2 SLAC custom boards (also used in other SLAC experiments)
8 x 2.5 Gbit/sec links to detector modules
Dataflow and processing
Managed 24-port 10-G Ethernet switching
Essentially 480 Gbit/sec switch capacity
Naturally scalable
Main LUSI instrument custom integrated circuits from Cornell & Brookhaven are already connected at SLAC to SLAC LCLS high-performance DAQ system

10. Controls: Cost Total Budget: $7,380,671 Engineering $3,032,110
Proc/Fab/Assy/Instl: $4,348,561
Status February 2009
Work Scheduled
$434,106
Work Performed
$417,319
Actual Cost
$327,278
Schedule Variance
$-16,787
Cost Variance
$90,041*
* Cost variance due to accounting error, charges have been moved from XES to LUSI account but is not reflected yet. So apparent under-run will disappear.

11. Risks & Safety Risks Safety
Late changes to design due to evolving user requirements
Mitigation
Adhere to BCR process.
Participate in Experimental Area design process
Release and update Engineering Requirement documents
Safety
Laser Safety and Hutch Protection Systems provided by LCLS XES, hutch 3 (XPP) is the third hutch to be operated
Same for User Safeguards (Oxygen Deficiency Monitor)
Electrical Safety
All cables/equipment are rated for their use

12. Recommendations from last Review
We recommend regularly scheduled meetings between the beamline scientists, diagnostics physicists and control system design engineers.
LUSI agrees and the project will schedule regular meetings including the beamline scientists, diagnostics physicists and control system design engineers.
Regularly scheduled meetings are occurring for the Cornell detector and supports.
Weekly XPP meetings have started after the XPP FIDR, two months ago.
Other meetings are still on an "as-needed" basis. We start regular meetings after the respective FIDR’s.
For XCS, CXI: June 2009

13. Summary Interface and Requirements documents released Design Mature
Clear what needs to be done
No issues, design meets requirements
Design Mature
Most items are already used (hardware and software) in XTOD and AMO, ahead of XPP, XCS, CXI
No technical risk
XPP Preliminary Design Review already completed
Most items similar to XTOD and AMO which both already had Final Design Reviews for Controls and Data Systems (XTOD is starting to be installed, AMO will follow in August 09)
CXI and XCS PDR’s scheduled for May 11, 2009
Team
Engineers and technicians from PPA Research Engineering Group, sufficient man-power available for LUSI