1. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations1 LUSI Experiment Needs Yiping Feng Fluctuations Diagnostic suite Intensity Spatial Temporal Spectral Large 2-dim detectors Sophisticated DAQ Data storage Real time processing Fluctuations Diagnostic suite Intensity Spatial Temporal Spectral Large 2-dim detectors Sophisticated DAQ Data storage Real time processing

2. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations2 Electron Beam Characteristics X-ray Free-Electron Laser (FEL) is fundamentally different from storage-ring based synchrotron sources. For the LCLS photo-injection at 120 Hz at LCLS Each macro electron bunch is different at origination Different timing, length, density After passing through the Linac including acceleration and compression Added difference in timing, length, density Additional difference in energy, orbit Orbit correction less effective due to low repetition rate in contrast to synchrotron sources (revolution frequency at APS = 272 kHz) X-ray Free-Electron Laser (FEL) is fundamentally different from storage-ring based synchrotron sources. For the LCLS photo-injection at 120 Hz at LCLS Each macro electron bunch is different at origination Different timing, length, density After passing through the Linac including acceleration and compression Added difference in timing, length, density Additional difference in energy, orbit Orbit correction less effective due to low repetition rate in contrast to synchrotron sources (revolution frequency at APS = 272 kHz)

3. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations3 X-ray Beam Characteristics X-ray amplification process based on self-seeding SASE* Lasing starts from a random electron density distribution Each X-ray pulse consists of a random time sequence of spikes of varying degrees of saturation  X-ray FEL exhibits inherent Intensity, spatial, temporal, and spectral fluctuations on pulse by pulse basis X-ray amplification process based on self-seeding SASE* Lasing starts from a random electron density distribution Each X-ray pulse consists of a random time sequence of spikes of varying degrees of saturation  X-ray FEL exhibits inherent Intensity, spatial, temporal, and spectral fluctuations on pulse by pulse basis *Self Amplification of Spontaneous Emission

4. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations4 Expected Fluctuations of LCLS FEL pulses ParameterValueOrigin* Pulse intensity fluctuation~ 30 % Varying # of FEL producing SASE spikes; 100% intensity fluctuation/per-spike; etc. Position & pointing jitter (x, y, ,  ) ~ 25 % of beam diameter ~ 25 % of beam divergence Varying trajectory per pulse; Saturation at different locations of  -tron curvature Source point jitter (z)~ 5 m SASE process reaching saturation at different z-points in undulator X-ray pulse timing (arrival time) jitter ~ 1 ps FWHM Timing jitter btw injection laser and RF; Varying e - energy per-pulse X-ray pulse width variation~ 15 % Varying e-energy leading to varying path (compression) in bunch compressors Center wavelength variation ~ 0.2 % (comparable to FEL bandwidth) Varying e-energy leading to varying FEL fundamental wavelength and higher order *To be discussed in details now

5. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations5 Expected Fluctuations of LCLS FEL pulses ParameterValueOrigin* Pulse intensity fluctuation~ 30 % Varying # of FEL producing SASE spikes; 100% intensity fluctuation/per-spike; etc. Position & pointing jitter (x, y, ,  ) ~ 25 % of beam diameter ~ 25 % of beam divergence Varying trajectory per pulse; Saturation at different locations of  -tron curvature Source point jitter (z)~ 5 m SASE process reaching saturation at different z-points in undulator X-ray pulse timing (arrival time) jitter ~ 1 ps FWHM Timing jitter btw injection laser and RF; Varying e - energy per-pulse X-ray pulse width variation~ 15 % Varying e-energy leading to varying path (compression) in bunch compressors Center wavelength variation ~ 0.2 % (comparable to FEL bandwidth) Varying e-energy leading to varying FEL fundamental wavelength and higher order *To be discussed in details now

6. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations6 Transverse Jitter Steering coil power supply regulation Quadrupole magnet transverse vibrations Quadrupole magnet power supply regulation in presence of typical 200-mm transverse misalignment RF structure wakefields with varying charge and typical 200-mm transverse misalignments CSR in bunch compressor chicanes with varying bunch length Steering coil power supply regulation Quadrupole magnet transverse vibrations Quadrupole magnet power supply regulation in presence of typical 200-mm transverse misalignment RF structure wakefields with varying charge and typical 200-mm transverse misalignments CSR in bunch compressor chicanes with varying bunch length

7. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations7 Spatial Jitter Orbit-1a Orbit-1b Orbit-2a Orbit-2b X-ray beam e- beam Transverse Stability Pointing Stability

8. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations8 Expected Fluctuations of LCLS FEL pulses ParameterValueOrigin* Pulse intensity fluctuation~ 30 % Varying # of FEL producing SASE spikes; 100% intensity fluctuation/per-spike; etc. Position & pointing jitter (x, y, ,  ) ~ 25 % of beam diameter ~ 25 % of beam divergence Varying trajectory per pulse; Saturation at different locations of  -tron curvature Source point jitter (z)~ 5 m SASE process reaching saturation at different z-points in undulator X-ray pulse timing (arrival time) jitter ~ 1 ps FWHM Timing jitter btw injection laser and RF; Varying e - energy per-pulse X-ray pulse width variation~ 15 % Varying e-energy leading to varying path (compression) in bunch compressors Center wavelength variation ~ 0.2 % (comparable to FEL bandwidth) Varying e-energy leading to varying FEL fundamental wavelength and higher order *To be discussed in details now

9. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations9 Z-Jitter zz  R 2 =  R 1 (R 2 /R 1 ) 2  R 2 =  Z R1R1 R2R2 R2R2

10. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations10 Expected Fluctuations of LCLS FEL pulses ParameterValueOrigin* Pulse intensity fluctuation~ 30 % Varying # of FEL producing SASE spikes; 100% intensity fluctuation/per-spike; etc. Position & pointing jitter (x, y, ,  ) ~ 25 % of beam diameter ~ 25 % of beam divergence Varying trajectory per pulse; Saturation at different locations of  -tron curvature Source point jitter (z)~ 5 m SASE process reaching saturation at different z-points in undulator X-ray pulse timing (arrival time) jitter ~ 1 ps FWHM Timing jitter btw injection laser and RF; Varying e - energy per-pulse X-ray pulse width variation~ 15 % Varying e-energy leading to varying path (compression) in bunch compressors Center wavelength variation ~ 0.2 % (comparable to FEL bandwidth) Varying e-energy leading to varying FEL fundamental wavelength and higher order *To be discussed in details now

11. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations11 Expected Fluctuations of LCLS FEL pulses ParameterValueOrigin* Pulse intensity fluctuation~ 30 % Varying # of FEL producing SASE spikes; 100% intensity fluctuation/per-spike; etc. Position & pointing jitter (x, y, ,  ) ~ 25 % of beam diameter ~ 25 % of beam divergence Varying trajectory per pulse; Saturation at different locations of  -tron curvature Source point jitter (z)~ 5 m SASE process reaching saturation at different z-points in undulator X-ray pulse timing (arrival time) jitter ~ 1 ps FWHM Timing jitter btw injection laser and RF; Varying e - energy per-pulse X-ray pulse width variation~ 15 % Varying e-energy leading to varying path (compression) in bunch compressors Center wavelength variation ~ 0.2 % (comparable to FEL bandwidth) Varying e-energy leading to varying FEL fundamental wavelength and higher order *To be discussed in details now

12. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations12 Goals X-ray diagnostics are required to measure these fluctuations since they can’t be eliminated Integral parts of Instruments Timing & intensity measurements for XPP experiments Wave-front characterization for CXI experiments Measurements made on pulse-by-pulse basis Requiring real-time processing by controls/data systems Commonalities in needs & specs Standardized and used for all applicable instruments Modularized for greater flexibility of deployment and placement  Critical diagnostics must be performed and data made available on pulse-by-pulse basis X-ray diagnostics are required to measure these fluctuations since they can’t be eliminated Integral parts of Instruments Timing & intensity measurements for XPP experiments Wave-front characterization for CXI experiments Measurements made on pulse-by-pulse basis Requiring real-time processing by controls/data systems Commonalities in needs & specs Standardized and used for all applicable instruments Modularized for greater flexibility of deployment and placement  Critical diagnostics must be performed and data made available on pulse-by-pulse basis

13. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations13 Fluctuations, 120 hz pulse rate drive DAQ requirements The 120 Hz per-pulse data collection/reduction, high data rate, large data volume, and sub-ps timing control requirements of LCLS experiments go far beyond those at existing synchrotron sources, requiring considerable complexity and sophistication in controls and data systems’ design, implementation, and integration that are not feasible for individual experimental teams LCLS/LUSI controls and data systems must Provide standard controls to all instruments Support diagnostic measurements Provide standard data acquisition capabilities Provide standard data storage and management capabilities Provide certain standard data analysis capabilities The 120 Hz per-pulse data collection/reduction, high data rate, large data volume, and sub-ps timing control requirements of LCLS experiments go far beyond those at existing synchrotron sources, requiring considerable complexity and sophistication in controls and data systems’ design, implementation, and integration that are not feasible for individual experimental teams LCLS/LUSI controls and data systems must Provide standard controls to all instruments Support diagnostic measurements Provide standard data acquisition capabilities Provide standard data storage and management capabilities Provide certain standard data analysis capabilities

14. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations14 Data system requirements Data acquisition Real-time data processing Quick view Data management On-line storage Long term archiving/retrieval Data analysis Volume rendering visualization Data acquisition Real-time data processing Quick view Data management On-line storage Long term archiving/retrieval Data analysis Volume rendering visualization

15. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations15 2D Detectors Cornell (PAD)BNL(XAMPS) Technologydiode/ASIC ArchitectureBump-bondintegrated readoutpixelcolumn size190x190x321024x1024 Data rate1.9Gb/s1.5Gb/s Resolution14bit12bit Plug-play with a common interface?

16. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations16 Data rates - CXI Data Rate/Volume of CXI Experiment (comparable to other experiments) LCLS Pulse Rep Rate (Hz)120 Detector Size (Megapixel)1.2 Intensity Depth (bit)14 Success Rate (%)30% Ave. Data Rate (Gigabit/s)0.6 Peak Data Rate (Gigabit/s)1.9 Daily Duty Cycle (%)50% Accu. for 1 station (TB/day)3.1 require high performance and high capacity data acquisition and management system Is it possible to perform real-time data analysis to reduce the data rate? high peak rate & large volume comparable to high- energy physics experiments such as BaBar @ SLAC

17. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations17 Long term data storage needs Year2009-2012-2015- Rep Rate (Hz)120 Detector Size (Megapixel) 0.581.16Projected 5.8 Intensity Depth (bit)14 Success Rate (%)10%30%50% Ave. Data Rate (Gigabit/s)0.10.584.9 Peak Data Rate (Gigabit/s)0.971.949.8 Daily Duty Cycle (%)25%50%75% Accu. for 1 station (TB/day)0.263.1439 Accu. for 3 stations (TB/day)0.809.4118 Yearly Uptime (%)25%50%75% Accu. (Petabyte/year)0.0721.732 Duration/Lifetime (year)333 Total Accu. (Petabyte)0.225.297

18. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations18 Overall data needs Per pulse data collection Experimental Diagnostic – EO signal, e- and  beam parameters Raw data rate and volume 2 Gb/sec or higher On-line storage capacity - 20 TB/day Timing/Triggering EO timing measurement < 1 ps Detector trigger < 1  s Real time analysis Frame correction, quality control To the extent possible - binning, sparsification, FFT Quick view Quasi real-time feedback, 5 frame/s Alignment Data Management Unified data model Archiving capacity – 5 PB/year Analysis staging storage capacity – 20 TB Offline Analysis > 1000 node cluster Per pulse data collection Experimental Diagnostic – EO signal, e- and  beam parameters Raw data rate and volume 2 Gb/sec or higher On-line storage capacity - 20 TB/day Timing/Triggering EO timing measurement < 1 ps Detector trigger < 1  s Real time analysis Frame correction, quality control To the extent possible - binning, sparsification, FFT Quick view Quasi real-time feedback, 5 frame/s Alignment Data Management Unified data model Archiving capacity – 5 PB/year Analysis staging storage capacity – 20 TB Offline Analysis > 1000 node cluster

19. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations19 Applications needs User programs Endstation operation Calibration Alignment Interface to SW for diffraction/scattering experiments SPEC Interface to instrumentation/analysis SW MatLab LabView User tools STRIP tool ALARM Handler User programs Endstation operation Calibration Alignment Interface to SW for diffraction/scattering experiments SPEC Interface to instrumentation/analysis SW MatLab LabView User tools STRIP tool ALARM Handler

20. Yiping Feng yfeng@slac.stanford.edu LUSI DOE Review July 23, 2007 Breakout Presentations20 Pieces of the Puzzle LUSI Control & Data System Control Subsystem for Operation & Controls Data Subsystem for Acquisition & Management LCLS Control System Controls for RF/Undulator SLAC Sci. Computing & Computing Srvs. Data Farm (PB Tape Drive) Computer Cluster (2000 processor Node) Data Archiving/Retrieval Offline Analysis/Rendering EO Timing & Triggering Feedback High peak rate/ large volume Pulse-by-pulse info exchange