1 BROOKHAVEN SCIENCE ASSOCIATES Open-Source Distributed Deterministic Device Control Larry Doolittle Alex Ratti Bob Dalesio

2 BROOKHAVEN SCIENCE ASSOCIATES Outline Goals 2 tier architecture Cell by Cell distribution for the Storage Ring Device Control Conclusion

3 BROOKHAVEN SCIENCE ASSOCIATES Create an Open-Source Platform for Integrated Device Control Support fast orbit feedback at 10 KHz Support event system with 1 nsec trigger resolution Support event system with < 1 psec jitter Support high performance platforms for FOFB ($1K) Support low cost device controllers (<$200) Support Machine Protection < 20 usec response time Work with industry and other labs to produce solutions that work in this network.

4 BROOKHAVEN SCIENCE ASSOCIATES Two Tier Device Control RF Clock Distribution 45 MHz Fiducial Distribution 1 Hz Timing System Device Controller 100 MB ENet Timing System Device Controller 100 MB ENet Timing System Device Controller 100 MB ENet …. VME I/OC EPICS Timing System Cell Controller 100 MB ENet IN VME Interface 100 MB ENet Out 2 GB ENet … VME I/OC EPICS Timing System Cell Controller 100 MB ENet IN VME Interface 100 MB ENet Out 2 GB ENet

5 BROOKHAVEN SCIENCE ASSOCIATES BPM Controller 30 Cells each with 10 BPMs / 6 PSs RF Clock Distribution 45 MHz Fiducial Distribution 1 Hz BPM Controller BPM Controller BPM Controller BPM Controller BPM Controller 100 MB ENET PS Controller PS Controller PS Controller PS Controller VME I/OC EPICS Cell Controller VME Interface VME I/OC EPICS Next Sector Cell Controller VME Interface VME I/OC EPICS Prev Sector Cell Controller VME Interface 2 GBit ENET +T0 + - Settling time on BPMs? +0.0 usecs - BPM to Compute Controller 384 bits = 64 bits * 6 BPMs 4.9 usecs = 384 bits over 100 MBit enet +4.9 usecs - Compute Controllers to each other 10,290 bits = 30 nodes * 384 bits 10.5 usecs = 10,290 bits over 2 GB enet usecs – Compute local matrix 0 usecs usecs - Communcate t Power Supply Controllers 24 = 4 PS * 4 bytes each 3.5 usecs usecs – loop complete settling time for magnets communicate diagnostic waveforms etc… usecs +200 usecs – start again

6 BROOKHAVEN SCIENCE ASSOCIATES BPM Controller Device Controllers needed RF Clock Distribution 45 MHz Fiducial Distribution 1 Hz BPM Controller BPM Controller BPM Controller BPM Controller BPM Controller 100 MB ENET PS Controller PS Controller PS Controller PS Controller VME I/OC EPICS Fast Orbit Feedback VME Interface VME I/OC EPICS Machine Protection VME Interface VME I/OC EPICS Event Generator VME Interface 2 GBit ENET Need to integrate LIbera and RF controllers Passes device inputs throughout network Need to include event data in this data stream Need to include Fast Orbit Feedback into Cell controllers Need to create/integrate power supply controllers Need to create/integrate Machine Protection

7 BROOKHAVEN SCIENCE ASSOCIATES Conclusion A rough design is in place The prototype cell controller is to be developed this year by Larry Doolittle along with NSLS II help 2008 should demonstrate timing, communication throughput, and interface through PMC or PCI 2009 should demonstrate device controllers and work with others to develop specific device controllers We are looking for others interested in this platform to work with us.