1 BROOKHAVEN SCIENCE ASSOCIATES EPICS V4 Support to Physics Application, Data Acquisition, and Data Analysis L. Dalesio, Gabriele Carcassi, Martin Richard.

Slides:



Advertisements
Similar presentations
Guobao Shen BNL Services Guobao Shen
Advertisements

Control System Studio (CSS)
V4 Status and Workshop Report CSS, DISCS, an V4 team.
Paul Chu FRIB Controls Group Leader (Acting) Service-Oriented Architecture for High-level Applications.
SNS Integrated Control System SNS RDB Requirements, wish list, status A little history l Oracle RDB used exclusively by accelerator physics group l JERI.
1 1999/Ph 514: Channel Access Concepts EPICS Channel Access Concepts Bob Dalesio LANL.
EPICS V4/areaDetector Integration
0 BROOKHAVEN SCIENCE ASSOCIATES Middle Layer Services at NSLS II for Beam Commissioning and Operation Guobao Shen Controls Group, Photon Sciences Brookhaven.
PvData,pvAccess,pvIOC,pvService Status EPICS Meeting June 2011 NSRRC,Hsinchu, Taiwan Marty Kraimer, Guobao Shen, and Matej Sekoranja.
EPICS Architecture Version 3 Channel Access Client (CAC) Connection Data Transfers WAN/LAN/Local Connection Data Transfers Channel Access Server (CAS)
CSS Developments at BNL / NSLS-II Gabriele Carcassi Feb
PCaPAC Satellite Workshop ~ High Level Applications Development and the Matlab Middlelayer ~ Sponsored by the Canadian Light Source Saskatoon, Canada October.
Jeffrey Hill.  LANSCE Requirements – a Review  EPICS Paradigm Shift – a Review  Status – What is Implemented  What is an Abstract Data Type?  Benefits.
0 BROOKHAVEN SCIENCE ASSOCIATES NSLS II Physics Application and its Open Architecture Guobao Shen Controls Group, Photon Sciences Brookhaven National Laboratory.
PvData,pvAccess,javaIOC,pvService Status EPICS Meeting Aix-en-Provence, France Marty Kraimer, Guobao Shen, and Matej Sekoranja.
AreaDetector Data Processing Pipeline In EPICS V4 Dave Hickin Diamond Light Source EPICS Collaboration Meeting Diamond Light Source 01/05/2013.
Model Server for Physics Applications Paul Chu SLAC National Accelerator Laboratory October 15, 2010.
Software Frameworks for Acquisition and Control European PhD – 2009 Horácio Fernandes.
Agenda Adaptation of existing open-source control systems from compact accelerators to large scale facilities.
8/21/2015J-PARC1 Data Management Machine / Application State Data.
Data Acquisition at the NSLS II Leo Dalesio, (NSLS II control group) Oct 22, 2014 (not 2010)
Scan System: Experiment Automation Kay Kasemir, Xihui Chen RAL EPICS Meeting, May 2013.
Web Application Beamline Control Module Very Sensitive Elemental and Structural Probe Employing Radiation from a Synchrotron (VESPERS) The VESPERS beamline.
50mm Telescope ACS Course Garching, 15 th to 19 th January 2007 January 2007Garching.
Upgrade to Real Time Linux Target: A MATLAB-Based Graphical Control Environment Thesis Defense by Hai Xu CLEMSON U N I V E R S I T Y Department of Electrical.
This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC Michigan State.
1 BROOKHAVEN SCIENCE ASSOCIATES EPICS Core (and other development efforts) L. Dalesio. EPICS April 25, 2013.
1 BROOKHAVEN SCIENCE ASSOCIATES NSLSII Physics Applications – Applying V4 The Control Group – presented by Bob Dalesio Taiwan EPICS Meeting, June 2011.
IRMIS 2 Overview Andrew Johnson Computer Scientist, AES Controls.
BROOKHAVEN SCIENCE ASSOCIATES High level applications and EPICS control GUOBAO SHEN NSLS-II, Control Group May 4 th, 2009.
IRMIS Status EPICS 2009 Vancouver D. A. Dohan. Outline IRMIS hardware model cable/cable run channel list Equipment Inventory System RDB Domain separation.
1/15 G. Manduchi EPICS Collaboration Meeting, Aix-en-Provence, Spring 2010 INTEGRATION OF EPICS AND MDSplus G. Manduchi, A. Luchetta, C. Taliercio, R.
The CSS Scan System Kay-Uwe Kasemir SNS/ORNL Dec
MASAR Service Guobao Shen Photon Sciences Department Brookhaven National Laboratory EPICS Collaboration Workshop Oct 05, 2013.
MASAR Server & Application Guobao Shen Photon Sciences Department Brookhaven National Laboratory Collaboration Working Group Oct 02, 2013.
Wir schaffen Wissen – heute für morgen Paul Scherrer Institut EPICS V4 Archiver Service and Matlab client Timo Korhonen.
March 2008EPICS Meeting in Shanghai1 KEKB Control System Status Mar Tatsuro NAKAMURA KEKB Control Group, KEK.
Experience Running Embedded EPICS on NI CompactRIO Eric Björklund Dolores Baros Scott Baily.
3.14 Work List IOC Core Channel Access. Changes to IOC Core Online add/delete of record instances Tool to support online add/delete OS independent layer.
Michael Borland Advanced Photon Source Using SDDS for Accelerator Commissioning and Operation Michael Borland Operations Analysis Group Advanced Photon.
1 BROOKHAVEN SCIENCE ASSOCIATES Control System Overview Bob Dalesio, Control Group HLA Review for NSLS-II Project April
EPICS EPICS Limitations Bob Dalesio Marty Kraimer.
A U.S. Department of Energy Office of Science Laboratory Operated by The University of Chicago Argonne National Laboratory Office of Science U.S. Department.
EPICS Release 3.15 Bob Dalesio May 19, Features for 3.15 Support for large arrays - done for rsrv in 3.14 Channel access priorities - planned to.
1 BROOKHAVEN SCIENCE ASSOCIATES EPICS Version 4 – Development Plan V4 Team – presented by Bob Dalesio EPICS Meeting October 12, 2010.
Controls & Monitoring Overview J. Leaver 03/06/2009.
BROOKHAVEN SCIENCE ASSOCIATES Enhanced Directory Service Ralph Lange EPICS Collaboration Meeting October 11, 2009.
EPICS Release 3.15 Bob Dalesio May 19, Features for 3.15 Support for large arrays Channel access priorities Portable server replacement of rsrv.
1 BROOKHAVEN SCIENCE ASSOCIATES High Level Applications Infrastructure and Current Status Guobao Shen, Lingyun Yang* Controls Group & Accelerator Physics.
Jan Hatje, DESY CSS – Control System Studio EPICS collaboration meeting CSS – Control System Studio Update EPICS collaboration meeting 2008 Shanghai.
B. Dalesio, N. Arnold, M. Kraimer, E. Norum, A. Johnson EPICS Collaboration Meeting December 8-10, 2004 Roadmap for IOC.
11 th February 2008Brian Martlew EPICS for MICE Status of the MICE slow control system Brian Martlew STFC, Daresbury Laboratory.
1 Channel Access Concepts – IHEP EPICS Training – K.F – Aug EPICS Channel Access Concepts Kazuro Furukawa, KEK (Bob Dalesio, LANL)
1 BROOKHAVEN SCIENCE ASSOCIATES Open-Source Distributed Deterministic Device Control Larry Doolittle Alex Ratti Bob Dalesio.
EPICS and LabVIEW Tony Vento, National Instruments
TRIUMF HLA Development High Level Applications Perform tasks of accelerator and beam control at control- room level, directly interfacing with operators.
ESS Integrated Control System Software Core Components S.Gysin
1 BROOKHAVEN SCIENCE ASSOCIATES EPICS Version 4 – Normative V4 Team – presented by Bob Dalesio EPICS Meeting October 7, 2011.
Control System Tools for Beam Commissioning Timo Korhonen Controls Division Chief Engineer April 8, 2014.
Version 4 Charter – Discussion Bob Dalesio Greg White.
1 BROOKHAVEN SCIENCE ASSOCIATES EPICS Version 4 – Development Plan V4 Team – presented by Bob Dalesio EPICS Meeting October 7, 2011.
LCLS Commissioning & Operations High Level Software
Presented by Li Gang Accelerator Control Group
Laboratorio per dottorandi 2017 Particle Accelerators Control System
Prototyping the Next EPICS Archiver
LCLS Commissioning & Operations High Level Software
EPICS Version 4 Abstract:
SLAC USA Marty Kraimer and Matej Sekoranja
EPICS 7 Matej Sekoranyja, Marty Karimer, Michael Davidsaver, Ralph Lange, Andrew Johnson, Timo Korhonen, Heinz Junkes, Patrick Marschalik, Murali Shankar,
TANGO from an EPICS perspective
Presentation transcript:

1 BROOKHAVEN SCIENCE ASSOCIATES EPICS V4 Support to Physics Application, Data Acquisition, and Data Analysis L. Dalesio, Gabriele Carcassi, Martin Richard Kraimer, Nikolay Malitsky, Guobao Shen, Michael Davidsaver, BNL, Upton, Long Island, New York, U.S.A, Ralph Lange,Bessy, Berlin, Germany, Matej Sekoranja, Cosylab, Ljubljana, Slovenia, James Rowland, Diamond Light Source, Oxfordshire, England, Greg White, SLAC, Menlo Park, California, U.S.A. Timo Korhonen, PSI, Villigen, Switzerland. ICALREPCS October 14, 2011

2 BROOKHAVEN SCIENCE ASSOCIATES Outline Version 3 recap Version 4 Version 4 Architecture for Machine Control Version 4 Architecture for Beam Line Control and DAQ Conclusions

3 BROOKHAVEN SCIENCE ASSOCIATES Version 3 Supports Instrumentation Records represented either an input signal, an output signal or an operation to perform on a set of signals Analog input, analog output, (multi-bit)binary input, (multi-bit) binary output, motor, event, PID, calc, etc….. Agreeing on what a device is – is difficult. Is it a power supply or a magnet? Does a motor have an LVDT, an encoder, back lash? Records implement continuous control in an autonomous controller to perform DCS functionality. Many different types of research and industrial facilities successfully applied this to their plant for equipment control. Process Variables (PVs) are available across the network Any field of any record can be a process variable. Functions on PVs are: get, put, monitor This service was designed and implemented to be robust and fast (15K PVs per second to a client on a 100 MB network) Channels always have a time stamp, alarm severity, and alarm status – the simple data type was not useful in most cases Channels have metadata to describe display, control, and alarm information. MANY clients were developed on this interface in many languages on many operating systems implementing the full range of SCADA capabilities. With two site developing EPICS, there were two display managers.

4 BROOKHAVEN SCIENCE ASSOCIATES Version 3 Has Limited Support for Devices Records did not operate on things more complex than scalar signals. No time domain, no frequency domain, no images. No way to represent things more complicated than scalar signals and 1 dimensional arrays Process Variables available across the network could not support everything needed No atomic command / response mechanism No way to ask for a PV subject to parameters. PVs metadata did not always fit properly for every field of a record – such as the display precision – what is the time stamp of this? Typically a get is done on connection for display, alarm limits, and control metadata changes are not reflected. Meta data was sent all of the time, so only time stamp and current alarm information is monitored. MANY clients added layers on top of V3 Process Variables to implement more complex data models

5 BROOKHAVEN SCIENCE ASSOCIATES EPICS Version 3 Architecture Distributed Front-Ends MMLT, SDDS, XAL, SAD, CDEV, SPEC, GDA, etc… Physical Device Ethernet EDM/MEDM/ DM2K/EDM/QT/ IDL/ CSS CAC Other GUI tools CAC Diag Database CAS Physical Device PS Database CAS Physical Device RF Database CAS Physical Device Vac Database CAS Physical Device Util Database CAS C, C++, java, Matlab, SDDS, Python CAC Channel Archiver CAC

6 BROOKHAVEN SCIENCE ASSOCIATES Version 4 Supports Complex Data Structures Java IOC can represent devices We will likely not implement devices, as it is still difficult to agree on what these are We will use V3 records at NSLS II. PVData (PVs) are available across the network Functions on PVs are: get, put, monitor, put/process/get (command/response) It is also hard to create object models on more complex devices such as a telescope or an accelerator. Normative types are defined to provide metadata for more complex constructs: multi-channel array, table, N dimensional Array, Image. PVData always has a time stamp, alarm severity, and alarm status Vectors have useful metadata and distinctions: time domain vector, frequency domain vector, histogram Operations can be performed on two PVs with the same normative types. We have NOT completed the work to resolve large data buffers PVService supports creating middle layers services MANY servers are being developed on this interface to implement middle layer through a collaboration for physics applications, beam line control, data acquisition, and data analysis.

7 BROOKHAVEN SCIENCE ASSOCIATES Applying Version 4 to Machine Control Distributed Front-Ends ?Refactor? XAL, MMLT, SDDS, GDA Physical Device Ethernet Thin HLA Client CAC Control System Studio CAC Diag Database CAS Physical Device PS Database CAS Physical Device RF Database CAS Physical Device Vac Database CAS Physical Device Util Database CAS Matlab, SDDS, Python CAC Diamond Simulation Diag & PS CAS Channel Archiver View PVManager PVAS Channel Finder Server SQL RDB PVAC PVAS Unit Conversion CAC PVAC PVAS Orbit CAC PVAS SQL RDB PVAC Model Server PVAS PVAC PVAS Archive Retrieval XML/RPC Channel Archiver PVAC Lattic, Alignment, Magnet Map

8 BROOKHAVEN SCIENCE ASSOCIATES Version 4 to Beam Line Control and DAQ 1) Request Parallel lanes for user FPGA Spec, GDA, Edna etc… Detector Ethernet Thin HLA Client CAC Control System Studio CAC Data Acq. CAS Channel Archiver View PVManager PVAS Channel Finder Server SQL RDB PVAC PVAS Virtual Axis Conversion CAC PVAC PVAS Analysis CAC PVAS Experiment Information. SQL IRMIS PVAC Scan Service PVAS PVAC PVAS Archive Retrieval XML/RPC Channel Archiver PVAC N-lanes Detector Storage User FPGA Data Analysis. CAS PVAS 2) User FPGA Converts to NTType 3) Analysis In IOC creates resutls as NTType 4) Analysis In middle layer sevice creates resutls as NTType 5) Connect V4 client to existing codes

9 BROOKHAVEN SCIENCE ASSOCIATES Science Support – Data Stores Experiment Planning The Experiment Planning database provides information about the sample, Equipment needed, scientist, etc… needed prior to the experiment Experiment Log Book The Experiment Log Book contains information regarding the sample and resultant scientific data. It includes logs for data taking, logs for analysis, and Export file formats used to produce HDF5 files. Log entries can be made by the Scientist or automatically by the experiment control or data analysis. Scientific Data The Scientific Data is the repository for large data sets. These data sets include Matrices and image sets with the metadata required to plot or view the data. These Are stored by sample and time stamp. Data can be written from experiment control or submitted from analysis. Other data sets can also be sent here such as Reference or model data. Machine Data Machine data is all time series data that is taken from the accelerator that is available for use in analysis. Beamline Data Beamline data is all time series data that is taken from the end station, beam line, Or accelerator that is available for use in analysis.

10 BROOKHAVEN SCIENCE ASSOCIATES Science Support – Proposed Development Experiment Planning Experiment Log Book Scientific Data Machine Data Experiment & Safety Database Measurements Beamline Archiver Beamline Data Machine Archiver File Exporter Analysis Processing Data Management

11 BROOKHAVEN SCIENCE ASSOCIATES Driver I/O Requirements:: Orbit from Cell Controllers – 180 BPMs (x, y, x’, y’, I + status + 10 kHz Turn by Turn Data – 180 BPMs for 230k on demand Ripple detector Corrector power supplies PS (10k 16 bit 1 Hz Detectors – 8 GB / sec Image Detector – 800 MB per second Queue – 1 to n deep Processing Block PVAccess Server Queue – 1 to n deep Driver scans or monitors into memory blocks Large Data Sets - Requirements & Ability Prototype the speed through an IOC Prototype the speed for input into an IOC PVAccess Client Prototype the speed over PVAccess

12 BROOKHAVEN SCIENCE ASSOCIATES Driver Allocate memory for and read:: scalar (time stamped) matrix (time stamped) table (time stamped) How to get aggregates into here – such as communication errors for an entire link or card? time series of scalar, matrix, time series Queue – 1 to n deep Processing Block Queue – 1 to n deep Processing Block Queue – 1 to n deep PVAccess Server Queue – 1 to n deep Configured from processing blocks – must understand hierarchy - Driver scans or monitors into memory blocks IOCs that Support Large Data Sets PVAccess Client Develop optimized processing blocks (multi-core?) Develop queuing mechanisms Develop memory allocation schemes

13 BROOKHAVEN SCIENCE ASSOCIATES Conclusions The interface is intended to allow us to create a standard client/server architecture for high level applications such as: areaDetector, Matlab Middle Layer Toolkit, SAD, SDDS, XAL, GDA, MDS+ NSLSII is committed to apply this technology to physics applications, experiment control, data acquisition, and data analysis. Low level applications will be developed for large data sets in either the V4 Java IOC or by extending the V3 IOC to connect to PVAccess. New structures are easy to create – but we plan to carefully limit these to general and useful normative types. We are in the stage of development most similar to the early days of the EPICS collaboration: our first applications are being deployed, the normative types are not settled, there are still many challenges.