Download presentation
Presentation is loading. Please wait.
1
Current State - and Replacement
Oct. 2008 Kay Kasemir
2
Current State Has been in use for several years
Works OK, but maintenance increasingly difficult Installation, dependence on older technology Maintenance of installed instances
3
Replacement Transparent to end users
Except maybe better than before Easier to maintain in the long run Still interface to previous setups Allow import of previous configurations GUI tools access old state and replacement
5
Previous Setup IOC “ASCII” Config. Channel Access Archive Engine config.xml Binary Data Files Data Server XML-RPC History ~2000: Started by Bob Dalesio ~2003: Index Tools, Data Server ~2007: CSS Client CSS-based OPI
6
Details Older Java “archive viewer” also available.
Archive Engines running on “sampling” computer, data server on “serving” machine. Scripts to restart engines, copy data, update indices. Headaches with data maintenance: Index time grows with data Stuck when index files reach 2GB SNS Users faced with ~80 sub-archives No clue what needs fixing after network/power problems No idea who contributes how many samples No way to remove selected channels or time ranges Improving on this means implementing an RDB
7
Other tools for config & samples
New Setup IOC Channel Access ArchiveEngine Config. Samples config.xml RDB (Oracle/MySQL) EngineConfig -Import Other tools for config & samples CSS-based OPI
8
RDB Setup Currently supported: MySQL or Oracle Table Schema
Main table difference: Oracle TIMESTAMP has nanosecs, MySQL has separate nanosecs col. All tools auto-configure based on JDBC URL Table Schema ERD, MySQL DBD (in org.csstudio.archive.rdb/dbd) Setup for Oracle (table types, partitioning) not final
9
Configure Sample Engines
Configuration is in RDB Directly use SQL EngineConfigImport for legacy config files View/Edit via web Hierarchical: Sampling engine (name, where to run, …) Groups Channels No more duplicate channels!
10
Web Interface to Engine Config in RDB
Tomcat/JSP/Servlets to view and edit
11
Web Config View: Channel Stats
12
Web Config View: Sample Stats
?? OK
13
Run Archive Engine Command-line tool similar to previous engine
More settings (RDB, Logging, JCA/CAJ, …) Compiled-in defaults from “preferences.ini” and “plugin_customization.ini” Can specify overrides via -pluginCustomization my_plugin_customization.ini Mandatory command-line options for instance engine_name to locate config in RDB port for consistency, must match settings in RDB Built-in web server for status, restart, stop: Empty page (used to be ‘main’) …./main: Main page …./reset: Reset statistics …./restart: Stop, re-read configuration, start again …./stop: Stop
14
View Data CSS Data Browser: Web Config View shows some stats
As before, just different URL jdbc:oracle … Web Config View shows some stats Custom reports based on RDB data
15
Report Example, SNS Beam Instr. Group
May be SNS-specific, but shows usefulness of data in RDB
16
Hurdles Months: Get new Oracle server configured Changes in 10g
Interface cards for storage array, fiber switches Firewall holes for office access, backup, admin Changes in 10g SELECT MIN(stamp), MAX(stamp) -> NULL, NULL No “range” partitioning on Index-Organized-Tables Configuration issues ORA-01654: unable to extend … ORA-00257: archiver error What used to be impossible is now “easy”, but may still expensive DELETE FROM SAMPLES WHERE …
17
Stats 37 sample engines, 78000 channels
Host that runs sampling engine: CPU load 45%, zero disk I/O wait, very responsive Oracle performance 8000 samples/sec peak Sustained maybe ¼ of that Details of Oracle server load, data storage, backups, network access to data: No longer have to care
18
Other Ideas Jlab’s MyA Gabriele Carcassi mentioned RDDTool
Operational, but Wrapper code around MySQL to create ‘cluster’ Handles less meta info (units, limits, …) Only ‘monitor’ mode, no ‘scan’ Viewer is one-of C++/TCL/Tk Gabriele Carcassi mentioned RDDTool Toolset for logging data with data-aging Command-line RPN tools, web viewer May be faster than general-purpose RDB but lacks advantage of gpp RDB
19
Message to take home All the pieces have been running for a few weeks
Looks more sustainable than previous setup .. but not operational, yet Thanks go to Oracle: Jeff Patton JSP: Katia Danilova Beam Instr. Reports: Mariano Padilla, Jeff, Douglas Edwardson IT: Greg Lawson
20
Stuff
21
SNS Setup for EngineConfigImport Tool
Imports existing XML config files into RDB On srv02 in …/imported_config *.xml files copied from archive1, includes some editing to remove duplicate channels Review *.log files 'chmk/chmkhebt/PPS_HEBT:PLC_B:Chmk100AlarmContactA’ already in 'pps/pps_hebt’ Maybe edit “your” *.xml file, refer to import.sh to re-import
22
Getting Sources, Building binaries
Get sources from DESY CVS repository Maybe binaries “real soon” from ChannelArchiver web page Build binaries Find somebody who understands “Eclipse RCP”, how to use org.csstudio.archive.rdb/EngineConfigImport.product org.csstudio.archive.engine/ArchiveEngine.product org.csstudio.sns.product/SNS_CSS.product (or DESY CSS.product) Settings Compile-time defaults usually in “preferences.ini” and “plugin_customization.ini” files. Either change, or prepare file for -pluginCustomization command-line option
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.