Presentation is loading. Please wait.

Presentation is loading. Please wait.

CORAL and COOL news for ATLAS (update since March 2012 ATLAS sw workshop)March 2012 Andrea Valassi (IT-SDC) ATLAS Database Meeting 24 th October 2013.

Similar presentations


Presentation on theme: "CORAL and COOL news for ATLAS (update since March 2012 ATLAS sw workshop)March 2012 Andrea Valassi (IT-SDC) ATLAS Database Meeting 24 th October 2013."— Presentation transcript:

1 CORAL and COOL news for ATLAS (update since March 2012 ATLAS sw workshop)March 2012 Andrea Valassi (IT-SDC) ATLAS Database Meeting 24 th October 2013

2 A. Valassi – CORAL and COOL news for ATLAS2 Outline  A few recent enhancements  CORAL handling of network glitches  Kerberos authentication  COOL performance validation on Oracle 12c servers  And a few more… see the most recent release notesrelease notes  Upcoming releases and work in progress  COOL vector payload  New CORAL server protocol  Port to ROOT6

3 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS3 Network glitch handling in CORAL  Major improvements in OracleAccess plugin  Automatically and transparently reconnect to Oracle after a connection glitch (unless it broke an active transaction)  Implemented by ‘refreshing’ Oracle OCI pointers to avoid crashes, hangs and other issues reported in the past  Released in CORAL 2.3.2 in 2012 (see CHEP2012 paper)CHEP2012 paper  Other improvements  Fixes in CoralServerProxy to address observed HLT crash  Generally improved connection handling in multi-threaded use cases, but limitations remain in non-Oracle back-ends

4 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS4 Kerberos authentication  An alternative to username/password authentication  Supported in CORAL and COOL since the end of 2012  While Oracle support for X509 certificates is still missing  Two ways to use your Kerberos ticket (~AFS token)  Principal authentication (must create new Oracle users)  Nicer: proxy authentication (map Kerberos to Oracle user)  Must be explicitly enabled on the Oracle server  Now only on CORAL test server, not on any ATLAS server  Also requires custom client-side sqlnet.ora

5 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS5 Validation on Oracle12c servers (1)  COOL performance validated on 12c servers  Details in the CoolPerformanceTests twiki pageCoolPerformanceTests  Using the same tool developed for the 10g → 11g migration  Not impressed with the “adaptive” features of 12c!  Without COOL hints, in some situations Oracle never finds a good execution plan if adaptive optimization is enabled!  Disable adaptive optimization in COOL at query-level  Add optional hook to disable it in CORAL at session-level

6 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS6 Validation on Oracle12c servers (2)  COOL performance report on Oracle 12c  With 12c “adaptive” features disabled (new COOL default)  COOL hints (developed on 11g) ensure good execution plans independently of statistics and bind variable peeking With hints Without hints

7 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS7 Oracle client  Currently using 11.2.0.3.0 (since Q3 2012)  Addresses security vulnerability in logon protocol  Includes fixes for SElinux and for AMD multicore nodes  Includes Kerberos bug workaround in custom sqlnet.ora  Using it on Linux and more recently also on MacOSX  Work in progress: testing 12.1.0.1.0  Following up Kerberos/password authentication issues  Expect minor improvements in redefinition of Kerberos and GSSAPI symbols, but this was declared a “Won’t fix”

8 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS8 Platforms and infrastructure  Some recent changes  CVS to SVN migration (also POOL for data preservation)  Support on gcc4.8 with c++11, clang3.3, icc13  On the to-do list  CMT to cmake migration  Savannah to Jira migration  Quattor to puppet migration (CORAL server test instance)

9 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS9 Tests and QA  Static code analysis  Fixed several issues reported by Coverity (others will be included in the upcoming API changes)  Memory analysis and time profiling  Fixed several leaks reported by valgrind and igprof  A few studies of elapsed/CPU time with gperftools too

10 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS10 Work in progress  Upcoming release by end 2013  COOL vector payload (currently validating performance)  New CORAL server protocol (but no monitoring added)  Other extensions (and bug fixes) in the API’s  Work in progress on the port to ROOT6  Only affects PyCool (Reflex to cling/pypy migration)  Plan integration tests with GaudiHive MT framework

11 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS11 COOL vector payload  This is only meant as a replacement of “CoraCool”  Useful in the ongoing ATLAS conditions database review  There are at least 3 options for vector-like conditions  Separate channels, vector payload, inline BLOBs…  See the CoolVectorPayload twiki pageCoolVectorPayload  Being tested from the COOL nightlies  Before this is released, can you confirm the present functionalities and implementation are ok for ATLAS?

12 24 th October 2013A. Valassi – CORAL and COOL news for ATLAS12 Summary  A few recent enhancements  CORAL handling of network glitches  Kerberos authentication  COOL performance validation on Oracle 12c servers  Upcoming releases and work in progress  COOL vector payload  New CORAL server protocol  Port to ROOT6 Thanks to IT-DB, to the SPI team and to ATLAS users/DBAs!


Download ppt "CORAL and COOL news for ATLAS (update since March 2012 ATLAS sw workshop)March 2012 Andrea Valassi (IT-SDC) ATLAS Database Meeting 24 th October 2013."

Similar presentations


Ads by Google