1. Managed by UT-Battelle for the Department of Energy 1 Integrated Catalogue (ICAT) Auto Update System Presented by Jessica Feng Research Alliance in Math and Science Scientific Computing Group Spallation Neutron Source Dr. Shelly Ren August 14, 2008 Oak Ridge, Tennessee

2. Managed by UT-Battelle for the Department of Energy 2 Introduction  Spallation Neutron Source (SNS) was built to study atoms in materials: –Arrangement –Motion –Interaction  SNS has wide range of applications –Rubber – studies in elasticity –Cars – fuel efficiency, quality of car engines –Planes – quality of weld on plane’s wings UTBOG_Computing_0801

3. Managed by UT-Battelle for the Department of Energy 3 Introduction (con’t)  Neutron research has potential to improve range and quality of many products  To effectively analyze and interpret vast amounts of data collected from SNS, software must be –Developed –Documented –Tested UTBOG_Computing_0801 Diagram of current and future beam lines at SNS

4. Managed by UT-Battelle for the Department of Energy 4 Outline  Logging various actions on programs –Translation Monitor –Proposal Checkin Utility  Writing user documentation for aforementioned programs  Working on incorporation of Integrated Proposal Tracking System (IPTS)  Assisting in checking and improving software to be used by internal and external users UTBOG_Computing_0801

5. Managed by UT-Battelle for the Department of Energy 5 Logging Actions on Programs Translation Monitor  Translation Monitor allows users to: –Monitor process of automatic translation and archival run data –Browse status and history of past transactions  Logging Actions: –Observed and tested different features  Live Mode vs. Request Mode  Sorting  Assorted filters –Recorded the outcomes from each feature

6. Managed by UT-Battelle for the Department of Energy 6 Logging Actions on Programs Proposal Checkin Utility  Proposal Checking Utility: –Used to dynamically manage proposal team members –Will continue to be used by outside facilities (LENS, Lujan) upon completion of the ICAT update system –Experiment data will be continued to be archived and catalogued at SNS  Logging Actions: –Added and deleted test proposals –Added and removed test team members –Observations from actions were recorded

7. Managed by UT-Battelle for the Department of Energy 7 User Documentation  Required for new software and programs  Typically describes features of a program and assists users in realizing those features  Documentation was written for two programs: –Translation Monitor –Proposal Checkin Utility  Information gathered from logged actions used to write documentations –Documentations added to repository and will be linked to each program’s help page

8. Managed by UT-Battelle for the Department of Energy 8 Incorporation of Integrated Proposal Tracking System (IPTS)  ICAT Server –Enterprise archive that is composed of several Java Archives which handle:  Data cataloguing  Metadata search  Data access control –Connects to Oracle Database to store experiment metadata for SNS, HFIR, LENS and Lujan –Provides interfaces for SNS components such as:  Live-cataloguing  Web portal interface  Data management for various services

9. Managed by UT-Battelle for the Department of Energy 9 Incorporation of the IPTS (con’t)  Lightweight Directory Access Protocol database (LDAP DB) –Server used to process queries and updates to a LDAP information directory –LDAP information directory is a type of database, but is heavily optimized for read performance

10. Managed by UT-Battelle for the Department of Energy 10 Incorporation of the IPTS (con’t) Current/LENS and Lujan System Checkin Utility (web application) ICAT (for portal users) LDAP DB (for shell users) Changes in team members Checkin Utility updates ICAT and LDAP This system will be used for user authorization and experimental data at LENS and Lujan. IPTS I’m left out!

11. Managed by UT-Battelle for the Department of Energy 11  Oracle Queue –When a new user is added to proposal system, a trigger is placed such that a message containing facility, instrument, proposal ID, uID and userRole will arrive in queue –Set up by proposal system to store all updates of IPTS team members  Cron Job –Java application –Written to connect to IPTS database and to retrieve team member messages off queue –Updates ICAT and LDAP DB accordingly  Testing will be conducted to ensure updated team information is uploaded into ICAT and LDAP DB Incorporation of the IPTS (con’t)

12. Managed by UT-Battelle for the Department of Energy 12 Incorporation of the IPTS (con’t) Proposal Team Access Control Data Flow Cron Job (java application) If there are new messages in the Oracle Queue, ICAT and LDAP are updated ICAT (for portal users) LDAP DB (for shell users) Permission check when users login to the databases to search and retrieve data Oracle Queue Cron job wakes up every 1-2 minutes and checks Oracle Queue for new messages Integrated Proposal Tracking System Web form will allow updates to proposal team members IPTS sends updated team member information to the Oracle Queue

13. Managed by UT-Battelle for the Department of Energy 13 Checking and Improving Software for Internal and External Users  Synced existing proposal team information from ICAT to IPTS using Structure Query Language (SQL) to import data  Instrument names were compared between portal and Proposal Checkin Utility so there will not be any future confusion User info from ICAT User info from IPTS Combined and updated user info Instrument names

14. Managed by UT-Battelle for the Department of Energy 14 Users at HFIR and SNS  About 1,000 – 2,000 users are expected per year  Usually scientists and engineers from: –Universities –Industries –Laboratories  Modern computational, communication and networking services will encourage interactive science and video teleconferencing and provide data acquisition and analysis capabilities for resident scholars and their colleagues around the world

15. Managed by UT-Battelle for the Department of Energy 15 Acknowledgments The Research Alliance in Math and Science program is sponsored by the Office of Advanced Scientific Computing Research, U.S. Department of Energy. The work was performed at the Oak Ridge National Laboratory, which is managed by UT-Battelle, LLC under Contract No. De-AC05-00OR22725. This work as been authorized by a contractor of the U.S. Government, accordingly, the U.S. Government retains a non-exclusive, royalty-free license to publish or reproduce the published form of this contribution, or allow others to do so, for U.S. Government purposes. The author would like to thank Shelly Ren and the Spallation Neutron Source Scientific Computing Group for the opportunity to work on this project. Special thanks go to Debbie McCoy and Jacki Isaacs who made provisions for this research experience.

16. Managed by UT-Battelle for the Department of Energy 16 Questions?