1. TeraGrid Arch Meeting RP Update: ORNL/NSTG 1 ORNL_RP_Update_080801 TeraGrid Arch Meeting RP Update: ORNL/NSTG August 1, 2008 John W. Cobb

2. Outline 2 ORNL_RP_Update_080801 NSTG Purpose SNS Background and Status Neutron Science Portal Progress Report on Neutron Science Portal TeraGrid integration with Neutron Science Portal NSTG Cluster Operations update

3. NSTG Purpose 3 ORNL_RP_Update_080801 NSTG = Neutron Science TeraGrid Gateway Goals. Seek to build/improve Bridging: between SNS and TeraGrid Facility integration (especially large science facilities) Neutron scattering science focus area Instruments/Experiments Inst/Exp was left out of new IPP, missing WBS areas were remapped to primarily {HPC-ops, SGW, EOT} areas. Close association with Spallation Neutron Source (SNS) Other interests: Other neutron sources (LENS, IPNS, NCNR, ISIS, J- SNS, ANSTO/OPAL, … Other large experimental user facilities (Diamond, APS, … Discipline based SW efforts (DANSE, …) CI software efforts (CIMA, …

4. SNS Background and Status 4 ORNL_RP_Update_080801 SNS – Spallation Neutron Source (http://neutrons.ornl.gov)http://neutrons.ornl.gov Located in Oak Ridge Pulsed neutron source: 1.4 MW, 1.4 GeV proton beam onto a mercury target. Up to 24 beam lines. Construction 1999-2006 Current Operations 6 instruments in SNS user program http://neutrons.ornl.gov/instrument_systems/sns_instruments.shtml http://neutrons.ornl.gov/instrument_systems/sns_instruments.shtml Power ramping up User days increasing http://neutrons.ornl.gov/proj_status/sns_long_schedule.shtml http://neutrons.ornl.gov/proj_status/sns_long_schedule.shtml High Flux Isotope Reactor now also part of org. http://neutrons.ornl.gov/hfir/hfir_facilities.shtml http://neutrons.ornl.gov/hfir/hfir_facilities.shtml

5. Neutron Science Portal 5 ORNL_RP_Update_080801 Location: http://neutronsr.us/portalhttp://neutronsr.us/portal Developed by SNS Software Group (ASG) SNS-ASG is collaboration contact point for NSTG SNS ASG highly leverages NSTG effort NS Portal uses wide mix of back-end CI, including TG Instrument local computers ASG centralized servers and storage OIC (ORNL’s version of campus clusters) TG via NSTG User’s desktops and home machines (portal thick client under development via SBIR with TechX Corp, Buffalo office)

6. 6 Cobb_TeraGrid_SC07 SNS data access via portal (Reduction, analysis, and simulation as well) Turnkey solutions are being requested by users and user groups ProblemSNS approach Providing advanced tools in an easy fashion while retaining customizability  Neutron Science User Portal  Totally in Java Acknowledgement: S. Miller and SNS ASG; J. Kohl, S. Vazhkudai and ORNL/CSM division) Function deployment order  First: Data acquisition and storage/stewardship  Then: Reduction, analysis, simulation, proposals for one-stop access

7. NS Portal architecture: (stylized) “flows from requirements” 7 Cobb_TeraGrid_SC07

8. NS Portal Identity Management 8 Cobb_TeraGrid_SC07 Identity created and maintained by SNS facility XCAMS – an external implementation of ORNL internal Unified accounts management system “X” for External (inadvertent, unfortunate Google search space collisions) X - lower identity proofing, suitable for user facilities (NIST level 1) NS portal maps identity (as needed) to access other CI resources using the “Application Manager” subsystem for execution orchestration. For TeraGrid integration, NS portal invokes “Jimmy Neutron” Community access Ack: Lynch, Vazhkudai, Kohl, Trater, Miller

9. NS Portal and TG Community Accounts 9 Cobb_TeraGrid_SC07 TeraGrid jobs executed in community account NS Portal application manager archives in DB community user “reach back” according to {SGW,SEC} WG policy TG Community account use from NS portal Installed for: McStas instrument simulation Generic (NL2SOL) fitting service Future possible installation for: Distributed data reduction Others Current TG use Increasing Still dominated by development experimental use SU use low, job count higher Ack: Lynch, Ren, Kohl, Miller

10. Progress Report on Neutron Science Portal Use 10 ORNL_RP_Update_080801 Ack: S. Miller & SNS ASG

11. SNS Facility Data Storage

12. End User Network Quality of Service (Not TG network) Within ORNL At LENS From Home From Hotel in Bloomington Informs decision on portal versus Thick client access

13. Neutron Science Discipline Science Areas 13 ORNL_RP_Update_080801 Full instrument/experiment simulation studies conducted by E. Farhi (ILL) Emerging interest by neutron imaging instrument design team (particularly data intensive). CI requirements being solicited Collaboration on diffused scattering data analysis project to improve software tools

14. Other NSTG areas 14 ORNL_RP_Update_080801 ESG (with NCAR) working to facilitate ESG data transfer over TG network between ORNL and NCAR (2 important ESG sites) OSG. NSTG cluster available as both TG and OSG resource to demonstrate feasibility. Motivated by “Should I use TG or OSG” question from a Neutron Scattering software project. A: Either, we support both. NSTG Status now “green” after a period of red following sys-admin transition

15. NSTG Cluster Operations Update 15 ORNL_RP_Update_080801 Usage update: Breckenridge meeting noted that NSTG cluster usage was increasing. Suspected cause was overflow from TG oversubscription. Recent usage trends by non neutron science related users down Suspected explanation: TeraGrid resources much larger Operations status : still good ( but – we lost /users due to NFS problem 2 weeks ago) Some system Admin changeover issues still linger - thanks Ack : Giles