TeraGrid Arch Meeting RP Update: ORNL/NSTG 1 ORNL_RP_Update_ TeraGrid Arch Meeting RP Update: ORNL/NSTG August 1, 2008 John W. Cobb

Outline 2 ORNL_RP_Update_ NSTG Purpose SNS Background and Status Neutron Science Portal Progress Report on Neutron Science Portal TeraGrid integration with Neutron Science Portal NSTG Cluster Operations update

NSTG Purpose 3 ORNL_RP_Update_ NSTG = Neutron Science TeraGrid Gateway Goals. Seek to build/improve Bridging: between SNS and TeraGrid Facility integration (especially large science facilities) Neutron scattering science focus area Instruments/Experiments Inst/Exp was left out of new IPP, missing WBS areas were remapped to primarily {HPC-ops, SGW, EOT} areas. Close association with Spallation Neutron Source (SNS) Other interests: Other neutron sources (LENS, IPNS, NCNR, ISIS, J- SNS, ANSTO/OPAL, … Other large experimental user facilities (Diamond, APS, … Discipline based SW efforts (DANSE, …) CI software efforts (CIMA, …

SNS Background and Status 4 ORNL_RP_Update_ SNS – Spallation Neutron Source ( Located in Oak Ridge Pulsed neutron source: 1.4 MW, 1.4 GeV proton beam onto a mercury target. Up to 24 beam lines. Construction Current Operations 6 instruments in SNS user program Power ramping up User days increasing High Flux Isotope Reactor now also part of org.

Neutron Science Portal 5 ORNL_RP_Update_ Location: Developed by SNS Software Group (ASG) SNS-ASG is collaboration contact point for NSTG SNS ASG highly leverages NSTG effort NS Portal uses wide mix of back-end CI, including TG Instrument local computers ASG centralized servers and storage OIC (ORNL’s version of campus clusters) TG via NSTG User’s desktops and home machines (portal thick client under development via SBIR with TechX Corp, Buffalo office)

6 Cobb_TeraGrid_SC07 SNS data access via portal (Reduction, analysis, and simulation as well) Turnkey solutions are being requested by users and user groups ProblemSNS approach Providing advanced tools in an easy fashion while retaining customizability  Neutron Science User Portal  Totally in Java Acknowledgement: S. Miller and SNS ASG; J. Kohl, S. Vazhkudai and ORNL/CSM division) Function deployment order  First: Data acquisition and storage/stewardship  Then: Reduction, analysis, simulation, proposals for one-stop access

NS Portal architecture: (stylized) “flows from requirements” 7 Cobb_TeraGrid_SC07

NS Portal Identity Management 8 Cobb_TeraGrid_SC07 Identity created and maintained by SNS facility XCAMS – an external implementation of ORNL internal Unified accounts management system “X” for External (inadvertent, unfortunate Google search space collisions) X - lower identity proofing, suitable for user facilities (NIST level 1) NS portal maps identity (as needed) to access other CI resources using the “Application Manager” subsystem for execution orchestration. For TeraGrid integration, NS portal invokes “Jimmy Neutron” Community access Ack: Lynch, Vazhkudai, Kohl, Trater, Miller

NS Portal and TG Community Accounts 9 Cobb_TeraGrid_SC07 TeraGrid jobs executed in community account NS Portal application manager archives in DB community user “reach back” according to {SGW,SEC} WG policy TG Community account use from NS portal Installed for: McStas instrument simulation Generic (NL2SOL) fitting service Future possible installation for: Distributed data reduction Others Current TG use Increasing Still dominated by development experimental use SU use low, job count higher Ack: Lynch, Ren, Kohl, Miller

Progress Report on Neutron Science Portal Use 10 ORNL_RP_Update_ Ack: S. Miller & SNS ASG

SNS Facility Data Storage

End User Network Quality of Service (Not TG network) Within ORNL At LENS From Home From Hotel in Bloomington Informs decision on portal versus Thick client access

Neutron Science Discipline Science Areas 13 ORNL_RP_Update_ Full instrument/experiment simulation studies conducted by E. Farhi (ILL) Emerging interest by neutron imaging instrument design team (particularly data intensive). CI requirements being solicited Collaboration on diffused scattering data analysis project to improve software tools

Other NSTG areas 14 ORNL_RP_Update_ ESG (with NCAR) working to facilitate ESG data transfer over TG network between ORNL and NCAR (2 important ESG sites) OSG. NSTG cluster available as both TG and OSG resource to demonstrate feasibility. Motivated by “Should I use TG or OSG” question from a Neutron Scattering software project. A: Either, we support both. NSTG Status now “green” after a period of red following sys-admin transition

NSTG Cluster Operations Update 15 ORNL_RP_Update_ Usage update: Breckenridge meeting noted that NSTG cluster usage was increasing. Suspected cause was overflow from TG oversubscription. Recent usage trends by non neutron science related users down Suspected explanation: TeraGrid resources much larger Operations status : still good ( but – we lost /users due to NFS problem 2 weeks ago) Some system Admin changeover issues still linger - thanks Ack : Giles