TeraGrid Accounting System Progress and Plans David Hart July 26, 2007

Recent Accounting Activities Server/Software Upgrade (Aug 2006) –New hardware, PostgreSQL upgrade –Test and development instances on prior hardware –Ongoing monitoring NPU processing bottleneck eliminated (Dec 2006) –Troubleshooting, identifying and fixing issue –Solving Purdue Condor job backlog Support for tracking arbitrary job “attributes” (Jan 2007) –Targeting proposed gateway needs Project out-of-funds/expired packets, PI notification (March 2007) –Plus update to provide more info to RPs in RPI packets –Notification in use by NCSA, TG Cluster; Purdue planned –User inactivation (RAI packets) Credits/debits via NPUs (May 2007) –Refunds, reservation charges, storage charges (in SUs), misc. credits/debits TGCDB user “roles” (May 2007) –NPUs can flag user types including “community user”, “PI”, “co-PI”, “allocation manager.” –Other roles can be added. (Perhaps “training user” )

Activities currently underway Job/NPU processing improvements –Simpler TGCDB structure, faster processing, easier error correction –Will also permit improved reporting capabilities –Ready, pending RP action AMIE benchmarking –To identify bottlenecks and improve packet transport performance Supporting ability for users to change contact information via portal GRAM/grid job info –Already supported by TGCDB/AMIE, requires RP action

Ongoing Activities DNs and DN propagation –TGCDB/AMIE components in place, troubleshooting TG-wide compliance Portal support –Miscellaneous requests, including improvements to add user form, portal logins, etc. Support for adding/decommissioning new resources, RPs –NCAR and Frost –Abe, Ranger, Big Ben, storage resources added –Lemieux, Radium, Tiger decommissioned tgusage updates Updated to v2.9 from v2.4 in August 2006 Requested feature to extract per-job details Ongoing support for trouble tickets, error correction –Including backloads of PSC data and PSC/SDSC DACs

Recent POPS Developments Portal login support Supporting grant data collection changes –to comply with NSF policy change New resource types (storage, ASP) and billing units (TBs, Months) Sept: Online proposal status tracking, viewing of reviewer comments –Enhanced admin capabilities to customize award notices and automate notifices to PIs/co-PIs Plans –Context-based help –Go “paperless” for reviewer meeting materials –DAC changes for NSF Graduate Fellows

Planned Activities Storage usage accounting and reporting Near-term updates –New features requested by other TG areas or to reflect policy changes –AMIE optimizations –Streamlining TGCDB procedures and triggers New “Core Services” proposal submitted –To replace current NCSA/SDSC Core-leveraged funding for allocations and accounting-related activities Better integration of and communication between POPS and Allocations activities/staff with TGCDB and Accounting activities/staff

TeraGrid Core Services 2.0 Major focus for next year Multi-site, GIG-funded team for requirements gathering and initial design Top to bottom evaluation and integration of the allocation, authentication, authorization, and accounting system components Seamless interaction between POPS, TGCDB, TGUP, Gateways infrastructure, and Authentication system Eliminate NCSA Sybase from the critical path Automate process to minimize the human effort required Multi-site or site-independent project/user creation