1 Internet End-to-end Monitoring Project at SLAC Les Cottrell, Connie Logg, Jerrod Williams, Gary Buhrmaster Site visit to SLAC by DoE program managers Thomas Ndousse & Mary Anne Scott April 27, Partially funded by DOE/MICS Field Work Proposal on Internet End-to-end Performance Monitoring (IEPM)

2 Overview Personnel/introductions – All,15 minutes Agenda bash Datagrid Wide area network Monitoring Infrastructure (DWMI) – Connie, 30 mins –Forecasting/event detection – Les/Fawad, 15 mins High speed transport evaluation – Les/Parakram 20 mins 10Gbits/s Testbeds – Les/Gary, 30 mins –SNV/SLAC, UltraLight, USN –SC200x/iGrid PingER and the Digital Divide – Les 15 mins Summary/Close out

3 Personnel Les Cottrell (PI), Connie Logg, Jerrod Williams (mostly funded by SLAC from overhead) Draw heavily on systems, network, security (SLAC overhead) Hiring a Post doc for two year post (mostly MICS funding, DWMI) –High speed measurement tools, web services, proposal writing, understand how to monitor circuit based (USN) infrastructures, QoS/MPLS impacts Also students: –Stanford RAs (two) One working on event detection/forecasting One working on 10GE, high-performance throughput, TCP/UDT evaluations –NIIT students (funded by US State Department/MOST) Five students at SLAC, each one year visit over next two years, first one arrived February 2005 Jerrod & Les visited Pak, also DG NIIT visited SLAC, more visits planned Mainly working on PingER management & visualization –To make it sustainable –Interest includes UN, ICFA, World Bank, ICTP, WIS, Internet 2 … Also working on forecasting/prediction for DWMI

4 Support SLAC increasingly multi program –BES: SPEAR3, LCLS; HEP; Astrophysics: Kavli, GLAST, LSST New budgeting models for computing services –More program based, less overhead Will increasingly need to provide direct funding for services used for MICS funded research

5 iGrid2005, SC2005 Igrid2005 Sep 26-30, SC2005 Nov Collaboration for Bandwidth Challenge –CalTech, SLAC, CERN, FNAL … –Multiple booths Multiple 10Gbits/s waves/lambda –Big bandwidth –Want to get applications Large memory cluster (Richard Mount/Andy Hanushevsky) at SLAC or in StorCloud, with clients in booth Lambda Station Disk to Disk, would like 100Gbits/s BUT –Problems with amount of equipment, space, cabling, power, heat etc. let alone cost of equipment Demonstrate monitoring etc.

6 Papers/presentations Our work funded by DoE gets DoE visibility/recognition/respect worldwide, and helps promote research and commercial partnerships for continued research, investigations and funding: –Last 12 months 10 published papers in reviewed journals 20 presentations (NASA to the World Bank) SC2004

7 Futures (funding permitting) IEPM for >= 10Gbits/s hybrid networks –Forecasting for middleware/scheduling, problem detection, trouble shooting, develop/evaluate new measurement tools –Passive monitoring for high speed links –Provide network monitoring infrastructure to support critical HEP experiments Engage in testbeds –USN, UltraLight, SC05, iGrid05, link to SLAC Next Gen transport evaluation: –User space transport (UDT, Precision I/O), new TCP stacks, RDMA/DDP Leverage skills/contacts to be “honest broker” –Industry contacts, testbeds, reputation, independence from developers/vendors etc.

8 Further information IEPM-BW home page: – Presentation on Event Detection: – Paper/presentation on Transport evaluation: – – 10Gbits/s testing: – SC04/Igrid2005 –www-iepm.slac.stanford.edu/monitoring/bulk/sc2004/hiperf.htmlwww-iepm.slac.stanford.edu/monitoring/bulk/sc2004/hiperf.html –www-iepm.slac.stanford.edu/monitoring/bulk/igrid2005/hiperf.htmlwww-iepm.slac.stanford.edu/monitoring/bulk/igrid2005/hiperf.html PingER results and Digital Divide report for ICFA, also I2: – –

9 More Information Status reports: –