Results of Prior NSF RI Grant: TITAN David E. Culler Computer Science Division U.C. Berkeley NSF Site Visit March 2, 1998

Titan Agenda Develop a new type of system which harnesses breakthrough communications technology to integrate a large collection of commodity computers into a powerful resource pool that can be accessed directly through its constituent nodes or through inexpensive media stations. SW architecture for global operating system programming language support advanced applications multimedia application development March 2, 1998 Previous NSF RI

Results Constructed three prototypes, culminating in 100 processor UltraSparc NOW GLUnix global operating system layer Active Messages providing fast, general purpose user-level communication xFS cluster file system Fast sockets, MPI, and SVM Titanium and Split-C parallel languages ScaLapack libraries Heavily used in dept. and external research => instrumental in establishing clusters as a viable approach to large scale computing => transitioning to an NPACI experimental resource March 2, 1998 Previous NSF RI

Highly Leveraged Project Large industrial contribution HP media stations Sun compute stations Sun SMPs Intel media stations Bay networks ATM, ethernet Enabled several federal grants NOW Titanium Daedalus Castle Berkeley Multimedia Research Center March 2, 1998 Previous NSF RI

Software Warehouse Coherent software environment throughout the research program Billions bytes of code Mirrored externally New SWW-NT March 2, 1998 Previous NSF RI

Novel Systems Design Virtual networks Implicit Co-scheduling integrate communication events into virtual memory system Implicit Co-scheduling cause local schedulers to co-schedule parallel computations using a two-phase spin-block and observing round-trip Co-operative caching access remote caches, rather than local disk, and enlarge global cache coverage by simple cooperation Network virtual memory, fast sockets Large-scale Storage Clusters ISAAC “active” security Internet Server Architecture TACC Proxy architecture March 2, 1998 Previous NSF RI

Novel Cluster Design Tertiary Disk Pleiades Clusters CLUMPS very low cost massive storage hosts archive of Museum of Fine Arts Pleiades Clusters functionally specialized storage and information servers constant back-up and restore at large scale NOW tore apart traditional AUSPEX servers CLUMPS cluster of SMPs with multiple NICs per node March 2, 1998 Previous NSF RI

Multi-Tier Networking Infrastructure Myrinet Cluster Interconnect ATM backbone Switched Ethernet Wireless March 2, 1998 Previous NSF RI

Applications Inktomi Search Engine World Record Disk-to_Disk store RSA 40-bit key IRAM simulations, Turbulence, AMR, Lin. Alg. Parallel image processing Protocol verification, Tempest, Bio, . . . Services that utilize NOW on demand TACC (transcoding) Proxy Transcend Wingman MBONE media gateway March 2, 1998 Previous NSF RI

Sample of 98 Degrees from Titan Amin Vahdat: WebOS Steven Lumetta: Multiprotocol Communication Wendy Heffner: Multicast Communication Protocols Doug Ghormley: Global OS Andrea Dusseau: Implicit Co-scheduling Armando Fox: TACC Proxy Architecture John Byers: Fast, Reliable Bulk Communication Elan Amir: Media Gateway David Bacon: Compiler Optimization Kristen Wright: Scalable web cast Jeanna Neefe: xFS Steven Gribble: Web caching Ian Goldberg: Wingman Eshwar Balani: WebOS security March 2, 1998 Previous NSF RI

Demo before Tour March 2, 1998 Previous NSF RI

UCB CSCW Class Sigh… no multicast, no bandwidth, no CSCW class... Problem Enable heterogeneous sets of participants to seamlessly join MBone sessions. March 2, 1998 Previous NSF RI

A Solution: Media Gateways Software agents that enable local processing (e.g. transcoding) and forwarding of source streams. Offer the isolation of a local rate-controller for each source stream. Controlling bandwidth allocation and format conversion to each source prevents link saturation and accommodates heterogeneity. GW GW March 2, 1998 Previous NSF RI

A Solution: Media Gateways Sigh… no multicast, no bandwidth, no MBone... AHA! MBone Media GW March 2, 1998 Previous NSF RI