1. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox TACC Update Daedalus/BARWAN Winter Retreat, January 1998 Armando Fox fox@cs.berkeley.edu

2. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Outline n TACC Review & Status n New TACC Services and CS 294-6: Internal Technology Transfer n Thin Clients & Computing By Proxy n Publication/Ongoing Research Activities n Summary

3. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Layered Model of Internet Services n TACC Layer äProgramming model based on composable building blocks n SNS Layer: “large virtual server” äImplements SNS requirements äCluster computing for hardware F/T and incremental scaling httpd, etc. TACCTACC Scalable Network Svc äExploit TACC model semantics for software F/T n SNS layer is reusable and isolated from TACC äFocus on application content äApplications get SNS behaviors for free

4. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox What’s TACC? n Transformation (“one-to-one”) äTranSend, Anonymizer n Aggregation (“many-to-one”) äSearch engines, crawlers, “my headlines” n Caching äBoth original and TACC-generated content n Mass Customization äPer user: for content generation äPer device: data delivery, content “packaging”

5. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox TACC Examples n HotBot search engine äQuery crawler’s DB äCache recent searches äCustomize UI/presentation n TranSend transformation proxy äOn-the-fly lossy compression of inline images (GIF, JPG, etc.) äCache original & transformed äUser specifies aggressiveness, “refinement” UI, etc. C T T $ $ A A T T $ $ C DB html

6. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox TACC Conceptual Data Flow C $ W W W A W W W T FE User request To Internet n Front end accepts RPC-like user requests n Original data fetched from cache or Internet n User’s customization profile retrieved n Aggregators/transformers operate on data according to customization profile

7. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Logical TACC Server Architecture n Component replication for scaling and FT n NOW with scalable interconnect n Incremental scaling: commodity building blocks C $ LB/FT Interconnect FE $$ W W W T W W W A GUI

8. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox TACC Contributions n TACC programming model äTransformation, Aggregation, Caching, Customization can all be composed äEncourages software structure that admits of simple F/T mechanisms äCaptures a large class of services n Cluster-based framework to instantiate TACC äAllows TACC authors to ignore SNS requirements äPerformance, scalability, and failure management adequate for real workloads äStock hardware

9. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox TACC Server Status n “Production” cluster running at UCB since 4/97 äTranSend web accelerator äVirtually zero downtime and zero maintenance n Software distribution in progress äBinaries for Solaris and Linux äSource snapshot ä“SDK” and additional modules coming soon n Used as testbed for CS 294-6 graduate seminar

10. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox CS 294-6: Internet Services n Survey: design & implementation of Internet services n Design and implement a service using TACC äBest ones deployed permanently, like TranSend äReal developers: a way to stress the software infrastructure (and documentation!) n Encourage other research projects to leverage TACC

11. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox New Services Deployed n Safe worker upload and execution n Cha-Cha, combining browsing and searching n Group Annotation for the Web n Top Gun Wingman, world’s only graphical Web browser for the Palm Pilot n Top Gun MediaBoard n RTSP Archive Server n Others… http://www.cs.berkeley.edu/~fox/cs294-6/

12. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Safe Worker Upload/Execution n ISAAC group: David Wagner, Prof. Eric Brewer n Any user can author a new worker/module n New workers are uploaded dynamically into a running TACC server n TACC “route selection” forms-based interface used to select worker(s) for each MIME type n Workers run in a Janus sandbox

13. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox HotBot Cha-Cha: Contextualizing Search n BAILANDO project: Mike Chen, Jason Hong, Prof. Marti Hearst (UCB SIMS) n TACC implementation improves performance & scaling of Cha-Cha prototype Layout (T) Query (A) Combine (A) Cha-Cha html

14. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Group Annotation n Multivalent Documents/Digital Libraries project: Marcel Kornacker, Ray Gilstrap, Tom Phelps, Prof. Robert Wilensky n Annotate the Web, without owning it Anno. DB UI Stock Web servers Anno. Svr. Web browser MVD Editor (Java)

15. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox RTSP Archive Server Front End n MASH project: Angela Schuett, Suchi Raman, Prof. Steve McCanne n Goal: Add scalability and availability using TACC

16. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Thin Clients: Top Gun Wingman n World’s only graphical browser for PalmPilot handheld device n >5000 users worldwide n Richest feature set of any Pilot browser, many uniquely enabled by proxy n #9 out of 100 in “People’s Choice” awards

17. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Groupware: Top Gun MediaBoard n mb comes to the Pilot n Combines MASH tools with TACC server äEnables future MASH collaboration n Inherits TACC robustness & scalability Superiority of proxy-based approach to enabling “thin” clients successfully demonstrated.

18. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Publication Activities n Invited submission to IEEE Personal Comms. äSpecial issue: Adapting to network and client variability n Structure, data semantics, and implementation of interactive Internet applications äCollaboration with Dr. Murray Mazer, Open Group Research Institute äPast work on annotating the Web and using HTTP proxies to build Web applications n Top Gun Wingman

19. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Summary n Validation of proxy architecture for thin clients äWingman is the fastest browser and the only one with graphics; MediaBoard is unprecedented n (Continuing) validation of methodology & platform for building scalable Internet services n Successful internal & external tech transfer äCS 294-6 projects äWingman, MediaBoard, MASH collaboration… äTranSend at UC Davis, SRI, soon Lucent n Next time: the eye-watering demo

20. Daedalus/BARWAN Retreat 1/98TACC Update/Armando Fox Credits n Top Gun Wingman: Ian Goldberg, Anthony Polito, David Lee n Top Gun MediaBoard: Yatin Chawathe, Steve Fink n MASH/TACC integration: Yatin Chawathe n RTSP Archive Server: Angela Schuett, Suchi Raman n Cha-Cha: Mike Chen, Jason Hong, Prof. Marti Hearst n Annotate the Web: Marcel Kornacker, Ray Gilstrap, Tom Phelps, Prof. Robert Wilensky n Secure upload: David Wagner