Universal Berkeley Activities in the ISRG / Endeavour David Culler Randy Katz, Eric Brewer, Anthony Joseph, James Landay and others Philips Visit 8/5/99

Philips2 Natural Tides of Innovation Time Integration Innovation Log R Mainframe Minicomputer Personal Computer Workstation Server 2/99

8/5/99Philips3 Expanding the Spectrum Desktops –max out at few 100M –in your face –connected to the infrastructure Ubiquitous Devices –billions –sensors / actuators –smart space –PDAs / smartphones / PCs –heterogeneous Service Path Scalable Infrastructure –highly available –persistent state (safe) –databases, agents –service programming environment

8/5/99Philips4 Issues Converge at the Extremes Powerful Services on “Small” Devices –massive computing and storage in the infrastructure –active adaptation of form and content “on the way” Lean, Flexible Communication Building-Blocks –simplicity is the key to efficiency Federated System of Systems Availability, Automatic Configuration and Management Novel interfaces and usage models Plug it all together and have it DWYM! Computer Science focused on problems of scale!

8/5/99Philips5 Outline Brief perspective on current activities Directions ahead under the Endeavour effort

8/5/99Philips6 ISRG+ Projects Millennium Testbed –Culler, Demmel, … (Intel, NSF, UCB, Microsoft, Sun, IBM, Nortel) Ninja Proactive Infrastructure –Brewer, Culler, Katz, Joseph (ARPA) Iceberg: Computer/Telephony Integration –Katz, Joseph (Ericsson, ATT) Istore / Telegraph / Oceanic –Patterson, Hellerstein, Kubiatowitz, Brewer GUIR - novel user interfaces –Landay Universal Computing Lab –IBM => Endeavour Expedition to the 21st Century

8/5/99Philips7 Underlying Message It’s not just putting together good computer science research projects, its growing a community that “thinks” in the emerging world

8/5/99Philips8 Network Infrastructure GSM BTS Millennium Cluster WLAN Pager IBM WorkPad CF788 MC-16 Motorola Pagewriter 2000 Text Speech Image/OCR 306 Soda 326 Soda “Colab” 405 Soda Ericsson Smart Spaces Personal Information Management Fax Experimental Testbed

8/5/99Philips9 Ninja Vision You walk into a room You have complete, secure, optimized access to local devices and your private resources Your PDA connects to the local infrastructure and asks it to build a custom GUI Next, your PDA asks the infrastructure for a path out to your personal information space, where agents are processing your , v-mail, faxes, and pages

8/5/99Philips10 Push Services into an Active Infrastructure Servers Clients Servers Infrastructure Services Open => enable Distributed Innovation of Scalable, Avail. Services

8/5/99Philips11 Embedded Untrusted Interface? Key Store DATEK (Trust Contract) Trusted Client https Content Filter (pseudonym) sRMI NINJA Infrastructure Services Embeded Untrusted Client https

8/5/99Philips12 One Time Passwd to pseudo-service Cannot increasing the security of the channel so decrease the value of the content.

8/5/99Philips13 Informal Collaborative Interfaces Meet in any environment Take free-form ink notes on Pilots or CrossPads * 1 2 * accumlate, share, transform in the infrastructure

8/5/99Philips14 Building the Bazaar What we need is not just a new research project, but a new “computing culture” => Build a department-wide, universal wireless PDA infrastructure, smart spaces and a community to take it forward Initial Seed Fall 98 with IBM –150+ IBM workpads + lots of cradles + IR + ??? –Pervade the first-year grad research projects –bold experiment in the senior UI course –accelerated the on-going research efforts Follow-on Universal Computing Lab Endeavour provides the framework

8/5/99Philips15 Some Lessons Communication is enabling –low-power wireless needs to be like IP Virtual Environment is important –Devices connect “into the infrastructure” »Network HotSync, groupware, centralized => Need lean, clean communication substrate “User Service” is fundamental –not just profile and customization info –routing point for security Much room for improvement in devices Development effort is the limiting factor –OSKI: 1 person for infrastructure, 2 for WorkPad => need complete distributed system debugging and simulation environment

The Endeavour Expedition: Charting the Fluid Information Utility Randy H. Katz, Principal Investigator EECS Department University of California, Berkeley Berkeley, CA

8/5/99Philips17 Vision/Objective Enhancing human understanding through information technology –Make it dramatically more convenient for people to interact with information, devices, and other people –Supported by a “planetary-scale” Information Utility »Stress tested by challenging applications in decision making and learning »New methodologies for design, construction, and administration of systems of unprecedented scale and complexity –Figure of merit: how effectively we amplify and leverage human intellect A pervasive Information Utility, based on “fluid systems technology” to enable new approaches for problem solving & learning

8/5/99Philips18 Potential Impacts on Commercial Practice Personal Information Mgmt is the Killer App –Not corporate processing but management, analysis, aggregation, dissemination, filtering for the individual People Create Knowledge, not Data –Not management/retrieval of explicitly entered information, but automated extraction and organization of daily activities Information Technology as a Utility –Continuous service delivery, on a planetary-scale, constructed on top of a highly dynamic information base Beyond the Desktop –Community computing: infer relationships among information, delegate control, establish authority

8/5/99Philips19 Proposed Approach Information Devices –Beyond desktop computers to MEMS-sensors/actuators with capture/display to yield enhanced activity spaces Information Utility Information Applications –High Speed/Collaborative Decision Making and Learning –Augmented “Smart” Spaces: Rooms and Vehicles Design Methodology –User-centric Design with HW/SW Co-design; –Formal methods for safe and trustworthy decomposable and reusable components “Fluid”, Network-Centric System Software –Partitioning and management of state between soft and persistent state –Data processing placement and movement –Component discovery and negotiation –Flexible capture, self- organization, and re-use of information

8/5/99Philips20 Information Utility Information Devices Applications Collaboration Spaces High Speed Decision Making Learning Classroom Info Appliances E-BookVehicles PDA Handset Laptop Camera Smartboard MEMS Sensor/Actuator/Locator Wallmount Display Generalized UI Support Proxy Agents Human Activity Capture Event Modeling Transcoding, Filtering, Aggregating Statistical Processing/Inference Negotiated APIsSelf-Organizing Data Interface ContractsWide-area Search & Index Nomadic Data & Processing Automated Duplication Distributed Cache Management Wide-Area Data & Processing Movement & Positioning Stream- and Path-Oriented Processing & Data Mgmt Non-Blocking RMISoft-/Hard-State Partitioning

Information Devices Information Utility Applications DesIgnDesIgn MethodologyMethodology MEMS Sensors/Actuators, Smart Dust, Radio Tags, Cameras, Displays, Communicators, PDAs Fluid Software, Cooperating Components, Diverse Device Support, Sensor-Centric Data Mgmt, Always Available, Tacit Information Exploitation (event modeling) Rapid Decision Making, Learning, Smart Spaces: Collaboration Rooms, Classrooms, Vehicles Base Program Option 1: Sys Arch for Diverse Devices Option 2: Oceanic Data Utility Option 4: Negotiation Arch for Cooperation Option 5: Tacit Knowledge Infrastructure Option 6: Classroom Testbed Option 7: Scalable Heterogeneous Component-Based Design Option 3: Capture and Re-Use Task Structure Task 1: Base Program Option 1: Systems Architecture for Vastly Diverse Computing Devices Option 2: Implementation and Deployment of the Oceanic Data Information Utility Option 3: Sensor-Centric Data Management for Capture and Reuse Option 4: Negotiation Architecture for Cooperating Components Option 5: Tacit Knowledge Infrastructure and High-Speed Decision-Making Option 6: Information Management for Intelligent Classroom Environments Option 7: Scalable Safe Component- based Design and UI Design Tools Option 8: Scaled-up Field Trials

8/5/99Philips22 Base Program: Leader Katz Broad but necessarily shallow investigation into all technologies/applications of interest –Primary focus on Information Utility »No new HW design: commercially available information devices »Only small-scale testbed in Soda Hall –Fundamental enabling technologies for Fluid Software »Partitioning and management of state between soft and persistent state »Data and processing placement and movement »Component discovery and negotiation »Flexible capture, self-organization, info re-use –Limited Applications –Methodology: Formal Methods & User-Centered Design

8/5/99Philips23 Option 1: “System Architecture for Vastly Diverse Devices” Leader Culler Distributed control & resource management: data mvmt & transformation, not processing –Path concept for information flow, not the thread –Persistent state in the infrastructure, soft state in the device –Non-blocking system state, no application state in the kernel –Functionality not in device is accessible thru non-blocking remote method invocation Extend the Ninja concepts (thin client/fat infrastructure) beyond PDAs to MEMS devices, cameras, displays, etc.

8/5/99Philips24 Option 2: Implementation & Deploy-ment of Oceanic Data Info Utility Leader Kubiatowicz Nomadic Data Access: serverless, homeless, freely flowing thru infrastructure –Opportunistic data distribution –Support for: promiscuous caching; freedom from administrative boundaries; high availability and disaster recovery; application-specific data consistency; security Data Location and Consistency –Overlapping, partially consistent indices –Data freedom of movement –Expanding search parties to find data, using application- specific hints (e.g., tacit information)

8/5/99Philips25 Option 3: Sensor-Centric Data Management for Capture/Reuse Leader Hellerstein Integration of embedded MEMS with software that can extract, manage, analyze streams of sensor-generated data –Wide-area distributed path-based processing and storage –Data reduction strategies for filtering/aggregation –Distributed collection and processing New information management techniques –Managing infinite length strings –Application-specific filtering and aggregation –Optimizing for running results rather than final answers –Beyond data mining to “evidence accumulation” from inherently noisy sensors

8/5/99Philips26 Option 4: Negotiation Architecture for Cooperating Components Leader Wilensky Cooperating Components –Self-administration through auto-discovery and configuration among confederated components –Less brittle/more adaptive systems Negotiation Architecture –Components announce their needs and services –Service discovery and rendezvous mechanisms to initiate confederations –Negotiated/contractural APIs: contract designing agents –Compliance monitoring and renegotiation –Graceful degradation in response to environmental changes

8/5/99Philips27 Option 5: Tacit Knowledge Infra- structure/Rapid Decision Making Leader Canny Exploit information about the flow of information to improve collaborative work –Capture, organize, and place tacit information for most effective use –Learning techniques: infer communications flow, indirect relationships, and availability/participation to enhance awareness and support opportunistic decision making New collaborative applications –3D “activity spaces” for representing decision-making activities, people, & information sources –Visual cues to denote strength of ties between agents, awareness levels, activity tracking, & attention span

8/5/99Philips28 Option 6: Info Mgmt for Intelligent Classrooms Leader Joseph Electronic Problem-based Learning –Collaborative learning enabled by information appliances Enhanced Physical and Virtual Learning Spaces –Wide-area, large-scale group collaboration –Capture interaction once for replay –Preference/task-driven information device selection –Service accessibility –Device connectivity –Wide-area support –Iterative evaluation

8/5/99Philips29 Option 7: Safe Component Design and UI Design Tools Leader Sangiovanni Information Appliances as an application of hardware/software codesign –Co-design Finite State Machines (CFSMs) –Formal methods to verify safety from faults –Safe partitioning of components into communicating subcomponents placed into the wide-area Model-based User Interface Tools –Information device user interfaces –Multimodal interface design for variety of devices

8/5/99Philips30 Option 8: Scaled-up Field Trials Leader Katz Testbed Rationale –Study impact on larger/more diverse user community –Higher usage levels to stress underlying architecture –Make commitment to true utility functionality Increasing Scale of Testbeds –Building-Scale »Order 100s individuals –Campus-Scale »Order 1000s individuals –City-Scale »Order individuals

8/5/99Philips31 Putting It All Together 1. Diverse Devices 2. Data Utility 3. Capture/Reuse 4. Negotiation 5. Tacit Knowledge 6. Classroom 7. Design Methods 8. Scale-up Devices Utility Applications Fluid Software Info Extract/Re-use Group Decision Making Learning Component Discovery & Negotiation Self-Organization

8/5/99Philips32 universal Function: adjective 1 : including or covering all or a whole collectively or distributively without limit or exception 2 a : present or occurring everywhere b : existent or operative everywhere or under all conditions 3 a : embracing a major part or the greatest portion (as of mankind) b : comprehensively broad and versatile 4 a : affirming or denying something of all members of a class or of all values of a variable b : denoting every member of a class 5 : adapted or adjustable to meet varied requirements (as of use, shape, or size)

8/5/99Philips33 F99 Universal Computing Lab w/ IBM Intelligence in the infrastructure –Production Ninja cluster servers Computing and connectivity wherever you go –compact notebooks and in the space around you –kiosk machines with touch-sensitive flat panels with novel form factors –more pilots plus a mix of wired ethernet, wireless, and IR rennovated offices to form a flexible shared space cutting across areas

8/5/99Philips34 Where should Philips and UCB go together?

8/5/99Philips35 Constrained Personal Device & Untrusted Gateway Key Store DATEK (Trust Contract) Trusted Client Content Filter (pseudonym) https Embeded Untrusted Client https sRMI Personal Appl CF NINJA GWY RMI PXY ST

8/5/99Philips36 Example: Minimal Trader Shared secret between user and keystore keystore maps to service identity / authentication Content filter transcodes to very concise info to pilot

8/5/99Philips37 Uniform Access to Diverse Services Key Store RMI PXY DATEK (Trust Contract) Trusted Client Content Filter (pseudonym) https Embeded Untrusted Client https sRMI Personal Appl GWY CF NINJA Trade-R-us ST

8/5/99Philips38 Automated “Clients”,... Key Store RMI PXY DATEK (Trust Contract) Trusted Client Content Filter (pseudonym) https Embeded Untrusted Client https sRMI Personal Appl GWY CF NINJA Trade-R-us BOT svc ST

8/5/99Philips39 Fall’98 Project Excerpts E-Commerce and Security –Pay-Per-Use Services on the Palm Computing Platform (Mike Chen, Andrew Geweke) –Secure Infrastructure for PDAs (Hoon Kang, Rob von Behren) –SyncAnywhere - Secure Network HotSync (Mike Chen, Helen Wang) Groupware –Kiretsu - Ninja Instant Messaging Service (Matt Welsh, Steve Gribble) –The MASH MediaPad - Shared Electronic Whiteboard for the PalmPilot (Yatin Chawathe) –NotePals - Lightweight Meeting Support Using PDAs (Richard Davis) – OSKI - Open Shared Kalendaring Infrastructure (Jason Hong, Brad Morrey, Mark Newman) OS and Communications – PalmRouter - Networking Sporadically Connected Devices (Andras Ferencz, Robert Szewczyk) Numerous Architecture Studies Excellent UI Projects –Ink Chat, Nutrition/Excercise Tracker, Rendezvous - Meeting Scheduler