Lessons Learned from David P. Anderson Director, Spaces Sciences Laboratory U.C. Berkeley April 2, 2002.

Slides:

Advertisements

Similar presentations

{ Making Microsoft Office work for you Organizing Your Life at work and home in the Cloud Presented by: Matthew Baker (321)

Advertisements

BOINC: A System for Public-Resource Computing and Storage David P. Anderson University of California, Berkeley.

Skyward Server Management Options Mike Bianco. Agenda: Managed Services Overview OpenEdge Management / OpenEdge Explorer OpenEdge Managed Demo.

Making Services Fault Tolerant

Performance Engineering Laboratories Computer Engineering Department King Fahd University of Petroleum & Minerals (KFUPM), Dhahran.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Volunteer Computing.

What does do? Mini-project for CSE 260 Qian Peng 15 November 2001 Ref.

High-Performance Task Distribution for Volunteer Computing Rom Walton

BOINC The Year in Review David P. Anderson Space Sciences Laboratory U.C. Berkeley 22 Oct 2009.

Sunny Gleason COM S 717 November 29, 2001 (Based on the article, Massively Distributed Computing for SETI.”)

Managing Information Systems Information Systems Security and Control Part 2 Dr. Stephania Loizidou Himona ACSC 345.

Chapter 5 System Software.

1-1 Incentive Mechanisms for Large Collaborative Resource Sharing Objectives:  Why Resource harnessing  Resource sharing  Assumptions  Considerations.

Basic Unix Dr Tim Cutts Team Leader Systems Support Group Infrastructure Management Team.

The Northwestern Mutual Life Insurance Company – Milwaukee, WI Application Monitoring Jeremy Kalsow.

Tripwire Enterprise Server – Getting Started Doreen Meyer and Vincent Fox UC Davis, Information and Education Technology June 6, 2006.

Deniss Gaplevsky System engineer at inbox.lv. The portal inbox.lv is a leading national e-service in Latvia More than 80% Latvian inhabitants use inbox.lv.

Load Test Planning Especially with HP LoadRunner >>>>>>>>>>>>>>>>>>>>>>

Windows Server MIS 424 Professor Sandvig. Overview Role of servers Performance Requirements Server Hardware Software Windows Server IIS.

Grid Toolkits Globus, Condor, BOINC, Xgrid Young Suk Moon.

Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific.

Module 13: Network Load Balancing Fundamentals. Server Availability and Scalability Overview Windows Network Load Balancing Configuring Windows Network.

GIS and Cloud Computing. Flickr  Upload and manage your photos online  Share your photos with your family and friends  Post your photos everywhere.

14 Publishing a Web Site Section 14.1 Identify the technical needs of a Web server Evaluate Web hosts Compare and contrast internal and external Web hosting.

Geographic Information Systems Cloud GIS. ► The use of computing resources (hardware and software) that are delivered as a service over the Internet ►

Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.

CIS : Federated Distributed Systems Adriana Iamnitchi (Anda)

CIS : Federated Distributed Systems Adriana Iamnitchi (Anda)

Chapter 7 Networks and the Internet Networks Sharing resources among multiple computers (workstations) Local Area Networks Wide Area Networks.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Natick Public Schools Technology Update April 23, 2007 Dennis Roche, CISA Director of Technology.

David Cameron Riccardo Bianchi Claire Adam Bourdarios Andrej Filipcic Eric Lançon Efrat Tal Hod Wenjing Wu on behalf of the ATLAS Collaboration CHEP 15,

07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge

BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

System Software Chapter Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.

and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

CERN - IT Department CH-1211 Genève 23 Switzerland t OIS Deployment of Exchange 2010 mail platform Pawel Grzywaczewski, CERN IT/OIS HEPIX.

Near Real-Time Verification At The Forecast Systems Laboratory: An Operational Perspective Michael P. Kay (CIRES/FSL/NOAA) Jennifer L. Mahoney (FSL/NOAA)

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.

TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

Install, configure and test ICT Networks

BMTS 242: Computer and Systems Lecture 5: Yousef Alharbi Website

BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

09/13/04 CDA 6506 Network Architecture and Client/Server Computing Peer-to-Peer Computing and Content Distribution Networks by Zornitza Genova Prodanoff.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.

Technology Coordinator Training. Agenda Getting Started Using SystemCheck Technology Configurations Infrastructure Trial Proctor Caching Overview Managing.

ACAT, Amsterdam, and BOINC Bruce Allen Director, Max Planck Institute for Gravitational Physics, Hannover.

APACHE Apache is generally recognized as the world's most popular Web server (HTTP server). Originally designed for Unix servers, the Apache Web server.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.

The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.

David P. Anderson Space Sciences Laboratory University of California – Berkeley A Million Years of Computing.

Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.

Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.

Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.

Nat 4/5 Computing Science Software

Volunteer Computing: SETI and Beyond David P

Designing a Runtime System for Volunteer Computing David P

David P. Anderson Space Sciences Lab UC Berkeley LASER

Grid Computing Colton Lewis.

The software infrastructure of II

Migration Strategies – Business Desktop Deployment (BDD) Overview

Design Unit 26 Design a small or home office network

Office 365 and Microsoft Project Integrations for HULAK Project Management Software Enable Teams to Remain Productive and Within Budget OFFICE 365 APP.

Presentation transcript:

Lessons Learned from David P. Anderson Director, Spaces Sciences Laboratory U.C. Berkeley April 2, 2002

Operations data recorder screensavers science DBuser DB WU storage splitters DLT tapes data server result queue acct. queue garbage collector tape archive, delete tape backup master DB redundancy checking RFI elimination repeat detection web site CGI program web page generator

Radio SETI projects NameSensitivitySky coverage (%sky) Frequency Range (MHz) Max drift rate (Hz/sec) Frequency resolution (Hz) Computing power (GFLOPs) Phoenix (SETI Inst.) 1e (1000 stars) to ,000 SERENDIP (Berkeley) 1e Beta (Harvard) 3e

History and statistics Conceived 1995, launched April 1999 Funding: TPS, DiMI, numerous companies 3.6M users (.5M active), 226 countries 40 TB data recorded, processed 25 TeraFLOPs average over last year Almost 1 million years CPU time No ET signals yet, but other results

Public-resource computing Original: GIMPS, distributed.net Commercial: United Devices, Entropia, Porivo, Popular Power Academic, open-source Cosm, II The peer-to-peer paradigm

Characterizing Fixed-rate data processing task Low bandwidth/computation ratio Independent parallelism Error tolerance

Millions and millions of computers Server scalability Dealing with excess CPU time Redundant computing Deals with cheating, malfunctions Control by changing computation Moore’s Law is true (causes same problems)

Network bandwidth costs money SSL to campus: 100 Mbps, free, unloaded Campus to ISP: 70 Mbps, not free First: load limiting at 25 Mbps Now: no limit, zero priority How to adapt load to capacity? What’s the break-even point (1GB per CPU day)

How to get and retain users Graphics are important But monitors do burn in Teams: users recruit other users Keep users informed Science news System management news Periodic project s

Reward users PDF certificates Milestone pages and s Leader boards (overall, country, …) Class pages Personal signal page

Let users express themselves User profiles Message boards Newsgroup (sci.astro.seti) Learn about users Online poll

Users are competitive Patched clients, benchmark wars Results with no computation Intentionally bad results Team recruitment by spam Sale of accounts on eBay Accounting is tricky

Anything can be reverse engineered Patched version of client efforts at self-checksumming Replacement of FFT routine Bad results Digital signing: doesn’t work Techniques for verifying work

Users will help if you let them Web-site translations Add-ons Server proxies Statistics DB and display Beta testers Porting Open-source development (will use in II)

Client: mechanism, not policy Error handling, versioning Load regulation Let server decide Reasonable default if no server Put in a level of indirection Separate control and data

Cross-platform is manageable Windows, Mac are harder GNU tools and POSIX rule

Server reliability/performance Hardware Air conditioning, RAID controller Software Database server Architect for failure Develop diagnostic tools

What’s next for public computing? Better handling of large data Network scheduling Reliable multicast Expand computation model Multi-application, multi-project platform BOINC (Berkeley Open Infrastructure for Network Computing)