David P. Anderson UC Berkeley Gilles Fedak INRIA The Computational and Storage Potential of Volunteer Computing.

Slides:

Advertisements

Similar presentations

Computing Infrastructure

Advertisements

Buffers & Spoolers J L Martin Think about it… All I/O is relatively slow. For most of us, input by typing is painfully slow. From the CPUs point.

By the end of this section, you will know and understand the hardware and software involved in making a LAN!

Novell Server Linux vs. windows server 2008 By: Gabe Miller.

LifeSize Desktop June 15, Page 2 LifeSize Desktop 1.0 Extending the LifeSize experience to your PC LifeSize ® Desktop offers unmatched performance.

High-Performance Task Distribution for Volunteer Computing Rom Walton

BOINC The Year in Review David P. Anderson Space Sciences Laboratory U.C. Berkeley 22 Oct 2009.

Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.

Distributed Computer Architecture Benjamin Jordan, Kevin Cone, Jason Bradley.

Capacity Planning in SharePoint Capacity Planning Process of evaluating a technology … Deciding … Hardware … Variety of Ways Different Services.

Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.

Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.

Selected Topics on Databases n Multi-User Databases –more than one user processes the database at the same time n System Architectures for Multi-User Environments.

Planning and Designing Server Virtualisation.

Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

David Cameron Riccardo Bianchi Claire Adam Bourdarios Andrej Filipcic Eric Lançon Efrat Tal Hod Wenjing Wu on behalf of the ATLAS Collaboration CHEP 15,

07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge

and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.

BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.

Cloud Computing is a Nebulous Subject Or how I learned to love VDF on Amazon.

Communications & Networks National 4 & 5 Computing Science.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Celebrating Diversity in Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley Sept. 1, 2008.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

Course 03 Basic Concepts assist. eng. Jánó Rajmond, PhD

Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server

CernVM and Volunteer Computing Ivan D Reid Brunel University London Laurence Field CERN.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Volunteer Computing with BOINC Dr. David P. Anderson University of California, Berkeley SC10 Nov. 14, 2010.

Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.

Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 30 Dec

DEGISCO Desktop Grids For International Scientific Collaboration Details on Roadmap (technical, legal, human aspects) Budapest, Robert Lovas,

The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.

David P. Anderson Space Sciences Laboratory University of California – Berkeley A Million Years of Computing.

Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.

The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.

Local Scheduling for Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab John McLeod VII Sybase March 30, 2007.

Using volunteered resources for data-intensive computing and storage David Anderson Space Sciences Lab UC Berkeley 10 April 2012.

Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.

Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 28 Nov

An Overview of Volunteer Computing

Volunteer Computing and BOINC

The Future of Volunteer Computing

University of California, Berkeley

Volunteer computing PC owners donate idle cycles to science projects

Volunteer Computing: SETI and Beyond David P

Volunteer Computing for Science Gateways

Designing a Runtime System for Volunteer Computing David P

Job Scheduling in a Grid Computing Environment

Grid Computing.

Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)

New developments for deploying

Operating Systems What are they and why do we need them?

The software infrastructure of II

Virtual Private Servers – Types of Virtualization platforms Virtual Private ServersVirtual Private Servers, popularly known as VPS is considered one of.

Download dumps - Microsoft Real Exam Questions Dumps4download

Get to know SysKit Monitor

المحور 3 : العمليات الأساسية والمفاهيم

Chapter 3 Hardware and software 1.

Chapter 3 Hardware and software 1.

Client/Server and Peer to Peer

For the MVHS Cyber Defense CLub

Implementation of a small-scale desktop grid computing infrastructure in a commercial domain

Exploring Multi-Core on

Presentation transcript:

David P. Anderson UC Berkeley Gilles Fedak INRIA The Computational and Storage Potential of Volunteer Computing

Volunteer computing projectsvolunteer s trust distrust ≠ (desktop) Grid computing, P2P, etc.

Volunteer computing history Projectstartwherearea peak #hosts GIMPS1994math 10,000 distributed.net1995cryptography 100,000 I1999UCBSETI 600, ,000 United Devices2002commercialbiomedicine 200,000 CPDN2003Oxfordclimate change 150,000 60, ,000 WCG2004commercialbiomedicine 200, ,000 II2005UCBSETI 850,000 Washbiology 100,000 SIMAP2005T.U. Munichbioinformatics 10,000

What is it good for? ● Throughput-oriented computing ● Computing with (soft) deadlines ● Distributed storage – capacity/reliability/throughput/latency ● Computing with large RAM or disk needs ● Data-intensive computing

Limiting factors ● Hardware – CPU, memory, disk, network ● Availability – Powered on? Connected? Enabled? – Higher-priority usage – Host churn ● User preferences – Compute only when idle, time-of-day restrictions, disk limitations, etc.

Hardware measurements ● BOINC core client measures host hardware and availability ● Results are stored in server database ● We studied hosts participating in during the week of Feb. 4-10, ● We didn't study change over time ● Data is available online

CPU performance Gross capacity: 535 TFLOPS

Processor type

RAM Didn't measure memory bandwidth (important)

Free disk space (total: 12 PB)

Network throughput (download)

Processing versus RAM

Host participation lifetime

Host availability ● BOINC is running: 81% of the time ● Connected to network: 83% of the time BOINC is running ● Active (able to computing) 84% of the time BOINC is running ● CPU efficiency (wall time/CPU time): 90%

User preferences ● Run if active: 72% yes ● Confirm before connecting (modem): 8.4% yes ● Max disk usage: 63GB or 42% of total space ● 17% participate in multiple projects

Net capacity ● Hardware * availability * preferences ● CPU – Gross 535 TFLOP – Net 150 TFLOPS ● Disk: 42% of 12 PB (5 PB)

Data-intensive apps ● Data rate: MB per CPU-hour

Conclusion ● Volunteer computing – Works well for throughput-oriented computing – May work well for a range of computing types ● More analysis needed for specific cases ● Need to extend BOINC to realize potential in some cases ● Number of hosts – This study: 330,000 – Potential: millions? Tens/hundreds of millions?