Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.

Slides:



Advertisements
Similar presentations
BOINC: A System for Public-Resource Computing and Storage David P. Anderson University of California, Berkeley.
Advertisements

BOINC Berkeley Open Infrastructure for Network Computing An open-source middleware system for volunteer and grid computing (much of the images and text.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Volunteer Computing.
High-Performance Task Distribution for Volunteer Computing Rom Walton
BOINC The Year in Review David P. Anderson Space Sciences Laboratory U.C. Berkeley 22 Oct 2009.
Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.
Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.
Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific.
1 port BOSS on Wenjing Wu (IHEP-CC)
Achievements and Opportunities in Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 18 April 2008.
A Guided Tour of BOINC David P. Anderson Space Sciences Lab University of California, Berkeley TACC November 8, 2013.
TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley May 7, 2008.
Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.
Scientific Computing in the Consumer Digital Infrastructure David P. Anderson Space Sciences Lab University of California, Berkeley The Austin Forum November.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Volunteer Computing with BOINC Dr. David P. Anderson University of California, Berkeley SC10 Nov. 14, 2010.
David P. Anderson Space Sciences Lab U.C. Berkeley Exa-Scale Volunteer Computing.
Volunteer Computing with GPUs David P. Anderson Space Sciences Laboratory U.C. Berkeley.
and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.
TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.
Dr Jukka Klem CHEP06 1 Public Resource Computing at CERN – Philippe Defert, Markku Degerholm, Francois Grey, Jukka Klem, Juan Antonio.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
A Tour of Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 14 Sept 2007.
Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 30 Dec
The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.
Volunteer Computing in the Next Decade David Anderson Space Sciences Lab University of California, Berkeley 4 May 2012.
The 6 th Annual Pangalactic BOINC Workshop. BOINC: The Year in Review David Anderson 31 Aug 2010.
Volunteer Computing in Biology David P. Anderson Space Sciences Lab U.C. Berkeley 10 Sept 2007.
David P. Anderson Space Sciences Laboratory University of California – Berkeley A Million Years of Computing.
Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.
Volunteer Computing: the Ultimate Cloud Dr. David P. Anderson University of California, Berkeley Oct 19, 2010.
A Brief History of (CPU) Time -or- Ten Years of Multitude David P. Anderson Spaces Sciences Lab University of California, Berkeley 2 Sept 2010.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.
The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.
All the computers in the world (~1 billion) BOINC: high-level goal Computational science biology, medicine Earth sciences, physics, astronomy, math, A.I.,...
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.
Using volunteered resources for data-intensive computing and storage David Anderson Space Sciences Lab UC Berkeley 10 April 2012.
Technology for Citizen Cyberscience Dr. David P. Anderson University of California, Berkeley May 2011.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab Nov. 15, 2006.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab January 30, 2007.
An Overview of Volunteer Computing
A Brief History of BOINC
Volunteer Computing and BOINC
The Future of Volunteer Computing
University of California, Berkeley
Building a Global Brain David P. Anderson U. C
Volunteer computing PC owners donate idle cycles to science projects
Volunteer Computing: Planting the Flag David P
Volunteer Computing: SETI and Beyond David P
Volunteer Computing for Science Gateways
Designing a Runtime System for Volunteer Computing David P
A Roadmap for Volunteer Computing in the U.S.
Exa-Scale Volunteer Computing
David P. Anderson Space Sciences Lab UC Berkeley LASER
The Global Status of Citizen Cyberscience
Volunteer computing and volunteer thinking Dr. David P
Grid Computing Colton Lewis.
Ivan Reid (Brunel University London/CMS)
Exploring Multi-Core on
Presentation transcript:

Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010

Outline Volunteer computing BOINC Applications Research directions

High-throughput computing High-performance computing program runs too slow on PC cluster (MPI) supercomputer cluster (batch) Grid Commercial cloud Volunteer computing single job # processors multiple jobs 10K-1M

History of volunteer computing Applications Middleware distributed.net, GIMPS Commercial: Entropia, United Devices,... BOINC Climateprediction.net IBM World Community Grid now Academic: Bayanihan, Javelin,... Applications

Terms ● FLOPS = floating point operations per second ● GigaFLOPS = 10 9 FLOPS – slow PC ● TeraFLOPS = FLOPS – fast GPU or 100-node cluster ● PetaFLOPS = FLOPS – fastest supercomputer ● ExaFLOPS = FLOPS – fantasy and science fiction

The yearly cost of 10 TeraFLOPS ● Amazon EC2 ● small instance: $.09/hour = $788/year ● 10 TeraFLOPS = 5,000 instances ● $3.94M/year plus network, storage costs ● Build your own cluster ● ~ $1.5M/year ● Volunteer computing ● ~ $0.1M/year

BOINC volunteers projects CPDN WCG attachments Scientists create projects using BOINC Volunteers install BOINC, attach to project(s) Applications are silently downloaded and executed on volunteer PCs

The Utopian vision Better research gets more computing power An enlightened public decides what’s better Scientific research The public resources education/outreach

The Consumer Digital Infrastructure ● 1.5 billion PCs ● Graphics Processing Units: TeraFLOPS ● Terabyte-scale storage ● Network speed approaching 1 Gbps ● Ideal for scientific computing!

The state of volunteer computing ● 40 projects ● 500K volunteers ● 800K computers ● 10 PetaFLOPS ● would cost $3.94 billion/year on Amazon EC2

The potential of volunteer computing The volunteer resource pool Current PetaFLOPS breakdown: Potential: ExaFLOPS today – 4M GPUs * 1 TFLOPS * 0.25 availability

Science areas using BOINC ● Biology: protein study, genetic analysis ● Medicine: drug discovery, epidemiology ● Physics: LHC, nanotechnology, quantum computing ● Astronomy: LIGO, radio data analysis; cosmology; galactic modeling ● Environment: climate modeling, botanical ecosystem simulation ● Math

Climateprediction.net ● Oxford University ● Climate change prediction

U of Wisconsin, Max Planck Inst. Gravitational waves; gravitational pulsars

● UC Berkeley ● SETI

● RPI ● Structure of the Milky Way galaxy

GPUGRID.net ● Barcelona Biomed Inst. ● Protein structure and dynamics

D-Wave Systems Simulation of “adiabatic quantum algorithms” for binary quadratic optimization

Quake Catcher Network

BOINC software overview client apps screensaver GUI scheduler MySQL data server daemons volunteer host project server HTTP

Anonymous platform mechanism Volunteer supplies app versions. – security – optimization – unsupported platforms

Account managers

Using virtual machines Application is VM wrapper + virtual machine image + executable BOINC client VM wrapper hypervisor (VirtualBox) VM

Organizational issues ● Single-scientist projects: a dead end ● Barriers to entry are too high ● Wrong marketing model ● Doesn’t handle sporadic requirements ● Umbrella projects ● IBM World Community Grid ● Campus-level ● Science portals (‘Hubs’)

How to realize this? A better model: ScienceUSA.org

Conclusion ● For most scientific computing, volunteer computing is far cheaper than either clouds or clusters ● Volunteer computing involves the public in science ● What is the future? ● will mobile and semi-mobile devices replace desktops and laptops?