Volunteer Computing and BOINC

Slides:



Advertisements
Similar presentations
BOINC Berkeley Open Infrastructure for Network Computing An open-source middleware system for volunteer and grid computing (much of the images and text.
Advertisements

BOINC The Year in Review David P. Anderson Space Sciences Laboratory U.C. Berkeley 22 Oct 2009.
The 9 th Annual Workshop September 2013 INRIA, Grenoble, France
Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.
Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.
1 port BOSS on Wenjing Wu (IHEP-CC)
Achievements and Opportunities in Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 18 April 2008.
A Guided Tour of BOINC David P. Anderson Space Sciences Lab University of California, Berkeley TACC November 8, 2013.
Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.
Scientific Computing in the Consumer Digital Infrastructure David P. Anderson Space Sciences Lab University of California, Berkeley The Austin Forum November.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Using Virtual Servers for the CERN Windows infrastructure Emmanuel Ormancey, Alberto Pace CERN, Information Technology Department.
Volunteer Computing with BOINC Dr. David P. Anderson University of California, Berkeley SC10 Nov. 14, 2010.
David P. Anderson Space Sciences Lab U.C. Berkeley Exa-Scale Volunteer Computing.
Volunteer Computing with GPUs David P. Anderson Space Sciences Laboratory U.C. Berkeley.
and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
What is gaming console & platform? A game console is a device which outputs video signal into TV screen to display the video game. A platform is in which.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.
TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.
BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Celebrating Diversity in Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley Sept. 1, 2008.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
Course 03 Basic Concepts assist. eng. Jánó Rajmond, PhD
CernVM and Volunteer Computing Ivan D Reid Brunel University London Laurence Field CERN.
A Tour of Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.
Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 30 Dec
The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.
Volunteer Computing in the Next Decade David Anderson Space Sciences Lab University of California, Berkeley 4 May 2012.
Emulating Volunteer Computing Scheduling Policies Dr. David P. Anderson University of California, Berkeley May 20, 2011.
David P. Anderson Space Sciences Laboratory University of California – Berkeley A Million Years of Computing.
Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.
Volunteer Computing: the Ultimate Cloud Dr. David P. Anderson University of California, Berkeley Oct 19, 2010.
A Brief History of (CPU) Time -or- Ten Years of Multitude David P. Anderson Spaces Sciences Lab University of California, Berkeley 2 Sept 2010.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.
The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.
All the computers in the world (~1 billion) BOINC: high-level goal Computational science biology, medicine Earth sciences, physics, astronomy, math, A.I.,...
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.
Using volunteered resources for data-intensive computing and storage David Anderson Space Sciences Lab UC Berkeley 10 April 2012.
Technology for Citizen Cyberscience Dr. David P. Anderson University of California, Berkeley May 2011.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab Nov. 15, 2006.
Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.
Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 28 Nov
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab January 30, 2007.
An Overview of Volunteer Computing
A Brief History of BOINC
A new model for volunteer computing
The Future of Volunteer Computing
University of California, Berkeley
Building a Global Brain David P. Anderson U. C
Volunteer computing PC owners donate idle cycles to science projects
Volunteer Computing: Planting the Flag David P
Volunteer Computing: SETI and Beyond David P
Volunteer Computing for Science Gateways
Designing a Runtime System for Volunteer Computing David P
A Roadmap for Volunteer Computing in the U.S.
Exa-Scale Volunteer Computing
David P. Anderson Space Sciences Lab UC Berkeley LASER
The Global Status of Citizen Cyberscience
University of California, Berkeley
Ivan Reid (Brunel University London/CMS)
Windows Virtual PC / Hyper-V
Software - Operating Systems
Exploring Multi-Core on
Presentation transcript:

Volunteer Computing and BOINC David P. Anderson Space Sciences Lab UC Berkeley MAGIC October 5, 2016

Scientific computing Consumer electronics Volunteer computing

BOINC Middleware for volunteer computing Open-source, NSF-funded development Community-maintained Server: used by scientists to make “projects” Client: runs on consumer devices “attach” to projects fetches/runs jobs in background

Example projects Climateprediction.net Rosetta@home Einstein@home IBM World Community Grid CERN

Current volunteered resources 500,000 active devices BOINC + Folding@home 2.3M CPU cores, 290K GPUs 93 PetaFLOPS 85% Windows, 7% Mac, 7% Linux

Performance potential 1 billion desktop/laptop PCs CPUs: 10 ExaFLOPS GPUs: 1,000 ExaFLOPS 5 billion smartphones CPUs: 20 ExaFLOPS GPUs: 1,500 ExaFLOPS

Realistic potential Study: 5-10% of people who learn about VC would participate Devices compute 60% of the time So if we can tell the world about VC, could get 100 ExaFLOPS

Cost

BOINC job model An app can have many versions Submit jobs to apps, not versions The BOINC scheduler decides what version(s) to use in response to a particular request

Per-platform apps Windows/Intel, 32 and 64 bit Mac OS X Linux/Intel Linux/ARM (works for Android too)

Other types of apps Multicore GPU apps CUDA (Nvidia) CAL (AMD) OpenCL (Nvidia, AMD, Intel)

VM apps App is VM image + executable BOINC client interfaces via “Vbox Wrapper” Advantages: No Win/Mac compilation sandbox security checkpoint/restart using Vbox “snapshots” Docker apps

Issues with VM apps Host must have VirtualBox installed included with default BOINC install To run 64-bit VMs or Docker, host must have VM CPU features enabled Doesn’t work with GPUs (currently) Doesn’t work with ARM/Android

What workload can VC handle? Variable turnaround, so best for bags of tasks but can handle DAGs/workflows too Moderate RAM, storage requirements Network: server capacity limits Data privacy

Areas where VC is useful Compute-intensive data analysis particle colliders (LHC) astrophysics genomics Simulations of physical systems nanosystems drug discovery, protein folding climate modeling cosmology

BOINC system structure: the original model Dynamic “ecosystem” of projects Projects compete for computing power by publicizing their research Volunteers browse projects, support what they think is important Best science gets most computing power Public learns about science

Original model hasn’t worked Creating a project is too hard Creating a project is risky It’s hard to publicize VC: too many “brands” Volunteers are static

A new model Volunteers see “Science@home”, not separate projects Can express “science preferences” Science@home allocates computing power Projects Science@home

New model, part 2 Instead of single-scientist projects, “umbrella” projects that serve many scientists, and are operated by organizations Prototypes under development: TACC nanoHUB

Corporate partnerships Past/current: IBM World Community Grid Intel Progress Thru Processors HTC Power to Give Samsung Power Sleep In development: Blizzard Entertainment (games) EE (British cell phone provider)

Contact info BOINC http://boinc.berkeley.edu Me davea@ssl.berkeley.edu