BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.

Slides:

Advertisements

Similar presentations

Operating System.

Advertisements

BOINC: A System for Public-Resource Computing and Storage David P. Anderson University of California, Berkeley.

BOINC The Year in Review David P. Anderson Space Sciences Laboratory U.C. Berkeley 22 Oct 2009.

The 9 th Annual Workshop September 2013 INRIA, Grenoble, France

Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.

Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.

Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific.

Screen Snapshot Service Kurt Biery SiTracker Monitoring Meeting, 23-Jan-2007.

1 port BOSS on Wenjing Wu (IHEP-CC)

Achievements and Opportunities in Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 18 April 2008.

Operating System. Architecture of Computer System Hardware Operating System (OS) Programming Language (e.g. PASCAL) Application Programs (e.g. WORD, EXCEL)

A Guided Tour of BOINC David P. Anderson Space Sciences Lab University of California, Berkeley TACC November 8, 2013.

HTCondor and BOINC. › Berkeley Open Infrastructure for Network Computing › Grew out of began in 2002 › Middleware system for volunteer computing.

Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.

Scientific Computing in the Consumer Digital Infrastructure David P. Anderson Space Sciences Lab University of California, Berkeley The Austin Forum November.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Introduction to the BOINC software David P. Anderson Space Sciences Laboratory University of California, Berkeley.

Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.

David Cameron Claire Adam Bourdarios Andrej Filipcic Eric Lancon Wenjing Wu ATLAS Computing Jamboree, 3 December 2014 Volunteer Computing.

David Cameron Riccardo Bianchi Claire Adam Bourdarios Andrej Filipcic Eric Lançon Efrat Tal Hod Wenjing Wu on behalf of the ATLAS Collaboration CHEP 15,

07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge

Volunteer Computing with BOINC Dr. David P. Anderson University of California, Berkeley SC10 Nov. 14, 2010.

Volunteer Computing with GPUs David P. Anderson Space Sciences Laboratory U.C. Berkeley.

and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.

TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.

Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 30 Dec

The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.

Volunteer Computing in the Next Decade David Anderson Space Sciences Lab University of California, Berkeley 4 May 2012.

Emulating Volunteer Computing Scheduling Policies Dr. David P. Anderson University of California, Berkeley May 20, 2011.

Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.

Volunteer Computing: the Ultimate Cloud Dr. David P. Anderson University of California, Berkeley Oct 19, 2010.

A Brief History of (CPU) Time -or- Ten Years of Multitude David P. Anderson Spaces Sciences Lab University of California, Berkeley 2 Sept 2010.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.

The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.

Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.

Using volunteered resources for data-intensive computing and storage David Anderson Space Sciences Lab UC Berkeley 10 April 2012.

Technology for Citizen Cyberscience Dr. David P. Anderson University of California, Berkeley May 2011.

Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.

Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 28 Nov

An Overview of Volunteer Computing

A Brief History of BOINC

Volunteer Computing and BOINC

Guide to Operating Systems, 5th Edition

The Future of Volunteer Computing

The 9th Annual BOINC Workshop

University of California, Berkeley

Volunteer computing PC owners donate idle cycles to science projects

Simulation Production System

Volunteer Computing: SETI and Beyond David P

Volunteer Computing for Science Gateways

Designing a Runtime System for Volunteer Computing David P

Jenny Pange University of Ioannina

Operating System.

A Roadmap for Volunteer Computing in the U.S.

Exa-Scale Volunteer Computing

David P. Anderson Space Sciences Lab UC Berkeley LASER

David Cameron ATLAS Site Jamboree, 20 Jan 2017

TYPES OFF OPERATING SYSTEM

Guide to Operating Systems, 5th Edition

Ivan Reid (Brunel University London/CMS)

IT Management, Simplified

Presentation transcript:

BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Computing resources PCs laptops mobile devices appliances Consumer desktop data center Organizational volunteer computing desktop grid computing cluster, cloud, Grid, super computing BOINC

Why volunteer computing? Consumer > 1 billion PCs  most w/GPU > 2 billion mobile devices Low cost to scientists Organizational ~10 million cluster/cloud nodes High cost

Volunteer computing status Volunteers: 400K people, 600K computers > 15 PetaFLOPS, many million jobs/day > 50 science projects, e.g.  IBM World Community Grid    Climateprediction.net 

Capacity in 5 years Participation: 50M devices? Processing  CPU: 50M * 1 TFLOPS = 50 ExaFLOPS  GPU: 50M * 20 TFLOPS = 1000 ExaFLOPS Storage:  50M * 10 TB = 500 ExaBytes Network bandwidth  50M * 100Mbps = 5 Petabit/sec

My talk VM-based applications Remote job submission BOINC on Android Volunteer storage

Using VM technology Consumer platforms:  85% Windows  7% Linux  7% Mac OS X Developing/maintaining versions for different platforms is hard  Even making a portable Linux executable is hard

BOINC VM-based applications You supply:  A VM image for your favorite environment can use the same one for many apps  An executable for that environment  An XML configuration file BOINC supplies:  The VBox Wrapper

How it works on the client BOINC client VirtualBox executive Vbox wrapper VM instance shared directory: executable input, output files VirtualBox “snapshots” provide checkpointing

Remote job submission science portal or PC BOINC server Scientists (users) sysadmins job submission file management

Managing multiple users User access control User quotas Sharing limited processing resources  handle small batches first  don’t starve large batches  enforce user quotas long-term

BOINC on Android Available in Google, Amazon app stores 7 projects have Android/ARM apps Battery, WiFi considerations GUI (Java) BOINC client (native) RPC apps (native)

BOINC storage architecture Data archival Applications Locality scheduling Dataset storage BOINC storage infrastructure Result archival

Storage-related features Client: allocating space among projects Client: support for large (multi-GB) files  efficient transfer, verification, copying Scheduler: storage policy plug-ins Example: volunteer data archival  multi-level erasure coding

Research opportunities Many job scheduling issues Big-data issues Simulation tools  client emulator  server emulator (Simba)  storage emulator

Thank you Please contact me to discuss BOINC or research collaboration: