BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Slides:

Advertisements

Similar presentations

Operating Systems Manage system resources –CPU scheduling –Process management –Memory management –Input/Output device management –Storage device management.

Advertisements

BOINC: A System for Public-Resource Computing and Storage David P. Anderson University of California, Berkeley.

The SLING project is funded by the European Commission within Research Infrastructures of the FP7 Capacities Specific Programme, grant agreement number.

Chapter 5 Operating Systems. 5 The Operating System When working with multimedia, the operating system is perhaps the most important, the most complex,

Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Volunteer Computing.

BOINC The Year in Review David P. Anderson Space Sciences Laboratory U.C. Berkeley 22 Oct 2009.

Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley May 2, 2007.

11 MONITORING MICROSOFT WINDOWS SERVER 2003 Chapter 3.

How Clients and Servers Work Together. Objectives Learn about the interaction of clients and servers Explore the features and functions of Web servers.

Introduction to windows operating system i

Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.

1 Web Database Processing. Web Database Applications Static Report Publishing a report is prepared from a database application and exported to HTML DB.

Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.

OM. Brad Gall Senior Consultant

Grid Toolkits Globus, Condor, BOINC, Xgrid Young Suk Moon.

Local Area Networks: Software © Abdou Illia, Spring 2007 School of Business Eastern Illinois University (Week 8, Thursday 3/1/2007)

Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific.

Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.

1 port BOSS on Wenjing Wu (IHEP-CC)

Chapter 9: Novell NetWare

A Guided Tour of BOINC David P. Anderson Space Sciences Lab University of California, Berkeley TACC November 8, 2013.

HTCondor and BOINC. › Berkeley Open Infrastructure for Network Computing › Grew out of began in 2002 › Middleware system for volunteer computing.

A Distributed Computing System Based on BOINC September - CHEP 2004 Pedro Andrade António Amorim Jaime Villate.

Robert Fourer, Jun Ma, Kipp Martin Copyright 2006 An Enterprise Computational System Built on the Optimization Services (OS) Framework and Standards Jun.

ORGANIZING AND ADMINISTERING OF VOLUNTEER DISTRIBUTED COMPUTING PROJECT Oleg Zaikin, Nikolay Khrapov Institute for System Dynamics and Control.

Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Introduction to the BOINC software David P. Anderson Space Sciences Laboratory University of California, Berkeley.

Wenjing Wu Computer Center, Institute of High Energy Physics Chinese Academy of Sciences, Beijing BOINC workshop 2013.

David Cameron Claire Adam Bourdarios Andrej Filipcic Eric Lancon Wenjing Wu ATLAS Computing Jamboree, 3 December 2014 Volunteer Computing.

07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge

Lessons Learned from David P. Anderson Director, Spaces Sciences Laboratory U.C. Berkeley April 2, 2002.

Volunteer Computing with BOINC Dr. David P. Anderson University of California, Berkeley SC10 Nov. 14, 2010.

BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Volunteer Computing with GPUs David P. Anderson Space Sciences Laboratory U.C. Berkeley.

and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.

BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.

Module 2 Part I Introduction To Windows Operating Systems Intro & History Introduction To Windows Operating Systems Intro & History.

TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.

Dr Jukka Klem CHEP06 1 Public Resource Computing at CERN – Philippe Defert, Markku Degerholm, Francois Grey, Jukka Klem, Juan Antonio.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

Amazon Web Services. Amazon Web Services (AWS) - robust, scalable and affordable infrastructure for cloud computing. This session is about:

CernVM and Volunteer Computing Ivan D Reid Brunel University London Laurence Field CERN.

Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.

The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.

Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.

The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.

Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.

Local Scheduling for Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab John McLeod VII Sybase March 30, 2007.

Using volunteered resources for data-intensive computing and storage David Anderson Space Sciences Lab UC Berkeley 10 April 2012.

Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.

Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab January 30, 2007.

Session 3 Developing a BOINC application. Development environments ● Windows – Visual Studio 2003 or 2005 – Tortoise CVS ● Mac OS X – Xcode ● Linux –

BOINC current work David Anderson 11 July Where we're at ● We've come a long way – Some successful projects – Progress on software ● The long road.

Volunteer Computing and BOINC

BEST CLOUD COMPUTING PLATFORM Skype : mukesh.k.bansal.

Volunteer Computing: SETI and Beyond David P

Volunteer Computing for Science Gateways

Designing a Runtime System for Volunteer Computing David P

Job Scheduling in a Grid Computing Environment

The software infrastructure of II

Cloud Web Filtering Platform

Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy

Presentation transcript:

BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley

Public-resource computing Home PCs business academic Advantages: scale free growth public education no policy issues Challenges: low BW at client costly BW at server firewall/NAT issues sporadic connection untrustworthy, insecure clients server security heterogeneity need PR, glitzy GUI your computers

Why share an infrastructure? Research lab X University YPublic project Z projects applications resource pool Participants install one program, select projects, specify constraints; all else is automatic Projects are autonomous Advantages of a shared platform: Better long-term resource utilization Better instantaneous resource utilization Faster/cheaper for projects, software is better Easier for projects to get participants Participants learn more

Goals of BOINC (Berkeley Open Infrastructure for Network Computing) Public-resource computing/storage Multi-project, multi-application –Participants can apportion resources Handle fairly diverse applications Work with legacy apps Support many participant platforms Small, simple

General structure of BOINC Project: Participant: Scheduling server (C++) BOINC DB (MySQL) Work generation data server (HTTP) App agent data server (HTTP) Web interfaces (PHP) Core agent (C++) Project back end Retry generation Result validation Result processing Garbage collection

Data model File attributes: –Name –URL list –Persistent flag –Upload-when-present flag Files may originate in client or in project work manager Projects can use participant disks for long- term data archival

Computing model Applications, platforms, app versions Workunits –Inputs to a computation –Estimates of resource requirements Results –Outputs of a computation

Hosts and scheduling Host measurements –CPU performance (integer/FP/memory) –RAM, cache, disk free/total –On/connected statistics –Network bandwidth statistics Workunit properties –RAM/disk/computation requirements Scheduling policy –feasibility –High/low water mark

Accounting and result validation Standardized unit of credit –CPU time * (int+FP+mem) –Project-specific benchmark? Result validation –Compare redundant results, flag incorrect results Granted credit: –Minimum of claimed credit among correct results

Participant preferences Examples: –Work only while user away –Confirm before connecting –Don’t work if on batteries –High, low water marks –Limits on disk space, bandwidth –Application-specific preferences –List of projects + authenticators + % allocation Edited via Web interface

Application Programming Checkpoint/restart Filename translation Graphics –OpenGL-based –Application window or screensaver

Conclusion BOINC status –Mostly feature-complete –Client runs on Linux, Solaris, Windows, MacOS X –Small: client is 5,000 lines, server 2,000 Projects: –Astropulse (later this year) –Other (Parkes etc.) climate prediction –Others: rendering? Theorem proving?