High-Performance Task Distribution for Volunteer Computing Rom Walton

Slides:

Advertisements

Similar presentations

Client/Server Computing (the wave of the future) Rajkumar Buyya School of Computer Science & Software Engineering Monash University Melbourne, Australia.

Advertisements

Copyright GeneGo CONFIDENTIAL »« MetaCore TM (System requirements and installation) Systems Biology for Drug Discovery.

Linux Clustering A way to supercomputing. What is Cluster? A group of individual computers bundled together using hardware and software in order to make.

Shimin Chen Big Data Reading Group.  Energy efficiency of: ◦ Single-machine instance of DBMS ◦ Standard server-grade hardware components ◦ A wide spectrum.

SharePoint and SQL Server integration Demo: SQL Server Optimizing Configurations SQL Server 2014 for SharePoint 2013 Avoiding ginormous transaction.

VMware Infrastructure Alex Dementsov Tao Yang Clarkson University Feb 28, 2007.

Multiple Tiers in Action

11 SERVER CLUSTERING Chapter 6. Chapter 6: SERVER CLUSTERING2 OVERVIEW  List the types of server clusters.  Determine which type of cluster to use for.

Distributed Computer Architecture Benjamin Jordan, Kevin Cone, Jason Bradley.

THE QUE GROUP WOULD LIKE TO THANK THE 2013 SPONSORS.

Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.

Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.

A Workflow-Aware Storage System Emalayan Vairavanathan 1 Samer Al-Kiswany, Lauro Beltrão Costa, Zhao Zhang, Daniel S. Katz, Michael Wilde, Matei Ripeanu.

Report ： Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.

ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.

Parallel Home Qiong Luo Hong Kong University of Science & Technology

DELL PowerEdge 6800 performance for MR study Alexander Molodozhentsev KEK for RCS-MR group meeting November 29, 2005.

1 Copyright © 2004, Oracle. All rights reserved. Introduction to Oracle Forms Developer and Oracle Forms Services.

AUTHORS: STIJN POLFLIET ET. AL. BY: ALI NIKRAVESH Studying Hardware and Software Trade-Offs for a Real-Life Web 2.0 Workload.

Pg 1 Information Technology Overview. Pg 2 Infrastructure Current website code is the result of 4+ years of accumulated band-aids, hurried projects, and.

Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.

Indiana University’s Name for its Sakai Implementation Oncourse CL (Collaborative Learning) Active Users = 112,341 Sites.

How computer’s are linked together.

Alireza Angabini Advanced DB class Dr. M.Rahgozar Fall 88.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.

07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge

Sandor Acs 05/07/

Ariel Technical Services, Inc. CGNA Preferred Vendor: Technology.

June 6, 2007TeraGrid '071 Clustering the Reliable File Transfer Service Jim Basney and Patrick Duda NCSA, University of Illinois This material is based.

and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.

BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.

Computational Research in the Battelle Center for Mathmatical medicine.

Grid Computing Unit I Introduction. Information anytime anywhere!!! support computation across administrative domains Generally  virtualizing computing.

Dr Jukka Klem CHEP06 1 Public Resource Computing at CERN – Philippe Defert, Markku Degerholm, Francois Grey, Jukka Klem, Juan Antonio.

An Efficient Threading Model to Boost Server Performance Anupam Chanda.

CNAF Database Service Barbara Martelli CNAF-INFN Elisabetta Vilucchi CNAF-INFN Simone Dalla Fina INFN-Padua.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.

Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server

A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.

Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.

The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.

Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.

David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.

David P. Anderson UC Berkeley Gilles Fedak INRIA The Computational and Storage Potential of Volunteer Computing.

Technology for Citizen Cyberscience Dr. David P. Anderson University of California, Berkeley May 2011.

Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.

Introduction to Oracle Forms Developer and Oracle Forms Services

Aga Private computer Institute Prepared by: Srwa Mohammad

DIT314 ~ Client Operating System & Administration

Scaling HDFS to more than 1 million operations per second with HopsFS

University of California, Berkeley

Volunteer computing PC owners donate idle cycles to science projects

Volunteer Computing: SETI and Beyond David P

Volunteer Computing for Science Gateways

Designing a Runtime System for Volunteer Computing David P

Virtualization OVERVIEW

Database backed DNS.

Introduction to Oracle Forms Developer and Oracle Forms Services

Job Scheduling in a Grid Computing Environment

Introduction to Oracle Forms Developer and Oracle Forms Services

Introduction of Week 3 Assignment Discussion

Overview Introduction VPS Understanding VPS Architecture

SAP HANA Cost-optimized Hardware for Non-Production

SAP HANA Cost-optimized Hardware for Non-Production

Dell EMC SQL Server Solutions Doug Bernhardt

Presentation transcript:

High-Performance Task Distribution for Volunteer Computing Rom Walton

Introduction What is Volunteer Computing? What is BOINC? Task Server Architecture Performance Measurements Performance Results Performance Limitations Query Optimization Potential Optimizations Questions and Answers

What is Volunteer Computing? A grid for the masses. Projects provide:  Progress Reports.  Discussion Forums.  Screensaver.  Credits.  Data that needs processing. Volunteers provide:  Computing Resources.  Storage Resources.  Enthusiasm.  Support.

What is BOINC? Berkeley Open Infrastructure for Network Computing

Task Server Architecture

Performance Measurements Reference Server Computer:  Dell PowerEdge 3850, 2GB RAM, 2x Intel Xeon 2.4Ghz Processors, Raid 0 - 3x160GB SCSI HD’s  Linux ELsmp kernel  MySQL (Max) BOINC tables are InnoDB Synthetic Workload:  Instances = 2, Minimum Quorum = 2  100,000 Task Instances Generated Per Run.  No input/output files were specified.

Performance Results

Performance Limitations Reference Client Computer:  1 GFLOP Computer Single Server Configuration:  8.8 Million clients can be supported.  Estimated 4.4 PetaFLOPS of computational power Multiple Server Configuration:  23.6 Million clients can be supported.

Query Optimization Reduce Database Roundtrips Increase Memory Page Relevance Don’t request a BLOB unless you need it Batch Updates

Potential Optimizations Stored Procedures Reducing Database Roundtrips Modifying the Database Schema Vertical Partitioning

BOINC Deployments DB Server was $10K and the project server was $8K Climateprediction.net’s DB Server was £6K and the project server was £4K Both projects support over 100,000 nodes and run 80%-95% idle

Conclusion You can gain access to a vast computational engine with an inspiring idea and a modest investment in hardware.  – TeraFLOPS  ClimatePrediction.net – TeraFLOPS  – TeraFLOPS  – TeraFLOPS  – TeraFLOPS Statistics brought to you by: 

Questions and Answers BOINC Website: BOINC Development Mailing List: BOINC Projects Mailing List: SETI Farms and Stacks: