and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.

Slides:



Advertisements
Similar presentations
BOINC: A System for Public-Resource Computing and Storage David P. Anderson University of California, Berkeley.
Advertisements

BOINC Berkeley Open Infrastructure for Network Computing An open-source middleware system for volunteer and grid computing (much of the images and text.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Volunteer Computing.
High-Performance Task Distribution for Volunteer Computing Rom Walton
BOINC The Year in Review David P. Anderson Space Sciences Laboratory U.C. Berkeley 22 Oct 2009.
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley May 2, 2007.
BOINC The Year in Review David P. Anderson Space Sciences Lab U.C. Berkeley 12 Sept 2008.
Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.
Volunteer Thinking with Bossa David P. Anderson Space Sciences Laboratory University of California, Berkeley.
Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.
Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific.
Achievements and Opportunities in Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 18 April 2008.
HTCondor and BOINC. › Berkeley Open Infrastructure for Network Computing › Grew out of began in 2002 › Middleware system for volunteer computing.
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley May 7, 2008.
Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.
Scientific Computing in the Consumer Digital Infrastructure David P. Anderson Space Sciences Lab University of California, Berkeley The Austin Forum November.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Introduction to the BOINC software David P. Anderson Space Sciences Laboratory University of California, Berkeley.
Volunteer Computing with BOINC Dr. David P. Anderson University of California, Berkeley SC10 Nov. 14, 2010.
David P. Anderson Space Sciences Lab U.C. Berkeley Exa-Scale Volunteer Computing.
Volunteer Computing with GPUs David P. Anderson Space Sciences Laboratory U.C. Berkeley.
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.
TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.
1 Volunteer Computing at CERN past, present and future Ben Segal / CERN (describing the work of many people at CERN and elsewhere ) White Area lecture.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
The rise of citizen cyberscience and its impact on professional research François Grey Citizen Cyberscience Centre, Geneva CERN/UNITAR/UNIGE.
A Tour of Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 14 Sept 2007.
Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.
Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 30 Dec
The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.
Volunteer Computing in Biology David P. Anderson Space Sciences Lab U.C. Berkeley 10 Sept 2007.
Emulating Volunteer Computing Scheduling Policies Dr. David P. Anderson University of California, Berkeley May 20, 2011.
David P. Anderson Space Sciences Laboratory University of California – Berkeley A Million Years of Computing.
Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.
Volunteer Computing: the Ultimate Cloud Dr. David P. Anderson University of California, Berkeley Oct 19, 2010.
A Brief History of (CPU) Time -or- Ten Years of Multitude David P. Anderson Spaces Sciences Lab University of California, Berkeley 2 Sept 2010.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.
The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.
Using volunteered resources for data-intensive computing and storage David Anderson Space Sciences Lab UC Berkeley 10 April 2012.
Technology for Citizen Cyberscience Dr. David P. Anderson University of California, Berkeley May 2011.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab Nov. 15, 2006.
Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab January 30, 2007.
An Overview of Volunteer Computing
A Brief History of BOINC
Volunteer Computing and BOINC
University of California, Berkeley
Building a Global Brain David P. Anderson U. C
Volunteer computing PC owners donate idle cycles to science projects
Volunteer Computing: Planting the Flag David P
Volunteer Computing: SETI and Beyond David P
Volunteer Computing for Science Gateways
Designing a Runtime System for Volunteer Computing David P
A Roadmap for Volunteer Computing in the U.S.
Exa-Scale Volunteer Computing
David P. Anderson Space Sciences Lab UC Berkeley LASER
The Global Status of Citizen Cyberscience
Volunteer computing and volunteer thinking Dr. David P
The software infrastructure of II
Presentation transcript:

and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley

Citizen Cyber-Science The use of Internet and computer technology to involve the public in scientific research Volunteer computing Volunteer thinking GalaxyZoo, FoldIt!

Classic Volunteer PC server Internet client download, install

Classic Volunteer PC server Internet client server request a job

Classic Volunteer PC server Internet client server send data database get job

Classic Volunteer PC server Internet client (process data)

Classic Volunteer PC server Internet server return results, request new job database store results get job client

Problems with Classic Hard to deploy new applications or versions Wasteful replication – “Always have work” policy No result validation Monolithic, inflexible server

Problems with Classic Client only downloads 1 job at a time Client uses only 1 CPU Unit of credit is “job” Hard to participate in >1 project (e.g. and

BOINC General-purpose “middleware” for volunteer computing Funded by NSF, present Open-source (LGPL)

Volunteer PC Internet BOINC client download, install

Volunteer PC Internet BOINC client “attach” to project server

Volunteer PC Internet BOINC client request jobs type of computer RAM, CPU speed connection interval server scheduler BOINC DB get jobs

Volunteer PC Internet BOINC client job descriptions list of application files list of input files list of output files server scheduler

Volunteer PC Internet BOINC client download program, input files server data servers

Volunteer PC Internet BOINC client server program (run applications)

Volunteer PC Internet BOINC client upload output files server data servers

Volunteer PC Internet BOINC client report completed jobs server scheduler BOINC DB Science DB assimilate validate

Problems solved Easy to deploy new apps Efficient replication – 2-fold, adaptive Errors, cheating are detected immediately Server is scalable, fail-soft Credit is based on FLOPS, not jobs Client can queue lots of jobs, use >1 CPU

Painful transition to BOINC (2005) Awkward registration process “techie” GUI Classic credit didn’t carry over User base: 500K -> 200K

The volunteer computing ecosystem projects CPDN WCG attachments volunteers

Climateprediction.net

Gravitational waves

Other projects IBM World Community Grid Etc. – epidemiology, plant ecology, genetic linkage, phylogenetics, graph theory, number theory, cognitive modeling, fluid dynamics, galactic structure, quantum chemistry, nanotechnology, quantum computing, cosmology

History of volunteer computing Applications Middleware distributed.net, GIMPS Commercial: Entropia, United Devices,... BOINC Climateprediction.net IBM World Community Grid now Academic: Bayanihan, Javelin,... Applications

Performance Current – 500K people, 1M computers – 6.5 PetaFLOPS (3 from GPUs, 1.4 from PS3s) Potential – 1 billion PCs today, 2 billion in 2015 – GPU: approaching 1 TFLOPS – 1 ExaFLOPS: 4M GPUs * 0.25 availability – Freescale i.MX51: 2 GFLOPS, 200mw

Organizational models Umbrella projects Institutional – Lattice, Corporate – IBM World Community Grid Community – AlmereGrid Research community – MindModeling.org Project publicity web development sysadmin

The Stardust mission Where’s the dust? – 23K volunteers – 43M viewings – 64 tracks found

jobs middleware people or computers identity accounting queuing assignment validation

What’s different? People vary Jobs may not be well-defined aptitude training

Bossa Open-source PHP-based middleware for volunteer thinking – Policies – replication, volunteer assessment, job assignment – Bossa doesn’t provide policies, but makes it easy to implement a wide range of policies

Projects in development – Collect photos of Middle Awash (Ethiopia) – Look for hominid and other fossils AfricaMap

Conclusion Citizen Cyber-Science – volunteer computing – volunteer thinking Benefits to science Benefits to society