Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific.

Slides:



Advertisements
Similar presentations
BOINC: A System for Public-Resource Computing and Storage David P. Anderson University of California, Berkeley.
Advertisements

BOINC Berkeley Open Infrastructure for Network Computing An open-source middleware system for volunteer and grid computing (much of the images and text.
Volunteer Computing Laurence Field IT/SDC 21 November 2014.
P2P Distributed Computing Platform: C.Y. ‘Connor’ Park KISTI Supercomputing Center.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Volunteer Computing.
Distributed Computer Architecture Benjamin Jordan, Kevin Cone, Jason Bradley.
Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.
Distributed Computing for CEPC YAN Tian On Behalf of Distributed Computing Group, CC, IHEP for 4 th CEPC Collaboration Meeting, Sep ,
Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.
Grid Toolkits Globus, Condor, BOINC, Xgrid Young Suk Moon.
1 port BOSS on Wenjing Wu (IHEP-CC)
Ali YILDIRIM Emre UZUNCAKARA
A Distributed Computing System Based on BOINC September - CHEP 2004 Pedro Andrade António Amorim Jaime Villate.
Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.
The Data Bridge Laurence Field IT/SDC 6 March 2015.
Scientific Computing in the Consumer Digital Infrastructure David P. Anderson Space Sciences Lab University of California, Berkeley The Austin Forum November.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.
Wenjing Wu Computer Center, Institute of High Energy Physics Chinese Academy of Sciences, Beijing BOINC workshop 2013.
David Cameron Claire Adam Bourdarios Andrej Filipcic Eric Lancon Wenjing Wu ATLAS Computing Jamboree, 3 December 2014 Volunteer Computing.
David Cameron Riccardo Bianchi Claire Adam Bourdarios Andrej Filipcic Eric Lançon Efrat Tal Hod Wenjing Wu on behalf of the ATLAS Collaboration CHEP 15,
07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
BOINC.
National Science Foundation CI-TEAM Proposal: Blast on Condor How Will This Help [InstAbbrev]? Your Name Here Your Job Title Here Your Department Here.
Scenarios for a Learning GRID Online Educa Nov 30 – Dec 2, 2005, Berlin, Germany Nicola Capuano, Agathe Merceron, PierLuigi Ritrovato
and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.
TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.
Dr Jukka Klem CHEP06 1 Public Resource Computing at CERN – Philippe Defert, Markku Degerholm, Francois Grey, Jukka Klem, Juan Antonio.
1 Volunteer Computing at CERN past, present and future Ben Segal / CERN (describing the work of many people at CERN and elsewhere ) White Area lecture.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
1 BOINC + CernVM Ben Segal / CERN (describing the work of many people at CERN and elsewhere ) Pre-GDB on Volunteer Computing CERN, November 11, 2014.
BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
3/12/2013Computer Engg, IIT(BHU)1 PARALLEL COMPUTERS- 1.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
– Past, Present, Future Volunteer Computing at CERN Helge Meinhard, Nils Høimyr / CERN for the CERN BOINC service team H. Meinhard et al. - Volunteer.
Volunteer Clouds for the LHC experiments H. Riahi – 12/11/15 EGI User Forum Laurence Field Hassen Riahi CERN IT-SDC.
CernVM and Volunteer Computing Ivan D Reid Brunel University London Laurence Field CERN.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.
The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.
Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.
Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.
Technology for Citizen Cyberscience Dr. David P. Anderson University of California, Berkeley May 2011.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab Nov. 15, 2006.
Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab January 30, 2007.
An Overview of Volunteer Computing
Status of WLCG FCPPL project
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
University of California, Berkeley
Building a Global Brain David P. Anderson U. C
Volunteer computing PC owners donate idle cycles to science projects
Volunteer Computing: SETI and Beyond David P
Volunteer Computing for Science Gateways
Designing a Runtime System for Volunteer Computing David P
Job Scheduling in a Grid Computing Environment
David P. Anderson Space Sciences Lab UC Berkeley LASER
David Cameron ATLAS Site Jamboree, 20 Jan 2017
Grid Computing.
The Global Status of Citizen Cyberscience
Grid Computing Colton Lewis.
Ivan Reid (Brunel University London/CMS)
Exploit the massive Volunteer Computing resource for HEP computation
Exploring Multi-Core on
Presentation transcript:

Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific program, September 12, 2014, Shanghai

Outline What is public-resource computing The BOINC midware A list public-resource computing projects using the BOINC platform Our work with BOINC CEPC Simulation implementation 2

Public-resource computing AKA global computing or P2P computing Combines the resources of personal computers and game consoles belonging to the general public to perform scientific computations Started with Great Internet Mersenne Prime Search (GIMPS) (1996) Distributed.net (1997) Contrast with grid computing: Grid computing involves "organizationally-owned resources" Centrally managed by IT professionals Powered on most of the time Connected by high-speed links Malicious behavior handled by organization Of course None of that is true for public-resource computing. 3

BOINC Berkeley Open Infrastructure for Network Computing Developed at UCB Space Science Laboratory by the group Reduce the barriers of entry to public-resource computing: A project can be run from a single computer running standard open-source software Share resources among autonomous projects: Each PC owner can join multiple projects Results in better resource utilization Support diverse applications: Offer various data distribution mechanisms Support various programming languages … Reward participants: Mostly by giving them credits System must be cheating-resistant Also by offering nice graphics Great screensavers! 4

Projects using BOINC search for intelligent extra-terrestrial life(hosts: , users: total cpu hours: ~ ) Search for gravitational signals emitted by pulsars(hosts: , users: total cpu hours:~ ) Climateprediction.net: long term-climate prediction(hosts: users: total cpu hours:~ ) World Community Grid: Runs multiple sub-projects that focus on humanitarian research including HIV/AIDS, cancer, dengue fever, malaria, etc(hosts: ,users:466627,total cpu hours:~ ) 5

Projects using BOINC Classic – SixTrack, 2003 hosts: & users: total cpu hours:~ b. Test4Theory virtualization technology c. - B-physics for LHCb experiment d. – atlas simulation 6

Our work with BOINC(I) First official Volunteer Project in mainland China Applications: TreeThreader, Lammps, etc address: 7

Our work with BOINC(II) ATLAS simulation A lot of CPUs needed for simulation Key point: virtualization Total jobs statistic in Aug.2014: ~24000 jobs completed. 8

9

Our work with BOINC(III) Desktop Grid: integrate Dirac and boinc, provide public resource for grid user. Test work completed and promotion in progress Application: BESIII simulation 10

Discusses CEPC Simulation implementation Feasibility: a. Simulation jobs : low I/O jobs b. virtualization technology: Heterogeneous Resources c. Huge potential resources: 1) Enthusiastic&strong volunteers from 2) Technologic collaboration with BOINC develop group &other project groups d. development experiences with Large physical experiments: & BESDIRAC project 11

Web protral/api Discusses CEPC Simulation implementation Work flow on boinc side boinc sever Image repository PC g PCs PCs PC Physicist User Physicist User Generater Running workuni t BOINC CLient Core Shared directory VM image output 12

Discusses CEPC Simulation implementation Basic architecture: ongoing integration Dirac and Boinc for CEPC simulation 13

Summary & Outlook Skilled technology for CEPC simulation experiment by using volunteer computing Completed some test simulation jobs on boinc(C/S) side and got good results, more test jobs are needed, and some more details should be discussed. Reduce the size of the image, current software all loaded in the image Database access not available for public, load database in the image. On going integration of DIRAC and boinc for CEPC simulation. Powerful resources are provided by volunteers from (host: cpu cores: ) &other boinc projects. 14

Thanks! Q & A Contacts: 15