A P2P Distributed Computing Platform: (Wed) C.Y. ‘Connor’ Park KISTI Supercomputing Center

2 Overview  ( KatH ) : A Software Platform for Distributed Computing using Volunteer Computer Resources  Features  Hybrid Peer-to-Peer architecture  Secure PKI-based Security and Digital Signature  Web Services with SOAP messaging

3 Motivation  To take advantage of and stimulate ‘Broadband Network Infrastructure in Korea’  To meet the growing needs of computing power for applications  Funded by ‘Ministry of Information and Communication (MIC)’

4 Broadband Network Infrastructure in Korea  Over 10M Broadband network (xDSL, Cable) households (over 70% penetration) –  Over 58.4% of PCs with Pentium3+

5 Similar Projects  Science  climateprediction.net  Life Science   Cryptography  Distributed.net, RSAttack576  Mathematics  Mersenne Prime Search, Pi(x) Project  Internet  Grub, CycleTrader  Financial  MoneyBee  Games  ChessBrain  Miscellaneous  DALiWorld from

6 Project History   MIC launched the pilot project  Application : Virtual Screening for New Drug Design   First pilot production and test  Client/Server Architecture Model   Second pilot production and test   Regularize the project “P2P Internet-based Distributed Computing Platform Development”   Announcement of Hybrid P2P-style Distributed Computing Platform

7 Architecture Cooperation Internet Large-scale Application Resource Management Subscription Distribution Agent Job Request

8 Job Distribution Internet KatH Server Agent  Authentication  Working Specification Request Is there any job for me to work? Who has the job data?  Getting data, working, and returning result to server

Pilot Projects  Application : Virtual Screening for New Drug Design  Client-Server Architecture  An Agent  Receives about 400KB-size file  Executes during 20 minutes per working unit  Returns about 190KB-size file  Total number of working job units : 50,000

10 Virtual Screening Structure Analysis Target Protein Share Analysis Chemical DB Disease Protein Ligand DB Server + + Client Client 2 Client 3 Virtual High-Throughput Screening Internet Calculating Ligand PMI Looking for Drug Candidate Clinical Demo New Drug Mass-produce Calculating Active Site PMI

11 Experimental Results  1st Test  1,217 installed agents   Max 53.5 Gflops / Avg Gflops  2nd Test  6,472 installed agents   Max 644 Gflops / Avg Gflops ※ World Top Rank Gflops: IBM xSeries Cluster Xeon 2.8 GHz - Myrinet/ 192 (from )

12 Intention of Participation UnderstandingIntention of Providing Resources Well-Understanding (44.9%) Understanding roughly (21.8%) Don’t Know (33.3%) Keep up Providing (59.5%) Providing later (30.4%) Providing with Compensation (7.2%) Don’t (2.9%) 67.7% of Netizen already know what is Distributed Computing and 89.9% of Netizen have intention of providing their PC resources.

Progresses  P2P data distribution  New Applications  Virtual Screening for New Drug Design  Global Risk Management for financial investment  3D image rendering  Supplementary plug-in  Remote backup service

14 Futurework  Make P2P agents more intelligent and cooperative with each other.  A set of APIs for application developers  Fault-tolerance : checkpointing & rollback recovery  IPv6 version  Open-Source (?)  Windows-only  Unix version

15 Thanks a lot! ^^

16 Design Goals  Application Developers (Job Requester)  Convenience  They should be able to use easily.  Flexibility  The platform is general enough to be used by various applications.  Correctness  The platform should return correct results.

17 Design Goals  PC agents (Resource Providers)  Transparency  PC users are not disturbed in their own works.  Reliability  It’s reliable not to make any security and privacy problem.  Reward  There is any kind of compensation, even just in mind.

18 Design Goals  Platform  Scalability  Performance should be improved according to the growth of agents.  Adaptability  It should put up with the dynamic features of Internet.

19 Implementation Choices  Web Services  SOAP messaging over https  Request-Response Model  It is Agents’ duty to make most decisions.  PKI-based certification and Digital Signature for files Make server as simple as possible, and Make PC agents more intelligent

20 Functional Classification  Resource Management  Authentication, Certification  Simple accounting  Scheduling and Job distribution  Job distribution with hybrid P2P style  Result gathering  Client Management  Client authentication  Application preparation to work  Digital signing  Result returning to client

21 Networking Issues  Network Security  DoS, Spoofing, Sniffing, …  Variable Connection  Dial-up, cable, xDSL, T1/E1, …  IPv6, WiFi, Bluetooth, …  Network Unobtrusiveness  Background/shared communication  Transparency (Firewall/NAT)